[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:15:24.067028  7002 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.214.190:46359
I20260709 13:15:24.068673  7002 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:15:24.069804  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:24.087450  7011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:24.087536  7008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:24.087540  7009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:24.088784  7002 server_base.cc:1061] running on GCE node
I20260709 13:15:25.308279  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:25.308537  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:25.308693  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783602925308677 us; error 0 us; skew 500 ppm
I20260709 13:15:25.309576  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:25.315163  7002 webserver.cc:533] Webserver started at http://127.6.214.190:37277/ using document root <none> and password file <none>
I20260709 13:15:25.316008  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:25.316207  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:25.316605  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:25.322496  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/master-0-root/instance:
uuid: "e1e489a5e56942909a9bc2f73191d603"
format_stamp: "Formatted at 2026-07-09 13:15:25 on dist-test-slave-rnv4"
I20260709 13:15:25.330262  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:15:25.335695  7017 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.336889  7002 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:15:25.337257  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/master-0-root
uuid: "e1e489a5e56942909a9bc2f73191d603"
format_stamp: "Formatted at 2026-07-09 13:15:25 on dist-test-slave-rnv4"
I20260709 13:15:25.337595  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:25.391577  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:25.393158  7002 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:15:25.393636  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:25.469527  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.190:46359
I20260709 13:15:25.469632  7068 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.190:46359 every 8 connection(s)
I20260709 13:15:25.477641  7069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.500305  7069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603: Bootstrap starting.
I20260709 13:15:25.506577  7069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.508496  7069 log.cc:826] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603: Log is configured to *not* fsync() on all Append() calls
I20260709 13:15:25.513305  7069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603: No bootstrap required, opened a new log
I20260709 13:15:25.535895  7069 raft_consensus.cc:359] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1e489a5e56942909a9bc2f73191d603" member_type: VOTER }
I20260709 13:15:25.536517  7069 raft_consensus.cc:385] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.536737  7069 raft_consensus.cc:740] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e489a5e56942909a9bc2f73191d603, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.537652  7069 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1e489a5e56942909a9bc2f73191d603" member_type: VOTER }
I20260709 13:15:25.538189  7069 raft_consensus.cc:399] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:25.538456  7069 raft_consensus.cc:493] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:25.538770  7069 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.543370  7069 raft_consensus.cc:515] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1e489a5e56942909a9bc2f73191d603" member_type: VOTER }
I20260709 13:15:25.544246  7069 leader_election.cc:304] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1e489a5e56942909a9bc2f73191d603; no voters: 
I20260709 13:15:25.546116  7069 leader_election.cc:290] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:25.546440  7072 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.549539  7072 raft_consensus.cc:697] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [term 1 LEADER]: Becoming Leader. State: Replica: e1e489a5e56942909a9bc2f73191d603, State: Running, Role: LEADER
I20260709 13:15:25.550698  7072 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1e489a5e56942909a9bc2f73191d603" member_type: VOTER }
I20260709 13:15:25.551937  7069 sys_catalog.cc:565] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:25.563510  7073 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1e489a5e56942909a9bc2f73191d603" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1e489a5e56942909a9bc2f73191d603" member_type: VOTER } }
I20260709 13:15:25.564427  7073 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:25.564981  7074 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1e489a5e56942909a9bc2f73191d603. Latest consensus state: current_term: 1 leader_uuid: "e1e489a5e56942909a9bc2f73191d603" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1e489a5e56942909a9bc2f73191d603" member_type: VOTER } }
I20260709 13:15:25.565729  7074 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:25.567950  7082 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:25.579933  7082 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:25.582397  7002 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:25.597649  7082 catalog_manager.cc:1383] Generated new cluster ID: 6c228ecca1cf42ca9607981587989618
I20260709 13:15:25.597945  7082 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:25.618160  7082 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:25.619858  7082 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:25.634581  7082 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603: Generated new TSK 0
I20260709 13:15:25.635586  7082 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:25.650285  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:25.660071  7091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:25.662667  7092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:25.664115  7094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:25.665982  7002 server_base.cc:1061] running on GCE node
I20260709 13:15:25.666915  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:25.667200  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:25.667402  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783602925667382 us; error 0 us; skew 500 ppm
I20260709 13:15:25.668203  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:25.672513  7002 webserver.cc:533] Webserver started at http://127.6.214.129:45999/ using document root <none> and password file <none>
I20260709 13:15:25.673237  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:25.673516  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:25.673877  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:25.675411  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/ts-0-root/instance:
uuid: "482ec669868d43228e5a7c0279120905"
format_stamp: "Formatted at 2026-07-09 13:15:25 on dist-test-slave-rnv4"
I20260709 13:15:25.682642  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.003s
I20260709 13:15:25.687901  7099 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.688902  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:15:25.689267  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/ts-0-root
uuid: "482ec669868d43228e5a7c0279120905"
format_stamp: "Formatted at 2026-07-09 13:15:25 on dist-test-slave-rnv4"
I20260709 13:15:25.689697  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:25.743233  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:25.745106  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:25.747964  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:25.753643  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:25.753978  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.754305  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:25.754532  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.853797  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.129:36319
I20260709 13:15:25.853866  7161 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.129:36319 every 8 connection(s)
I20260709 13:15:25.862644  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:25.874811  7166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:25.882061  7167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:25.888988  7002 server_base.cc:1061] running on GCE node
W20260709 13:15:25.890376  7169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:25.892588  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:25.892956  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:25.893169  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783602925893153 us; error 0 us; skew 500 ppm
I20260709 13:15:25.894002  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:25.898221  7002 webserver.cc:533] Webserver started at http://127.6.214.130:40047/ using document root <none> and password file <none>
I20260709 13:15:25.898907  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:25.899158  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:25.899494  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:25.900861  7162 heartbeater.cc:344] Connected to a master server at 127.6.214.190:46359
I20260709 13:15:25.900964  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/ts-1-root/instance:
uuid: "9376bab1f7f3446699ce394cc08e0aa1"
format_stamp: "Formatted at 2026-07-09 13:15:25 on dist-test-slave-rnv4"
I20260709 13:15:25.901473  7162 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:25.902527  7162 heartbeater.cc:507] Master 127.6.214.190:46359 requested a full tablet report, sending...
I20260709 13:15:25.905887  7034 ts_manager.cc:194] Registered new tserver with Master: 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319)
I20260709 13:15:25.908329  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:15:25.909541  7034 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40484
I20260709 13:15:25.914790  7174 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.915714  7002 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:15:25.916064  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/ts-1-root
uuid: "9376bab1f7f3446699ce394cc08e0aa1"
format_stamp: "Formatted at 2026-07-09 13:15:25 on dist-test-slave-rnv4"
I20260709 13:15:25.916388  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:25.935065  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:25.936481  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:25.938881  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:25.942056  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:25.942314  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.942595  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:25.942802  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:26.042892  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.130:34109
I20260709 13:15:26.043285  7237 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.130:34109 every 8 connection(s)
I20260709 13:15:26.051084  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:26.062177  7242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:26.063284  7241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:26.069943  7002 server_base.cc:1061] running on GCE node
I20260709 13:15:26.071306  7238 heartbeater.cc:344] Connected to a master server at 127.6.214.190:46359
I20260709 13:15:26.071758  7238 heartbeater.cc:461] Registering TS with master...
W20260709 13:15:26.072060  7244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:26.072926  7238 heartbeater.cc:507] Master 127.6.214.190:46359 requested a full tablet report, sending...
I20260709 13:15:26.073395  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:26.073812  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:26.074126  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783602926074106 us; error 0 us; skew 500 ppm
I20260709 13:15:26.074993  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:26.075361  7034 ts_manager.cc:194] Registered new tserver with Master: 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:26.077205  7034 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40498
I20260709 13:15:26.078342  7002 webserver.cc:533] Webserver started at http://127.6.214.131:44713/ using document root <none> and password file <none>
I20260709 13:15:26.079057  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:26.079308  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:26.079632  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:26.081357  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/ts-2-root/instance:
uuid: "33c2c688da794e89b128fc596b4ff21b"
format_stamp: "Formatted at 2026-07-09 13:15:26 on dist-test-slave-rnv4"
I20260709 13:15:26.087574  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:15:26.092422  7249 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:26.093510  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:26.093941  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/ts-2-root
uuid: "33c2c688da794e89b128fc596b4ff21b"
format_stamp: "Formatted at 2026-07-09 13:15:26 on dist-test-slave-rnv4"
I20260709 13:15:26.094347  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602923898527-7002-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:26.131196  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:26.133037  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:26.134845  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:26.138034  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:26.138311  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:26.138616  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:26.138851  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:26.232973  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.131:45445
I20260709 13:15:26.233029  7311 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.131:45445 every 8 connection(s)
I20260709 13:15:26.253999  7312 heartbeater.cc:344] Connected to a master server at 127.6.214.190:46359
I20260709 13:15:26.254400  7312 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:26.255259  7312 heartbeater.cc:507] Master 127.6.214.190:46359 requested a full tablet report, sending...
I20260709 13:15:26.257301  7034 ts_manager.cc:194] Registered new tserver with Master: 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:26.258069  7002 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016060135s
I20260709 13:15:26.259047  7034 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40504
I20260709 13:15:26.314388  7034 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40506:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:26.318557  7034 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:26.431767  7203 tablet_service.cc:1511] Processing CreateTablet for tablet ce662cccc58549f4a58cc43237bf7ca0 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:26.433784  7203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce662cccc58549f4a58cc43237bf7ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.436079  7202 tablet_service.cc:1511] Processing CreateTablet for tablet 3c9ec53cae204b1c8177b1da07bb2080 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:26.437747  7202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9ec53cae204b1c8177b1da07bb2080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.447041  7127 tablet_service.cc:1511] Processing CreateTablet for tablet ce662cccc58549f4a58cc43237bf7ca0 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:26.449625  7125 tablet_service.cc:1511] Processing CreateTablet for tablet d20721d2e72241db94e4f23a96f91971 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:26.455989  7201 tablet_service.cc:1511] Processing CreateTablet for tablet d20721d2e72241db94e4f23a96f91971 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:26.454958  7123 tablet_service.cc:1511] Processing CreateTablet for tablet be3c73389e124baa99aa4080e593d1d6 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:26.461920  7199 tablet_service.cc:1511] Processing CreateTablet for tablet be3c73389e124baa99aa4080e593d1d6 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:26.462033  7124 tablet_service.cc:1511] Processing CreateTablet for tablet bf275d22b378476d84bb819006363228 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:26.461963  7121 tablet_service.cc:1511] Processing CreateTablet for tablet 3769dba8cd0048ed8305dad93d73f817 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:26.461928  7122 tablet_service.cc:1511] Processing CreateTablet for tablet 6a54eb4b904c4915bd339a14f8c46813 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:26.463121  7200 tablet_service.cc:1511] Processing CreateTablet for tablet bf275d22b378476d84bb819006363228 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:26.464694  7127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce662cccc58549f4a58cc43237bf7ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.461481  7126 tablet_service.cc:1511] Processing CreateTablet for tablet 3c9ec53cae204b1c8177b1da07bb2080 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:26.474511  7201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d20721d2e72241db94e4f23a96f91971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.476871  7125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d20721d2e72241db94e4f23a96f91971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.477923  7200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf275d22b378476d84bb819006363228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.479947  7122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a54eb4b904c4915bd339a14f8c46813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.482249  7198 tablet_service.cc:1511] Processing CreateTablet for tablet 6a54eb4b904c4915bd339a14f8c46813 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:26.487192  7124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf275d22b378476d84bb819006363228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.488925  7120 tablet_service.cc:1511] Processing CreateTablet for tablet 17fb5239d9374164995f9850ea265145 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:26.490492  7199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be3c73389e124baa99aa4080e593d1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.496712  7120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17fb5239d9374164995f9850ea265145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.496743  7198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a54eb4b904c4915bd339a14f8c46813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.496641  7197 tablet_service.cc:1511] Processing CreateTablet for tablet 3769dba8cd0048ed8305dad93d73f817 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:26.500362  7197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3769dba8cd0048ed8305dad93d73f817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.502871  7121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3769dba8cd0048ed8305dad93d73f817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.504176  7196 tablet_service.cc:1511] Processing CreateTablet for tablet 17fb5239d9374164995f9850ea265145 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:26.509150  7196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17fb5239d9374164995f9850ea265145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.517691  7123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be3c73389e124baa99aa4080e593d1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.539196  7119 tablet_service.cc:1511] Processing CreateTablet for tablet a7897ab92ced40f884f353b8a96a91ea (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:26.568316  7277 tablet_service.cc:1511] Processing CreateTablet for tablet ce662cccc58549f4a58cc43237bf7ca0 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:26.575244  7126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9ec53cae204b1c8177b1da07bb2080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.584040  7274 tablet_service.cc:1511] Processing CreateTablet for tablet bf275d22b378476d84bb819006363228 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:26.597949  7272 tablet_service.cc:1511] Processing CreateTablet for tablet 6a54eb4b904c4915bd339a14f8c46813 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:26.615450  7277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce662cccc58549f4a58cc43237bf7ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.616662  7275 tablet_service.cc:1511] Processing CreateTablet for tablet d20721d2e72241db94e4f23a96f91971 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:26.619004  7119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7897ab92ced40f884f353b8a96a91ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.626292  7273 tablet_service.cc:1511] Processing CreateTablet for tablet be3c73389e124baa99aa4080e593d1d6 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:26.631153  7274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf275d22b378476d84bb819006363228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.624698  7195 tablet_service.cc:1511] Processing CreateTablet for tablet a7897ab92ced40f884f353b8a96a91ea (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:26.638305  7269 tablet_service.cc:1511] Processing CreateTablet for tablet a7897ab92ced40f884f353b8a96a91ea (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:26.644758  7270 tablet_service.cc:1511] Processing CreateTablet for tablet 17fb5239d9374164995f9850ea265145 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:26.624749  7276 tablet_service.cc:1511] Processing CreateTablet for tablet 3c9ec53cae204b1c8177b1da07bb2080 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:26.648145  7330 tablet_bootstrap.cc:492] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1: Bootstrap starting.
I20260709 13:15:26.658203  7275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d20721d2e72241db94e4f23a96f91971. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:26.655978  7081 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:26.666397  7273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be3c73389e124baa99aa4080e593d1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.677984  7195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7897ab92ced40f884f353b8a96a91ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.684140  7270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17fb5239d9374164995f9850ea265145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.665119  7271 tablet_service.cc:1511] Processing CreateTablet for tablet 3769dba8cd0048ed8305dad93d73f817 (DEFAULT_TABLE table=test-workload [id=61365d6723ad40c29fa5bd6f9e360f9d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:26.688454  7269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7897ab92ced40f884f353b8a96a91ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.726210  7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9ec53cae204b1c8177b1da07bb2080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.733951  7271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3769dba8cd0048ed8305dad93d73f817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.769511  7272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a54eb4b904c4915bd339a14f8c46813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.806903  7330 tablet_bootstrap.cc:654] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.812135  7331 tablet_bootstrap.cc:492] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905: Bootstrap starting.
I20260709 13:15:26.835054  7332 tablet_bootstrap.cc:492] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b: Bootstrap starting.
I20260709 13:15:26.847467  7332 tablet_bootstrap.cc:654] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.851838  7330 tablet_bootstrap.cc:492] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1: No bootstrap required, opened a new log
I20260709 13:15:26.852281  7332 tablet_bootstrap.cc:492] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b: No bootstrap required, opened a new log
I20260709 13:15:26.852339  7330 ts_tablet_manager.cc:1403] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent bootstrapping tablet: real 0.218s	user 0.012s	sys 0.015s
I20260709 13:15:26.852447  7331 tablet_bootstrap.cc:654] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.852790  7332 ts_tablet_manager.cc:1403] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:15:26.855724  7330 raft_consensus.cc:359] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
I20260709 13:15:26.856621  7330 raft_consensus.cc:385] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.856302  7332 raft_consensus.cc:359] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:26.856930  7330 raft_consensus.cc:740] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.857007  7332 raft_consensus.cc:385] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.857451  7332 raft_consensus.cc:740] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.857831  7330 consensus_queue.cc:260] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
I20260709 13:15:26.858337  7332 consensus_queue.cc:260] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:26.867789  7238 heartbeater.cc:499] Master 127.6.214.190:46359 was elected leader, sending a full tablet report...
I20260709 13:15:26.868219  7330 ts_tablet_manager.cc:1434] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.008s
I20260709 13:15:26.869186  7330 tablet_bootstrap.cc:492] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1: Bootstrap starting.
I20260709 13:15:26.870169  7331 tablet_bootstrap.cc:492] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905: No bootstrap required, opened a new log
I20260709 13:15:26.870673  7331 ts_tablet_manager.cc:1403] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.006s
I20260709 13:15:26.877416  7330 tablet_bootstrap.cc:654] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.878489  7312 heartbeater.cc:499] Master 127.6.214.190:46359 was elected leader, sending a full tablet report...
I20260709 13:15:26.878948  7332 ts_tablet_manager.cc:1434] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b: Time spent starting tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 13:15:26.879945  7332 tablet_bootstrap.cc:492] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b: Bootstrap starting.
I20260709 13:15:26.889663  7332 tablet_bootstrap.cc:654] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.889321  7331 raft_consensus.cc:359] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:26.890265  7331 raft_consensus.cc:385] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.897222  7330 tablet_bootstrap.cc:492] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1: No bootstrap required, opened a new log
I20260709 13:15:26.897976  7331 raft_consensus.cc:740] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482ec669868d43228e5a7c0279120905, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.898288  7330 ts_tablet_manager.cc:1403] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.014s
I20260709 13:15:26.902213  7330 raft_consensus.cc:359] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:26.898999  7331 consensus_queue.cc:260] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:26.902892  7330 raft_consensus.cc:385] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.903234  7330 raft_consensus.cc:740] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.904249  7332 tablet_bootstrap.cc:492] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b: No bootstrap required, opened a new log
I20260709 13:15:26.904000  7330 consensus_queue.cc:260] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:26.904690  7332 ts_tablet_manager.cc:1403] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.008s
I20260709 13:15:26.906158  7330 ts_tablet_manager.cc:1434] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:26.907815  7330 tablet_bootstrap.cc:492] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1: Bootstrap starting.
I20260709 13:15:26.907570  7332 raft_consensus.cc:359] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:26.908308  7332 raft_consensus.cc:385] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.908610  7332 raft_consensus.cc:740] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.909358  7332 consensus_queue.cc:260] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:26.911501  7332 ts_tablet_manager.cc:1434] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:26.912436  7332 tablet_bootstrap.cc:492] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b: Bootstrap starting.
I20260709 13:15:26.913906  7162 heartbeater.cc:499] Master 127.6.214.190:46359 was elected leader, sending a full tablet report...
I20260709 13:15:26.921897  7332 tablet_bootstrap.cc:654] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.922266  7331 ts_tablet_manager.cc:1434] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.004s
I20260709 13:15:26.930008  7331 tablet_bootstrap.cc:492] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905: Bootstrap starting.
I20260709 13:15:26.930868  7330 tablet_bootstrap.cc:654] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.940021  7331 tablet_bootstrap.cc:654] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.940589  7332 tablet_bootstrap.cc:492] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b: No bootstrap required, opened a new log
I20260709 13:15:26.941219  7332 ts_tablet_manager.cc:1403] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.008s
I20260709 13:15:26.945123  7332 raft_consensus.cc:359] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:26.946689  7332 raft_consensus.cc:385] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.947098  7332 raft_consensus.cc:740] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.948088  7332 consensus_queue.cc:260] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:26.951915  7332 ts_tablet_manager.cc:1434] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:15:26.952105  7330 tablet_bootstrap.cc:492] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1: No bootstrap required, opened a new log
I20260709 13:15:26.952654  7330 ts_tablet_manager.cc:1403] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.011s
I20260709 13:15:26.952872  7332 tablet_bootstrap.cc:492] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b: Bootstrap starting.
I20260709 13:15:26.956219  7330 raft_consensus.cc:359] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:26.957062  7330 raft_consensus.cc:385] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.957516  7330 raft_consensus.cc:740] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.958351  7330 consensus_queue.cc:260] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:26.960567  7332 tablet_bootstrap.cc:654] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.968868  7330 ts_tablet_manager.cc:1434] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:15:26.968856  7337 raft_consensus.cc:493] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.969609  7337 raft_consensus.cc:515] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:26.970225  7330 tablet_bootstrap.cc:492] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1: Bootstrap starting.
I20260709 13:15:26.972659  7337 leader_election.cc:290] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:26.980118  7330 tablet_bootstrap.cc:654] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:26.993525  7313 tablet.cc:2406] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:26.996083  7331 tablet_bootstrap.cc:492] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905: No bootstrap required, opened a new log
I20260709 13:15:26.998399  7330 tablet_bootstrap.cc:492] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1: No bootstrap required, opened a new log
I20260709 13:15:26.999276  7330 ts_tablet_manager.cc:1403] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.009s
I20260709 13:15:27.000025  7331 ts_tablet_manager.cc:1403] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.000s
I20260709 13:15:27.003048  7331 raft_consensus.cc:359] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.003115  7330 raft_consensus.cc:359] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.004395  7330 raft_consensus.cc:385] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.003954  7331 raft_consensus.cc:385] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.004873  7330 raft_consensus.cc:740] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.005295  7331 raft_consensus.cc:740] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482ec669868d43228e5a7c0279120905, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.006235  7331 consensus_queue.cc:260] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.006135  7330 consensus_queue.cc:260] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.018275  7330 ts_tablet_manager.cc:1434] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:15:27.019752  7330 tablet_bootstrap.cc:492] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1: Bootstrap starting.
I20260709 13:15:27.023846  7332 tablet_bootstrap.cc:492] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b: No bootstrap required, opened a new log
I20260709 13:15:27.024204  7331 ts_tablet_manager.cc:1434] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260709 13:15:27.024363  7332 ts_tablet_manager.cc:1403] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b: Time spent bootstrapping tablet: real 0.072s	user 0.022s	sys 0.039s
I20260709 13:15:27.025467  7331 tablet_bootstrap.cc:492] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905: Bootstrap starting.
I20260709 13:15:27.027319  7332 raft_consensus.cc:359] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.028025  7332 raft_consensus.cc:385] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.028338  7332 raft_consensus.cc:740] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.029071  7332 consensus_queue.cc:260] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.029393  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3c73389e124baa99aa4080e593d1d6" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905" is_pre_election: true
I20260709 13:15:27.031661  7332 ts_tablet_manager.cc:1434] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
W20260709 13:15:27.031718  7253 leader_election.cc:343] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.032809  7332 tablet_bootstrap.cc:492] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b: Bootstrap starting.
I20260709 13:15:27.033391  7340 raft_consensus.cc:493] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.033924  7340 raft_consensus.cc:515] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.036752  7330 tablet_bootstrap.cc:654] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.039846  7332 tablet_bootstrap.cc:654] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.042261  7336 raft_consensus.cc:493] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.042825  7336 raft_consensus.cc:515] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.043435  7340 leader_election.cc:290] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:27.047096  7337 raft_consensus.cc:493] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.047679  7337 raft_consensus.cc:515] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.048483  7336 leader_election.cc:290] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:27.050588  7337 leader_election.cc:290] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:27.051249  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7897ab92ced40f884f353b8a96a91ea" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905" is_pre_election: true
W20260709 13:15:27.053745  7253 leader_election.cc:343] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.064640  7336 raft_consensus.cc:493] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.065296  7332 tablet_bootstrap.cc:492] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b: No bootstrap required, opened a new log
I20260709 13:15:27.065201  7336 raft_consensus.cc:515] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
I20260709 13:15:27.073833  7336 leader_election.cc:290] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445), 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319)
I20260709 13:15:27.072005  7332 ts_tablet_manager.cc:1403] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.001s
I20260709 13:15:27.084506  7331 tablet_bootstrap.cc:654] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.089202  7332 raft_consensus.cc:359] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.092942  7213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3c73389e124baa99aa4080e593d1d6" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1" is_pre_election: true
I20260709 13:15:27.095178  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7897ab92ced40f884f353b8a96a91ea" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1" is_pre_election: true
I20260709 13:15:27.095682  7332 raft_consensus.cc:385] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:27.098425  7252 leader_election.cc:343] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.098896  7252 leader_election.cc:304] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b; no voters: 482ec669868d43228e5a7c0279120905, 9376bab1f7f3446699ce394cc08e0aa1
I20260709 13:15:27.097527  7332 raft_consensus.cc:740] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.103255  7337 raft_consensus.cc:2749] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:27.105753  7252 leader_election.cc:343] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.105206  7332 consensus_queue.cc:260] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.107976  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905" is_pre_election: true
I20260709 13:15:27.108943  7330 tablet_bootstrap.cc:492] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1: No bootstrap required, opened a new log
I20260709 13:15:27.109536  7330 ts_tablet_manager.cc:1403] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent bootstrapping tablet: real 0.090s	user 0.020s	sys 0.022s
W20260709 13:15:27.110522  7179 leader_election.cc:343] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.111764  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce662cccc58549f4a58cc43237bf7ca0" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905" is_pre_election: true
W20260709 13:15:27.113306  7179 leader_election.cc:343] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.110049  7252 leader_election.cc:304] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b; no voters: 482ec669868d43228e5a7c0279120905, 9376bab1f7f3446699ce394cc08e0aa1
I20260709 13:15:27.113889  7330 raft_consensus.cc:359] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.115025  7337 raft_consensus.cc:2749] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.115083  7330 raft_consensus.cc:385] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.116050  7337 raft_consensus.cc:493] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.116235  7330 raft_consensus.cc:740] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.116727  7337 raft_consensus.cc:515] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.118675  7330 consensus_queue.cc:260] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.119989  7337 leader_election.cc:290] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:27.121168  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1" is_pre_election: true
I20260709 13:15:27.126863  7330 ts_tablet_manager.cc:1434] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:15:27.128535  7212 raft_consensus.cc:2468] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 0.
I20260709 13:15:27.129199  7332 ts_tablet_manager.cc:1434] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.006s
I20260709 13:15:27.129892  7252 leader_election.cc:304] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:27.130751  7337 raft_consensus.cc:2804] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.131299  7337 raft_consensus.cc:493] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.131918  7337 raft_consensus.cc:3060] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.131254  7330 tablet_bootstrap.cc:492] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1: Bootstrap starting.
I20260709 13:15:27.133823  7332 tablet_bootstrap.cc:492] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b: Bootstrap starting.
I20260709 13:15:27.142482  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905" is_pre_election: true
W20260709 13:15:27.146870  7253 leader_election.cc:343] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.149356  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1" is_pre_election: true
W20260709 13:15:27.154126  7102 leader_election.cc:343] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.162313  7331 tablet_bootstrap.cc:492] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905: No bootstrap required, opened a new log
I20260709 13:15:27.162137  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2c688da794e89b128fc596b4ff21b" is_pre_election: true
I20260709 13:15:27.165864  7358 raft_consensus.cc:493] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.165392  7331 ts_tablet_manager.cc:1403] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905: Time spent bootstrapping tablet: real 0.140s	user 0.018s	sys 0.015s
I20260709 13:15:27.164745  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce662cccc58549f4a58cc43237bf7ca0" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2c688da794e89b128fc596b4ff21b" is_pre_election: true
W20260709 13:15:27.167874  7178 leader_election.cc:343] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.166862  7358 raft_consensus.cc:515] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.169252  7178 leader_election.cc:304] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9376bab1f7f3446699ce394cc08e0aa1; no voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905
I20260709 13:15:27.170675  7336 raft_consensus.cc:2749] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:27.171169  7178 leader_election.cc:343] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.171579  7178 leader_election.cc:304] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9376bab1f7f3446699ce394cc08e0aa1; no voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905
I20260709 13:15:27.172546  7336 raft_consensus.cc:2749] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.167939  7337 raft_consensus.cc:515] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.176331  7331 raft_consensus.cc:359] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.177347  7331 raft_consensus.cc:385] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.178524  7331 raft_consensus.cc:740] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482ec669868d43228e5a7c0279120905, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.180056  7330 tablet_bootstrap.cc:654] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.180238  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:27.179842  7331 consensus_queue.cc:260] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
W20260709 13:15:27.181787  7253 leader_election.cc:343] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.181970  7332 tablet_bootstrap.cc:654] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.182885  7337 leader_election.cc:290] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:27.185480  7358 leader_election.cc:290] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:27.186177  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905" is_pre_election: true
I20260709 13:15:27.186895  7137 raft_consensus.cc:2468] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 0.
I20260709 13:15:27.187317  7331 ts_tablet_manager.cc:1434] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:15:27.188377  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:27.188449  7253 leader_election.cc:304] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:27.189121  7212 raft_consensus.cc:3060] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.188387  7331 tablet_bootstrap.cc:492] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905: Bootstrap starting.
I20260709 13:15:27.190419  7336 raft_consensus.cc:493] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.197270  7213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1" is_pre_election: true
W20260709 13:15:27.198855  7252 leader_election.cc:343] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.196938  7336 raft_consensus.cc:515] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.201084  7336 leader_election.cc:290] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:27.201869  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf275d22b378476d84bb819006363228" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905" is_pre_election: true
I20260709 13:15:27.202289  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf275d22b378476d84bb819006363228" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2c688da794e89b128fc596b4ff21b" is_pre_election: true
I20260709 13:15:27.202790  7212 raft_consensus.cc:2468] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 1.
W20260709 13:15:27.204183  7179 leader_election.cc:343] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:27.204737  7178 leader_election.cc:343] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.205299  7178 leader_election.cc:304] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9376bab1f7f3446699ce394cc08e0aa1; no voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905
I20260709 13:15:27.206022  7336 raft_consensus.cc:2749] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.206436  7252 leader_election.cc:304] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 482ec669868d43228e5a7c0279120905
I20260709 13:15:27.191062  7358 raft_consensus.cc:2804] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.208349  7337 raft_consensus.cc:2804] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.208659  7358 raft_consensus.cc:493] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.210310  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2c688da794e89b128fc596b4ff21b" is_pre_election: true
I20260709 13:15:27.210498  7358 raft_consensus.cc:3060] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.222007  7337 raft_consensus.cc:697] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Becoming Leader. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Running, Role: LEADER
I20260709 13:15:27.223904  7331 tablet_bootstrap.cc:654] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.224141  7337 consensus_queue.cc:237] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.225827  7332 tablet_bootstrap.cc:492] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b: No bootstrap required, opened a new log
I20260709 13:15:27.226313  7332 ts_tablet_manager.cc:1403] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.013s
I20260709 13:15:27.229204  7332 raft_consensus.cc:359] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
I20260709 13:15:27.231122  7332 raft_consensus.cc:385] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.231427  7332 raft_consensus.cc:740] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.232504  7330 tablet_bootstrap.cc:492] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1: No bootstrap required, opened a new log
I20260709 13:15:27.232143  7332 consensus_queue.cc:260] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
I20260709 13:15:27.232965  7330 ts_tablet_manager.cc:1403] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.012s
I20260709 13:15:27.234670  7332 ts_tablet_manager.cc:1434] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:27.235633  7332 tablet_bootstrap.cc:492] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b: Bootstrap starting.
I20260709 13:15:27.235793  7330 raft_consensus.cc:359] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.236526  7330 raft_consensus.cc:385] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.233500  7358 raft_consensus.cc:515] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.236820  7330 raft_consensus.cc:740] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.237797  7286 raft_consensus.cc:2393] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 482ec669868d43228e5a7c0279120905 in current term 1: Already voted for candidate 33c2c688da794e89b128fc596b4ff21b in this term.
I20260709 13:15:27.238283  7330 consensus_queue.cc:260] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.241624  7102 leader_election.cc:304] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 482ec669868d43228e5a7c0279120905; no voters: 33c2c688da794e89b128fc596b4ff21b, 9376bab1f7f3446699ce394cc08e0aa1
I20260709 13:15:27.241947  7330 ts_tablet_manager.cc:1434] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.006s
I20260709 13:15:27.242442  7340 raft_consensus.cc:3060] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.243032  7330 tablet_bootstrap.cc:492] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1: Bootstrap starting.
I20260709 13:15:27.243940  7358 leader_election.cc:290] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:27.246554  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:27.246884  7331 tablet_bootstrap.cc:492] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905: No bootstrap required, opened a new log
I20260709 13:15:27.247368  7331 ts_tablet_manager.cc:1403] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.006s
I20260709 13:15:27.250284  7331 raft_consensus.cc:359] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
I20260709 13:15:27.250988  7331 raft_consensus.cc:385] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.251277  7331 raft_consensus.cc:740] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482ec669868d43228e5a7c0279120905, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.251616  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:27.252203  7331 consensus_queue.cc:260] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
W20260709 13:15:27.253240  7252 leader_election.cc:343] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.254506  7330 tablet_bootstrap.cc:654] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.257067  7034 catalog_manager.cc:5697] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b reported cstate change: term changed from 0 to 1, leader changed from <none> to 33c2c688da794e89b128fc596b4ff21b (127.6.214.131). New cstate: current_term: 1 leader_uuid: "33c2c688da794e89b128fc596b4ff21b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.262058  7331 ts_tablet_manager.cc:1434] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.011s
I20260709 13:15:27.265017  7331 tablet_bootstrap.cc:492] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905: Bootstrap starting.
I20260709 13:15:27.263681  7340 raft_consensus.cc:2749] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.266515  7330 tablet_bootstrap.cc:492] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1: No bootstrap required, opened a new log
I20260709 13:15:27.262662  7332 tablet_bootstrap.cc:654] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.274015  7330 ts_tablet_manager.cc:1403] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.009s
I20260709 13:15:27.272643  7331 tablet_bootstrap.cc:654] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.277400  7137 raft_consensus.cc:2468] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 1.
I20260709 13:15:27.277222  7330 raft_consensus.cc:359] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.278317  7330 raft_consensus.cc:385] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.278694  7330 raft_consensus.cc:740] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.279662  7253 leader_election.cc:304] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 9376bab1f7f3446699ce394cc08e0aa1
I20260709 13:15:27.280537  7337 raft_consensus.cc:2804] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.281113  7337 raft_consensus.cc:697] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Becoming Leader. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Running, Role: LEADER
I20260709 13:15:27.282171  7337 consensus_queue.cc:237] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.284351  7332 tablet_bootstrap.cc:492] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b: No bootstrap required, opened a new log
I20260709 13:15:27.286096  7332 ts_tablet_manager.cc:1403] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.005s
I20260709 13:15:27.279954  7330 consensus_queue.cc:260] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.287400  7331 tablet_bootstrap.cc:492] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905: No bootstrap required, opened a new log
I20260709 13:15:27.289011  7340 raft_consensus.cc:493] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.292306  7340 raft_consensus.cc:515] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
I20260709 13:15:27.294660  7340 leader_election.cc:290] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:27.287873  7331 ts_tablet_manager.cc:1403] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.002s
I20260709 13:15:27.295881  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce662cccc58549f4a58cc43237bf7ca0" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2c688da794e89b128fc596b4ff21b" is_pre_election: true
I20260709 13:15:27.296561  7286 raft_consensus.cc:2468] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 0.
I20260709 13:15:27.289603  7358 raft_consensus.cc:493] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.296732  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce662cccc58549f4a58cc43237bf7ca0" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1" is_pre_election: true
I20260709 13:15:27.289446  7332 raft_consensus.cc:359] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.297510  7332 raft_consensus.cc:385] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.297535  7212 raft_consensus.cc:2468] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 0.
I20260709 13:15:27.297375  7358 raft_consensus.cc:515] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.297996  7332 raft_consensus.cc:740] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.297897  7102 leader_election.cc:304] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:27.298724  7340 raft_consensus.cc:2804] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.299085  7340 raft_consensus.cc:493] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.299414  7340 raft_consensus.cc:3060] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.299690  7358 leader_election.cc:290] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:27.290705  7330 ts_tablet_manager.cc:1434] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 13:15:27.301695  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3769dba8cd0048ed8305dad93d73f817" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905" is_pre_election: true
I20260709 13:15:27.302595  7137 raft_consensus.cc:2468] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 0.
I20260709 13:15:27.303843  7253 leader_election.cc:304] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:27.301695  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3769dba8cd0048ed8305dad93d73f817" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1" is_pre_election: true
I20260709 13:15:27.304725  7212 raft_consensus.cc:2468] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 0.
I20260709 13:15:27.306260  7340 raft_consensus.cc:515] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
I20260709 13:15:27.307789  7358 raft_consensus.cc:2804] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.308269  7340 leader_election.cc:290] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 1 election: Requested vote from peers 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:27.309960  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce662cccc58549f4a58cc43237bf7ca0" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:27.310130  7331 raft_consensus.cc:359] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.311997  7331 raft_consensus.cc:385] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.310750  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce662cccc58549f4a58cc43237bf7ca0" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:27.312378  7331 raft_consensus.cc:740] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482ec669868d43228e5a7c0279120905, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.312600  7212 raft_consensus.cc:3060] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.312736  7330 tablet_bootstrap.cc:492] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1: Bootstrap starting.
I20260709 13:15:27.313118  7331 consensus_queue.cc:260] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.315326  7331 ts_tablet_manager.cc:1434] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:15:27.316259  7331 tablet_bootstrap.cc:492] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905: Bootstrap starting.
I20260709 13:15:27.310997  7332 consensus_queue.cc:260] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.311957  7286 raft_consensus.cc:3060] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.319114  7332 ts_tablet_manager.cc:1434] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:15:27.321115  7332 tablet_bootstrap.cc:492] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b: Bootstrap starting.
I20260709 13:15:27.320474  7358 raft_consensus.cc:493] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.322888  7212 raft_consensus.cc:2468] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 1.
I20260709 13:15:27.325266  7358 raft_consensus.cc:3060] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.326305  7102 leader_election.cc:304] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482ec669868d43228e5a7c0279120905, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:27.329046  7340 raft_consensus.cc:2804] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.329548  7340 raft_consensus.cc:697] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 1 LEADER]: Becoming Leader. State: Replica: 482ec669868d43228e5a7c0279120905, State: Running, Role: LEADER
I20260709 13:15:27.330089  7330 tablet_bootstrap.cc:654] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.330536  7340 consensus_queue.cc:237] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
I20260709 13:15:27.341640  7286 raft_consensus.cc:2468] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 1.
I20260709 13:15:27.355835  7358 raft_consensus.cc:515] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.356715  7332 tablet_bootstrap.cc:654] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.357357  7336 raft_consensus.cc:493] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.358114  7336 raft_consensus.cc:515] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.360347  7336 leader_election.cc:290] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:27.364938  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3c73389e124baa99aa4080e593d1d6" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905" is_pre_election: true
W20260709 13:15:27.366647  7179 leader_election.cc:343] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.367271  7331 tablet_bootstrap.cc:654] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.367434  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3769dba8cd0048ed8305dad93d73f817" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:27.367627  7330 tablet_bootstrap.cc:492] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1: No bootstrap required, opened a new log
I20260709 13:15:27.368137  7330 ts_tablet_manager.cc:1403] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.004s
I20260709 13:15:27.368022  7137 raft_consensus.cc:3060] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.364526  7032 catalog_manager.cc:5697] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b reported cstate change: term changed from 0 to 1, leader changed from <none> to 33c2c688da794e89b128fc596b4ff21b (127.6.214.131). New cstate: current_term: 1 leader_uuid: "33c2c688da794e89b128fc596b4ff21b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.376865  7330 raft_consensus.cc:359] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.377633  7330 raft_consensus.cc:385] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.378018  7330 raft_consensus.cc:740] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.379806  7330 consensus_queue.cc:260] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.379451  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3c73389e124baa99aa4080e593d1d6" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2c688da794e89b128fc596b4ff21b" is_pre_election: true
I20260709 13:15:27.382620  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3769dba8cd0048ed8305dad93d73f817" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:27.383179  7212 raft_consensus.cc:3060] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.384519  7330 ts_tablet_manager.cc:1434] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:15:27.385385  7330 tablet_bootstrap.cc:492] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1: Bootstrap starting.
I20260709 13:15:27.379597  7358 leader_election.cc:290] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:27.382265  7286 raft_consensus.cc:2468] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 0.
I20260709 13:15:27.387537  7034 catalog_manager.cc:5697] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482ec669868d43228e5a7c0279120905 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "482ec669868d43228e5a7c0279120905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.392515  7178 leader_election.cc:304] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 482ec669868d43228e5a7c0279120905
I20260709 13:15:27.390601  7137 raft_consensus.cc:2468] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 1.
I20260709 13:15:27.390974  7332 tablet_bootstrap.cc:492] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b: No bootstrap required, opened a new log
I20260709 13:15:27.393321  7336 raft_consensus.cc:2804] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.393710  7336 raft_consensus.cc:493] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.394111  7336 raft_consensus.cc:3060] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.394232  7253 leader_election.cc:304] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:27.395115  7358 raft_consensus.cc:2804] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.395577  7330 tablet_bootstrap.cc:654] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.395896  7358 raft_consensus.cc:697] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Becoming Leader. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Running, Role: LEADER
I20260709 13:15:27.393806  7332 ts_tablet_manager.cc:1403] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.008s
I20260709 13:15:27.396765  7358 consensus_queue.cc:237] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.399932  7332 raft_consensus.cc:359] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.400811  7332 raft_consensus.cc:385] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.401155  7332 raft_consensus.cc:740] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.407929  7332 consensus_queue.cc:260] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.409899  7332 ts_tablet_manager.cc:1434] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:15:27.410715  7332 tablet_bootstrap.cc:492] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b: Bootstrap starting.
I20260709 13:15:27.416821  7332 tablet_bootstrap.cc:654] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.419553  7330 tablet_bootstrap.cc:492] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1: No bootstrap required, opened a new log
I20260709 13:15:27.420058  7330 ts_tablet_manager.cc:1403] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.015s
I20260709 13:15:27.422698  7330 raft_consensus.cc:359] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.423393  7330 raft_consensus.cc:385] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.423693  7330 raft_consensus.cc:740] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.424409  7330 consensus_queue.cc:260] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.427644  7212 raft_consensus.cc:2468] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 1.
I20260709 13:15:27.427605  7336 raft_consensus.cc:515] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.429186  7332 tablet_bootstrap.cc:492] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b: No bootstrap required, opened a new log
I20260709 13:15:27.429684  7332 ts_tablet_manager.cc:1403] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.009s
I20260709 13:15:27.430452  7331 tablet_bootstrap.cc:492] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905: No bootstrap required, opened a new log
I20260709 13:15:27.430785  7331 ts_tablet_manager.cc:1403] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.005s
I20260709 13:15:27.432397  7332 raft_consensus.cc:359] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.434978  7332 raft_consensus.cc:385] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.435446  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3c73389e124baa99aa4080e593d1d6" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:27.435962  7336 leader_election.cc:290] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:27.435658  7332 raft_consensus.cc:740] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.432710  7331 raft_consensus.cc:359] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.439172  7331 raft_consensus.cc:385] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.439030  7332 consensus_queue.cc:260] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.441354  7332 ts_tablet_manager.cc:1434] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 13:15:27.438337  7330 ts_tablet_manager.cc:1434] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 13:15:27.437774  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3c73389e124baa99aa4080e593d1d6" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:27.444044  7286 raft_consensus.cc:3060] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.445012  7033 catalog_manager.cc:5697] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b reported cstate change: term changed from 0 to 1, leader changed from <none> to 33c2c688da794e89b128fc596b4ff21b (127.6.214.131). New cstate: current_term: 1 leader_uuid: "33c2c688da794e89b128fc596b4ff21b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.451171  7286 raft_consensus.cc:2468] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 1.
I20260709 13:15:27.439548  7331 raft_consensus.cc:740] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482ec669868d43228e5a7c0279120905, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.452385  7178 leader_election.cc:304] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:27.453404  7336 raft_consensus.cc:2804] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.453977  7336 raft_consensus.cc:697] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 LEADER]: Becoming Leader. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:27.452323  7331 consensus_queue.cc:260] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.455407  7137 raft_consensus.cc:3060] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.457111  7331 ts_tablet_manager.cc:1434] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:15:27.455049  7336 consensus_queue.cc:237] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.458117  7331 tablet_bootstrap.cc:492] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905: Bootstrap starting.
I20260709 13:15:27.463100  7137 raft_consensus.cc:2468] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 1.
I20260709 13:15:27.468062  7331 tablet_bootstrap.cc:654] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.480250  7032 catalog_manager.cc:5697] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.483525  7331 tablet_bootstrap.cc:492] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905: No bootstrap required, opened a new log
I20260709 13:15:27.484071  7331 ts_tablet_manager.cc:1403] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.007s
I20260709 13:15:27.487097  7331 raft_consensus.cc:359] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.487838  7331 raft_consensus.cc:385] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.488171  7331 raft_consensus.cc:740] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482ec669868d43228e5a7c0279120905, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.488862  7331 consensus_queue.cc:260] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.491356  7358 raft_consensus.cc:493] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.491888  7358 raft_consensus.cc:515] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.491523  7331 ts_tablet_manager.cc:1434] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:27.493597  7331 tablet_bootstrap.cc:492] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905: Bootstrap starting.
I20260709 13:15:27.494026  7358 leader_election.cc:290] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:27.495185  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf275d22b378476d84bb819006363228" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905" is_pre_election: true
I20260709 13:15:27.495595  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf275d22b378476d84bb819006363228" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1" is_pre_election: true
I20260709 13:15:27.495775  7137 raft_consensus.cc:2468] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 0.
I20260709 13:15:27.496165  7212 raft_consensus.cc:2468] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 0.
I20260709 13:15:27.497159  7253 leader_election.cc:304] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:27.497977  7358 raft_consensus.cc:2804] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.498363  7358 raft_consensus.cc:493] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.498668  7358 raft_consensus.cc:3060] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.501364  7331 tablet_bootstrap.cc:654] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.505575  7358 raft_consensus.cc:515] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.506525  7331 tablet_bootstrap.cc:492] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905: No bootstrap required, opened a new log
I20260709 13:15:27.506963  7331 ts_tablet_manager.cc:1403] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:15:27.508667  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf275d22b378476d84bb819006363228" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:27.509311  7137 raft_consensus.cc:3060] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.509918  7331 raft_consensus.cc:359] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.510622  7331 raft_consensus.cc:385] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.510877  7331 raft_consensus.cc:740] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482ec669868d43228e5a7c0279120905, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.511512  7331 consensus_queue.cc:260] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.513713  7331 ts_tablet_manager.cc:1434] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:15:27.514590  7331 tablet_bootstrap.cc:492] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905: Bootstrap starting.
I20260709 13:15:27.517191  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf275d22b378476d84bb819006363228" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:27.517956  7212 raft_consensus.cc:3060] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.517877  7137 raft_consensus.cc:2468] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 1.
I20260709 13:15:27.523932  7253 leader_election.cc:304] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:27.524781  7331 tablet_bootstrap.cc:654] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.524945  7337 raft_consensus.cc:2804] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.525717  7337 raft_consensus.cc:697] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Becoming Leader. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Running, Role: LEADER
I20260709 13:15:27.526721  7337 consensus_queue.cc:237] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.534488  7212 raft_consensus.cc:2468] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 1.
I20260709 13:15:27.535518  7358 leader_election.cc:290] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 1 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:27.538565  7331 tablet_bootstrap.cc:492] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905: No bootstrap required, opened a new log
I20260709 13:15:27.539004  7331 ts_tablet_manager.cc:1403] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905: Time spent bootstrapping tablet: real 0.025s	user 0.003s	sys 0.015s
I20260709 13:15:27.540573  7033 catalog_manager.cc:5697] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b reported cstate change: term changed from 0 to 1, leader changed from <none> to 33c2c688da794e89b128fc596b4ff21b (127.6.214.131). New cstate: current_term: 1 leader_uuid: "33c2c688da794e89b128fc596b4ff21b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.541411  7331 raft_consensus.cc:359] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.542069  7331 raft_consensus.cc:385] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.542323  7331 raft_consensus.cc:740] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482ec669868d43228e5a7c0279120905, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.542965  7331 consensus_queue.cc:260] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.544787  7331 ts_tablet_manager.cc:1434] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:27.561362  7336 raft_consensus.cc:493] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.562162  7336 raft_consensus.cc:515] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.565855  7336 leader_election.cc:290] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:27.566399  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905" is_pre_election: true
I20260709 13:15:27.566916  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2c688da794e89b128fc596b4ff21b" is_pre_election: true
I20260709 13:15:27.567490  7137 raft_consensus.cc:2393] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9376bab1f7f3446699ce394cc08e0aa1 in current term 1: Already voted for candidate 33c2c688da794e89b128fc596b4ff21b in this term.
I20260709 13:15:27.568605  7179 leader_election.cc:304] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9376bab1f7f3446699ce394cc08e0aa1; no voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905
I20260709 13:15:27.569324  7336 raft_consensus.cc:3060] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.574122  7336 raft_consensus.cc:2749] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.579082  7340 raft_consensus.cc:493] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.579627  7340 raft_consensus.cc:515] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.581624  7340 leader_election.cc:290] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:27.582419  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17fb5239d9374164995f9850ea265145" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1" is_pre_election: true
I20260709 13:15:27.582754  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17fb5239d9374164995f9850ea265145" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2c688da794e89b128fc596b4ff21b" is_pre_election: true
I20260709 13:15:27.583066  7212 raft_consensus.cc:2468] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 0.
I20260709 13:15:27.583388  7286 raft_consensus.cc:2468] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 0.
I20260709 13:15:27.584169  7102 leader_election.cc:304] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482ec669868d43228e5a7c0279120905, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:27.584887  7340 raft_consensus.cc:2804] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.585278  7340 raft_consensus.cc:493] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.585713  7340 raft_consensus.cc:3060] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.590265  7340 raft_consensus.cc:515] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.592145  7340 leader_election.cc:290] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 1 election: Requested vote from peers 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:27.592922  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17fb5239d9374164995f9850ea265145" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:27.593147  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17fb5239d9374164995f9850ea265145" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:27.593524  7212 raft_consensus.cc:3060] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.593766  7286 raft_consensus.cc:3060] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.598775  7286 raft_consensus.cc:2468] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 1.
I20260709 13:15:27.599881  7102 leader_election.cc:304] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:27.599948  7212 raft_consensus.cc:2468] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 1.
I20260709 13:15:27.600718  7340 raft_consensus.cc:2804] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.601841  7340 raft_consensus.cc:697] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 1 LEADER]: Becoming Leader. State: Replica: 482ec669868d43228e5a7c0279120905, State: Running, Role: LEADER
I20260709 13:15:27.602702  7340 consensus_queue.cc:237] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.611769  7032 catalog_manager.cc:5697] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482ec669868d43228e5a7c0279120905 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "482ec669868d43228e5a7c0279120905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.646803  7340 raft_consensus.cc:493] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.647426  7340 raft_consensus.cc:515] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.649770  7340 leader_election.cc:290] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:27.650759  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2c688da794e89b128fc596b4ff21b" is_pre_election: true
I20260709 13:15:27.651373  7286 raft_consensus.cc:2468] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 0.
I20260709 13:15:27.650676  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1" is_pre_election: true
I20260709 13:15:27.651944  7212 raft_consensus.cc:2468] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 0.
I20260709 13:15:27.652364  7102 leader_election.cc:304] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:27.653139  7340 raft_consensus.cc:2804] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.653574  7340 raft_consensus.cc:493] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.653967  7340 raft_consensus.cc:3060] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.661197  7340 raft_consensus.cc:515] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.663416  7340 leader_election.cc:290] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 1 election: Requested vote from peers 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:27.664633  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:27.664974  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:27.665248  7212 raft_consensus.cc:3060] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.665535  7286 raft_consensus.cc:3060] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.671876  7212 raft_consensus.cc:2468] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 1.
I20260709 13:15:27.671876  7286 raft_consensus.cc:2468] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 1.
I20260709 13:15:27.673245  7102 leader_election.cc:304] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:27.674027  7340 raft_consensus.cc:2804] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.674644  7340 raft_consensus.cc:697] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 1 LEADER]: Becoming Leader. State: Replica: 482ec669868d43228e5a7c0279120905, State: Running, Role: LEADER
I20260709 13:15:27.675590  7340 consensus_queue.cc:237] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
W20260709 13:15:27.685529  7081 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:27.685612  7032 catalog_manager.cc:5697] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 reported cstate change: term changed from 0 to 1, leader changed from <none> to 482ec669868d43228e5a7c0279120905 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "482ec669868d43228e5a7c0279120905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.722815  7340 consensus_queue.cc:1048] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.726255  7336 raft_consensus.cc:493] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.726845  7336 raft_consensus.cc:515] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.729377  7336 leader_election.cc:290] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:27.730643  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7897ab92ced40f884f353b8a96a91ea" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2c688da794e89b128fc596b4ff21b" is_pre_election: true
I20260709 13:15:27.731369  7286 raft_consensus.cc:2468] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 0.
I20260709 13:15:27.732237  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7897ab92ced40f884f353b8a96a91ea" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905" is_pre_election: true
I20260709 13:15:27.732766  7178 leader_election.cc:304] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:27.732895  7137 raft_consensus.cc:2468] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 0.
I20260709 13:15:27.735188  7336 raft_consensus.cc:2804] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.735600  7336 raft_consensus.cc:493] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.736059  7336 raft_consensus.cc:3060] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.741209  7340 consensus_queue.cc:1048] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.754195  7358 consensus_queue.cc:1048] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.755882  7336 raft_consensus.cc:515] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.757644  7358 consensus_queue.cc:1048] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.761050  7336 leader_election.cc:290] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:27.761478  7137 raft_consensus.cc:3060] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.765182  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7897ab92ced40f884f353b8a96a91ea" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:27.765769  7136 raft_consensus.cc:3060] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.774508  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7897ab92ced40f884f353b8a96a91ea" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:27.774883  7136 raft_consensus.cc:2468] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 1.
I20260709 13:15:27.776057  7286 raft_consensus.cc:3060] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.776841  7179 leader_election.cc:304] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482ec669868d43228e5a7c0279120905, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:27.777784  7336 raft_consensus.cc:2804] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.778414  7336 raft_consensus.cc:697] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 LEADER]: Becoming Leader. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:27.779435  7336 consensus_queue.cc:237] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:27.787873  7358 consensus_queue.cc:1048] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.794826  7286 raft_consensus.cc:2468] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 1.
I20260709 13:15:27.796835  7358 consensus_queue.cc:1048] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.824111  7034 catalog_manager.cc:5697] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.830188  7358 consensus_queue.cc:1048] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.857280  7398 consensus_queue.cc:1048] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.878101  7336 consensus_queue.cc:1048] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.892501  7336 consensus_queue.cc:1048] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.925680  7286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080"
dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
mode: GRACEFUL
new_leader_uuid: "482ec669868d43228e5a7c0279120905"
 from {username='slave'} at 127.0.0.1:54028
I20260709 13:15:27.926417  7286 raft_consensus.cc:606] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Received request to transfer leadership to TS 482ec669868d43228e5a7c0279120905
I20260709 13:15:27.931852  7286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971"
dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
mode: GRACEFUL
new_leader_uuid: "482ec669868d43228e5a7c0279120905"
 from {username='slave'} at 127.0.0.1:54028
I20260709 13:15:27.932379  7286 raft_consensus.cc:606] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Received request to transfer leadership to TS 482ec669868d43228e5a7c0279120905
I20260709 13:15:27.937274  7286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf275d22b378476d84bb819006363228"
dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
mode: GRACEFUL
new_leader_uuid: "482ec669868d43228e5a7c0279120905"
 from {username='slave'} at 127.0.0.1:54028
I20260709 13:15:27.937829  7286 raft_consensus.cc:606] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Received request to transfer leadership to TS 482ec669868d43228e5a7c0279120905
I20260709 13:15:27.953328  7135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813"
dest_uuid: "482ec669868d43228e5a7c0279120905"
mode: GRACEFUL
new_leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:55790
I20260709 13:15:27.953966  7135 raft_consensus.cc:606] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 1 LEADER]: Received request to transfer leadership to TS 9376bab1f7f3446699ce394cc08e0aa1
I20260709 13:15:27.958948  7286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3769dba8cd0048ed8305dad93d73f817"
dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
mode: GRACEFUL
new_leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:54028
I20260709 13:15:27.959472  7286 raft_consensus.cc:606] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Received request to transfer leadership to TS 9376bab1f7f3446699ce394cc08e0aa1
I20260709 13:15:27.964447  7135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17fb5239d9374164995f9850ea265145"
dest_uuid: "482ec669868d43228e5a7c0279120905"
mode: GRACEFUL
new_leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:55790
I20260709 13:15:27.964931  7135 raft_consensus.cc:606] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 1 LEADER]: Received request to transfer leadership to TS 9376bab1f7f3446699ce394cc08e0aa1
I20260709 13:15:27.972756  7398 consensus_queue.cc:1048] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.982190  7358 raft_consensus.cc:993] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b: : Instructing follower 482ec669868d43228e5a7c0279120905 to start an election
I20260709 13:15:27.982637  7358 raft_consensus.cc:1081] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Signalling peer 482ec669868d43228e5a7c0279120905 to start an election
I20260709 13:15:27.982990  7213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7897ab92ced40f884f353b8a96a91ea"
dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
mode: GRACEFUL
new_leader_uuid: "33c2c688da794e89b128fc596b4ff21b"
 from {username='slave'} at 127.0.0.1:52864
I20260709 13:15:27.983564  7213 raft_consensus.cc:606] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 LEADER]: Received request to transfer leadership to TS 33c2c688da794e89b128fc596b4ff21b
I20260709 13:15:27.989868  7137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf275d22b378476d84bb819006363228"
dest_uuid: "482ec669868d43228e5a7c0279120905"
 from {username='slave'} at 127.0.0.1:55780
I20260709 13:15:27.990490  7137 raft_consensus.cc:493] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:27.990546  7398 consensus_queue.cc:1048] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.990993  7137 raft_consensus.cc:3060] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:27.999118  7137 raft_consensus.cc:515] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.000286  7135 raft_consensus.cc:1240] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Rejecting Update request from peer 33c2c688da794e89b128fc596b4ff21b for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:28.001335  7137 leader_election.cc:290] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 2 election: Requested vote from peers 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:28.003254  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf275d22b378476d84bb819006363228" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:28.003489  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf275d22b378476d84bb819006363228" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:28.003805  7212 raft_consensus.cc:3060] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.004076  7286 raft_consensus.cc:3055] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:28.004428  7286 raft_consensus.cc:740] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Running, Role: LEADER
I20260709 13:15:28.005280  7286 consensus_queue.cc:260] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.006590  7286 raft_consensus.cc:3060] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.010548  7212 raft_consensus.cc:2468] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 2.
I20260709 13:15:28.012660  7102 leader_election.cc:304] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482ec669868d43228e5a7c0279120905, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:28.013559  7340 raft_consensus.cc:2804] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:28.014014  7340 raft_consensus.cc:697] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Becoming Leader. State: Replica: 482ec669868d43228e5a7c0279120905, State: Running, Role: LEADER
I20260709 13:15:28.014894  7286 raft_consensus.cc:2468] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 2.
I20260709 13:15:28.014775  7340 consensus_queue.cc:237] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.022754  7032 catalog_manager.cc:5697] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 reported cstate change: term changed from 1 to 2, leader changed from 33c2c688da794e89b128fc596b4ff21b (127.6.214.131) to 482ec669868d43228e5a7c0279120905 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "482ec669868d43228e5a7c0279120905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.069972  7340 consensus_queue.cc:1048] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.083205  7411 consensus_queue.cc:1048] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.084515  7365 raft_consensus.cc:993] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905: : Instructing follower 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:28.084986  7365 raft_consensus.cc:1081] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 1 LEADER]: Signalling peer 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:28.089131  7212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813"
dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:52852
I20260709 13:15:28.089761  7212 raft_consensus.cc:493] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:28.090163  7212 raft_consensus.cc:3060] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.094584  7340 consensus_queue.cc:1048] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.095674  7365 raft_consensus.cc:993] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905: : Instructing follower 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:28.096135  7365 raft_consensus.cc:1081] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 1 LEADER]: Signalling peer 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:28.098070  7212 raft_consensus.cc:515] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.101882  7135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:28.102946  7212 leader_election.cc:290] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 2 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:28.102607  7135 raft_consensus.cc:3055] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:28.105734  7135 raft_consensus.cc:740] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 482ec669868d43228e5a7c0279120905, State: Running, Role: LEADER
I20260709 13:15:28.106586  7135 consensus_queue.cc:260] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.107170  7213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17fb5239d9374164995f9850ea265145"
dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:52852
I20260709 13:15:28.108150  7213 raft_consensus.cc:493] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:28.108512  7213 raft_consensus.cc:3060] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.109061  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:28.109716  7286 raft_consensus.cc:3060] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.113107  7135 raft_consensus.cc:3060] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.115231  7213 raft_consensus.cc:515] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.116334  7212 raft_consensus.cc:1240] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Rejecting Update request from peer 482ec669868d43228e5a7c0279120905 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:28.119423  7213 leader_election.cc:290] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 2 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:28.120059  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17fb5239d9374164995f9850ea265145" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:28.120810  7137 raft_consensus.cc:3055] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:28.121002  7285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17fb5239d9374164995f9850ea265145" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:28.121162  7137 raft_consensus.cc:740] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 482ec669868d43228e5a7c0279120905, State: Running, Role: LEADER
I20260709 13:15:28.121183  7340 consensus_queue.cc:1059] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.121723  7285 raft_consensus.cc:3060] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.122573  7137 consensus_queue.cc:260] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.124786  7137 raft_consensus.cc:3060] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.129159  7285 raft_consensus.cc:2468] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 2.
I20260709 13:15:28.130514  7178 leader_election.cc:304] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:28.131843  7403 raft_consensus.cc:2804] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:28.132416  7403 raft_consensus.cc:697] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Becoming Leader. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:28.133036  7137 raft_consensus.cc:2468] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 2.
I20260709 13:15:28.133349  7286 raft_consensus.cc:2468] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 2.
I20260709 13:15:28.133378  7403 consensus_queue.cc:237] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.134246  7287 raft_consensus.cc:1240] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Rejecting Update request from peer 482ec669868d43228e5a7c0279120905 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:15:28.135687  7135 raft_consensus.cc:2468] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 2.
I20260709 13:15:28.137068  7178 leader_election.cc:304] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:28.138150  7380 raft_consensus.cc:2804] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:28.138670  7380 raft_consensus.cc:697] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Becoming Leader. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:28.139544  7380 consensus_queue.cc:237] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.142488  7032 catalog_manager.cc:5697] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 reported cstate change: term changed from 1 to 2, leader changed from 482ec669868d43228e5a7c0279120905 (127.6.214.129) to 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.154330  7032 catalog_manager.cc:5697] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 reported cstate change: term changed from 1 to 2, leader changed from 482ec669868d43228e5a7c0279120905 (127.6.214.129) to 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.220157  7380 consensus_queue.cc:1048] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.235471  7380 consensus_queue.cc:1048] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.243163  7403 raft_consensus.cc:993] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1: : Instructing follower 33c2c688da794e89b128fc596b4ff21b to start an election
I20260709 13:15:28.243628  7403 raft_consensus.cc:1081] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 LEADER]: Signalling peer 33c2c688da794e89b128fc596b4ff21b to start an election
I20260709 13:15:28.245327  7287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7897ab92ced40f884f353b8a96a91ea"
dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
 from {username='slave'} at 127.0.0.1:54012
I20260709 13:15:28.245878  7287 raft_consensus.cc:493] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:28.246201  7287 raft_consensus.cc:3060] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.250916  7287 raft_consensus.cc:515] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.252981  7287 leader_election.cc:290] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 2 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:28.253402  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7897ab92ced40f884f353b8a96a91ea" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:28.253628  7213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7897ab92ced40f884f353b8a96a91ea" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:28.254073  7137 raft_consensus.cc:3060] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.254212  7213 raft_consensus.cc:3055] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:28.254614  7213 raft_consensus.cc:740] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:28.255404  7213 consensus_queue.cc:260] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.256628  7213 raft_consensus.cc:3060] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.258893  7137 raft_consensus.cc:2468] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 2.
I20260709 13:15:28.259979  7253 leader_election.cc:304] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:28.260650  7398 raft_consensus.cc:2804] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:28.261111  7398 raft_consensus.cc:697] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 2 LEADER]: Becoming Leader. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Running, Role: LEADER
I20260709 13:15:28.261909  7398 consensus_queue.cc:237] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.265322  7213 raft_consensus.cc:2468] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 2.
I20260709 13:15:28.269691  7033 catalog_manager.cc:5697] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b reported cstate change: term changed from 1 to 2, leader changed from 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130) to 33c2c688da794e89b128fc596b4ff21b (127.6.214.131). New cstate: current_term: 2 leader_uuid: "33c2c688da794e89b128fc596b4ff21b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.272943  7398 raft_consensus.cc:993] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b: : Instructing follower 482ec669868d43228e5a7c0279120905 to start an election
I20260709 13:15:28.273643  7361 raft_consensus.cc:1081] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Signalling peer 482ec669868d43228e5a7c0279120905 to start an election
I20260709 13:15:28.275507  7137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971"
dest_uuid: "482ec669868d43228e5a7c0279120905"
 from {username='slave'} at 127.0.0.1:55780
I20260709 13:15:28.276160  7137 raft_consensus.cc:493] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:28.276659  7137 raft_consensus.cc:3060] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.284056  7137 raft_consensus.cc:515] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.287456  7137 leader_election.cc:290] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 2 election: Requested vote from peers 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:28.288582  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:28.288923  7213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:28.289258  7287 raft_consensus.cc:3055] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:28.289533  7213 raft_consensus.cc:3060] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.289676  7287 raft_consensus.cc:740] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Running, Role: LEADER
I20260709 13:15:28.290596  7287 consensus_queue.cc:260] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.291951  7287 raft_consensus.cc:3060] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.297079  7213 raft_consensus.cc:2468] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 2.
I20260709 13:15:28.298382  7102 leader_election.cc:304] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482ec669868d43228e5a7c0279120905, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:28.299360  7413 raft_consensus.cc:2804] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:28.299539  7287 raft_consensus.cc:2468] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 2.
I20260709 13:15:28.299908  7413 raft_consensus.cc:697] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Becoming Leader. State: Replica: 482ec669868d43228e5a7c0279120905, State: Running, Role: LEADER
I20260709 13:15:28.300851  7413 consensus_queue.cc:237] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.308135  7033 catalog_manager.cc:5697] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 reported cstate change: term changed from 1 to 2, leader changed from 33c2c688da794e89b128fc596b4ff21b (127.6.214.131) to 482ec669868d43228e5a7c0279120905 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "482ec669868d43228e5a7c0279120905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.319056  7337 raft_consensus.cc:993] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b: : Instructing follower 482ec669868d43228e5a7c0279120905 to start an election
I20260709 13:15:28.319551  7361 raft_consensus.cc:1081] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Signalling peer 482ec669868d43228e5a7c0279120905 to start an election
I20260709 13:15:28.321054  7137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080"
dest_uuid: "482ec669868d43228e5a7c0279120905"
 from {username='slave'} at 127.0.0.1:55780
I20260709 13:15:28.321643  7137 raft_consensus.cc:493] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:28.322009  7137 raft_consensus.cc:3060] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.328451  7137 raft_consensus.cc:515] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.330571  7137 leader_election.cc:290] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 2 election: Requested vote from peers 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:28.331467  7213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:28.331784  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:28.332170  7213 raft_consensus.cc:3060] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.332363  7287 raft_consensus.cc:3055] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:28.332760  7287 raft_consensus.cc:740] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Running, Role: LEADER
I20260709 13:15:28.333659  7287 consensus_queue.cc:260] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.334949  7287 raft_consensus.cc:3060] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.339722  7213 raft_consensus.cc:2468] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 2.
I20260709 13:15:28.341122  7102 leader_election.cc:304] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482ec669868d43228e5a7c0279120905, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:28.341989  7287 raft_consensus.cc:2468] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 2.
I20260709 13:15:28.342020  7413 raft_consensus.cc:2804] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:28.342643  7413 raft_consensus.cc:697] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Becoming Leader. State: Replica: 482ec669868d43228e5a7c0279120905, State: Running, Role: LEADER
I20260709 13:15:28.343451  7413 consensus_queue.cc:237] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.350597  7033 catalog_manager.cc:5697] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 reported cstate change: term changed from 1 to 2, leader changed from 33c2c688da794e89b128fc596b4ff21b (127.6.214.131) to 482ec669868d43228e5a7c0279120905 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "482ec669868d43228e5a7c0279120905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.432564  7213 raft_consensus.cc:1275] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Refusing update from remote peer 482ec669868d43228e5a7c0279120905: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:28.434122  7413 consensus_queue.cc:1048] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:28.442899  7287 raft_consensus.cc:1275] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Refusing update from remote peer 482ec669868d43228e5a7c0279120905: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:28.444443  7411 consensus_queue.cc:1048] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:28.457969  7398 raft_consensus.cc:993] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b: : Instructing follower 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:28.458665  7361 raft_consensus.cc:1081] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Signalling peer 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:28.460366  7213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3769dba8cd0048ed8305dad93d73f817"
dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:52850
I20260709 13:15:28.461002  7213 raft_consensus.cc:493] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:28.461449  7213 raft_consensus.cc:3060] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.468073  7213 raft_consensus.cc:515] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.470839  7213 leader_election.cc:290] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 2 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:28.471402  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3769dba8cd0048ed8305dad93d73f817" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:28.472129  7287 raft_consensus.cc:3055] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:28.472466  7287 raft_consensus.cc:740] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Running, Role: LEADER
I20260709 13:15:28.473027  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3769dba8cd0048ed8305dad93d73f817" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:28.473536  7287 consensus_queue.cc:260] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.474124  7137 raft_consensus.cc:3060] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.474804  7287 raft_consensus.cc:3060] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.481034  7137 raft_consensus.cc:2468] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 2.
I20260709 13:15:28.481534  7287 raft_consensus.cc:2468] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 2.
I20260709 13:15:28.482336  7179 leader_election.cc:304] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482ec669868d43228e5a7c0279120905, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:28.483198  7403 raft_consensus.cc:2804] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:28.483700  7403 raft_consensus.cc:697] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Becoming Leader. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:28.484632  7403 consensus_queue.cc:237] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:28.491380  7033 catalog_manager.cc:5697] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 reported cstate change: term changed from 1 to 2, leader changed from 33c2c688da794e89b128fc596b4ff21b (127.6.214.131) to 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.546041  7287 raft_consensus.cc:1275] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:28.547508  7403 consensus_queue.cc:1048] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.559298  7137 raft_consensus.cc:1275] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:28.561134  7336 consensus_queue.cc:1048] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:28.666831  7137 raft_consensus.cc:1275] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:28.668224  7336 consensus_queue.cc:1048] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:28.670789  7287 raft_consensus.cc:1275] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:28.672122  7417 consensus_queue.cc:1048] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.723565  7137 raft_consensus.cc:1275] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Refusing update from remote peer 33c2c688da794e89b128fc596b4ff21b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:28.724763  7361 consensus_queue.cc:1048] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:28.732664  7213 raft_consensus.cc:1275] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Refusing update from remote peer 33c2c688da794e89b128fc596b4ff21b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:28.734683  7398 consensus_queue.cc:1048] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:28.822402  7287 raft_consensus.cc:1275] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Refusing update from remote peer 482ec669868d43228e5a7c0279120905: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:28.823935  7365 consensus_queue.cc:1048] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:28.833055  7213 raft_consensus.cc:1275] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Refusing update from remote peer 482ec669868d43228e5a7c0279120905: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:28.834462  7411 consensus_queue.cc:1048] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:28.882340  7287 raft_consensus.cc:1275] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:28.883599  7403 consensus_queue.cc:1048] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:28.895993  7137 raft_consensus.cc:1275] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:28.897648  7380 consensus_queue.cc:1048] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:28.904984  7213 raft_consensus.cc:1275] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Refusing update from remote peer 482ec669868d43228e5a7c0279120905: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:28.906250  7411 consensus_queue.cc:1048] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:28.914845  7287 raft_consensus.cc:1275] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Refusing update from remote peer 482ec669868d43228e5a7c0279120905: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:28.916101  7365 consensus_queue.cc:1048] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:31.014299  7002 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:15:31.015061  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:31.035050  7213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813"
dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
mode: GRACEFUL
new_leader_uuid: "33c2c688da794e89b128fc596b4ff21b"
 from {username='slave'} at 127.0.0.1:52872
I20260709 13:15:31.035568  7213 raft_consensus.cc:606] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Received request to transfer leadership to TS 33c2c688da794e89b128fc596b4ff21b
I20260709 13:15:31.046672  7137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971"
dest_uuid: "482ec669868d43228e5a7c0279120905"
mode: GRACEFUL
new_leader_uuid: "33c2c688da794e89b128fc596b4ff21b"
 from {username='slave'} at 127.0.0.1:55806
I20260709 13:15:31.047214  7137 raft_consensus.cc:606] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Received request to transfer leadership to TS 33c2c688da794e89b128fc596b4ff21b
I20260709 13:15:31.048334  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:31.048739  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:31.411916  7417 raft_consensus.cc:993] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1: : Instructing follower 33c2c688da794e89b128fc596b4ff21b to start an election
I20260709 13:15:31.412418  7427 raft_consensus.cc:1081] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Signalling peer 33c2c688da794e89b128fc596b4ff21b to start an election
I20260709 13:15:31.413935  7287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813"
dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
 from {username='slave'} at 127.0.0.1:54012
I20260709 13:15:31.414494  7287 raft_consensus.cc:493] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:31.414796  7287 raft_consensus.cc:3060] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:31.419308  7287 raft_consensus.cc:515] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:31.420806  7287 leader_election.cc:290] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 3 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:31.421851  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:31.421916  7213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:31.422448  7136 raft_consensus.cc:3060] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:31.422520  7213 raft_consensus.cc:3055] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:31.422887  7213 raft_consensus.cc:740] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:31.423548  7213 consensus_queue.cc:260] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:31.424419  7213 raft_consensus.cc:3060] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:31.427204  7136 raft_consensus.cc:2468] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 3.
I20260709 13:15:31.428298  7253 leader_election.cc:304] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:31.429028  7213 raft_consensus.cc:2468] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 3.
I20260709 13:15:31.429100  7398 raft_consensus.cc:2804] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:31.430555  7398 raft_consensus.cc:697] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 3 LEADER]: Becoming Leader. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Running, Role: LEADER
I20260709 13:15:31.431279  7398 consensus_queue.cc:237] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:31.439590  7031 catalog_manager.cc:5697] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b reported cstate change: term changed from 2 to 3, leader changed from 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130) to 33c2c688da794e89b128fc596b4ff21b (127.6.214.131). New cstate: current_term: 3 leader_uuid: "33c2c688da794e89b128fc596b4ff21b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:31.462496  7435 raft_consensus.cc:993] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905: : Instructing follower 33c2c688da794e89b128fc596b4ff21b to start an election
I20260709 13:15:31.462987  7434 raft_consensus.cc:1081] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Signalling peer 33c2c688da794e89b128fc596b4ff21b to start an election
I20260709 13:15:31.464419  7287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971"
dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
 from {username='slave'} at 127.0.0.1:54006
I20260709 13:15:31.464970  7287 raft_consensus.cc:493] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:31.465288  7287 raft_consensus.cc:3060] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:31.470000  7287 raft_consensus.cc:515] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:31.471467  7287 leader_election.cc:290] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 3 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:31.472254  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:31.472465  7213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:31.472829  7136 raft_consensus.cc:3055] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:31.472956  7213 raft_consensus.cc:3060] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:31.473286  7136 raft_consensus.cc:740] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 482ec669868d43228e5a7c0279120905, State: Running, Role: LEADER
I20260709 13:15:31.474077  7136 consensus_queue.cc:260] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:31.475488  7136 raft_consensus.cc:3060] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:31.479669  7213 raft_consensus.cc:2468] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 3.
I20260709 13:15:31.480880  7252 leader_election.cc:304] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:31.481616  7398 raft_consensus.cc:2804] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:31.481559  7136 raft_consensus.cc:2468] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 3.
I20260709 13:15:31.482199  7398 raft_consensus.cc:697] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 3 LEADER]: Becoming Leader. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Running, Role: LEADER
I20260709 13:15:31.483022  7398 consensus_queue.cc:237] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:31.489606  7031 catalog_manager.cc:5697] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b reported cstate change: term changed from 2 to 3, leader changed from 482ec669868d43228e5a7c0279120905 (127.6.214.129) to 33c2c688da794e89b128fc596b4ff21b (127.6.214.131). New cstate: current_term: 3 leader_uuid: "33c2c688da794e89b128fc596b4ff21b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:31.876837  7213 raft_consensus.cc:1275] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Refusing update from remote peer 33c2c688da794e89b128fc596b4ff21b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:31.878317  7398 consensus_queue.cc:1048] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.889922  7136 raft_consensus.cc:1275] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Refusing update from remote peer 33c2c688da794e89b128fc596b4ff21b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:31.892215  7398 consensus_queue.cc:1048] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.920722  7213 raft_consensus.cc:1275] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Refusing update from remote peer 33c2c688da794e89b128fc596b4ff21b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:31.922076  7398 consensus_queue.cc:1048] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.931249  7136 raft_consensus.cc:1275] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Refusing update from remote peer 33c2c688da794e89b128fc596b4ff21b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:31.934739  7428 consensus_queue.cc:1048] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:32.049593  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:32.059538  7136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce662cccc58549f4a58cc43237bf7ca0"
dest_uuid: "482ec669868d43228e5a7c0279120905"
mode: GRACEFUL
new_leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:55790
I20260709 13:15:32.060076  7136 raft_consensus.cc:606] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 1 LEADER]: Received request to transfer leadership to TS 9376bab1f7f3446699ce394cc08e0aa1
I20260709 13:15:32.065232  7136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080"
dest_uuid: "482ec669868d43228e5a7c0279120905"
mode: GRACEFUL
new_leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:55790
I20260709 13:15:32.065799  7136 raft_consensus.cc:606] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Received request to transfer leadership to TS 9376bab1f7f3446699ce394cc08e0aa1
I20260709 13:15:32.070950  7287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971"
dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
mode: GRACEFUL
new_leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:54028
I20260709 13:15:32.071511  7287 raft_consensus.cc:606] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 3 LEADER]: Received request to transfer leadership to TS 9376bab1f7f3446699ce394cc08e0aa1
I20260709 13:15:32.076697  7136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf275d22b378476d84bb819006363228"
dest_uuid: "482ec669868d43228e5a7c0279120905"
mode: GRACEFUL
new_leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:55790
I20260709 13:15:32.077365  7136 raft_consensus.cc:606] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Received request to transfer leadership to TS 9376bab1f7f3446699ce394cc08e0aa1
I20260709 13:15:32.084764  7287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813"
dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
mode: GRACEFUL
new_leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:54028
I20260709 13:15:32.085222  7287 raft_consensus.cc:606] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 3 LEADER]: Received request to transfer leadership to TS 9376bab1f7f3446699ce394cc08e0aa1
I20260709 13:15:32.181641  7434 raft_consensus.cc:993] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905: : Instructing follower 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:32.182102  7434 raft_consensus.cc:1081] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 1 LEADER]: Signalling peer 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:32.183534  7213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce662cccc58549f4a58cc43237bf7ca0"
dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:52852
I20260709 13:15:32.183957  7213 raft_consensus.cc:493] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:32.184203  7213 raft_consensus.cc:3060] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:32.188164  7213 raft_consensus.cc:515] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
I20260709 13:15:32.189846  7213 leader_election.cc:290] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 2 election: Requested vote from peers 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445), 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319)
I20260709 13:15:32.190528  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce662cccc58549f4a58cc43237bf7ca0" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:32.190866  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce662cccc58549f4a58cc43237bf7ca0" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:32.191107  7287 raft_consensus.cc:3060] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:32.191428  7136 raft_consensus.cc:3055] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:32.191795  7136 raft_consensus.cc:740] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 482ec669868d43228e5a7c0279120905, State: Running, Role: LEADER
I20260709 13:15:32.192560  7136 consensus_queue.cc:260] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
I20260709 13:15:32.193783  7136 raft_consensus.cc:3060] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:32.197564  7287 raft_consensus.cc:2468] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 2.
I20260709 13:15:32.198755  7178 leader_election.cc:304] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:32.199440  7427 raft_consensus.cc:2804] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:32.199836  7136 raft_consensus.cc:2468] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 2.
I20260709 13:15:32.200400  7427 raft_consensus.cc:697] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Becoming Leader. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:32.201184  7427 consensus_queue.cc:237] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
I20260709 13:15:32.208158  7033 catalog_manager.cc:5697] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 reported cstate change: term changed from 1 to 2, leader changed from 482ec669868d43228e5a7c0279120905 (127.6.214.129) to 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.314703  7398 raft_consensus.cc:993] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b: : Instructing follower 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:32.315150  7428 raft_consensus.cc:1081] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 3 LEADER]: Signalling peer 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:32.316565  7213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971"
dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:52850
I20260709 13:15:32.317138  7213 raft_consensus.cc:493] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:32.317514  7213 raft_consensus.cc:3060] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:32.322086  7213 raft_consensus.cc:515] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:32.323668  7213 leader_election.cc:290] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 4 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:32.324654  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:32.324687  7135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d20721d2e72241db94e4f23a96f91971" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:32.325286  7287 raft_consensus.cc:3055] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:32.325462  7135 raft_consensus.cc:3060] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:32.325676  7287 raft_consensus.cc:740] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Running, Role: LEADER
I20260709 13:15:32.326331  7287 consensus_queue.cc:260] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:32.327171  7287 raft_consensus.cc:3060] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:32.330257  7135 raft_consensus.cc:2468] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 4.
I20260709 13:15:32.331027  7287 raft_consensus.cc:2468] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 4.
I20260709 13:15:32.331202  7179 leader_election.cc:304] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482ec669868d43228e5a7c0279120905, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:32.331998  7427 raft_consensus.cc:2804] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:32.332378  7427 raft_consensus.cc:697] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 LEADER]: Becoming Leader. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:32.333148  7427 consensus_queue.cc:237] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:32.338636  7033 catalog_manager.cc:5697] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 reported cstate change: term changed from 3 to 4, leader changed from 33c2c688da794e89b128fc596b4ff21b (127.6.214.131) to 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130). New cstate: current_term: 4 leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.383332  7428 raft_consensus.cc:993] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b: : Instructing follower 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:32.383948  7444 raft_consensus.cc:1081] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 3 LEADER]: Signalling peer 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:32.385339  7213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813"
dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:52850
I20260709 13:15:32.385735  7213 raft_consensus.cc:493] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:32.385984  7213 raft_consensus.cc:3060] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:32.389864  7213 raft_consensus.cc:515] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:32.391187  7213 leader_election.cc:290] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 4 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:32.392110  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:32.392110  7135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a54eb4b904c4915bd339a14f8c46813" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:32.392833  7287 raft_consensus.cc:3055] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:32.392913  7135 raft_consensus.cc:3060] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:32.393116  7287 raft_consensus.cc:740] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Running, Role: LEADER
I20260709 13:15:32.393802  7287 consensus_queue.cc:260] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:32.394593  7287 raft_consensus.cc:3060] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:32.397575  7135 raft_consensus.cc:2468] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 4.
I20260709 13:15:32.398514  7287 raft_consensus.cc:2468] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 4.
I20260709 13:15:32.398491  7179 leader_election.cc:304] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 482ec669868d43228e5a7c0279120905, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:32.399458  7427 raft_consensus.cc:2804] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:32.399912  7427 raft_consensus.cc:697] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 LEADER]: Becoming Leader. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:32.400625  7427 consensus_queue.cc:237] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:32.406337  7446 raft_consensus.cc:993] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905: : Instructing follower 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:32.406800  7446 raft_consensus.cc:1081] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Signalling peer 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:32.406087  7033 catalog_manager.cc:5697] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 reported cstate change: term changed from 3 to 4, leader changed from 33c2c688da794e89b128fc596b4ff21b (127.6.214.131) to 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130). New cstate: current_term: 4 leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.408341  7213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080"
dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:52852
I20260709 13:15:32.408746  7213 raft_consensus.cc:493] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:32.409010  7213 raft_consensus.cc:3060] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.414281  7213 raft_consensus.cc:515] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:32.415948  7213 leader_election.cc:290] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 3 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:32.416633  7135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:32.416832  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:32.417215  7135 raft_consensus.cc:3055] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:32.417387  7287 raft_consensus.cc:3060] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.417763  7135 raft_consensus.cc:740] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 482ec669868d43228e5a7c0279120905, State: Running, Role: LEADER
I20260709 13:15:32.418613  7135 consensus_queue.cc:260] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:32.419507  7135 raft_consensus.cc:3060] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.422147  7287 raft_consensus.cc:2468] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 3.
I20260709 13:15:32.423303  7178 leader_election.cc:304] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:32.424104  7427 raft_consensus.cc:2804] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:32.424401  7135 raft_consensus.cc:2468] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 3.
I20260709 13:15:32.424607  7427 raft_consensus.cc:697] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 LEADER]: Becoming Leader. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:32.425510  7427 consensus_queue.cc:237] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:32.432294  7033 catalog_manager.cc:5697] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 reported cstate change: term changed from 2 to 3, leader changed from 482ec669868d43228e5a7c0279120905 (127.6.214.129) to 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.546236  7434 raft_consensus.cc:993] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905: : Instructing follower 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:32.546703  7434 raft_consensus.cc:1081] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Signalling peer 9376bab1f7f3446699ce394cc08e0aa1 to start an election
I20260709 13:15:32.548265  7213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf275d22b378476d84bb819006363228"
dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
 from {username='slave'} at 127.0.0.1:52852
I20260709 13:15:32.548782  7213 raft_consensus.cc:493] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:32.549165  7213 raft_consensus.cc:3060] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.553929  7213 raft_consensus.cc:515] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:32.555482  7213 leader_election.cc:290] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 3 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:32.556344  7135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf275d22b378476d84bb819006363228" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:32.556511  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf275d22b378476d84bb819006363228" candidate_uuid: "9376bab1f7f3446699ce394cc08e0aa1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:32.556869  7135 raft_consensus.cc:3055] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:32.556988  7287 raft_consensus.cc:3060] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.557176  7135 raft_consensus.cc:740] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 482ec669868d43228e5a7c0279120905, State: Running, Role: LEADER
I20260709 13:15:32.557998  7135 consensus_queue.cc:260] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:32.558878  7135 raft_consensus.cc:3060] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.561197  7287 raft_consensus.cc:2468] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 3.
I20260709 13:15:32.562177  7178 leader_election.cc:304] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 9376bab1f7f3446699ce394cc08e0aa1; no voters: 
I20260709 13:15:32.563005  7427 raft_consensus.cc:2804] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:32.563491  7427 raft_consensus.cc:697] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 LEADER]: Becoming Leader. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:32.563817  7135 raft_consensus.cc:2468] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9376bab1f7f3446699ce394cc08e0aa1 in term 3.
I20260709 13:15:32.564273  7427 consensus_queue.cc:237] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:32.571045  7033 catalog_manager.cc:5697] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 reported cstate change: term changed from 2 to 3, leader changed from 482ec669868d43228e5a7c0279120905 (127.6.214.129) to 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "9376bab1f7f3446699ce394cc08e0aa1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.749902  7287 raft_consensus.cc:1275] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:32.751160  7427 consensus_queue.cc:1048] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:32.760955  7135 raft_consensus.cc:1275] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:32.763082  7456 consensus_queue.cc:1048] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:32.811836  7287 raft_consensus.cc:1275] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 4 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:32.813300  7456 consensus_queue.cc:1048] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:32.820086  7135 raft_consensus.cc:1275] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 4 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:32.822779  7427 consensus_queue.cc:1048] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:32.844139  7135 raft_consensus.cc:1275] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 4 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:32.845564  7427 consensus_queue.cc:1048] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:32.846958  7135 raft_consensus.cc:1275] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:32.848542  7427 consensus_queue.cc:1048] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:32.853927  7287 raft_consensus.cc:1275] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 4 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:32.856712  7427 consensus_queue.cc:1048] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:32.866521  7287 raft_consensus.cc:1275] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:32.871338  7461 consensus_queue.cc:1048] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:33.051092  7136 raft_consensus.cc:1275] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:33.052368  7461 consensus_queue.cc:1048] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:33.062282  7287 raft_consensus.cc:1275] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Refusing update from remote peer 9376bab1f7f3446699ce394cc08e0aa1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:33.063741  7427 consensus_queue.cc:1048] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:35.094332  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:35.101739  7213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17fb5239d9374164995f9850ea265145"
dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
mode: GRACEFUL
new_leader_uuid: "33c2c688da794e89b128fc596b4ff21b"
 from {username='slave'} at 127.0.0.1:52872
I20260709 13:15:35.102425  7213 raft_consensus.cc:606] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Received request to transfer leadership to TS 33c2c688da794e89b128fc596b4ff21b
I20260709 13:15:35.104970  7213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080"
dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
mode: GRACEFUL
new_leader_uuid: "33c2c688da794e89b128fc596b4ff21b"
 from {username='slave'} at 127.0.0.1:52872
I20260709 13:15:35.105342  7213 raft_consensus.cc:606] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 LEADER]: Received request to transfer leadership to TS 33c2c688da794e89b128fc596b4ff21b
I20260709 13:15:35.107669  7213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be3c73389e124baa99aa4080e593d1d6"
dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
mode: GRACEFUL
new_leader_uuid: "482ec669868d43228e5a7c0279120905"
 from {username='slave'} at 127.0.0.1:52872
I20260709 13:15:35.108096  7213 raft_consensus.cc:606] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 LEADER]: Received request to transfer leadership to TS 482ec669868d43228e5a7c0279120905
I20260709 13:15:35.110155  7213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf275d22b378476d84bb819006363228"
dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
mode: GRACEFUL
new_leader_uuid: "482ec669868d43228e5a7c0279120905"
 from {username='slave'} at 127.0.0.1:52872
I20260709 13:15:35.110517  7213 raft_consensus.cc:606] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 LEADER]: Received request to transfer leadership to TS 482ec669868d43228e5a7c0279120905
I20260709 13:15:35.112826  7213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce662cccc58549f4a58cc43237bf7ca0"
dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
mode: GRACEFUL
new_leader_uuid: "482ec669868d43228e5a7c0279120905"
 from {username='slave'} at 127.0.0.1:52872
I20260709 13:15:35.113206  7213 raft_consensus.cc:606] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Received request to transfer leadership to TS 482ec669868d43228e5a7c0279120905
I20260709 13:15:35.114269  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:35.114661  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:35.236640  7464 raft_consensus.cc:993] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1: : Instructing follower 482ec669868d43228e5a7c0279120905 to start an election
I20260709 13:15:35.237212  7469 raft_consensus.cc:1081] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 LEADER]: Signalling peer 482ec669868d43228e5a7c0279120905 to start an election
I20260709 13:15:35.238933  7135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf275d22b378476d84bb819006363228"
dest_uuid: "482ec669868d43228e5a7c0279120905"
 from {username='slave'} at 127.0.0.1:55786
I20260709 13:15:35.239614  7135 raft_consensus.cc:493] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:35.240001  7135 raft_consensus.cc:3060] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:35.246220  7135 raft_consensus.cc:515] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:35.248468  7135 leader_election.cc:290] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 4 election: Requested vote from peers 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:35.249480  7213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf275d22b378476d84bb819006363228" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:35.249993  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf275d22b378476d84bb819006363228" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:35.250314  7213 raft_consensus.cc:3055] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:35.250454  7287 raft_consensus.cc:3060] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:35.250634  7213 raft_consensus.cc:740] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:35.251444  7213 consensus_queue.cc:260] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:35.252372  7213 raft_consensus.cc:3060] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:35.255278  7287 raft_consensus.cc:2468] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 4.
I20260709 13:15:35.256968  7102 leader_election.cc:304] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:35.257655  7213 raft_consensus.cc:2468] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 4.
I20260709 13:15:35.259150  7471 raft_consensus.cc:2804] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:35.259997  7471 raft_consensus.cc:697] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 4 LEADER]: Becoming Leader. State: Replica: 482ec669868d43228e5a7c0279120905, State: Running, Role: LEADER
I20260709 13:15:35.260865  7471 consensus_queue.cc:237] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:35.268275  7032 catalog_manager.cc:5697] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 reported cstate change: term changed from 3 to 4, leader changed from 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130) to 482ec669868d43228e5a7c0279120905 (127.6.214.129). New cstate: current_term: 4 leader_uuid: "482ec669868d43228e5a7c0279120905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:35.291313  7464 raft_consensus.cc:993] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1: : Instructing follower 482ec669868d43228e5a7c0279120905 to start an election
I20260709 13:15:35.291939  7469 raft_consensus.cc:1081] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 LEADER]: Signalling peer 482ec669868d43228e5a7c0279120905 to start an election
I20260709 13:15:35.293648  7135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be3c73389e124baa99aa4080e593d1d6"
dest_uuid: "482ec669868d43228e5a7c0279120905"
 from {username='slave'} at 127.0.0.1:55786
I20260709 13:15:35.294154  7135 raft_consensus.cc:493] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:35.294505  7135 raft_consensus.cc:3060] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:35.299194  7135 raft_consensus.cc:515] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:35.300804  7135 leader_election.cc:290] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 2 election: Requested vote from peers 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:35.302034  7213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3c73389e124baa99aa4080e593d1d6" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:35.302326  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3c73389e124baa99aa4080e593d1d6" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:35.302748  7213 raft_consensus.cc:3055] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:35.302748  7287 raft_consensus.cc:3060] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:35.303304  7213 raft_consensus.cc:740] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:35.304081  7213 consensus_queue.cc:260] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:35.305181  7213 raft_consensus.cc:3060] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:35.309193  7287 raft_consensus.cc:2468] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 2.
I20260709 13:15:35.310360  7102 leader_election.cc:304] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:35.310922  7213 raft_consensus.cc:2468] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 2.
I20260709 13:15:35.311158  7471 raft_consensus.cc:2804] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:35.311736  7471 raft_consensus.cc:697] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Becoming Leader. State: Replica: 482ec669868d43228e5a7c0279120905, State: Running, Role: LEADER
I20260709 13:15:35.312646  7471 consensus_queue.cc:237] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:35.320668  7032 catalog_manager.cc:5697] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 reported cstate change: term changed from 1 to 2, leader changed from 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130) to 482ec669868d43228e5a7c0279120905 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "482ec669868d43228e5a7c0279120905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:35.360863  7464 raft_consensus.cc:993] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1: : Instructing follower 33c2c688da794e89b128fc596b4ff21b to start an election
I20260709 13:15:35.361321  7469 raft_consensus.cc:1081] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Signalling peer 33c2c688da794e89b128fc596b4ff21b to start an election
I20260709 13:15:35.362792  7287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17fb5239d9374164995f9850ea265145"
dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
 from {username='slave'} at 127.0.0.1:54012
I20260709 13:15:35.363269  7287 raft_consensus.cc:493] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:35.363565  7287 raft_consensus.cc:3060] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:35.368427  7287 raft_consensus.cc:515] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:35.370375  7287 leader_election.cc:290] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 3 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:35.371534  7464 raft_consensus.cc:993] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1: : Instructing follower 33c2c688da794e89b128fc596b4ff21b to start an election
I20260709 13:15:35.371533  7213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17fb5239d9374164995f9850ea265145" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:35.371728  7135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17fb5239d9374164995f9850ea265145" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:35.372299  7213 raft_consensus.cc:3055] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:35.372262  7469 raft_consensus.cc:1081] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 LEADER]: Signalling peer 33c2c688da794e89b128fc596b4ff21b to start an election
I20260709 13:15:35.372501  7135 raft_consensus.cc:3060] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:35.372747  7213 raft_consensus.cc:740] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:35.373593  7213 consensus_queue.cc:260] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:35.374385  7287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080"
dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
 from {username='slave'} at 127.0.0.1:54012
I20260709 13:15:35.374807  7213 raft_consensus.cc:3060] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:35.374912  7287 raft_consensus.cc:493] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:35.375262  7287 raft_consensus.cc:3060] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:35.378959  7135 raft_consensus.cc:2468] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 3.
I20260709 13:15:35.380362  7253 leader_election.cc:304] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:35.381282  7444 raft_consensus.cc:2804] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:35.381572  7287 raft_consensus.cc:515] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:35.382705  7444 raft_consensus.cc:697] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 3 LEADER]: Becoming Leader. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Running, Role: LEADER
I20260709 13:15:35.382004  7213 raft_consensus.cc:2468] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 3.
I20260709 13:15:35.384109  7287 leader_election.cc:290] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 4 election: Requested vote from peers 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319), 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109)
I20260709 13:15:35.383647  7444 consensus_queue.cc:237] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:35.384606  7135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "482ec669868d43228e5a7c0279120905"
I20260709 13:15:35.385126  7135 raft_consensus.cc:3060] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:35.385267  7213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9ec53cae204b1c8177b1da07bb2080" candidate_uuid: "33c2c688da794e89b128fc596b4ff21b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:35.385793  7213 raft_consensus.cc:3055] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:35.386102  7213 raft_consensus.cc:740] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:35.387014  7213 consensus_queue.cc:260] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:35.388181  7213 raft_consensus.cc:3060] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:35.392068  7135 raft_consensus.cc:2468] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 4.
I20260709 13:15:35.393397  7253 leader_election.cc:304] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:35.394569  7479 raft_consensus.cc:2804] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:35.395097  7479 raft_consensus.cc:697] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 4 LEADER]: Becoming Leader. State: Replica: 33c2c688da794e89b128fc596b4ff21b, State: Running, Role: LEADER
I20260709 13:15:35.395380  7213 raft_consensus.cc:2468] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33c2c688da794e89b128fc596b4ff21b in term 4.
I20260709 13:15:35.395980  7479 consensus_queue.cc:237] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } }
I20260709 13:15:35.399200  7032 catalog_manager.cc:5697] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b reported cstate change: term changed from 2 to 3, leader changed from 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130) to 33c2c688da794e89b128fc596b4ff21b (127.6.214.131). New cstate: current_term: 3 leader_uuid: "33c2c688da794e89b128fc596b4ff21b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:35.410977  7032 catalog_manager.cc:5697] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b reported cstate change: term changed from 3 to 4, leader changed from 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130) to 33c2c688da794e89b128fc596b4ff21b (127.6.214.131). New cstate: current_term: 4 leader_uuid: "33c2c688da794e89b128fc596b4ff21b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:35.472322  7464 raft_consensus.cc:993] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1: : Instructing follower 482ec669868d43228e5a7c0279120905 to start an election
I20260709 13:15:35.472793  7469 raft_consensus.cc:1081] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Signalling peer 482ec669868d43228e5a7c0279120905 to start an election
I20260709 13:15:35.474529  7135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce662cccc58549f4a58cc43237bf7ca0"
dest_uuid: "482ec669868d43228e5a7c0279120905"
 from {username='slave'} at 127.0.0.1:55786
I20260709 13:15:35.475135  7135 raft_consensus.cc:493] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:35.475538  7135 raft_consensus.cc:3060] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:35.480733  7135 raft_consensus.cc:515] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
I20260709 13:15:35.482468  7135 leader_election.cc:290] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 3 election: Requested vote from peers 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130:34109), 33c2c688da794e89b128fc596b4ff21b (127.6.214.131:45445)
I20260709 13:15:35.483382  7213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce662cccc58549f4a58cc43237bf7ca0" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9376bab1f7f3446699ce394cc08e0aa1"
I20260709 13:15:35.483729  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce662cccc58549f4a58cc43237bf7ca0" candidate_uuid: "482ec669868d43228e5a7c0279120905" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "33c2c688da794e89b128fc596b4ff21b"
I20260709 13:15:35.483843  7213 raft_consensus.cc:3055] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:35.484246  7287 raft_consensus.cc:3060] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:35.484274  7213 raft_consensus.cc:740] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9376bab1f7f3446699ce394cc08e0aa1, State: Running, Role: LEADER
I20260709 13:15:35.485112  7213 consensus_queue.cc:260] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
I20260709 13:15:35.486034  7213 raft_consensus.cc:3060] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:35.488816  7287 raft_consensus.cc:2468] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 3.
I20260709 13:15:35.489856  7213 raft_consensus.cc:2468] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 482ec669868d43228e5a7c0279120905 in term 3.
I20260709 13:15:35.489776  7102 leader_election.cc:304] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33c2c688da794e89b128fc596b4ff21b, 482ec669868d43228e5a7c0279120905; no voters: 
I20260709 13:15:35.490581  7471 raft_consensus.cc:2804] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:35.491052  7471 raft_consensus.cc:697] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 3 LEADER]: Becoming Leader. State: Replica: 482ec669868d43228e5a7c0279120905, State: Running, Role: LEADER
I20260709 13:15:35.491796  7471 consensus_queue.cc:237] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } }
I20260709 13:15:35.498906  7032 catalog_manager.cc:5697] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 reported cstate change: term changed from 2 to 3, leader changed from 9376bab1f7f3446699ce394cc08e0aa1 (127.6.214.130) to 482ec669868d43228e5a7c0279120905 (127.6.214.129). New cstate: current_term: 3 leader_uuid: "482ec669868d43228e5a7c0279120905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:35.687100  7287 raft_consensus.cc:1275] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 4 FOLLOWER]: Refusing update from remote peer 482ec669868d43228e5a7c0279120905: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:35.688292  7471 consensus_queue.cc:1048] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:35.698232  7213 raft_consensus.cc:1275] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 FOLLOWER]: Refusing update from remote peer 482ec669868d43228e5a7c0279120905: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:35.699836  7472 consensus_queue.cc:1048] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:35.759267  7213 raft_consensus.cc:1275] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Refusing update from remote peer 482ec669868d43228e5a7c0279120905: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:35.760396  7472 consensus_queue.cc:1048] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:35.768596  7287 raft_consensus.cc:1275] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Refusing update from remote peer 482ec669868d43228e5a7c0279120905: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:35.770403  7489 consensus_queue.cc:1048] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:35.780833  7213 raft_consensus.cc:1275] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Refusing update from remote peer 33c2c688da794e89b128fc596b4ff21b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:35.782196  7479 consensus_queue.cc:1048] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:35.787585  7212 raft_consensus.cc:1275] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 FOLLOWER]: Refusing update from remote peer 33c2c688da794e89b128fc596b4ff21b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:35.789620  7479 consensus_queue.cc:1048] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:35.813671  7135 raft_consensus.cc:1275] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 4 FOLLOWER]: Refusing update from remote peer 33c2c688da794e89b128fc596b4ff21b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:35.818637  7494 consensus_queue.cc:1048] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:35.819582  7135 raft_consensus.cc:1275] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Refusing update from remote peer 33c2c688da794e89b128fc596b4ff21b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:35.821681  7444 consensus_queue.cc:1048] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [LEADER]: Connected to new peer: Peer: permanent_uuid: "482ec669868d43228e5a7c0279120905" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:36.022269  7286 raft_consensus.cc:1275] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Refusing update from remote peer 482ec669868d43228e5a7c0279120905: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:36.023741  7489 consensus_queue.cc:1048] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33c2c688da794e89b128fc596b4ff21b" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:36.036201  7213 raft_consensus.cc:1275] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Refusing update from remote peer 482ec669868d43228e5a7c0279120905: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:36.037758  7472 consensus_queue.cc:1048] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9376bab1f7f3446699ce394cc08e0aa1" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:36.121455  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:36.127223  7002 tablet_server.cc:179] TabletServer@127.6.214.129:0 shutting down...
I20260709 13:15:36.150617  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:36.151283  7002 tablet_replica.cc:333] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905: stopping tablet replica
I20260709 13:15:36.151947  7002 raft_consensus.cc:2243] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.152456  7002 raft_consensus.cc:2272] T 3c9ec53cae204b1c8177b1da07bb2080 P 482ec669868d43228e5a7c0279120905 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.155608  7002 tablet_replica.cc:333] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905: stopping tablet replica
I20260709 13:15:36.156268  7002 raft_consensus.cc:2243] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.156706  7002 raft_consensus.cc:2272] T 17fb5239d9374164995f9850ea265145 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:36.157156  7253 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:36.159051  7002 tablet_replica.cc:333] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905: stopping tablet replica
I20260709 13:15:36.159729  7002 raft_consensus.cc:2243] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:36.160437  7002 raft_consensus.cc:2272] T be3c73389e124baa99aa4080e593d1d6 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:36.161609  7253 consensus_peers.cc:597] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b -> Peer 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319): Couldn't send request to peer 482ec669868d43228e5a7c0279120905. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:36.162467  7002 tablet_replica.cc:333] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905: stopping tablet replica
I20260709 13:15:36.163029  7002 raft_consensus.cc:2243] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:36.163754  7002 raft_consensus.cc:2272] T bf275d22b378476d84bb819006363228 P 482ec669868d43228e5a7c0279120905 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.165674  7002 tablet_replica.cc:333] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905: stopping tablet replica
I20260709 13:15:36.166146  7002 raft_consensus.cc:2243] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:36.166894  7002 raft_consensus.cc:2272] T ce662cccc58549f4a58cc43237bf7ca0 P 482ec669868d43228e5a7c0279120905 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.168596  7002 tablet_replica.cc:333] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905: stopping tablet replica
I20260709 13:15:36.169060  7002 raft_consensus.cc:2243] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.169515  7002 raft_consensus.cc:2272] T a7897ab92ced40f884f353b8a96a91ea P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.171087  7002 tablet_replica.cc:333] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905: stopping tablet replica
I20260709 13:15:36.171525  7002 raft_consensus.cc:2243] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.171921  7002 raft_consensus.cc:2272] T 6a54eb4b904c4915bd339a14f8c46813 P 482ec669868d43228e5a7c0279120905 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.173540  7002 tablet_replica.cc:333] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905: stopping tablet replica
I20260709 13:15:36.174033  7002 raft_consensus.cc:2243] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.174398  7002 raft_consensus.cc:2272] T 3769dba8cd0048ed8305dad93d73f817 P 482ec669868d43228e5a7c0279120905 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.175876  7002 tablet_replica.cc:333] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905: stopping tablet replica
I20260709 13:15:36.176340  7002 raft_consensus.cc:2243] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.176721  7002 raft_consensus.cc:2272] T d20721d2e72241db94e4f23a96f91971 P 482ec669868d43228e5a7c0279120905 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.276307  7002 tablet_server.cc:196] TabletServer@127.6.214.129:0 shutdown complete.
I20260709 13:15:36.295281  7002 tablet_server.cc:179] TabletServer@127.6.214.130:0 shutting down...
I20260709 13:15:36.317160  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:36.317929  7002 tablet_replica.cc:333] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1: stopping tablet replica
I20260709 13:15:36.318856  7002 raft_consensus.cc:2243] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:36.319648  7002 raft_consensus.cc:2272] T d20721d2e72241db94e4f23a96f91971 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.321482  7002 tablet_replica.cc:333] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1: stopping tablet replica
I20260709 13:15:36.321936  7002 raft_consensus.cc:2243] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.322273  7002 raft_consensus.cc:2272] T 17fb5239d9374164995f9850ea265145 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.324374  7002 tablet_replica.cc:333] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1: stopping tablet replica
I20260709 13:15:36.324997  7002 raft_consensus.cc:2243] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:36.325794  7002 raft_consensus.cc:2272] T 3769dba8cd0048ed8305dad93d73f817 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.327359  7002 tablet_replica.cc:333] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1: stopping tablet replica
I20260709 13:15:36.327842  7002 raft_consensus.cc:2243] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.328262  7002 raft_consensus.cc:2272] T a7897ab92ced40f884f353b8a96a91ea P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.329871  7002 tablet_replica.cc:333] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1: stopping tablet replica
I20260709 13:15:36.330325  7002 raft_consensus.cc:2243] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:36.331040  7002 raft_consensus.cc:2272] T 6a54eb4b904c4915bd339a14f8c46813 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.332744  7002 tablet_replica.cc:333] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1: stopping tablet replica
I20260709 13:15:36.333266  7002 raft_consensus.cc:2243] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.333767  7002 raft_consensus.cc:2272] T be3c73389e124baa99aa4080e593d1d6 P 9376bab1f7f3446699ce394cc08e0aa1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.335697  7002 tablet_replica.cc:333] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1: stopping tablet replica
I20260709 13:15:36.336166  7002 raft_consensus.cc:2243] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.336594  7002 raft_consensus.cc:2272] T 3c9ec53cae204b1c8177b1da07bb2080 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.338644  7002 tablet_replica.cc:333] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1: stopping tablet replica
I20260709 13:15:36.339092  7002 raft_consensus.cc:2243] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.339468  7002 raft_consensus.cc:2272] T bf275d22b378476d84bb819006363228 P 9376bab1f7f3446699ce394cc08e0aa1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.341260  7002 tablet_replica.cc:333] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1: stopping tablet replica
I20260709 13:15:36.341717  7002 raft_consensus.cc:2243] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.342037  7002 raft_consensus.cc:2272] T ce662cccc58549f4a58cc43237bf7ca0 P 9376bab1f7f3446699ce394cc08e0aa1 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:36.350615  7253 consensus_peers.cc:597] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b -> Peer 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319): Couldn't send request to peer 482ec669868d43228e5a7c0279120905. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:36319: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:36.372910  7002 tablet_server.cc:196] TabletServer@127.6.214.130:0 shutdown complete.
W20260709 13:15:36.374437  7253 consensus_peers.cc:597] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b -> Peer 482ec669868d43228e5a7c0279120905 (127.6.214.129:36319): Couldn't send request to peer 482ec669868d43228e5a7c0279120905. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:36319: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:36.389740  7002 tablet_server.cc:179] TabletServer@127.6.214.131:0 shutting down...
I20260709 13:15:36.414393  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:36.415118  7002 tablet_replica.cc:333] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b: stopping tablet replica
I20260709 13:15:36.415784  7002 raft_consensus.cc:2243] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.416261  7002 raft_consensus.cc:2272] T bf275d22b378476d84bb819006363228 P 33c2c688da794e89b128fc596b4ff21b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.419059  7002 tablet_replica.cc:333] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b: stopping tablet replica
I20260709 13:15:36.419574  7002 raft_consensus.cc:2243] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:36.420277  7002 raft_consensus.cc:2272] T 17fb5239d9374164995f9850ea265145 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.422410  7002 tablet_replica.cc:333] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b: stopping tablet replica
I20260709 13:15:36.422894  7002 raft_consensus.cc:2243] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.423295  7002 raft_consensus.cc:2272] T ce662cccc58549f4a58cc43237bf7ca0 P 33c2c688da794e89b128fc596b4ff21b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.425694  7002 tablet_replica.cc:333] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b: stopping tablet replica
I20260709 13:15:36.426165  7002 raft_consensus.cc:2243] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.426548  7002 raft_consensus.cc:2272] T 3769dba8cd0048ed8305dad93d73f817 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.428187  7002 tablet_replica.cc:333] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b: stopping tablet replica
I20260709 13:15:36.428637  7002 raft_consensus.cc:2243] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:36.429351  7002 raft_consensus.cc:2272] T 3c9ec53cae204b1c8177b1da07bb2080 P 33c2c688da794e89b128fc596b4ff21b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.431603  7002 tablet_replica.cc:333] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b: stopping tablet replica
I20260709 13:15:36.432092  7002 raft_consensus.cc:2243] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.432478  7002 raft_consensus.cc:2272] T 6a54eb4b904c4915bd339a14f8c46813 P 33c2c688da794e89b128fc596b4ff21b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.434103  7002 tablet_replica.cc:333] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b: stopping tablet replica
I20260709 13:15:36.434487  7002 raft_consensus.cc:2243] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:36.435128  7002 raft_consensus.cc:2272] T a7897ab92ced40f884f353b8a96a91ea P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.436697  7002 tablet_replica.cc:333] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b: stopping tablet replica
I20260709 13:15:36.437095  7002 raft_consensus.cc:2243] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.437480  7002 raft_consensus.cc:2272] T be3c73389e124baa99aa4080e593d1d6 P 33c2c688da794e89b128fc596b4ff21b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.439638  7002 tablet_replica.cc:333] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b: stopping tablet replica
I20260709 13:15:36.440105  7002 raft_consensus.cc:2243] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:36.440572  7002 raft_consensus.cc:2272] T d20721d2e72241db94e4f23a96f91971 P 33c2c688da794e89b128fc596b4ff21b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.469352  7002 tablet_server.cc:196] TabletServer@127.6.214.131:0 shutdown complete.
I20260709 13:15:36.487859  7002 master.cc:562] Master@127.6.214.190:46359 shutting down...
I20260709 13:15:36.507786  7002 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:36.508348  7002 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:36.508689  7002 tablet_replica.cc:333] T 00000000000000000000000000000000 P e1e489a5e56942909a9bc2f73191d603: stopping tablet replica
W20260709 13:15:36.881223  7065 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 7005
W20260709 13:15:37.525110  7002 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 7065)
W20260709 13:15:38.525561  7002 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 7065)
I20260709 13:15:39.282244  7002 master.cc:584] Master@127.6.214.190:46359 shutdown complete.
33c2c688da794e89b128fc596b4ff21b  1
482ec669868d43228e5a7c0279120905  4
9376bab1f7f3446699ce394cc08e0aa1  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (15260 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:15:39.324278  7002 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.214.190:39717
I20260709 13:15:39.325512  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:39.331717  7503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:39.331857  7502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:39.332669  7505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:39.333261  7002 server_base.cc:1061] running on GCE node
I20260709 13:15:39.334290  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:39.334491  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:39.334619  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783602939334607 us; error 0 us; skew 500 ppm
I20260709 13:15:39.335098  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:39.337771  7002 webserver.cc:533] Webserver started at http://127.6.214.190:36769/ using document root <none> and password file <none>
I20260709 13:15:39.338325  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:39.338541  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:39.338793  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:39.340081  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/master-0-root/instance:
uuid: "bb556d093eb74553a8a83637adbd8011"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-rnv4"
I20260709 13:15:39.344951  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:15:39.348526  7510 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.349514  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:39.349858  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/master-0-root
uuid: "bb556d093eb74553a8a83637adbd8011"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-rnv4"
I20260709 13:15:39.350104  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:39.382596  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:39.384284  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:39.426034  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.190:39717
I20260709 13:15:39.426126  7561 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.190:39717 every 8 connection(s)
I20260709 13:15:39.430195  7562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.439915  7562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011: Bootstrap starting.
I20260709 13:15:39.444450  7562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.448606  7562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011: No bootstrap required, opened a new log
I20260709 13:15:39.450661  7562 raft_consensus.cc:359] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb556d093eb74553a8a83637adbd8011" member_type: VOTER }
I20260709 13:15:39.451045  7562 raft_consensus.cc:385] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.451290  7562 raft_consensus.cc:740] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb556d093eb74553a8a83637adbd8011, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.451943  7562 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb556d093eb74553a8a83637adbd8011" member_type: VOTER }
I20260709 13:15:39.452381  7562 raft_consensus.cc:399] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:39.452570  7562 raft_consensus.cc:493] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:39.452780  7562 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.456812  7562 raft_consensus.cc:515] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb556d093eb74553a8a83637adbd8011" member_type: VOTER }
I20260709 13:15:39.457294  7562 leader_election.cc:304] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb556d093eb74553a8a83637adbd8011; no voters: 
I20260709 13:15:39.458455  7562 leader_election.cc:290] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:39.458941  7565 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:39.460309  7565 raft_consensus.cc:697] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [term 1 LEADER]: Becoming Leader. State: Replica: bb556d093eb74553a8a83637adbd8011, State: Running, Role: LEADER
I20260709 13:15:39.460983  7565 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb556d093eb74553a8a83637adbd8011" member_type: VOTER }
I20260709 13:15:39.461314  7562 sys_catalog.cc:565] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:39.466054  7566 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb556d093eb74553a8a83637adbd8011" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb556d093eb74553a8a83637adbd8011" member_type: VOTER } }
I20260709 13:15:39.466068  7567 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb556d093eb74553a8a83637adbd8011. Latest consensus state: current_term: 1 leader_uuid: "bb556d093eb74553a8a83637adbd8011" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb556d093eb74553a8a83637adbd8011" member_type: VOTER } }
I20260709 13:15:39.467024  7566 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:39.467283  7567 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:39.470144  7573 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:39.475430  7573 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:39.478422  7002 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:39.484227  7573 catalog_manager.cc:1383] Generated new cluster ID: 88912575f11948168d7595d8206bb459
I20260709 13:15:39.484515  7573 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:39.511673  7573 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:39.512974  7573 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:39.528193  7573 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011: Generated new TSK 0
I20260709 13:15:39.528964  7573 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:39.545506  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:39.551642  7583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:39.552889  7584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:39.555336  7586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:39.555699  7002 server_base.cc:1061] running on GCE node
I20260709 13:15:39.556789  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:39.556977  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:39.557096  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783602939557085 us; error 0 us; skew 500 ppm
I20260709 13:15:39.557682  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:39.560109  7002 webserver.cc:533] Webserver started at http://127.6.214.129:43153/ using document root <none> and password file <none>
I20260709 13:15:39.560586  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:39.560752  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:39.560959  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:39.562057  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/ts-0-root/instance:
uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-rnv4"
I20260709 13:15:39.566591  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:39.570247  7591 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.571168  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:15:39.571535  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/ts-0-root
uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-rnv4"
I20260709 13:15:39.571846  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:39.587052  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:39.588366  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:39.589891  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:39.592192  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:39.592422  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.592669  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:39.592885  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.634702  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.129:42303
I20260709 13:15:39.634810  7653 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.129:42303 every 8 connection(s)
I20260709 13:15:39.639488  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:39.646845  7658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:39.648612  7659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:39.651333  7661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:39.651938  7002 server_base.cc:1061] running on GCE node
I20260709 13:15:39.653080  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:39.653259  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:39.653501  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783602939653478 us; error 0 us; skew 500 ppm
I20260709 13:15:39.654049  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:39.656700  7002 webserver.cc:533] Webserver started at http://127.6.214.130:36827/ using document root <none> and password file <none>
I20260709 13:15:39.657310  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:39.657603  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:39.657934  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:39.658320  7654 heartbeater.cc:344] Connected to a master server at 127.6.214.190:39717
I20260709 13:15:39.658725  7654 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:39.659161  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/ts-1-root/instance:
uuid: "74d1986924254a7c8e2f3cdd2cef5150"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-rnv4"
I20260709 13:15:39.659616  7654 heartbeater.cc:507] Master 127.6.214.190:39717 requested a full tablet report, sending...
I20260709 13:15:39.662101  7527 ts_manager.cc:194] Registered new tserver with Master: c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303)
I20260709 13:15:39.664453  7527 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56842
I20260709 13:15:39.664628  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:15:39.668393  7666 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.669201  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:15:39.669539  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/ts-1-root
uuid: "74d1986924254a7c8e2f3cdd2cef5150"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-rnv4"
I20260709 13:15:39.669804  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:39.680094  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:39.681212  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:39.682718  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:39.684855  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:39.685029  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.685314  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:39.685509  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:15:39.725925  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.130:40141
I20260709 13:15:39.726039  7728 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.130:40141 every 8 connection(s)
I20260709 13:15:39.730621  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:39.738019  7732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:39.739014  7733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:39.741291  7002 server_base.cc:1061] running on GCE node
W20260709 13:15:39.741580  7735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:39.742592  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:39.742838  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:39.743034  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783602939743011 us; error 0 us; skew 500 ppm
I20260709 13:15:39.743716  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:39.745476  7729 heartbeater.cc:344] Connected to a master server at 127.6.214.190:39717
I20260709 13:15:39.745944  7729 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:39.746747  7729 heartbeater.cc:507] Master 127.6.214.190:39717 requested a full tablet report, sending...
I20260709 13:15:39.746951  7002 webserver.cc:533] Webserver started at http://127.6.214.131:44787/ using document root <none> and password file <none>
I20260709 13:15:39.747519  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:39.747759  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:39.748083  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:39.749069  7527 ts_manager.cc:194] Registered new tserver with Master: 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141)
I20260709 13:15:39.749326  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/ts-2-root/instance:
uuid: "3bb1879bdca14efc91805d92ef1047e1"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-rnv4"
I20260709 13:15:39.750655  7527 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56850
I20260709 13:15:39.754180  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:39.757607  7740 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.758466  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:39.758806  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/ts-2-root
uuid: "3bb1879bdca14efc91805d92ef1047e1"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-rnv4"
I20260709 13:15:39.759099  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602923898527-7002-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:39.792522  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:39.793911  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:39.795557  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:39.798082  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:39.798345  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.798621  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:39.798835  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.843560  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.131:46335
I20260709 13:15:39.843664  7802 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.131:46335 every 8 connection(s)
I20260709 13:15:39.858415  7803 heartbeater.cc:344] Connected to a master server at 127.6.214.190:39717
I20260709 13:15:39.858955  7803 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:39.859795  7803 heartbeater.cc:507] Master 127.6.214.190:39717 requested a full tablet report, sending...
I20260709 13:15:39.861935  7527 ts_manager.cc:194] Registered new tserver with Master: 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:39.862982  7002 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016229959s
I20260709 13:15:39.863521  7527 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56866
I20260709 13:15:39.890766  7527 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56868:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:39.893771  7527 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:39.967485  7618 tablet_service.cc:1511] Processing CreateTablet for tablet ac6c32b30f30451aa1c95c8269738a87 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:39.969130  7618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac6c32b30f30451aa1c95c8269738a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.970588  7617 tablet_service.cc:1511] Processing CreateTablet for tablet 63fb8aace3b04293840c69f688cc1136 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:39.973382  7619 tablet_service.cc:1511] Processing CreateTablet for tablet 81fc76e522454f429fdf052091879f54 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:39.977481  7616 tablet_service.cc:1511] Processing CreateTablet for tablet e54c9b6f80504fa9956fc3ad067dbc21 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:39.980584  7615 tablet_service.cc:1511] Processing CreateTablet for tablet d9feefdd7b53416ebc44f6ebbf656729 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:39.982265  7619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81fc76e522454f429fdf052091879f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.983271  7615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9feefdd7b53416ebc44f6ebbf656729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.983911  7617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63fb8aace3b04293840c69f688cc1136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.987218  7614 tablet_service.cc:1511] Processing CreateTablet for tablet fe073b6bddd0413ebe268077052b0788 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:39.988627  7614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe073b6bddd0413ebe268077052b0788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.989876  7616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54c9b6f80504fa9956fc3ad067dbc21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.990520  7768 tablet_service.cc:1511] Processing CreateTablet for tablet 81fc76e522454f429fdf052091879f54 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:39.992509  7768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81fc76e522454f429fdf052091879f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.995281  7767 tablet_service.cc:1511] Processing CreateTablet for tablet ac6c32b30f30451aa1c95c8269738a87 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:39.997392  7767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac6c32b30f30451aa1c95c8269738a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.001207  7764 tablet_service.cc:1511] Processing CreateTablet for tablet d9feefdd7b53416ebc44f6ebbf656729 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:40.008257  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9feefdd7b53416ebc44f6ebbf656729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.002722  7765 tablet_service.cc:1511] Processing CreateTablet for tablet e54c9b6f80504fa9956fc3ad067dbc21 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:40.011511  7765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54c9b6f80504fa9956fc3ad067dbc21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.999315  7766 tablet_service.cc:1511] Processing CreateTablet for tablet 63fb8aace3b04293840c69f688cc1136 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:40.015040  7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63fb8aace3b04293840c69f688cc1136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.021692  7617 tablet_service.cc:1511] Processing CreateTablet for tablet 702bc4ee168244e4acf0b33636235024 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:40.023015  7617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702bc4ee168244e4acf0b33636235024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.023890  7763 tablet_service.cc:1511] Processing CreateTablet for tablet fe073b6bddd0413ebe268077052b0788 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:40.026037  7763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe073b6bddd0413ebe268077052b0788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.031710  7818 tablet_bootstrap.cc:492] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb: Bootstrap starting.
I20260709 13:15:40.033627  7694 tablet_service.cc:1511] Processing CreateTablet for tablet 81fc76e522454f429fdf052091879f54 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:40.035185  7694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81fc76e522454f429fdf052091879f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.041422  7693 tablet_service.cc:1511] Processing CreateTablet for tablet ac6c32b30f30451aa1c95c8269738a87 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:40.043044  7693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac6c32b30f30451aa1c95c8269738a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.046214  7762 tablet_service.cc:1511] Processing CreateTablet for tablet 702bc4ee168244e4acf0b33636235024 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:40.047731  7762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702bc4ee168244e4acf0b33636235024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.050453  7613 tablet_service.cc:1511] Processing CreateTablet for tablet 292de7734639434eacd4fb6c6dd91b26 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:40.051891  7613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292de7734639434eacd4fb6c6dd91b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.056160  7692 tablet_service.cc:1511] Processing CreateTablet for tablet 63fb8aace3b04293840c69f688cc1136 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:40.058689  7691 tablet_service.cc:1511] Processing CreateTablet for tablet e54c9b6f80504fa9956fc3ad067dbc21 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:40.061182  7690 tablet_service.cc:1511] Processing CreateTablet for tablet d9feefdd7b53416ebc44f6ebbf656729 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:40.063431  7761 tablet_service.cc:1511] Processing CreateTablet for tablet 292de7734639434eacd4fb6c6dd91b26 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:40.060405  7617 tablet_service.cc:1511] Processing CreateTablet for tablet 1f09aa6221bd4163b9b2ecf3f370fbe2 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:40.064749  7761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292de7734639434eacd4fb6c6dd91b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.064930  7617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f09aa6221bd4163b9b2ecf3f370fbe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.066833  7689 tablet_service.cc:1511] Processing CreateTablet for tablet fe073b6bddd0413ebe268077052b0788 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:40.069144  7760 tablet_service.cc:1511] Processing CreateTablet for tablet 1f09aa6221bd4163b9b2ecf3f370fbe2 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:40.070600  7760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f09aa6221bd4163b9b2ecf3f370fbe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.070974  7612 tablet_service.cc:1511] Processing CreateTablet for tablet 1910b60b6df94e0b8cb445ca2f6d0047 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:40.075102  7692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63fb8aace3b04293840c69f688cc1136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.076360  7759 tablet_service.cc:1511] Processing CreateTablet for tablet 1910b60b6df94e0b8cb445ca2f6d0047 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:40.076872  7688 tablet_service.cc:1511] Processing CreateTablet for tablet 702bc4ee168244e4acf0b33636235024 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:40.077759  7689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe073b6bddd0413ebe268077052b0788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.077705  7759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1910b60b6df94e0b8cb445ca2f6d0047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.079159  7687 tablet_service.cc:1511] Processing CreateTablet for tablet 292de7734639434eacd4fb6c6dd91b26 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:40.080456  7687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292de7734639434eacd4fb6c6dd91b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.081125  7690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9feefdd7b53416ebc44f6ebbf656729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.082589  7686 tablet_service.cc:1511] Processing CreateTablet for tablet 1f09aa6221bd4163b9b2ecf3f370fbe2 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:40.083907  7686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f09aa6221bd4163b9b2ecf3f370fbe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.085852  7691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54c9b6f80504fa9956fc3ad067dbc21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.087041  7685 tablet_service.cc:1511] Processing CreateTablet for tablet 1910b60b6df94e0b8cb445ca2f6d0047 (DEFAULT_TABLE table=test-workload [id=0470d597ee4a4063b0383ba33d009bac]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:40.088313  7685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1910b60b6df94e0b8cb445ca2f6d0047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.089881  7688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702bc4ee168244e4acf0b33636235024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.077705  7612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1910b60b6df94e0b8cb445ca2f6d0047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.039201  7818 tablet_bootstrap.cc:654] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.167013  7820 tablet_bootstrap.cc:492] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150: Bootstrap starting.
I20260709 13:15:40.178480  7820 tablet_bootstrap.cc:654] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.184365  7821 tablet_bootstrap.cc:492] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1: Bootstrap starting.
I20260709 13:15:40.184731  7818 tablet_bootstrap.cc:492] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb: No bootstrap required, opened a new log
I20260709 13:15:40.185243  7818 ts_tablet_manager.cc:1403] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent bootstrapping tablet: real 0.166s	user 0.017s	sys 0.022s
I20260709 13:15:40.188038  7820 tablet_bootstrap.cc:492] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150: No bootstrap required, opened a new log
I20260709 13:15:40.188464  7820 ts_tablet_manager.cc:1403] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.007s
I20260709 13:15:40.188304  7818 raft_consensus.cc:359] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.189142  7818 raft_consensus.cc:385] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.189483  7818 raft_consensus.cc:740] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.190232  7818 consensus_queue.cc:260] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.191480  7821 tablet_bootstrap.cc:654] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.191171  7820 raft_consensus.cc:359] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.191951  7820 raft_consensus.cc:385] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.192281  7820 raft_consensus.cc:740] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.192626  7654 heartbeater.cc:499] Master 127.6.214.190:39717 was elected leader, sending a full tablet report...
I20260709 13:15:40.192994  7818 ts_tablet_manager.cc:1434] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:40.193164  7820 consensus_queue.cc:260] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.194028  7818 tablet_bootstrap.cc:492] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb: Bootstrap starting.
I20260709 13:15:40.202572  7820 ts_tablet_manager.cc:1434] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.005s
I20260709 13:15:40.202878  7818 tablet_bootstrap.cc:654] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.203359  7729 heartbeater.cc:499] Master 127.6.214.190:39717 was elected leader, sending a full tablet report...
I20260709 13:15:40.212596  7820 tablet_bootstrap.cc:492] T 1910b60b6df94e0b8cb445ca2f6d0047 P 74d1986924254a7c8e2f3cdd2cef5150: Bootstrap starting.
I20260709 13:15:40.214085  7821 tablet_bootstrap.cc:492] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1: No bootstrap required, opened a new log
I20260709 13:15:40.214671  7821 ts_tablet_manager.cc:1403] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.025s
I20260709 13:15:40.217792  7821 raft_consensus.cc:359] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.218585  7821 raft_consensus.cc:385] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.218940  7821 raft_consensus.cc:740] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.219732  7821 consensus_queue.cc:260] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.221190  7820 tablet_bootstrap.cc:654] T 1910b60b6df94e0b8cb445ca2f6d0047 P 74d1986924254a7c8e2f3cdd2cef5150: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.229146  7818 tablet_bootstrap.cc:492] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb: No bootstrap required, opened a new log
I20260709 13:15:40.229839  7818 ts_tablet_manager.cc:1403] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.016s
I20260709 13:15:40.234630  7818 raft_consensus.cc:359] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.235594  7818 raft_consensus.cc:385] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.235991  7818 raft_consensus.cc:740] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.237174  7818 consensus_queue.cc:260] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.242686  7818 ts_tablet_manager.cc:1434] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:15:40.244062  7818 tablet_bootstrap.cc:492] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb: Bootstrap starting.
I20260709 13:15:40.253033  7818 tablet_bootstrap.cc:654] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.258297  7803 heartbeater.cc:499] Master 127.6.214.190:39717 was elected leader, sending a full tablet report...
I20260709 13:15:40.258996  7821 ts_tablet_manager.cc:1434] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1: Time spent starting tablet: real 0.044s	user 0.033s	sys 0.010s
I20260709 13:15:40.260005  7821 tablet_bootstrap.cc:492] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1: Bootstrap starting.
I20260709 13:15:40.264072  7820 tablet_bootstrap.cc:492] T 1910b60b6df94e0b8cb445ca2f6d0047 P 74d1986924254a7c8e2f3cdd2cef5150: No bootstrap required, opened a new log
I20260709 13:15:40.264752  7820 ts_tablet_manager.cc:1403] T 1910b60b6df94e0b8cb445ca2f6d0047 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent bootstrapping tablet: real 0.052s	user 0.027s	sys 0.017s
I20260709 13:15:40.267585  7821 tablet_bootstrap.cc:654] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.268651  7820 raft_consensus.cc:359] T 1910b60b6df94e0b8cb445ca2f6d0047 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.273209  7820 raft_consensus.cc:385] T 1910b60b6df94e0b8cb445ca2f6d0047 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.273643  7820 raft_consensus.cc:740] T 1910b60b6df94e0b8cb445ca2f6d0047 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.274652  7820 consensus_queue.cc:260] T 1910b60b6df94e0b8cb445ca2f6d0047 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.277070  7820 ts_tablet_manager.cc:1434] T 1910b60b6df94e0b8cb445ca2f6d0047 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:15:40.278002  7820 tablet_bootstrap.cc:492] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150: Bootstrap starting.
I20260709 13:15:40.284354  7820 tablet_bootstrap.cc:654] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.288379  7818 tablet_bootstrap.cc:492] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb: No bootstrap required, opened a new log
I20260709 13:15:40.288872  7818 ts_tablet_manager.cc:1403] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.011s
I20260709 13:15:40.291021  7818 raft_consensus.cc:359] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.291597  7818 raft_consensus.cc:385] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.291854  7827 raft_consensus.cc:493] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.291961  7818 raft_consensus.cc:740] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.292356  7827 raft_consensus.cc:515] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.292766  7818 consensus_queue.cc:260] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.297454  7827 leader_election.cc:290] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141)
I20260709 13:15:40.299662  7818 ts_tablet_manager.cc:1434] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:15:40.300916  7818 tablet_bootstrap.cc:492] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb: Bootstrap starting.
I20260709 13:15:40.309154  7818 tablet_bootstrap.cc:654] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.311115  7820 tablet_bootstrap.cc:492] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150: No bootstrap required, opened a new log
I20260709 13:15:40.312835  7820 ts_tablet_manager.cc:1403] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.004s
I20260709 13:15:40.315039  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1910b60b6df94e0b8cb445ca2f6d0047" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" is_pre_election: true
W20260709 13:15:40.317654  7743 leader_election.cc:343] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.318470  7820 raft_consensus.cc:359] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.319096  7821 tablet_bootstrap.cc:492] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1: No bootstrap required, opened a new log
I20260709 13:15:40.319371  7820 raft_consensus.cc:385] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.319586  7821 ts_tablet_manager.cc:1403] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.024s
I20260709 13:15:40.319691  7820 raft_consensus.cc:740] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.320504  7820 consensus_queue.cc:260] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.322667  7820 ts_tablet_manager.cc:1434] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:40.322638  7821 raft_consensus.cc:359] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.323431  7821 raft_consensus.cc:385] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.323802  7820 tablet_bootstrap.cc:492] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150: Bootstrap starting.
I20260709 13:15:40.323717  7821 raft_consensus.cc:740] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.324623  7821 consensus_queue.cc:260] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.326702  7821 ts_tablet_manager.cc:1434] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:40.327658  7821 tablet_bootstrap.cc:492] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1: Bootstrap starting.
I20260709 13:15:40.330564  7820 tablet_bootstrap.cc:654] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.341919  7818 tablet_bootstrap.cc:492] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb: No bootstrap required, opened a new log
I20260709 13:15:40.342775  7818 ts_tablet_manager.cc:1403] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.028s
I20260709 13:15:40.345613  7818 raft_consensus.cc:359] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.346362  7821 tablet_bootstrap.cc:654] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.346398  7818 raft_consensus.cc:385] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.347066  7818 raft_consensus.cc:740] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.346905  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1910b60b6df94e0b8cb445ca2f6d0047" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150" is_pre_election: true
I20260709 13:15:40.347886  7818 consensus_queue.cc:260] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.348784  7704 raft_consensus.cc:2468] T 1910b60b6df94e0b8cb445ca2f6d0047 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bb1879bdca14efc91805d92ef1047e1 in term 0.
I20260709 13:15:40.350199  7744 leader_election.cc:304] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, 74d1986924254a7c8e2f3cdd2cef5150; no voters: c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:40.351039  7827 raft_consensus.cc:2804] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.351437  7827 raft_consensus.cc:493] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.351794  7827 raft_consensus.cc:3060] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.352923  7818 ts_tablet_manager.cc:1434] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:40.353925  7818 tablet_bootstrap.cc:492] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb: Bootstrap starting.
I20260709 13:15:40.360203  7818 tablet_bootstrap.cc:654] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.367801  7827 raft_consensus.cc:515] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.371115  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1910b60b6df94e0b8cb445ca2f6d0047" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
W20260709 13:15:40.373068  7743 leader_election.cc:343] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.377714  7827 leader_election.cc:290] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141)
I20260709 13:15:40.379678  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1910b60b6df94e0b8cb445ca2f6d0047" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:40.380441  7704 raft_consensus.cc:3060] T 1910b60b6df94e0b8cb445ca2f6d0047 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.384262  7823 raft_consensus.cc:493] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.384771  7823 raft_consensus.cc:515] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.388857  7704 raft_consensus.cc:2468] T 1910b60b6df94e0b8cb445ca2f6d0047 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1879bdca14efc91805d92ef1047e1 in term 1.
I20260709 13:15:40.390210  7744 leader_election.cc:304] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, 74d1986924254a7c8e2f3cdd2cef5150; no voters: c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:40.391489  7827 raft_consensus.cc:2804] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.394281  7827 raft_consensus.cc:697] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 LEADER]: Becoming Leader. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Running, Role: LEADER
I20260709 13:15:40.394894  7823 leader_election.cc:290] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.395246  7827 consensus_queue.cc:237] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.399150  7839 raft_consensus.cc:493] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.399726  7839 raft_consensus.cc:515] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.402472  7825 raft_consensus.cc:493] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.403084  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" is_pre_election: true
I20260709 13:15:40.402935  7825 raft_consensus.cc:515] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
W20260709 13:15:40.404518  7743 leader_election.cc:343] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.408200  7825 leader_election.cc:290] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.408736  7821 tablet_bootstrap.cc:492] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1: No bootstrap required, opened a new log
I20260709 13:15:40.408746  7820 tablet_bootstrap.cc:492] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150: No bootstrap required, opened a new log
I20260709 13:15:40.409324  7821 ts_tablet_manager.cc:1403] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1: Time spent bootstrapping tablet: real 0.082s	user 0.036s	sys 0.032s
I20260709 13:15:40.409327  7820 ts_tablet_manager.cc:1403] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.053s
I20260709 13:15:40.412207  7820 raft_consensus.cc:359] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.412349  7821 raft_consensus.cc:359] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.412962  7820 raft_consensus.cc:385] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.413036  7821 raft_consensus.cc:385] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.413318  7820 raft_consensus.cc:740] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.413383  7821 raft_consensus.cc:740] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.414017  7839 leader_election.cc:290] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141)
I20260709 13:15:40.414309  7821 consensus_queue.cc:260] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.414162  7820 consensus_queue.cc:260] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.416426  7821 ts_tablet_manager.cc:1434] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:15:40.417407  7821 tablet_bootstrap.cc:492] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1: Bootstrap starting.
I20260709 13:15:40.418437  7820 ts_tablet_manager.cc:1434] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:15:40.419384  7820 tablet_bootstrap.cc:492] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150: Bootstrap starting.
I20260709 13:15:40.426437  7821 tablet_bootstrap.cc:654] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.429773  7825 raft_consensus.cc:493] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.430438  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150" is_pre_election: true
I20260709 13:15:40.431150  7825 raft_consensus.cc:515] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.433597  7825 leader_election.cc:290] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
W20260709 13:15:40.435088  7744 leader_election.cc:343] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.434134  7524 catalog_manager.cc:5697] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131). New cstate: current_term: 1 leader_uuid: "3bb1879bdca14efc91805d92ef1047e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.435719  7744 leader_election.cc:304] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1; no voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:40.437875  7827 raft_consensus.cc:2749] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.439530  7818 tablet_bootstrap.cc:492] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb: No bootstrap required, opened a new log
I20260709 13:15:40.440136  7818 ts_tablet_manager.cc:1403] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.018s
I20260709 13:15:40.443431  7818 raft_consensus.cc:359] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.447470  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54c9b6f80504fa9956fc3ad067dbc21" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" is_pre_election: true
I20260709 13:15:40.447971  7628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" is_pre_election: true
I20260709 13:15:40.457190  7628 raft_consensus.cc:2468] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 0.
I20260709 13:15:40.457556  7823 raft_consensus.cc:493] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.458102  7823 raft_consensus.cc:515] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.458825  7669 leader_election.cc:304] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:40.459653  7825 raft_consensus.cc:2804] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.460036  7820 tablet_bootstrap.cc:654] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.460027  7825 raft_consensus.cc:493] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.460479  7825 raft_consensus.cc:3060] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.460548  7823 leader_election.cc:290] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.461203  7629 raft_consensus.cc:2468] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 0.
I20260709 13:15:40.465806  7669 leader_election.cc:304] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:40.467177  7818 raft_consensus.cc:385] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.469071  7818 raft_consensus.cc:740] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.470443  7818 consensus_queue.cc:260] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.471500  7825 raft_consensus.cc:515] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.479205  7825 leader_election.cc:290] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.479835  7825 raft_consensus.cc:2804] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.480221  7825 raft_consensus.cc:493] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:40.480428  7575 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:40.480633  7825 raft_consensus.cc:3060] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.483392  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54c9b6f80504fa9956fc3ad067dbc21" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1" is_pre_election: true
I20260709 13:15:40.484830  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1" is_pre_election: true
I20260709 13:15:40.486136  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:40.488063  7821 tablet_bootstrap.cc:492] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1: No bootstrap required, opened a new log
W20260709 13:15:40.488332  7668 leader_election.cc:343] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.488546  7821 ts_tablet_manager.cc:1403] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1: Time spent bootstrapping tablet: real 0.071s	user 0.022s	sys 0.014s
W20260709 13:15:40.488978  7668 leader_election.cc:343] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:40.489871  7668 leader_election.cc:343] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.492362  7818 ts_tablet_manager.cc:1434] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:15:40.493364  7818 tablet_bootstrap.cc:492] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb: Bootstrap starting.
I20260709 13:15:40.493942  7825 raft_consensus.cc:515] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.494774  7821 raft_consensus.cc:359] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.495520  7821 raft_consensus.cc:385] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.495872  7821 raft_consensus.cc:740] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.495935  7825 leader_election.cc:290] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.496863  7821 consensus_queue.cc:260] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.498024  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54c9b6f80504fa9956fc3ad067dbc21" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:40.498590  7776 raft_consensus.cc:3060] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.500182  7818 tablet_bootstrap.cc:654] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.501338  7821 ts_tablet_manager.cc:1434] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:15:40.506745  7820 tablet_bootstrap.cc:492] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150: No bootstrap required, opened a new log
I20260709 13:15:40.509234  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
I20260709 13:15:40.509845  7629 raft_consensus.cc:3060] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.510172  7776 raft_consensus.cc:2468] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 1.
I20260709 13:15:40.511492  7668 leader_election.cc:304] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, 74d1986924254a7c8e2f3cdd2cef5150; no voters: 
I20260709 13:15:40.512707  7847 raft_consensus.cc:2804] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.513360  7847 raft_consensus.cc:697] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Becoming Leader. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:40.513604  7628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54c9b6f80504fa9956fc3ad067dbc21" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
I20260709 13:15:40.514788  7628 raft_consensus.cc:3060] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.514958  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54c9b6f80504fa9956fc3ad067dbc21" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1" is_pre_election: true
I20260709 13:15:40.514716  7847 consensus_queue.cc:237] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.515816  7777 raft_consensus.cc:2393] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c72b4670cb5b4e01b6aa33bf5b6644cb in current term 1: Already voted for candidate 74d1986924254a7c8e2f3cdd2cef5150 in this term.
I20260709 13:15:40.516732  7820 ts_tablet_manager.cc:1403] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.011s
I20260709 13:15:40.520908  7820 raft_consensus.cc:359] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.521672  7820 raft_consensus.cc:385] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.521958  7820 raft_consensus.cc:740] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.522585  7628 raft_consensus.cc:2468] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 1.
I20260709 13:15:40.522789  7820 consensus_queue.cc:260] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.524746  7820 ts_tablet_manager.cc:1434] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 13:15:40.525638  7820 tablet_bootstrap.cc:492] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150: Bootstrap starting.
I20260709 13:15:40.526273  7629 raft_consensus.cc:2468] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 1.
I20260709 13:15:40.530606  7820 tablet_bootstrap.cc:654] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.532472  7669 leader_election.cc:304] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 3bb1879bdca14efc91805d92ef1047e1
I20260709 13:15:40.511037  7821 tablet_bootstrap.cc:492] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1: Bootstrap starting.
I20260709 13:15:40.534472  7825 raft_consensus.cc:2804] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.534669  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150" is_pre_election: true
I20260709 13:15:40.535297  7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54c9b6f80504fa9956fc3ad067dbc21" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150" is_pre_election: true
I20260709 13:15:40.540110  7595 leader_election.cc:304] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 3bb1879bdca14efc91805d92ef1047e1, 74d1986924254a7c8e2f3cdd2cef5150
I20260709 13:15:40.540908  7820 tablet_bootstrap.cc:492] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150: No bootstrap required, opened a new log
I20260709 13:15:40.541250  7823 raft_consensus.cc:2749] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.541577  7820 ts_tablet_manager.cc:1403] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:15:40.546262  7820 raft_consensus.cc:359] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.547089  7820 raft_consensus.cc:385] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.547441  7820 raft_consensus.cc:740] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.548022  7818 tablet_bootstrap.cc:492] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb: No bootstrap required, opened a new log
I20260709 13:15:40.548540  7818 ts_tablet_manager.cc:1403] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.006s
I20260709 13:15:40.548457  7820 consensus_queue.cc:260] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.536513  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1" is_pre_election: true
I20260709 13:15:40.551343  7825 raft_consensus.cc:697] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Becoming Leader. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
W20260709 13:15:40.551931  7593 leader_election.cc:343] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.552721  7825 consensus_queue.cc:237] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.554456  7821 tablet_bootstrap.cc:654] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.552736  7818 raft_consensus.cc:359] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.555918  7818 raft_consensus.cc:385] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.556308  7818 raft_consensus.cc:740] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.557372  7818 consensus_queue.cc:260] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.562368  7818 ts_tablet_manager.cc:1434] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:15:40.564987  7524 catalog_manager.cc:5697] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "74d1986924254a7c8e2f3cdd2cef5150" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.567359  7820 ts_tablet_manager.cc:1434] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent starting tablet: real 0.025s	user 0.016s	sys 0.003s
I20260709 13:15:40.568564  7820 tablet_bootstrap.cc:492] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150: Bootstrap starting.
I20260709 13:15:40.568871  7821 tablet_bootstrap.cc:492] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1: No bootstrap required, opened a new log
I20260709 13:15:40.565024  7818 tablet_bootstrap.cc:492] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb: Bootstrap starting.
I20260709 13:15:40.574318  7595 leader_election.cc:304] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 3bb1879bdca14efc91805d92ef1047e1, 74d1986924254a7c8e2f3cdd2cef5150
I20260709 13:15:40.575534  7823 raft_consensus.cc:2749] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.575980  7820 tablet_bootstrap.cc:654] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.576867  7823 raft_consensus.cc:493] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.577241  7818 tablet_bootstrap.cc:654] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.577354  7823 raft_consensus.cc:515] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.579596  7823 leader_election.cc:290] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.581671  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fb8aace3b04293840c69f688cc1136" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1" is_pre_election: true
I20260709 13:15:40.582563  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fb8aace3b04293840c69f688cc1136" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150" is_pre_election: true
I20260709 13:15:40.583390  7704 raft_consensus.cc:2468] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 0.
W20260709 13:15:40.583472  7593 leader_election.cc:343] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.588407  7821 ts_tablet_manager.cc:1403] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.003s
I20260709 13:15:40.592422  7821 raft_consensus.cc:359] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.593129  7821 raft_consensus.cc:385] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.593564  7821 raft_consensus.cc:740] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.594810  7821 consensus_queue.cc:260] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.595337  7595 leader_election.cc:304] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 3bb1879bdca14efc91805d92ef1047e1
I20260709 13:15:40.596514  7823 raft_consensus.cc:2804] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.596992  7823 raft_consensus.cc:493] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.597455  7823 raft_consensus.cc:3060] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.606222  7524 catalog_manager.cc:5697] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "74d1986924254a7c8e2f3cdd2cef5150" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.608295  7825 raft_consensus.cc:493] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.609117  7825 raft_consensus.cc:515] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.612190  7825 leader_election.cc:290] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.614764  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe073b6bddd0413ebe268077052b0788" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1" is_pre_election: true
I20260709 13:15:40.615506  7776 raft_consensus.cc:2468] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 0.
I20260709 13:15:40.616878  7668 leader_election.cc:304] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, 74d1986924254a7c8e2f3cdd2cef5150; no voters: 
I20260709 13:15:40.617801  7825 raft_consensus.cc:2804] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.618189  7825 raft_consensus.cc:493] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.618597  7825 raft_consensus.cc:3060] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.619012  7821 ts_tablet_manager.cc:1434] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.004s
I20260709 13:15:40.620200  7821 tablet_bootstrap.cc:492] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1: Bootstrap starting.
I20260709 13:15:40.622033  7820 tablet_bootstrap.cc:492] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150: No bootstrap required, opened a new log
I20260709 13:15:40.622674  7820 ts_tablet_manager.cc:1403] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent bootstrapping tablet: real 0.054s	user 0.037s	sys 0.015s
I20260709 13:15:40.624495  7847 raft_consensus.cc:493] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.625181  7847 raft_consensus.cc:515] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.625694  7820 raft_consensus.cc:359] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.625918  7823 raft_consensus.cc:515] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.626613  7820 raft_consensus.cc:385] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.626999  7820 raft_consensus.cc:740] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.627539  7847 leader_election.cc:290] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.627760  7820 consensus_queue.cc:260] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.629056  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fb8aace3b04293840c69f688cc1136" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:40.629390  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fc76e522454f429fdf052091879f54" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1" is_pre_election: true
I20260709 13:15:40.630576  7820 ts_tablet_manager.cc:1434] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 13:15:40.630666  7668 leader_election.cc:343] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:40.630666  7593 leader_election.cc:343] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.631891  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fb8aace3b04293840c69f688cc1136" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:40.632619  7704 raft_consensus.cc:3060] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.633416  7820 tablet_bootstrap.cc:492] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150: Bootstrap starting.
I20260709 13:15:40.634840  7858 raft_consensus.cc:493] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.635322  7858 raft_consensus.cc:515] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.638200  7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702bc4ee168244e4acf0b33636235024" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150" is_pre_election: true
W20260709 13:15:40.639684  7595 leader_election.cc:343] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.639956  7704 raft_consensus.cc:2468] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 1.
I20260709 13:15:40.640268  7823 leader_election.cc:290] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 election: Requested vote from peers 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.641108  7820 tablet_bootstrap.cc:654] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.643242  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702bc4ee168244e4acf0b33636235024" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1" is_pre_election: true
I20260709 13:15:40.644101  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe073b6bddd0413ebe268077052b0788" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" is_pre_election: true
I20260709 13:15:40.645233  7818 tablet_bootstrap.cc:492] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb: No bootstrap required, opened a new log
I20260709 13:15:40.644932  7629 raft_consensus.cc:2468] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 0.
I20260709 13:15:40.645810  7818 ts_tablet_manager.cc:1403] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent bootstrapping tablet: real 0.081s	user 0.022s	sys 0.023s
W20260709 13:15:40.644953  7593 leader_election.cc:343] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.646983  7821 tablet_bootstrap.cc:654] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.646664  7593 leader_election.cc:304] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 3bb1879bdca14efc91805d92ef1047e1, 74d1986924254a7c8e2f3cdd2cef5150
I20260709 13:15:40.647720  7823 raft_consensus.cc:2749] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.645121  7858 leader_election.cc:290] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.648177  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fc76e522454f429fdf052091879f54" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" is_pre_election: true
I20260709 13:15:40.648801  7818 raft_consensus.cc:359] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.651430  7818 raft_consensus.cc:385] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.651835  7818 raft_consensus.cc:740] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.649864  7595 leader_election.cc:304] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 3bb1879bdca14efc91805d92ef1047e1
I20260709 13:15:40.650524  7825 raft_consensus.cc:515] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.653935  7858 raft_consensus.cc:2804] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.654402  7858 raft_consensus.cc:697] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 LEADER]: Becoming Leader. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:40.655213  7858 consensus_queue.cc:237] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.656340  7628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe073b6bddd0413ebe268077052b0788" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
I20260709 13:15:40.656507  7825 leader_election.cc:290] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.656926  7628 raft_consensus.cc:3060] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.652772  7818 consensus_queue.cc:260] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.658030  7629 raft_consensus.cc:2468] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 0.
I20260709 13:15:40.659859  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe073b6bddd0413ebe268077052b0788" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:40.660470  7777 raft_consensus.cc:3060] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.664523  7628 raft_consensus.cc:2468] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 1.
I20260709 13:15:40.671021  7669 leader_election.cc:304] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 3bb1879bdca14efc91805d92ef1047e1
I20260709 13:15:40.672834  7825 raft_consensus.cc:2804] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.673311  7825 raft_consensus.cc:493] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.673764  7825 raft_consensus.cc:3060] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.673437  7669 leader_election.cc:304] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:40.678166  7847 raft_consensus.cc:2804] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.682591  7847 raft_consensus.cc:697] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Becoming Leader. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:40.683506  7847 consensus_queue.cc:237] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.687866  7777 raft_consensus.cc:2468] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 1.
I20260709 13:15:40.687819  7527 catalog_manager.cc:5697] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129). New cstate: current_term: 1 leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.689247  7825 raft_consensus.cc:515] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.692474  7820 tablet_bootstrap.cc:492] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150: No bootstrap required, opened a new log
I20260709 13:15:40.693012  7820 ts_tablet_manager.cc:1403] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent bootstrapping tablet: real 0.060s	user 0.023s	sys 0.014s
I20260709 13:15:40.693154  7628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fc76e522454f429fdf052091879f54" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
I20260709 13:15:40.693994  7628 raft_consensus.cc:3060] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.696189  7820 raft_consensus.cc:359] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.696943  7820 raft_consensus.cc:385] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.698663  7820 raft_consensus.cc:740] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.707680  7820 consensus_queue.cc:260] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.710216  7825 leader_election.cc:290] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.711205  7820 ts_tablet_manager.cc:1434] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:15:40.711570  7818 ts_tablet_manager.cc:1434] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent starting tablet: real 0.065s	user 0.024s	sys 0.013s
I20260709 13:15:40.711544  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fc76e522454f429fdf052091879f54" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:40.712357  7820 tablet_bootstrap.cc:492] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150: Bootstrap starting.
I20260709 13:15:40.715452  7821 tablet_bootstrap.cc:492] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1: No bootstrap required, opened a new log
I20260709 13:15:40.715981  7821 ts_tablet_manager.cc:1403] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1: Time spent bootstrapping tablet: real 0.096s	user 0.033s	sys 0.008s
W20260709 13:15:40.717257  7668 leader_election.cc:343] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.718813  7820 tablet_bootstrap.cc:654] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.719215  7628 raft_consensus.cc:2468] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 1.
I20260709 13:15:40.719125  7821 raft_consensus.cc:359] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.720012  7821 raft_consensus.cc:385] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.720356  7821 raft_consensus.cc:740] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.721254  7669 leader_election.cc:304] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 3bb1879bdca14efc91805d92ef1047e1
I20260709 13:15:40.721400  7527 catalog_manager.cc:5697] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "74d1986924254a7c8e2f3cdd2cef5150" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.723477  7818 tablet_bootstrap.cc:492] T 1910b60b6df94e0b8cb445ca2f6d0047 P c72b4670cb5b4e01b6aa33bf5b6644cb: Bootstrap starting.
I20260709 13:15:40.721277  7821 consensus_queue.cc:260] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.724926  7853 raft_consensus.cc:493] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.725453  7853 raft_consensus.cc:515] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.729061  7821 ts_tablet_manager.cc:1434] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:15:40.730129  7821 tablet_bootstrap.cc:492] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1: Bootstrap starting.
I20260709 13:15:40.733354  7818 tablet_bootstrap.cc:654] T 1910b60b6df94e0b8cb445ca2f6d0047 P c72b4670cb5b4e01b6aa33bf5b6644cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.737236  7821 tablet_bootstrap.cc:654] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.736971  7628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702bc4ee168244e4acf0b33636235024" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" is_pre_election: true
I20260709 13:15:40.737780  7628 raft_consensus.cc:2468] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 0.
I20260709 13:15:40.741185  7669 leader_election.cc:304] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:40.745632  7847 raft_consensus.cc:2804] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.745925  7818 tablet_bootstrap.cc:492] T 1910b60b6df94e0b8cb445ca2f6d0047 P c72b4670cb5b4e01b6aa33bf5b6644cb: No bootstrap required, opened a new log
I20260709 13:15:40.746369  7847 raft_consensus.cc:697] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Becoming Leader. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:40.746803  7851 raft_consensus.cc:2804] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.747414  7851 raft_consensus.cc:493] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.747912  7851 raft_consensus.cc:3060] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.747486  7847 consensus_queue.cc:237] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.753650  7821 tablet_bootstrap.cc:492] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1: No bootstrap required, opened a new log
I20260709 13:15:40.753985  7853 leader_election.cc:290] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.754189  7821 ts_tablet_manager.cc:1403] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.007s
I20260709 13:15:40.755750  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702bc4ee168244e4acf0b33636235024" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1" is_pre_election: true
I20260709 13:15:40.757157  7821 raft_consensus.cc:359] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
W20260709 13:15:40.757742  7668 leader_election.cc:343] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.757936  7821 raft_consensus.cc:385] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.758420  7821 raft_consensus.cc:740] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.759181  7821 consensus_queue.cc:260] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.764421  7821 ts_tablet_manager.cc:1434] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:40.746709  7818 ts_tablet_manager.cc:1403] T 1910b60b6df94e0b8cb445ca2f6d0047 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 13:15:40.765419  7821 tablet_bootstrap.cc:492] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1: Bootstrap starting.
I20260709 13:15:40.769625  7818 raft_consensus.cc:359] T 1910b60b6df94e0b8cb445ca2f6d0047 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.772315  7821 tablet_bootstrap.cc:654] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.772518  7851 raft_consensus.cc:515] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.774111  7818 raft_consensus.cc:385] T 1910b60b6df94e0b8cb445ca2f6d0047 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.774600  7818 raft_consensus.cc:740] T 1910b60b6df94e0b8cb445ca2f6d0047 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.775846  7820 tablet_bootstrap.cc:492] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150: No bootstrap required, opened a new log
I20260709 13:15:40.775549  7818 consensus_queue.cc:260] T 1910b60b6df94e0b8cb445ca2f6d0047 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.776299  7820 ts_tablet_manager.cc:1403] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.043s
I20260709 13:15:40.779021  7820 raft_consensus.cc:359] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.779644  7820 raft_consensus.cc:385] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.779836  7820 raft_consensus.cc:740] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.780517  7820 consensus_queue.cc:260] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.781762  7827 raft_consensus.cc:493] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.782930  7820 ts_tablet_manager.cc:1434] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:15:40.782437  7827 raft_consensus.cc:515] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.783867  7820 tablet_bootstrap.cc:492] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150: Bootstrap starting.
I20260709 13:15:40.786063  7628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292de7734639434eacd4fb6c6dd91b26" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" is_pre_election: true
I20260709 13:15:40.787240  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292de7734639434eacd4fb6c6dd91b26" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150" is_pre_election: true
W20260709 13:15:40.787497  7743 leader_election.cc:343] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.788149  7704 raft_consensus.cc:2468] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bb1879bdca14efc91805d92ef1047e1 in term 0.
I20260709 13:15:40.789350  7827 leader_election.cc:290] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141)
I20260709 13:15:40.789664  7744 leader_election.cc:304] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, 74d1986924254a7c8e2f3cdd2cef5150; no voters: c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:40.790249  7820 tablet_bootstrap.cc:654] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.790587  7827 raft_consensus.cc:2804] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.791069  7827 raft_consensus.cc:493] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.791565  7827 raft_consensus.cc:3060] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.794359  7820 tablet_bootstrap.cc:492] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150: No bootstrap required, opened a new log
I20260709 13:15:40.794749  7820 ts_tablet_manager.cc:1403] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:15:40.796519  7820 raft_consensus.cc:359] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.796995  7820 raft_consensus.cc:385] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.797248  7820 raft_consensus.cc:740] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.798053  7820 consensus_queue.cc:260] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.800189  7820 ts_tablet_manager.cc:1434] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:15:40.801608  7827 raft_consensus.cc:515] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.803005  7524 catalog_manager.cc:5697] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "74d1986924254a7c8e2f3cdd2cef5150" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.803886  7851 leader_election.cc:290] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.805169  7818 ts_tablet_manager.cc:1434] T 1910b60b6df94e0b8cb445ca2f6d0047 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:15:40.805651  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292de7734639434eacd4fb6c6dd91b26" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
I20260709 13:15:40.807130  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702bc4ee168244e4acf0b33636235024" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:40.808089  7628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702bc4ee168244e4acf0b33636235024" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
W20260709 13:15:40.808501  7668 leader_election.cc:343] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.808727  7628 raft_consensus.cc:3060] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.809002  7821 tablet_bootstrap.cc:492] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1: No bootstrap required, opened a new log
I20260709 13:15:40.809401  7818 tablet_bootstrap.cc:492] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb: Bootstrap starting.
I20260709 13:15:40.809531  7821 ts_tablet_manager.cc:1403] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1: Time spent bootstrapping tablet: real 0.044s	user 0.023s	sys 0.017s
I20260709 13:15:40.812247  7821 raft_consensus.cc:359] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.813083  7821 raft_consensus.cc:385] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.813397  7821 raft_consensus.cc:740] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Initialized, Role: FOLLOWER
W20260709 13:15:40.807171  7743 leader_election.cc:343] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.815519  7629 raft_consensus.cc:3060] T 1910b60b6df94e0b8cb445ca2f6d0047 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.815972  7818 tablet_bootstrap.cc:654] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.819557  7628 raft_consensus.cc:2468] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 1.
I20260709 13:15:40.819908  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292de7734639434eacd4fb6c6dd91b26" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:40.820549  7704 raft_consensus.cc:3060] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.820849  7669 leader_election.cc:304] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 3bb1879bdca14efc91805d92ef1047e1
I20260709 13:15:40.822086  7851 raft_consensus.cc:2804] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.822599  7851 raft_consensus.cc:697] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Becoming Leader. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:40.823504  7851 consensus_queue.cc:237] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.824702  7839 consensus_queue.cc:1048] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.814278  7821 consensus_queue.cc:260] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.827592  7704 raft_consensus.cc:2468] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1879bdca14efc91805d92ef1047e1 in term 1.
I20260709 13:15:40.828980  7821 ts_tablet_manager.cc:1434] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:15:40.828862  7744 leader_election.cc:304] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, 74d1986924254a7c8e2f3cdd2cef5150; no voters: c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:40.830370  7821 tablet_bootstrap.cc:492] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1: Bootstrap starting.
I20260709 13:15:40.830081  7839 raft_consensus.cc:2804] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.829574  7827 leader_election.cc:290] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141)
I20260709 13:15:40.836966  7827 raft_consensus.cc:493] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.837504  7827 raft_consensus.cc:515] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.838027  7821 tablet_bootstrap.cc:654] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.840292  7839 raft_consensus.cc:697] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 LEADER]: Becoming Leader. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Running, Role: LEADER
I20260709 13:15:40.842427  7839 consensus_queue.cc:237] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.857419  7872 raft_consensus.cc:493] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.856191  7527 catalog_manager.cc:5697] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "74d1986924254a7c8e2f3cdd2cef5150" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.858110  7872 raft_consensus.cc:515] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.861636  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fb8aace3b04293840c69f688cc1136" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" is_pre_election: true
I20260709 13:15:40.862592  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fb8aace3b04293840c69f688cc1136" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150" is_pre_election: true
I20260709 13:15:40.863500  7704 raft_consensus.cc:2393] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bb1879bdca14efc91805d92ef1047e1 in current term 1: Already voted for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in this term.
I20260709 13:15:40.864977  7744 leader_election.cc:304] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1; no voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:40.875038  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fc76e522454f429fdf052091879f54" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" is_pre_election: true
I20260709 13:15:40.875742  7818 tablet_bootstrap.cc:492] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb: No bootstrap required, opened a new log
I20260709 13:15:40.875946  7629 raft_consensus.cc:2393] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bb1879bdca14efc91805d92ef1047e1 in current term 1: Already voted for candidate 74d1986924254a7c8e2f3cdd2cef5150 in this term.
I20260709 13:15:40.876256  7818 ts_tablet_manager.cc:1403] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent bootstrapping tablet: real 0.067s	user 0.007s	sys 0.005s
I20260709 13:15:40.879492  7818 raft_consensus.cc:359] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.880283  7818 raft_consensus.cc:385] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.880522  7827 leader_election.cc:290] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141)
I20260709 13:15:40.881050  7827 raft_consensus.cc:3060] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.881896  7872 leader_election.cc:290] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141)
I20260709 13:15:40.884917  7851 raft_consensus.cc:493] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.885253  7821 tablet_bootstrap.cc:492] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1: No bootstrap required, opened a new log
I20260709 13:15:40.885748  7821 ts_tablet_manager.cc:1403] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.030s
I20260709 13:15:40.885505  7851 raft_consensus.cc:515] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.887126  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fc76e522454f429fdf052091879f54" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150" is_pre_election: true
I20260709 13:15:40.888514  7821 raft_consensus.cc:359] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.888769  7744 leader_election.cc:304] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1; no voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:40.889183  7821 raft_consensus.cc:385] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.889508  7821 raft_consensus.cc:740] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.889353  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" is_pre_election: true
I20260709 13:15:40.890117  7629 raft_consensus.cc:2468] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 0.
I20260709 13:15:40.890264  7821 consensus_queue.cc:260] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.891004  7839 raft_consensus.cc:3060] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.891372  7669 leader_election.cc:304] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:40.892315  7847 raft_consensus.cc:2804] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.892715  7847 raft_consensus.cc:493] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.892979  7821 ts_tablet_manager.cc:1434] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:40.893147  7847 raft_consensus.cc:3060] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.895676  7526 catalog_manager.cc:5697] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131). New cstate: current_term: 1 leader_uuid: "3bb1879bdca14efc91805d92ef1047e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.897925  7821 tablet_bootstrap.cc:492] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1: Bootstrap starting.
I20260709 13:15:40.899503  7839 raft_consensus.cc:2749] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.880553  7818 raft_consensus.cc:740] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.901008  7818 consensus_queue.cc:260] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.904115  7821 tablet_bootstrap.cc:654] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.904918  7827 raft_consensus.cc:2749] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.907526  7818 ts_tablet_manager.cc:1434] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:15:40.908983  7818 tablet_bootstrap.cc:492] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb: Bootstrap starting.
I20260709 13:15:40.916847  7818 tablet_bootstrap.cc:654] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.916432  7847 raft_consensus.cc:515] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.920096  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1" is_pre_election: true
I20260709 13:15:40.920853  7777 raft_consensus.cc:2468] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 0.
I20260709 13:15:40.926975  7851 leader_election.cc:290] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.929651  7851 consensus_queue.cc:1048] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.932879  7847 leader_election.cc:290] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.932981  7629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
I20260709 13:15:40.936398  7629 raft_consensus.cc:3060] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.936605  7821 tablet_bootstrap.cc:492] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1: No bootstrap required, opened a new log
I20260709 13:15:40.937358  7821 ts_tablet_manager.cc:1403] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.005s
I20260709 13:15:40.939627  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:40.940338  7776 raft_consensus.cc:3060] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.951113  7851 raft_consensus.cc:493] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.951850  7851 raft_consensus.cc:515] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.956190  7627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f09aa6221bd4163b9b2ecf3f370fbe2" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" is_pre_election: true
I20260709 13:15:40.957095  7627 raft_consensus.cc:2468] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 0.
I20260709 13:15:40.958878  7669 leader_election.cc:304] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:40.960057  7847 raft_consensus.cc:2804] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.960625  7847 raft_consensus.cc:493] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.961143  7847 raft_consensus.cc:3060] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.966969  7839 raft_consensus.cc:493] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.967660  7839 raft_consensus.cc:515] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.960448  7776 raft_consensus.cc:2468] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 1.
I20260709 13:15:40.972092  7627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f09aa6221bd4163b9b2ecf3f370fbe2" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" is_pre_election: true
I20260709 13:15:40.974452  7821 raft_consensus.cc:359] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.975800  7821 raft_consensus.cc:385] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.975997  7821 raft_consensus.cc:740] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.977341  7839 leader_election.cc:290] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141)
I20260709 13:15:40.974453  7847 raft_consensus.cc:515] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.976564  7627 raft_consensus.cc:2468] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bb1879bdca14efc91805d92ef1047e1 in term 0.
I20260709 13:15:40.979969  7821 consensus_queue.cc:260] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.980917  7818 tablet_bootstrap.cc:492] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb: No bootstrap required, opened a new log
I20260709 13:15:40.981158  7851 leader_election.cc:290] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.981355  7818 ts_tablet_manager.cc:1403] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent bootstrapping tablet: real 0.073s	user 0.036s	sys 0.024s
I20260709 13:15:40.983003  7627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f09aa6221bd4163b9b2ecf3f370fbe2" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
I20260709 13:15:40.983621  7627 raft_consensus.cc:3060] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.983904  7821 ts_tablet_manager.cc:1434] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:15:40.983807  7818 raft_consensus.cc:359] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.984547  7818 raft_consensus.cc:385] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.984599  7847 leader_election.cc:290] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:40.984895  7818 raft_consensus.cc:740] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.980742  7629 raft_consensus.cc:2468] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 1.
I20260709 13:15:40.986279  7743 leader_election.cc:304] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:40.986824  7669 leader_election.cc:304] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:40.988791  7818 consensus_queue.cc:260] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:40.990109  7875 consensus_queue.cc:1048] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:40.990842  7818 ts_tablet_manager.cc:1434] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:15:40.991526  7875 raft_consensus.cc:2804] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.991937  7875 raft_consensus.cc:493] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.992316  7875 raft_consensus.cc:3060] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.993849  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f09aa6221bd4163b9b2ecf3f370fbe2" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150" is_pre_election: true
I20260709 13:15:40.994769  7704 raft_consensus.cc:2393] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bb1879bdca14efc91805d92ef1047e1 in current term 1: Already voted for candidate 74d1986924254a7c8e2f3cdd2cef5150 in this term.
I20260709 13:15:40.995232  7847 raft_consensus.cc:2804] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.995743  7847 raft_consensus.cc:697] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Becoming Leader. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:40.996555  7847 consensus_queue.cc:237] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.001693  7851 consensus_queue.cc:1048] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.005789  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f09aa6221bd4163b9b2ecf3f370fbe2" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:41.014032  7776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f09aa6221bd4163b9b2ecf3f370fbe2" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1" is_pre_election: true
I20260709 13:15:41.018860  7778 raft_consensus.cc:3060] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.029071  7627 raft_consensus.cc:2468] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 1.
I20260709 13:15:41.033975  7875 raft_consensus.cc:515] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.035658  7669 leader_election.cc:304] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:41.037648  7847 raft_consensus.cc:2804] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.040409  7777 raft_consensus.cc:2393] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 74d1986924254a7c8e2f3cdd2cef5150 in current term 1: Already voted for candidate 3bb1879bdca14efc91805d92ef1047e1 in this term.
I20260709 13:15:41.038360  7847 raft_consensus.cc:697] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Becoming Leader. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:41.044421  7847 consensus_queue.cc:237] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.044616  7627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f09aa6221bd4163b9b2ecf3f370fbe2" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
I20260709 13:15:41.045642  7627 raft_consensus.cc:2393] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3bb1879bdca14efc91805d92ef1047e1 in current term 1: Already voted for candidate 74d1986924254a7c8e2f3cdd2cef5150 in this term.
I20260709 13:15:41.046300  7825 consensus_queue.cc:1048] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.046439  7851 consensus_queue.cc:1048] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.047982  7875 leader_election.cc:290] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141)
I20260709 13:15:41.047575  7527 catalog_manager.cc:5697] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "74d1986924254a7c8e2f3cdd2cef5150" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.048744  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f09aa6221bd4163b9b2ecf3f370fbe2" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:41.051162  7743 leader_election.cc:304] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1; no voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:41.053126  7875 raft_consensus.cc:2749] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.080987  7525 catalog_manager.cc:5697] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "74d1986924254a7c8e2f3cdd2cef5150" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.156294  7704 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81fc76e522454f429fdf052091879f54"
dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
mode: GRACEFUL
new_leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:40564
I20260709 13:15:41.156850  7704 raft_consensus.cc:606] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Received request to transfer leadership to TS c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:41.162374  7704 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87"
dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
mode: GRACEFUL
new_leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:40564
I20260709 13:15:41.162900  7704 raft_consensus.cc:606] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Received request to transfer leadership to TS c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:41.171216  7847 consensus_queue.cc:1048] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.171538  7704 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e54c9b6f80504fa9956fc3ad067dbc21"
dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
mode: GRACEFUL
new_leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:40564
I20260709 13:15:41.172211  7704 raft_consensus.cc:606] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Received request to transfer leadership to TS c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:41.177876  7704 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729"
dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
mode: GRACEFUL
new_leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:40564
I20260709 13:15:41.178414  7704 raft_consensus.cc:606] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Received request to transfer leadership to TS c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:41.180482  7861 consensus_queue.cc:1048] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.184408  7825 raft_consensus.cc:993] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150: : Instructing follower c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:41.184909  7847 raft_consensus.cc:1081] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Signalling peer c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:41.190706  7629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81fc76e522454f429fdf052091879f54"
dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:55638
I20260709 13:15:41.191259  7629 raft_consensus.cc:493] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:41.191642  7629 raft_consensus.cc:3060] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.195771  7825 consensus_queue.cc:1048] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.198486  7629 raft_consensus.cc:515] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.202203  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fc76e522454f429fdf052091879f54" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:41.202941  7704 raft_consensus.cc:3055] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.203352  7704 raft_consensus.cc:740] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:41.204231  7704 consensus_queue.cc:260] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.205303  7704 raft_consensus.cc:3060] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.210798  7875 raft_consensus.cc:493] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.211297  7875 raft_consensus.cc:515] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.215467  7627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702bc4ee168244e4acf0b33636235024" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" is_pre_election: true
I20260709 13:15:41.216539  7627 raft_consensus.cc:2393] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bb1879bdca14efc91805d92ef1047e1 in current term 1: Already voted for candidate 74d1986924254a7c8e2f3cdd2cef5150 in this term.
I20260709 13:15:41.218467  7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702bc4ee168244e4acf0b33636235024" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150" is_pre_election: true
I20260709 13:15:41.213358  7875 leader_election.cc:290] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141)
I20260709 13:15:41.220099  7744 leader_election.cc:304] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1; no voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:41.221015  7875 raft_consensus.cc:3060] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.229668  7861 consensus_queue.cc:1048] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.233806  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fc76e522454f429fdf052091879f54" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:41.234576  7777 raft_consensus.cc:3060] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.242735  7778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "292de7734639434eacd4fb6c6dd91b26"
dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
mode: GRACEFUL
new_leader_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
 from {username='slave'} at 127.0.0.1:35464
I20260709 13:15:41.243691  7778 raft_consensus.cc:606] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 LEADER]: Received request to transfer leadership to TS 74d1986924254a7c8e2f3cdd2cef5150
I20260709 13:15:41.244109  7704 raft_consensus.cc:2468] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 2.
I20260709 13:15:41.245455  7595 leader_election.cc:304] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:41.246343  7861 raft_consensus.cc:2804] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:41.246855  7861 raft_consensus.cc:697] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Becoming Leader. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:41.247030  7777 raft_consensus.cc:2468] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 2.
I20260709 13:15:41.248296  7629 leader_election.cc:290] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 2 election: Requested vote from peers 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:41.247766  7861 consensus_queue.cc:237] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.251094  7875 raft_consensus.cc:2749] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.262830  7526 catalog_manager.cc:5697] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb reported cstate change: term changed from 1 to 2, leader changed from 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130) to c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129). New cstate: current_term: 2 leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.272477  7861 raft_consensus.cc:493] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.272986  7861 raft_consensus.cc:515] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.275132  7861 leader_election.cc:290] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:41.275859  7703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292de7734639434eacd4fb6c6dd91b26" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150" is_pre_election: true
I20260709 13:15:41.276127  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292de7734639434eacd4fb6c6dd91b26" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1879bdca14efc91805d92ef1047e1" is_pre_election: true
I20260709 13:15:41.276739  7703 raft_consensus.cc:2393] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c72b4670cb5b4e01b6aa33bf5b6644cb in current term 1: Already voted for candidate 3bb1879bdca14efc91805d92ef1047e1 in this term.
I20260709 13:15:41.277794  7595 leader_election.cc:304] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 3bb1879bdca14efc91805d92ef1047e1, 74d1986924254a7c8e2f3cdd2cef5150
I20260709 13:15:41.278437  7861 raft_consensus.cc:3060] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.283438  7861 raft_consensus.cc:2749] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.286289  7825 consensus_queue.cc:1048] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.298117  7847 consensus_queue.cc:1048] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.312907  7847 consensus_queue.cc:1048] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.324699  7825 consensus_queue.cc:1048] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.386948  7875 consensus_queue.cc:1048] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.394938  7872 raft_consensus.cc:993] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1: : Instructing follower 74d1986924254a7c8e2f3cdd2cef5150 to start an election
I20260709 13:15:41.395440  7839 raft_consensus.cc:1081] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 LEADER]: Signalling peer 74d1986924254a7c8e2f3cdd2cef5150 to start an election
I20260709 13:15:41.398527  7704 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "292de7734639434eacd4fb6c6dd91b26"
dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
 from {username='slave'} at 127.0.0.1:40544
I20260709 13:15:41.399164  7704 raft_consensus.cc:493] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:41.399596  7704 raft_consensus.cc:3060] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.403466  7875 consensus_queue.cc:1048] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.406910  7704 raft_consensus.cc:515] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.409655  7627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292de7734639434eacd4fb6c6dd91b26" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
I20260709 13:15:41.410233  7627 raft_consensus.cc:3060] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.412920  7704 leader_election.cc:290] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 2 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:41.414237  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292de7734639434eacd4fb6c6dd91b26" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:41.414812  7777 raft_consensus.cc:3055] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.415129  7777 raft_consensus.cc:740] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Running, Role: LEADER
I20260709 13:15:41.415859  7627 raft_consensus.cc:2468] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 2.
I20260709 13:15:41.416014  7777 consensus_queue.cc:260] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.417007  7669 leader_election.cc:304] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:41.417248  7777 raft_consensus.cc:3060] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.417822  7825 raft_consensus.cc:2804] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:41.418349  7825 raft_consensus.cc:697] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 LEADER]: Becoming Leader. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:41.419130  7825 consensus_queue.cc:237] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.424082  7777 raft_consensus.cc:2468] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 2.
I20260709 13:15:41.426251  7524 catalog_manager.cc:5697] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 reported cstate change: term changed from 1 to 2, leader changed from 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131) to 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "74d1986924254a7c8e2f3cdd2cef5150" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.443725  7825 consensus_queue.cc:1048] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.449990  7851 raft_consensus.cc:993] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150: : Instructing follower c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:41.450453  7853 raft_consensus.cc:1081] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Signalling peer c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:41.452145  7629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87"
dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:55638
I20260709 13:15:41.452699  7629 raft_consensus.cc:493] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:41.453060  7629 raft_consensus.cc:3060] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.455420  7851 consensus_queue.cc:1048] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.459934  7629 raft_consensus.cc:515] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.461018  7627 raft_consensus.cc:1240] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Rejecting Update request from peer 74d1986924254a7c8e2f3cdd2cef5150 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:41.464555  7851 consensus_queue.cc:1059] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.465366  7851 raft_consensus.cc:3055] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.465759  7851 raft_consensus.cc:740] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:41.466684  7853 consensus_queue.cc:1048] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.466621  7851 consensus_queue.cc:260] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.467895  7851 raft_consensus.cc:3060] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.468215  7629 leader_election.cc:290] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 2 election: Requested vote from peers 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:41.469254  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:41.469849  7777 raft_consensus.cc:3060] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.475152  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:41.480391  7777 raft_consensus.cc:2468] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 2.
I20260709 13:15:41.482036  7704 raft_consensus.cc:2468] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 2.
I20260709 13:15:41.483335  7595 leader_election.cc:304] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:41.484184  7861 raft_consensus.cc:2804] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:41.484678  7861 raft_consensus.cc:697] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Becoming Leader. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:41.485532  7861 consensus_queue.cc:237] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.502983  7853 raft_consensus.cc:993] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150: : Instructing follower c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:41.504417  7853 raft_consensus.cc:1081] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Signalling peer c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:41.505995  7629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e54c9b6f80504fa9956fc3ad067dbc21"
dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:55638
I20260709 13:15:41.507093  7825 consensus_queue.cc:1048] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.510983  7527 catalog_manager.cc:5697] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb reported cstate change: term changed from 1 to 2, leader changed from 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130) to c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129). New cstate: current_term: 2 leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.514143  7629 raft_consensus.cc:493] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:41.514684  7629 raft_consensus.cc:3060] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.520632  7629 raft_consensus.cc:515] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.522481  7629 leader_election.cc:290] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 2 election: Requested vote from peers 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:41.523177  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54c9b6f80504fa9956fc3ad067dbc21" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:41.523761  7704 raft_consensus.cc:3055] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.523976  7704 raft_consensus.cc:740] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:41.524595  7704 consensus_queue.cc:260] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.525408  7704 raft_consensus.cc:3060] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.528239  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54c9b6f80504fa9956fc3ad067dbc21" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:41.528800  7777 raft_consensus.cc:3060] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.530270  7704 raft_consensus.cc:2468] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 2.
I20260709 13:15:41.531229  7595 leader_election.cc:304] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:41.531890  7861 raft_consensus.cc:2804] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:41.532294  7861 raft_consensus.cc:697] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Becoming Leader. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:41.532981  7861 consensus_queue.cc:237] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.534299  7777 raft_consensus.cc:2468] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 2.
I20260709 13:15:41.539157  7526 catalog_manager.cc:5697] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb reported cstate change: term changed from 1 to 2, leader changed from 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130) to c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129). New cstate: current_term: 2 leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.603403  7853 raft_consensus.cc:993] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150: : Instructing follower c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:41.603852  7825 raft_consensus.cc:1081] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Signalling peer c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:41.605546  7629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729"
dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:55638
I20260709 13:15:41.606082  7629 raft_consensus.cc:493] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:41.606431  7629 raft_consensus.cc:3060] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.611411  7629 raft_consensus.cc:515] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.613739  7629 leader_election.cc:290] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 2 election: Requested vote from peers 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:41.615082  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:41.615165  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:41.615751  7778 raft_consensus.cc:3060] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.615988  7704 raft_consensus.cc:3055] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.616408  7704 raft_consensus.cc:740] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:41.617204  7704 consensus_queue.cc:260] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.618247  7704 raft_consensus.cc:3060] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.621644  7778 raft_consensus.cc:2468] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 2.
I20260709 13:15:41.622720  7593 leader_election.cc:304] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:41.623421  7861 raft_consensus.cc:2804] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:41.623939  7861 raft_consensus.cc:697] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Becoming Leader. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:41.624217  7704 raft_consensus.cc:2468] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 2.
I20260709 13:15:41.624871  7861 consensus_queue.cc:237] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:41.631644  7526 catalog_manager.cc:5697] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb reported cstate change: term changed from 1 to 2, leader changed from 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130) to c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129). New cstate: current_term: 2 leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.639024  7704 raft_consensus.cc:1275] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.640690  7861 consensus_queue.cc:1048] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.649026  7778 raft_consensus.cc:1275] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.650918  7898 consensus_queue.cc:1048] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.800158  7629 raft_consensus.cc:1275] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Refusing update from remote peer 74d1986924254a7c8e2f3cdd2cef5150: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.801524  7825 consensus_queue.cc:1048] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:41.808948  7778 raft_consensus.cc:1275] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Refusing update from remote peer 74d1986924254a7c8e2f3cdd2cef5150: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.811085  7853 consensus_queue.cc:1048] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.892607  7778 raft_consensus.cc:1275] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.894290  7898 consensus_queue.cc:1048] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:41.903386  7704 raft_consensus.cc:1275] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.904834  7898 consensus_queue.cc:1048] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:42.014076  7778 raft_consensus.cc:1275] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:42.015595  7898 consensus_queue.cc:1048] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:42.025172  7704 raft_consensus.cc:1275] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:42.027094  7898 consensus_queue.cc:1048] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:42.143541  7704 raft_consensus.cc:1275] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:42.144984  7898 consensus_queue.cc:1048] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:42.153844  7778 raft_consensus.cc:1275] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:42.155187  7861 consensus_queue.cc:1048] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:44.293593  7002 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:15:44.294538  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:44.315672  7627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87"
dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
mode: GRACEFUL
new_leader_uuid: "3bb1879bdca14efc91805d92ef1047e1"
 from {username='slave'} at 127.0.0.1:42536
I20260709 13:15:44.316411  7627 raft_consensus.cc:606] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Received request to transfer leadership to TS 3bb1879bdca14efc91805d92ef1047e1
I20260709 13:15:44.319146  7627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729"
dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
mode: GRACEFUL
new_leader_uuid: "3bb1879bdca14efc91805d92ef1047e1"
 from {username='slave'} at 127.0.0.1:42536
I20260709 13:15:44.319636  7627 raft_consensus.cc:606] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Received request to transfer leadership to TS 3bb1879bdca14efc91805d92ef1047e1
I20260709 13:15:44.320837  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:44.321269  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:44.419401  7918 raft_consensus.cc:993] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb: : Instructing follower 3bb1879bdca14efc91805d92ef1047e1 to start an election
I20260709 13:15:44.420104  7896 raft_consensus.cc:1081] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Signalling peer 3bb1879bdca14efc91805d92ef1047e1 to start an election
I20260709 13:15:44.421873  7778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87"
dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
 from {username='slave'} at 127.0.0.1:35446
I20260709 13:15:44.422384  7778 raft_consensus.cc:493] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:44.422716  7778 raft_consensus.cc:3060] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.428435  7778 raft_consensus.cc:515] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:44.430420  7778 leader_election.cc:290] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 3 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141)
I20260709 13:15:44.431471  7627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
I20260709 13:15:44.432010  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:44.432293  7627 raft_consensus.cc:3055] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:44.432623  7627 raft_consensus.cc:740] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:44.432709  7704 raft_consensus.cc:3060] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.433560  7627 consensus_queue.cc:260] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:44.434705  7627 raft_consensus.cc:3060] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.440274  7627 raft_consensus.cc:2468] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1879bdca14efc91805d92ef1047e1 in term 3.
I20260709 13:15:44.440346  7704 raft_consensus.cc:2468] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1879bdca14efc91805d92ef1047e1 in term 3.
I20260709 13:15:44.442117  7743 leader_election.cc:304] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:44.443089  7872 raft_consensus.cc:2804] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:44.444051  7872 raft_consensus.cc:697] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 LEADER]: Becoming Leader. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Running, Role: LEADER
I20260709 13:15:44.444835  7872 consensus_queue.cc:237] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:44.452191  7526 catalog_manager.cc:5697] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 reported cstate change: term changed from 2 to 3, leader changed from c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129) to 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131). New cstate: current_term: 3 leader_uuid: "3bb1879bdca14efc91805d92ef1047e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:44.578975  7918 raft_consensus.cc:993] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb: : Instructing follower 3bb1879bdca14efc91805d92ef1047e1 to start an election
I20260709 13:15:44.579478  7896 raft_consensus.cc:1081] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Signalling peer 3bb1879bdca14efc91805d92ef1047e1 to start an election
I20260709 13:15:44.580974  7778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729"
dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
 from {username='slave'} at 127.0.0.1:35446
I20260709 13:15:44.581514  7778 raft_consensus.cc:493] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:44.581820  7778 raft_consensus.cc:3060] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.586495  7778 raft_consensus.cc:515] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:44.588099  7778 leader_election.cc:290] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 3 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141)
I20260709 13:15:44.588991  7627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
I20260709 13:15:44.589111  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:44.589654  7704 raft_consensus.cc:3060] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.589653  7627 raft_consensus.cc:3055] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:44.590207  7627 raft_consensus.cc:740] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:44.591076  7627 consensus_queue.cc:260] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:44.592288  7627 raft_consensus.cc:3060] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.596200  7704 raft_consensus.cc:2468] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1879bdca14efc91805d92ef1047e1 in term 3.
I20260709 13:15:44.597713  7744 leader_election.cc:304] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, 74d1986924254a7c8e2f3cdd2cef5150; no voters: 
I20260709 13:15:44.598441  7872 raft_consensus.cc:2804] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:44.598762  7627 raft_consensus.cc:2468] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1879bdca14efc91805d92ef1047e1 in term 3.
I20260709 13:15:44.598940  7872 raft_consensus.cc:697] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 LEADER]: Becoming Leader. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Running, Role: LEADER
I20260709 13:15:44.599853  7872 consensus_queue.cc:237] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:44.607194  7526 catalog_manager.cc:5697] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 reported cstate change: term changed from 2 to 3, leader changed from c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129) to 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131). New cstate: current_term: 3 leader_uuid: "3bb1879bdca14efc91805d92ef1047e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:44.860587  7627 raft_consensus.cc:1275] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Refusing update from remote peer 3bb1879bdca14efc91805d92ef1047e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:44.862362  7872 consensus_queue.cc:1048] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:44.888095  7704 raft_consensus.cc:1275] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Refusing update from remote peer 3bb1879bdca14efc91805d92ef1047e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:44.889515  7872 consensus_queue.cc:1048] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:45.056762  7704 raft_consensus.cc:1275] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Refusing update from remote peer 3bb1879bdca14efc91805d92ef1047e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:45.058215  7872 consensus_queue.cc:1048] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:45.067728  7627 raft_consensus.cc:1275] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Refusing update from remote peer 3bb1879bdca14efc91805d92ef1047e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:45.069487  7930 consensus_queue.cc:1048] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:45.322137  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:45.335299  7778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87"
dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
mode: GRACEFUL
new_leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:35464
I20260709 13:15:45.335803  7778 raft_consensus.cc:606] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 LEADER]: Received request to transfer leadership to TS c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:45.345091  7778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729"
dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
mode: GRACEFUL
new_leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:35464
I20260709 13:15:45.345620  7778 raft_consensus.cc:606] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 LEADER]: Received request to transfer leadership to TS c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:45.350651  7704 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe073b6bddd0413ebe268077052b0788"
dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
mode: GRACEFUL
new_leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:40564
I20260709 13:15:45.351192  7704 raft_consensus.cc:606] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Received request to transfer leadership to TS c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:45.356231  7704 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "702bc4ee168244e4acf0b33636235024"
dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
mode: GRACEFUL
new_leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:40564
I20260709 13:15:45.356698  7704 raft_consensus.cc:606] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Received request to transfer leadership to TS c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:45.361696  7704 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "292de7734639434eacd4fb6c6dd91b26"
dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
mode: GRACEFUL
new_leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:40564
I20260709 13:15:45.362309  7704 raft_consensus.cc:606] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 LEADER]: Received request to transfer leadership to TS c72b4670cb5b4e01b6aa33bf5b6644cb
I20260709 13:15:45.389398  7853 raft_consensus.cc:993] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150: : Instructing follower c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:45.389832  7935 raft_consensus.cc:1081] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Signalling peer c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:45.391323  7627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "702bc4ee168244e4acf0b33636235024"
dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:55638
I20260709 13:15:45.391772  7627 raft_consensus.cc:493] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:45.392014  7627 raft_consensus.cc:3060] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.396339  7627 raft_consensus.cc:515] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:45.398525  7627 leader_election.cc:290] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 2 election: Requested vote from peers 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:45.399183  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702bc4ee168244e4acf0b33636235024" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:45.399603  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702bc4ee168244e4acf0b33636235024" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:45.399853  7704 raft_consensus.cc:3055] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:45.400192  7778 raft_consensus.cc:3060] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.400168  7704 raft_consensus.cc:740] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:45.401336  7704 consensus_queue.cc:260] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:45.402675  7704 raft_consensus.cc:3060] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.407694  7778 raft_consensus.cc:2468] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 2.
I20260709 13:15:45.409176  7593 leader_election.cc:304] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:45.409545  7704 raft_consensus.cc:2468] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 2.
I20260709 13:15:45.410022  7896 raft_consensus.cc:2804] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:45.411530  7896 raft_consensus.cc:697] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Becoming Leader. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:45.412580  7896 consensus_queue.cc:237] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:45.421700  7524 catalog_manager.cc:5697] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb reported cstate change: term changed from 1 to 2, leader changed from 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130) to c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129). New cstate: current_term: 2 leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.452945  7919 raft_consensus.cc:993] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1: : Instructing follower c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:45.453487  7872 raft_consensus.cc:1081] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 LEADER]: Signalling peer c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:45.455087  7627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87"
dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:55624
I20260709 13:15:45.455646  7627 raft_consensus.cc:493] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:45.455935  7627 raft_consensus.cc:3060] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:45.460783  7627 raft_consensus.cc:515] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:45.462476  7627 leader_election.cc:290] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 4 election: Requested vote from peers 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:45.463364  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:45.463413  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:45.464046  7704 raft_consensus.cc:3060] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:45.464061  7778 raft_consensus.cc:3055] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:45.464519  7778 raft_consensus.cc:740] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Running, Role: LEADER
I20260709 13:15:45.465301  7778 consensus_queue.cc:260] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:45.466470  7778 raft_consensus.cc:3060] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:45.470292  7704 raft_consensus.cc:2468] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 4.
I20260709 13:15:45.471475  7595 leader_election.cc:304] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:45.472165  7896 raft_consensus.cc:2804] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:45.472635  7896 raft_consensus.cc:697] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 4 LEADER]: Becoming Leader. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:45.473053  7778 raft_consensus.cc:2468] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 4.
I20260709 13:15:45.473474  7896 consensus_queue.cc:237] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:45.477214  7919 raft_consensus.cc:993] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1: : Instructing follower c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:45.477705  7930 raft_consensus.cc:1081] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 LEADER]: Signalling peer c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:45.479286  7627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729"
dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:55624
I20260709 13:15:45.479828  7627 raft_consensus.cc:493] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:45.480501  7627 raft_consensus.cc:3060] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:45.480422  7526 catalog_manager.cc:5697] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb reported cstate change: term changed from 3 to 4, leader changed from 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131) to c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129). New cstate: current_term: 4 leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.486256  7627 raft_consensus.cc:515] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:45.488425  7627 leader_election.cc:290] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 4 election: Requested vote from peers 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:45.489003  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:45.489562  7704 raft_consensus.cc:3060] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:45.489862  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9feefdd7b53416ebc44f6ebbf656729" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:45.490397  7778 raft_consensus.cc:3055] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:45.490702  7778 raft_consensus.cc:740] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Running, Role: LEADER
I20260709 13:15:45.491473  7778 consensus_queue.cc:260] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:45.492695  7778 raft_consensus.cc:3060] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:45.495913  7704 raft_consensus.cc:2468] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 4.
I20260709 13:15:45.497030  7595 leader_election.cc:304] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74d1986924254a7c8e2f3cdd2cef5150, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:45.497754  7896 raft_consensus.cc:2804] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:45.498202  7896 raft_consensus.cc:697] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 4 LEADER]: Becoming Leader. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:45.498489  7778 raft_consensus.cc:2468] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 4.
I20260709 13:15:45.499022  7896 consensus_queue.cc:237] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:45.504828  7526 catalog_manager.cc:5697] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb reported cstate change: term changed from 3 to 4, leader changed from 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131) to c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129). New cstate: current_term: 4 leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.627296  7853 raft_consensus.cc:993] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150: : Instructing follower c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:45.627790  7853 raft_consensus.cc:1081] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Signalling peer c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:45.629196  7627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe073b6bddd0413ebe268077052b0788"
dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:55638
I20260709 13:15:45.629684  7627 raft_consensus.cc:493] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:45.629989  7627 raft_consensus.cc:3060] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.634419  7627 raft_consensus.cc:515] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:45.636130  7627 leader_election.cc:290] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 2 election: Requested vote from peers 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:45.636816  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe073b6bddd0413ebe268077052b0788" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:45.637156  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe073b6bddd0413ebe268077052b0788" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:45.637316  7704 raft_consensus.cc:3055] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:45.637686  7778 raft_consensus.cc:3060] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.637691  7704 raft_consensus.cc:740] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:45.638429  7704 consensus_queue.cc:260] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:45.639247  7704 raft_consensus.cc:3060] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.641824  7778 raft_consensus.cc:2468] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 2.
I20260709 13:15:45.642702  7593 leader_election.cc:304] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:45.643374  7896 raft_consensus.cc:2804] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:45.643802  7896 raft_consensus.cc:697] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Becoming Leader. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:45.643368  7704 raft_consensus.cc:2468] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 2.
I20260709 13:15:45.644575  7896 consensus_queue.cc:237] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:45.651582  7526 catalog_manager.cc:5697] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb reported cstate change: term changed from 1 to 2, leader changed from 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130) to c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129). New cstate: current_term: 2 leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.817642  7935 raft_consensus.cc:993] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150: : Instructing follower c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:45.818238  7853 raft_consensus.cc:1081] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 LEADER]: Signalling peer c72b4670cb5b4e01b6aa33bf5b6644cb to start an election
I20260709 13:15:45.819610  7627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "292de7734639434eacd4fb6c6dd91b26"
dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
 from {username='slave'} at 127.0.0.1:55638
I20260709 13:15:45.820122  7627 raft_consensus.cc:493] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:45.820546  7627 raft_consensus.cc:3060] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:45.824983  7627 raft_consensus.cc:515] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:45.826473  7627 leader_election.cc:290] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 3 election: Requested vote from peers 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:45.827342  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292de7734639434eacd4fb6c6dd91b26" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:45.827472  7778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292de7734639434eacd4fb6c6dd91b26" candidate_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:45.827877  7704 raft_consensus.cc:3055] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:45.827961  7778 raft_consensus.cc:3060] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:45.828253  7704 raft_consensus.cc:740] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:45.828938  7704 consensus_queue.cc:260] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:45.830052  7704 raft_consensus.cc:3060] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:45.834205  7778 raft_consensus.cc:2468] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 3.
I20260709 13:15:45.835377  7593 leader_election.cc:304] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, c72b4670cb5b4e01b6aa33bf5b6644cb; no voters: 
I20260709 13:15:45.835868  7704 raft_consensus.cc:2468] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c72b4670cb5b4e01b6aa33bf5b6644cb in term 3.
I20260709 13:15:45.836059  7896 raft_consensus.cc:2804] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:45.836980  7896 raft_consensus.cc:697] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 LEADER]: Becoming Leader. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:45.838243  7704 raft_consensus.cc:1275] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:45.837990  7896 consensus_queue.cc:237] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:45.839468  7937 consensus_queue.cc:1048] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:45.846289  7526 catalog_manager.cc:5697] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb reported cstate change: term changed from 2 to 3, leader changed from 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130) to c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129). New cstate: current_term: 3 leader_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.851715  7778 raft_consensus.cc:1275] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:45.853273  7937 consensus_queue.cc:1048] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:45.892558  7704 raft_consensus.cc:1275] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 4 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:45.893919  7896 consensus_queue.cc:1048] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:45.894124  7703 raft_consensus.cc:1275] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 4 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:45.896103  7896 consensus_queue.cc:1048] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:45.900843  7777 raft_consensus.cc:1275] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 4 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:45.903623  7777 raft_consensus.cc:1275] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 4 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:45.903115  7937 consensus_queue.cc:1048] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:15:45.906605  7896 consensus_queue.cc:1048] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:46.088342  7704 raft_consensus.cc:1275] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:46.089483  7949 consensus_queue.cc:1048] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:46.097965  7778 raft_consensus.cc:1275] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:46.099647  7949 consensus_queue.cc:1048] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:46.325273  7704 raft_consensus.cc:1275] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:46.326805  7949 consensus_queue.cc:1048] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:46.335407  7778 raft_consensus.cc:1275] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Refusing update from remote peer c72b4670cb5b4e01b6aa33bf5b6644cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:46.337291  7936 consensus_queue.cc:1048] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:48.370028  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:48.377235  7627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63fb8aace3b04293840c69f688cc1136"
dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
mode: GRACEFUL
new_leader_uuid: "3bb1879bdca14efc91805d92ef1047e1"
 from {username='slave'} at 127.0.0.1:42536
I20260709 13:15:48.377907  7627 raft_consensus.cc:606] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 LEADER]: Received request to transfer leadership to TS 3bb1879bdca14efc91805d92ef1047e1
I20260709 13:15:48.380139  7627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "702bc4ee168244e4acf0b33636235024"
dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
mode: GRACEFUL
new_leader_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
 from {username='slave'} at 127.0.0.1:42536
I20260709 13:15:48.380574  7627 raft_consensus.cc:606] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Received request to transfer leadership to TS 74d1986924254a7c8e2f3cdd2cef5150
I20260709 13:15:48.382946  7627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87"
dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
mode: GRACEFUL
new_leader_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
 from {username='slave'} at 127.0.0.1:42536
I20260709 13:15:48.383375  7627 raft_consensus.cc:606] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 4 LEADER]: Received request to transfer leadership to TS 74d1986924254a7c8e2f3cdd2cef5150
I20260709 13:15:48.385797  7627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e54c9b6f80504fa9956fc3ad067dbc21"
dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
mode: GRACEFUL
new_leader_uuid: "3bb1879bdca14efc91805d92ef1047e1"
 from {username='slave'} at 127.0.0.1:42536
I20260709 13:15:48.386220  7627 raft_consensus.cc:606] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Received request to transfer leadership to TS 3bb1879bdca14efc91805d92ef1047e1
I20260709 13:15:48.387194  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:48.387633  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:48.458004  7949 raft_consensus.cc:993] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb: : Instructing follower 3bb1879bdca14efc91805d92ef1047e1 to start an election
I20260709 13:15:48.458451  7936 raft_consensus.cc:1081] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Signalling peer 3bb1879bdca14efc91805d92ef1047e1 to start an election
I20260709 13:15:48.459856  7777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e54c9b6f80504fa9956fc3ad067dbc21"
dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
 from {username='slave'} at 127.0.0.1:35446
I20260709 13:15:48.460318  7777 raft_consensus.cc:493] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:48.460770  7777 raft_consensus.cc:3060] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.465734  7777 raft_consensus.cc:515] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:48.467571  7777 leader_election.cc:290] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 3 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141)
I20260709 13:15:48.468618  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54c9b6f80504fa9956fc3ad067dbc21" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:48.469172  7704 raft_consensus.cc:3060] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.469323  7627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e54c9b6f80504fa9956fc3ad067dbc21" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
I20260709 13:15:48.470081  7627 raft_consensus.cc:3055] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:48.470480  7627 raft_consensus.cc:740] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:48.471776  7627 consensus_queue.cc:260] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:48.473107  7627 raft_consensus.cc:3060] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.475900  7704 raft_consensus.cc:2468] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1879bdca14efc91805d92ef1047e1 in term 3.
I20260709 13:15:48.477147  7744 leader_election.cc:304] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, 74d1986924254a7c8e2f3cdd2cef5150; no voters: 
I20260709 13:15:48.478015  7930 raft_consensus.cc:2804] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:48.479025  7930 raft_consensus.cc:697] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 LEADER]: Becoming Leader. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Running, Role: LEADER
I20260709 13:15:48.479804  7930 consensus_queue.cc:237] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:48.482884  7627 raft_consensus.cc:2468] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1879bdca14efc91805d92ef1047e1 in term 3.
I20260709 13:15:48.489621  7524 catalog_manager.cc:5697] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 reported cstate change: term changed from 2 to 3, leader changed from c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129) to 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131). New cstate: current_term: 3 leader_uuid: "3bb1879bdca14efc91805d92ef1047e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:48.650996  7949 raft_consensus.cc:993] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb: : Instructing follower 74d1986924254a7c8e2f3cdd2cef5150 to start an election
I20260709 13:15:48.651417  7949 raft_consensus.cc:1081] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 4 LEADER]: Signalling peer 74d1986924254a7c8e2f3cdd2cef5150 to start an election
I20260709 13:15:48.652750  7704 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87"
dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
 from {username='slave'} at 127.0.0.1:40548
I20260709 13:15:48.653205  7704 raft_consensus.cc:493] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:48.653509  7704 raft_consensus.cc:3060] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:48.657323  7704 raft_consensus.cc:515] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:48.658810  7704 leader_election.cc:290] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 5 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:48.659613  7627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
I20260709 13:15:48.659824  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6c32b30f30451aa1c95c8269738a87" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:48.660166  7627 raft_consensus.cc:3055] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:48.660384  7777 raft_consensus.cc:3060] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:48.660485  7627 raft_consensus.cc:740] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:48.661288  7627 consensus_queue.cc:260] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:48.662452  7627 raft_consensus.cc:3060] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:48.666618  7777 raft_consensus.cc:2468] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 5.
I20260709 13:15:48.667903  7668 leader_election.cc:304] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, 74d1986924254a7c8e2f3cdd2cef5150; no voters: 
I20260709 13:15:48.668499  7627 raft_consensus.cc:2468] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 5.
I20260709 13:15:48.668900  7955 raft_consensus.cc:2804] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:48.670184  7955 raft_consensus.cc:697] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 5 LEADER]: Becoming Leader. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:48.671110  7955 consensus_queue.cc:237] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:48.677718  7524 catalog_manager.cc:5697] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 reported cstate change: term changed from 4 to 5, leader changed from c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129) to 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130). New cstate: current_term: 5 leader_uuid: "74d1986924254a7c8e2f3cdd2cef5150" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.776089  7936 raft_consensus.cc:993] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb: : Instructing follower 3bb1879bdca14efc91805d92ef1047e1 to start an election
I20260709 13:15:48.776515  7949 raft_consensus.cc:1081] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 LEADER]: Signalling peer 3bb1879bdca14efc91805d92ef1047e1 to start an election
I20260709 13:15:48.777751  7777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63fb8aace3b04293840c69f688cc1136"
dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
 from {username='slave'} at 127.0.0.1:35446
I20260709 13:15:48.778234  7777 raft_consensus.cc:493] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:48.778512  7777 raft_consensus.cc:3060] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:48.782562  7777 raft_consensus.cc:515] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:48.783897  7777 leader_election.cc:290] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 2 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130:40141)
I20260709 13:15:48.784845  7704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fb8aace3b04293840c69f688cc1136" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
I20260709 13:15:48.784770  7627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fb8aace3b04293840c69f688cc1136" candidate_uuid: "3bb1879bdca14efc91805d92ef1047e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
I20260709 13:15:48.785478  7704 raft_consensus.cc:3060] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:48.785568  7627 raft_consensus.cc:3055] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:48.785996  7627 raft_consensus.cc:740] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:48.786711  7627 consensus_queue.cc:260] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:48.787868  7627 raft_consensus.cc:3060] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:48.789496  7936 raft_consensus.cc:993] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb: : Instructing follower 74d1986924254a7c8e2f3cdd2cef5150 to start an election
I20260709 13:15:48.789915  7949 raft_consensus.cc:1081] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Signalling peer 74d1986924254a7c8e2f3cdd2cef5150 to start an election
I20260709 13:15:48.790900  7704 raft_consensus.cc:2468] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1879bdca14efc91805d92ef1047e1 in term 2.
I20260709 13:15:48.791486  7703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "702bc4ee168244e4acf0b33636235024"
dest_uuid: "74d1986924254a7c8e2f3cdd2cef5150"
 from {username='slave'} at 127.0.0.1:40548
I20260709 13:15:48.791869  7744 leader_election.cc:304] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, 74d1986924254a7c8e2f3cdd2cef5150; no voters: 
I20260709 13:15:48.792032  7703 raft_consensus.cc:493] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:48.792428  7703 raft_consensus.cc:3060] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.792637  7930 raft_consensus.cc:2804] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:48.793159  7930 raft_consensus.cc:697] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 LEADER]: Becoming Leader. State: Replica: 3bb1879bdca14efc91805d92ef1047e1, State: Running, Role: LEADER
I20260709 13:15:48.793524  7627 raft_consensus.cc:2468] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1879bdca14efc91805d92ef1047e1 in term 2.
I20260709 13:15:48.793928  7930 consensus_queue.cc:237] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:48.797312  7703 raft_consensus.cc:515] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:48.799443  7703 leader_election.cc:290] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 3 election: Requested vote from peers c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303), 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131:46335)
I20260709 13:15:48.800060  7627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702bc4ee168244e4acf0b33636235024" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb"
I20260709 13:15:48.800395  7777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702bc4ee168244e4acf0b33636235024" candidate_uuid: "74d1986924254a7c8e2f3cdd2cef5150" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bb1879bdca14efc91805d92ef1047e1"
I20260709 13:15:48.800612  7627 raft_consensus.cc:3055] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:48.800904  7627 raft_consensus.cc:740] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c72b4670cb5b4e01b6aa33bf5b6644cb, State: Running, Role: LEADER
I20260709 13:15:48.800930  7777 raft_consensus.cc:3060] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.801476  7524 catalog_manager.cc:5697] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 reported cstate change: term changed from 1 to 2, leader changed from c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129) to 3bb1879bdca14efc91805d92ef1047e1 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "3bb1879bdca14efc91805d92ef1047e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:48.801687  7627 consensus_queue.cc:260] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:48.802778  7627 raft_consensus.cc:3060] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.807014  7777 raft_consensus.cc:2468] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 3.
I20260709 13:15:48.808239  7668 leader_election.cc:304] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1879bdca14efc91805d92ef1047e1, 74d1986924254a7c8e2f3cdd2cef5150; no voters: 
I20260709 13:15:48.808449  7627 raft_consensus.cc:2468] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74d1986924254a7c8e2f3cdd2cef5150 in term 3.
I20260709 13:15:48.808996  7955 raft_consensus.cc:2804] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:48.809516  7955 raft_consensus.cc:697] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 LEADER]: Becoming Leader. State: Replica: 74d1986924254a7c8e2f3cdd2cef5150, State: Running, Role: LEADER
I20260709 13:15:48.810197  7955 consensus_queue.cc:237] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } }
I20260709 13:15:48.816502  7524 catalog_manager.cc:5697] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 reported cstate change: term changed from 2 to 3, leader changed from c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129) to 74d1986924254a7c8e2f3cdd2cef5150 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "74d1986924254a7c8e2f3cdd2cef5150" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.928179  7627 raft_consensus.cc:1275] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Refusing update from remote peer 3bb1879bdca14efc91805d92ef1047e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:48.929486  7930 consensus_queue.cc:1048] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:48.939221  7703 raft_consensus.cc:1275] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Refusing update from remote peer 3bb1879bdca14efc91805d92ef1047e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:48.941131  7968 consensus_queue.cc:1048] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:49.085258  7627 raft_consensus.cc:1275] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 5 FOLLOWER]: Refusing update from remote peer 74d1986924254a7c8e2f3cdd2cef5150: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:49.086370  7955 consensus_queue.cc:1048] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c72b4670cb5b4e01b6aa33bf5b6644cb" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 42303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:49.095747  7777 raft_consensus.cc:1275] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 5 FOLLOWER]: Refusing update from remote peer 74d1986924254a7c8e2f3cdd2cef5150: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:49.097314  7973 consensus_queue.cc:1048] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:49.388501  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:49.394281  7002 tablet_server.cc:179] TabletServer@127.6.214.129:0 shutting down...
I20260709 13:15:49.399425  7703 raft_consensus.cc:1275] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Refusing update from remote peer 3bb1879bdca14efc91805d92ef1047e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:49.399907  7743 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260709 13:15:49.401484  7930 consensus_queue.cc:1048] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d1986924254a7c8e2f3cdd2cef5150" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:49.405761  7743 consensus_peers.cc:597] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 -> Peer c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303): Couldn't send request to peer c72b4670cb5b4e01b6aa33bf5b6644cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:49.410117  7777 raft_consensus.cc:1275] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Refusing update from remote peer 74d1986924254a7c8e2f3cdd2cef5150: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:49.414284  7973 consensus_queue.cc:1048] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1879bdca14efc91805d92ef1047e1" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:15:49.420274  7743 consensus_peers.cc:597] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 -> Peer c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303): Couldn't send request to peer c72b4670cb5b4e01b6aa33bf5b6644cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:49.446266  7669 consensus_peers.cc:597] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 -> Peer c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303): Couldn't send request to peer c72b4670cb5b4e01b6aa33bf5b6644cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:49.458766  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:49.459940  7002 tablet_replica.cc:333] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb: stopping tablet replica
I20260709 13:15:49.460826  7002 raft_consensus.cc:2243] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.461611  7002 raft_consensus.cc:2272] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.464059  7002 tablet_replica.cc:333] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb: stopping tablet replica
I20260709 13:15:49.464651  7002 raft_consensus.cc:2243] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.465099  7002 raft_consensus.cc:2272] T ac6c32b30f30451aa1c95c8269738a87 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.467739  7002 tablet_replica.cc:333] T 1910b60b6df94e0b8cb445ca2f6d0047 P c72b4670cb5b4e01b6aa33bf5b6644cb: stopping tablet replica
I20260709 13:15:49.468314  7002 raft_consensus.cc:2243] T 1910b60b6df94e0b8cb445ca2f6d0047 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.468760  7002 raft_consensus.cc:2272] T 1910b60b6df94e0b8cb445ca2f6d0047 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.470569  7002 tablet_replica.cc:333] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb: stopping tablet replica
I20260709 13:15:49.471200  7002 raft_consensus.cc:2243] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.471664  7002 raft_consensus.cc:2272] T e54c9b6f80504fa9956fc3ad067dbc21 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.474606  7002 tablet_replica.cc:333] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb: stopping tablet replica
I20260709 13:15:49.475366  7002 raft_consensus.cc:2243] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:49.476243  7002 raft_consensus.cc:2272] T fe073b6bddd0413ebe268077052b0788 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.478657  7002 tablet_replica.cc:333] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb: stopping tablet replica
I20260709 13:15:49.479209  7002 raft_consensus.cc:2243] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:49.479933  7002 raft_consensus.cc:2272] T d9feefdd7b53416ebc44f6ebbf656729 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.481885  7002 tablet_replica.cc:333] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb: stopping tablet replica
I20260709 13:15:49.482438  7002 raft_consensus.cc:2243] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:49.483237  7002 raft_consensus.cc:2272] T 81fc76e522454f429fdf052091879f54 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.484982  7002 tablet_replica.cc:333] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb: stopping tablet replica
I20260709 13:15:49.485597  7002 raft_consensus.cc:2243] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.485994  7002 raft_consensus.cc:2272] T 702bc4ee168244e4acf0b33636235024 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.487754  7002 tablet_replica.cc:333] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb: stopping tablet replica
I20260709 13:15:49.488310  7002 raft_consensus.cc:2243] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:49.489081  7002 raft_consensus.cc:2272] T 292de7734639434eacd4fb6c6dd91b26 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.490957  7002 tablet_replica.cc:333] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb: stopping tablet replica
I20260709 13:15:49.491453  7002 raft_consensus.cc:2243] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.491863  7002 raft_consensus.cc:2272] T 63fb8aace3b04293840c69f688cc1136 P c72b4670cb5b4e01b6aa33bf5b6644cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.520453  7002 tablet_server.cc:196] TabletServer@127.6.214.129:0 shutdown complete.
I20260709 13:15:49.540884  7002 tablet_server.cc:179] TabletServer@127.6.214.130:0 shutting down...
W20260709 13:15:49.564733  7743 consensus_peers.cc:597] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 -> Peer c72b4670cb5b4e01b6aa33bf5b6644cb (127.6.214.129:42303): Couldn't send request to peer c72b4670cb5b4e01b6aa33bf5b6644cb. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:42303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:49.568279  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:49.568998  7002 tablet_replica.cc:333] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150: stopping tablet replica
I20260709 13:15:49.569615  7002 raft_consensus.cc:2243] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:49.570286  7002 raft_consensus.cc:2272] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.572084  7002 tablet_replica.cc:333] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150: stopping tablet replica
I20260709 13:15:49.572536  7002 raft_consensus.cc:2243] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:15:49.573271  7002 raft_consensus.cc:2272] T ac6c32b30f30451aa1c95c8269738a87 P 74d1986924254a7c8e2f3cdd2cef5150 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.575103  7002 tablet_replica.cc:333] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150: stopping tablet replica
I20260709 13:15:49.575536  7002 raft_consensus.cc:2243] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.575872  7002 raft_consensus.cc:2272] T 292de7734639434eacd4fb6c6dd91b26 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.577194  7002 tablet_replica.cc:333] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150: stopping tablet replica
I20260709 13:15:49.577674  7002 raft_consensus.cc:2243] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.577994  7002 raft_consensus.cc:2272] T 63fb8aace3b04293840c69f688cc1136 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.579805  7002 tablet_replica.cc:333] T 1910b60b6df94e0b8cb445ca2f6d0047 P 74d1986924254a7c8e2f3cdd2cef5150: stopping tablet replica
I20260709 13:15:49.580253  7002 raft_consensus.cc:2243] T 1910b60b6df94e0b8cb445ca2f6d0047 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.580739  7002 raft_consensus.cc:2272] T 1910b60b6df94e0b8cb445ca2f6d0047 P 74d1986924254a7c8e2f3cdd2cef5150 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.582953  7002 tablet_replica.cc:333] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150: stopping tablet replica
I20260709 13:15:49.583597  7002 raft_consensus.cc:2243] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.584216  7002 raft_consensus.cc:2272] T e54c9b6f80504fa9956fc3ad067dbc21 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.586705  7002 tablet_replica.cc:333] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150: stopping tablet replica
I20260709 13:15:49.587332  7002 raft_consensus.cc:2243] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.587790  7002 raft_consensus.cc:2272] T fe073b6bddd0413ebe268077052b0788 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.590067  7002 tablet_replica.cc:333] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150: stopping tablet replica
I20260709 13:15:49.590683  7002 raft_consensus.cc:2243] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:49.591634  7002 raft_consensus.cc:2272] T 702bc4ee168244e4acf0b33636235024 P 74d1986924254a7c8e2f3cdd2cef5150 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.593988  7002 tablet_replica.cc:333] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150: stopping tablet replica
I20260709 13:15:49.594604  7002 raft_consensus.cc:2243] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.595084  7002 raft_consensus.cc:2272] T 81fc76e522454f429fdf052091879f54 P 74d1986924254a7c8e2f3cdd2cef5150 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.596534  7002 tablet_replica.cc:333] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150: stopping tablet replica
I20260709 13:15:49.596912  7002 raft_consensus.cc:2243] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.597232  7002 raft_consensus.cc:2272] T d9feefdd7b53416ebc44f6ebbf656729 P 74d1986924254a7c8e2f3cdd2cef5150 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.625046  7002 tablet_server.cc:196] TabletServer@127.6.214.130:0 shutdown complete.
I20260709 13:15:49.642410  7002 tablet_server.cc:179] TabletServer@127.6.214.131:0 shutting down...
I20260709 13:15:49.665817  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:49.666570  7002 tablet_replica.cc:333] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1: stopping tablet replica
I20260709 13:15:49.667237  7002 raft_consensus.cc:2243] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.667667  7002 raft_consensus.cc:2272] T d9feefdd7b53416ebc44f6ebbf656729 P 3bb1879bdca14efc91805d92ef1047e1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.669252  7002 tablet_replica.cc:333] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1: stopping tablet replica
I20260709 13:15:49.669837  7002 raft_consensus.cc:2243] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.670251  7002 raft_consensus.cc:2272] T 702bc4ee168244e4acf0b33636235024 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.672571  7002 tablet_replica.cc:333] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1: stopping tablet replica
I20260709 13:15:49.673156  7002 raft_consensus.cc:2243] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.673643  7002 raft_consensus.cc:2272] T 81fc76e522454f429fdf052091879f54 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.675292  7002 tablet_replica.cc:333] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1: stopping tablet replica
I20260709 13:15:49.675799  7002 raft_consensus.cc:2243] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:49.676523  7002 raft_consensus.cc:2272] T 1910b60b6df94e0b8cb445ca2f6d0047 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.678247  7002 tablet_replica.cc:333] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1: stopping tablet replica
I20260709 13:15:49.678723  7002 raft_consensus.cc:2243] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.679118  7002 raft_consensus.cc:2272] T fe073b6bddd0413ebe268077052b0788 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.680609  7002 tablet_replica.cc:333] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1: stopping tablet replica
I20260709 13:15:49.681079  7002 raft_consensus.cc:2243] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:49.681810  7002 raft_consensus.cc:2272] T e54c9b6f80504fa9956fc3ad067dbc21 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.683601  7002 tablet_replica.cc:333] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1: stopping tablet replica
I20260709 13:15:49.684098  7002 raft_consensus.cc:2243] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:49.684759  7002 raft_consensus.cc:2272] T 63fb8aace3b04293840c69f688cc1136 P 3bb1879bdca14efc91805d92ef1047e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.686574  7002 tablet_replica.cc:333] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1: stopping tablet replica
I20260709 13:15:49.687026  7002 raft_consensus.cc:2243] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.687435  7002 raft_consensus.cc:2272] T 292de7734639434eacd4fb6c6dd91b26 P 3bb1879bdca14efc91805d92ef1047e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.688856  7002 tablet_replica.cc:333] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1: stopping tablet replica
I20260709 13:15:49.689285  7002 raft_consensus.cc:2243] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.689677  7002 raft_consensus.cc:2272] T 1f09aa6221bd4163b9b2ecf3f370fbe2 P 3bb1879bdca14efc91805d92ef1047e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.691131  7002 tablet_replica.cc:333] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1: stopping tablet replica
I20260709 13:15:49.691555  7002 raft_consensus.cc:2243] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.691937  7002 raft_consensus.cc:2272] T ac6c32b30f30451aa1c95c8269738a87 P 3bb1879bdca14efc91805d92ef1047e1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.718988  7002 tablet_server.cc:196] TabletServer@127.6.214.131:0 shutdown complete.
I20260709 13:15:49.736421  7002 master.cc:562] Master@127.6.214.190:39717 shutting down...
I20260709 13:15:49.850106  7002 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:49.850603  7002 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:49.850874  7002 tablet_replica.cc:333] T 00000000000000000000000000000000 P bb556d093eb74553a8a83637adbd8011: stopping tablet replica
I20260709 13:15:49.870250  7002 master.cc:584] Master@127.6.214.190:39717 shutdown complete.
3bb1879bdca14efc91805d92ef1047e1  1
74d1986924254a7c8e2f3cdd2cef5150  4
c72b4670cb5b4e01b6aa33bf5b6644cb  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10586 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:15:49.911072  7002 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.214.190:45311
I20260709 13:15:49.912266  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:49.917762  7981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:49.918443  7982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:49.919118  7984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:49.920300  7002 server_base.cc:1061] running on GCE node
I20260709 13:15:49.921159  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:49.921335  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:49.921526  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783602949921510 us; error 0 us; skew 500 ppm
I20260709 13:15:49.922271  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:49.924829  7002 webserver.cc:533] Webserver started at http://127.6.214.190:36511/ using document root <none> and password file <none>
I20260709 13:15:49.925278  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:49.925482  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:49.925734  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:49.926785  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/master-0-root/instance:
uuid: "e5e50b3438e24144a9523cb9ae40543f"
format_stamp: "Formatted at 2026-07-09 13:15:49 on dist-test-slave-rnv4"
I20260709 13:15:49.931177  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:15:49.934481  7989 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:49.935274  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:49.935540  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/master-0-root
uuid: "e5e50b3438e24144a9523cb9ae40543f"
format_stamp: "Formatted at 2026-07-09 13:15:49 on dist-test-slave-rnv4"
I20260709 13:15:49.935858  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:49.991245  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:49.992506  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:50.030484  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.190:45311
I20260709 13:15:50.030606  8040 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.190:45311 every 8 connection(s)
I20260709 13:15:50.034745  8041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.044329  8041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Bootstrap starting.
I20260709 13:15:50.048856  8041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:50.053166  8041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: No bootstrap required, opened a new log
I20260709 13:15:50.055325  8041 raft_consensus.cc:359] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e50b3438e24144a9523cb9ae40543f" member_type: VOTER }
I20260709 13:15:50.055763  8041 raft_consensus.cc:385] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:50.055996  8041 raft_consensus.cc:740] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5e50b3438e24144a9523cb9ae40543f, State: Initialized, Role: FOLLOWER
I20260709 13:15:50.056612  8041 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e50b3438e24144a9523cb9ae40543f" member_type: VOTER }
I20260709 13:15:50.057289  8041 raft_consensus.cc:399] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:50.057619  8041 raft_consensus.cc:493] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:50.057930  8041 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:50.062089  8041 raft_consensus.cc:515] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e50b3438e24144a9523cb9ae40543f" member_type: VOTER }
I20260709 13:15:50.062620  8041 leader_election.cc:304] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5e50b3438e24144a9523cb9ae40543f; no voters: 
I20260709 13:15:50.063850  8041 leader_election.cc:290] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:50.064249  8044 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:50.065614  8044 raft_consensus.cc:697] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [term 1 LEADER]: Becoming Leader. State: Replica: e5e50b3438e24144a9523cb9ae40543f, State: Running, Role: LEADER
I20260709 13:15:50.066207  8044 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e50b3438e24144a9523cb9ae40543f" member_type: VOTER }
I20260709 13:15:50.066788  8041 sys_catalog.cc:565] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:50.070600  8046 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5e50b3438e24144a9523cb9ae40543f. Latest consensus state: current_term: 1 leader_uuid: "e5e50b3438e24144a9523cb9ae40543f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e50b3438e24144a9523cb9ae40543f" member_type: VOTER } }
I20260709 13:15:50.071266  8046 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:50.070572  8045 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5e50b3438e24144a9523cb9ae40543f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5e50b3438e24144a9523cb9ae40543f" member_type: VOTER } }
I20260709 13:15:50.072386  8045 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:50.074429  8051 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:50.079444  8051 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:50.082880  7002 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:50.089316  8051 catalog_manager.cc:1383] Generated new cluster ID: 65b2e0d4d3284f2ea38134f2fad76fcc
I20260709 13:15:50.089679  8051 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:50.109083  8051 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:50.110308  8051 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:50.121500  8051 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Generated new TSK 0
I20260709 13:15:50.122108  8051 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:50.150717  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:50.156749  8062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:50.157652  8063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:50.159880  8065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:50.159936  7002 server_base.cc:1061] running on GCE node
I20260709 13:15:50.161141  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:50.161320  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:50.161592  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783602950161573 us; error 0 us; skew 500 ppm
I20260709 13:15:50.162128  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:50.164443  7002 webserver.cc:533] Webserver started at http://127.6.214.129:45863/ using document root <none> and password file <none>
I20260709 13:15:50.164919  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:50.165114  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:50.165381  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:50.166466  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/instance:
uuid: "9480609eccc44250a4d7fcc9686e76cf"
format_stamp: "Formatted at 2026-07-09 13:15:50 on dist-test-slave-rnv4"
I20260709 13:15:50.171237  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:15:50.174646  8070 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:50.175426  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:15:50.175760  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root
uuid: "9480609eccc44250a4d7fcc9686e76cf"
format_stamp: "Formatted at 2026-07-09 13:15:50 on dist-test-slave-rnv4"
I20260709 13:15:50.176059  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:50.196224  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:50.197571  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:50.199061  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:50.201539  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:50.201763  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:50.201999  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:50.202188  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:50.245074  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.129:45123
I20260709 13:15:50.245149  8132 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.129:45123 every 8 connection(s)
I20260709 13:15:50.249923  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:50.256567  8137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:50.257632  8138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:50.259727  8140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:50.261699  7002 server_base.cc:1061] running on GCE node
I20260709 13:15:50.262573  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:50.262751  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:50.262874  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783602950262863 us; error 0 us; skew 500 ppm
I20260709 13:15:50.263319  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:50.265588  7002 webserver.cc:533] Webserver started at http://127.6.214.130:36587/ using document root <none> and password file <none>
I20260709 13:15:50.266012  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:50.266160  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:50.266353  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:50.267364  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-1-root/instance:
uuid: "9bd264598fd2483e9e17674bab9ba4e8"
format_stamp: "Formatted at 2026-07-09 13:15:50 on dist-test-slave-rnv4"
I20260709 13:15:50.270888  8133 heartbeater.cc:344] Connected to a master server at 127.6.214.190:45311
I20260709 13:15:50.271342  8133 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:50.272359  8133 heartbeater.cc:507] Master 127.6.214.190:45311 requested a full tablet report, sending...
I20260709 13:15:50.272945  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 13:15:50.274791  8006 ts_manager.cc:194] Registered new tserver with Master: 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123)
I20260709 13:15:50.277103  8145 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:50.277143  8006 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39810
I20260709 13:15:50.278350  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:50.278710  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-1-root
uuid: "9bd264598fd2483e9e17674bab9ba4e8"
format_stamp: "Formatted at 2026-07-09 13:15:50 on dist-test-slave-rnv4"
I20260709 13:15:50.278990  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:50.300690  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:50.302138  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:50.303761  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:50.306299  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:50.306562  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:50.306883  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:50.307108  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:50.351866  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.130:46389
I20260709 13:15:50.351987  8207 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.130:46389 every 8 connection(s)
I20260709 13:15:50.356773  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:50.364280  8211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:50.364369  8212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:50.368844  8214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:50.369086  7002 server_base.cc:1061] running on GCE node
I20260709 13:15:50.370029  8208 heartbeater.cc:344] Connected to a master server at 127.6.214.190:45311
I20260709 13:15:50.370168  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:50.370486  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:50.370472  8208 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:50.370857  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783602950370834 us; error 0 us; skew 500 ppm
I20260709 13:15:50.371559  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:50.371564  8208 heartbeater.cc:507] Master 127.6.214.190:45311 requested a full tablet report, sending...
I20260709 13:15:50.374384  8006 ts_manager.cc:194] Registered new tserver with Master: 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:50.374694  7002 webserver.cc:533] Webserver started at http://127.6.214.131:45137/ using document root <none> and password file <none>
I20260709 13:15:50.375358  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:50.375602  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:50.375921  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:50.376282  8006 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39814
I20260709 13:15:50.377673  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-2-root/instance:
uuid: "a0f96c12124b4e1a816d9fa970464091"
format_stamp: "Formatted at 2026-07-09 13:15:50 on dist-test-slave-rnv4"
I20260709 13:15:50.382581  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:50.386023  8219 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:50.386785  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:15:50.387092  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-2-root
uuid: "a0f96c12124b4e1a816d9fa970464091"
format_stamp: "Formatted at 2026-07-09 13:15:50 on dist-test-slave-rnv4"
I20260709 13:15:50.387391  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:50.413259  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:50.414528  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:50.416054  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:50.418349  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:50.418588  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:50.418831  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:50.419004  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:50.460544  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.131:45561
I20260709 13:15:50.460669  8281 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.131:45561 every 8 connection(s)
I20260709 13:15:50.475368  8282 heartbeater.cc:344] Connected to a master server at 127.6.214.190:45311
I20260709 13:15:50.475745  8282 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:50.476526  8282 heartbeater.cc:507] Master 127.6.214.190:45311 requested a full tablet report, sending...
I20260709 13:15:50.478550  8006 ts_manager.cc:194] Registered new tserver with Master: a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:50.478788  7002 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015042383s
I20260709 13:15:50.479871  8006 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39828
I20260709 13:15:50.503891  8006 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39830:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:50.510006  8006 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:50.710232  8098 tablet_service.cc:1511] Processing CreateTablet for tablet 5328e1082b164f3dbf9bdbb846c37b26 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:50.711666  8098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5328e1082b164f3dbf9bdbb846c37b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.715196  8097 tablet_service.cc:1511] Processing CreateTablet for tablet 17d4c6719ffc4a51a444f84eff0c28b7 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:50.715814  8096 tablet_service.cc:1511] Processing CreateTablet for tablet b491e7c261394e498f940b0169e957b6 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:50.716670  8097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d4c6719ffc4a51a444f84eff0c28b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.717325  8096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b491e7c261394e498f940b0169e957b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.718005  8095 tablet_service.cc:1511] Processing CreateTablet for tablet a64e531fcf0742cd8db17f008824d588 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:50.718819  8247 tablet_service.cc:1511] Processing CreateTablet for tablet 5328e1082b164f3dbf9bdbb846c37b26 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:50.719349  8095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a64e531fcf0742cd8db17f008824d588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.720088  8247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5328e1082b164f3dbf9bdbb846c37b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.721558  8173 tablet_service.cc:1511] Processing CreateTablet for tablet 5328e1082b164f3dbf9bdbb846c37b26 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:50.722931  8173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5328e1082b164f3dbf9bdbb846c37b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.722693  8245 tablet_service.cc:1511] Processing CreateTablet for tablet b491e7c261394e498f940b0169e957b6 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:50.722877  8094 tablet_service.cc:1511] Processing CreateTablet for tablet dded0a12a5b14bc38c2b5ac21e951545 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:50.724046  8094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dded0a12a5b14bc38c2b5ac21e951545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.723788  8169 tablet_service.cc:1511] Processing CreateTablet for tablet dded0a12a5b14bc38c2b5ac21e951545 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:50.725071  8169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dded0a12a5b14bc38c2b5ac21e951545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.725205  8244 tablet_service.cc:1511] Processing CreateTablet for tablet a64e531fcf0742cd8db17f008824d588 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:50.726567  8093 tablet_service.cc:1511] Processing CreateTablet for tablet 093d3bfbbaf542b5aa9ecd4e865ff155 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:50.726821  8172 tablet_service.cc:1511] Processing CreateTablet for tablet 17d4c6719ffc4a51a444f84eff0c28b7 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:50.727878  8093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 093d3bfbbaf542b5aa9ecd4e865ff155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.728552  8172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d4c6719ffc4a51a444f84eff0c28b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.729236  8242 tablet_service.cc:1511] Processing CreateTablet for tablet 093d3bfbbaf542b5aa9ecd4e865ff155 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:50.730357  8168 tablet_service.cc:1511] Processing CreateTablet for tablet 093d3bfbbaf542b5aa9ecd4e865ff155 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:50.730505  8091 tablet_service.cc:1511] Processing CreateTablet for tablet 7588eb91ce3841808ca10d7985976be2 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:50.731737  8168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 093d3bfbbaf542b5aa9ecd4e865ff155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.731392  8241 tablet_service.cc:1511] Processing CreateTablet for tablet 82a8e4371bab42f3a4d150da194ce8bd (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:50.731829  8091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7588eb91ce3841808ca10d7985976be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.731518  8170 tablet_service.cc:1511] Processing CreateTablet for tablet a64e531fcf0742cd8db17f008824d588 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:50.732864  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a64e531fcf0742cd8db17f008824d588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.730357  8171 tablet_service.cc:1511] Processing CreateTablet for tablet b491e7c261394e498f940b0169e957b6 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:50.734512  8092 tablet_service.cc:1511] Processing CreateTablet for tablet 82a8e4371bab42f3a4d150da194ce8bd (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:50.735531  8171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b491e7c261394e498f940b0169e957b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.735842  8092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a8e4371bab42f3a4d150da194ce8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.733795  8246 tablet_service.cc:1511] Processing CreateTablet for tablet 17d4c6719ffc4a51a444f84eff0c28b7 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:50.727479  8243 tablet_service.cc:1511] Processing CreateTablet for tablet dded0a12a5b14bc38c2b5ac21e951545 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:50.724040  8245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b491e7c261394e498f940b0169e957b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.742082  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a64e531fcf0742cd8db17f008824d588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.742718  8243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dded0a12a5b14bc38c2b5ac21e951545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.744021  8246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d4c6719ffc4a51a444f84eff0c28b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.746441  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a8e4371bab42f3a4d150da194ce8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.747172  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 093d3bfbbaf542b5aa9ecd4e865ff155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.766595  8167 tablet_service.cc:1511] Processing CreateTablet for tablet 82a8e4371bab42f3a4d150da194ce8bd (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:50.768067  8167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a8e4371bab42f3a4d150da194ce8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.816097  8298 tablet_bootstrap.cc:492] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:50.822427  8297 tablet_bootstrap.cc:492] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:50.830682  8167 tablet_service.cc:1511] Processing CreateTablet for tablet 7588eb91ce3841808ca10d7985976be2 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:50.832069  8167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7588eb91ce3841808ca10d7985976be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.839687  8247 tablet_service.cc:1511] Processing CreateTablet for tablet 7588eb91ce3841808ca10d7985976be2 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:50.842933  8247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7588eb91ce3841808ca10d7985976be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.855264  8297 tablet_bootstrap.cc:654] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:50.861660  8095 tablet_service.cc:1511] Processing CreateTablet for tablet 5d69cb3874984241afb1521d6e9178f2 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:50.861904  8168 tablet_service.cc:1511] Processing CreateTablet for tablet 5d69cb3874984241afb1521d6e9178f2 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:50.863101  8095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d69cb3874984241afb1521d6e9178f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.863131  8168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d69cb3874984241afb1521d6e9178f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.877130  8242 tablet_service.cc:1511] Processing CreateTablet for tablet 5d69cb3874984241afb1521d6e9178f2 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:50.878748  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d69cb3874984241afb1521d6e9178f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.883332  8170 tablet_service.cc:1511] Processing CreateTablet for tablet 73b079a720af4d478dba8d608aeb9059 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:50.883939  8246 tablet_service.cc:1511] Processing CreateTablet for tablet 73b079a720af4d478dba8d608aeb9059 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:50.884816  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b079a720af4d478dba8d608aeb9059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.888664  8298 tablet_bootstrap.cc:654] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:50.889544  8090 tablet_service.cc:1511] Processing CreateTablet for tablet 3393bfbad81242a2a3374049ddfa0b63 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:50.892899  8090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3393bfbad81242a2a3374049ddfa0b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.885335  8246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b079a720af4d478dba8d608aeb9059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.893957  8169 tablet_service.cc:1511] Processing CreateTablet for tablet 3393bfbad81242a2a3374049ddfa0b63 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:50.895241  8169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3393bfbad81242a2a3374049ddfa0b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.903467  8244 tablet_service.cc:1511] Processing CreateTablet for tablet 3393bfbad81242a2a3374049ddfa0b63 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:50.904950  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3393bfbad81242a2a3374049ddfa0b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.890818  8093 tablet_service.cc:1511] Processing CreateTablet for tablet 73b079a720af4d478dba8d608aeb9059 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:50.908869  8093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b079a720af4d478dba8d608aeb9059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.909157  8089 tablet_service.cc:1511] Processing CreateTablet for tablet c0190f54981846a5a2a1df128af42b35 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:50.915678  8299 tablet_bootstrap.cc:492] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:50.917888  8089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0190f54981846a5a2a1df128af42b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.943393  8169 tablet_service.cc:1511] Processing CreateTablet for tablet c0190f54981846a5a2a1df128af42b35 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:50.944886  8169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0190f54981846a5a2a1df128af42b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.952056  8243 tablet_service.cc:1511] Processing CreateTablet for tablet 5247aeecdc5c4ebf8516da3b94073f35 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:50.952276  8092 tablet_service.cc:1511] Processing CreateTablet for tablet fbd85d0f27664dc8a33e2cdf0fd4ebdb (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:50.953672  8092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd85d0f27664dc8a33e2cdf0fd4ebdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.955946  8240 tablet_service.cc:1511] Processing CreateTablet for tablet fbd85d0f27664dc8a33e2cdf0fd4ebdb (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:50.958482  8239 tablet_service.cc:1511] Processing CreateTablet for tablet 3e96746d2ece4e52ab82eca0737daf2e (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:50.961591  8166 tablet_service.cc:1511] Processing CreateTablet for tablet 8dca4b8aebe74578b370a72879bb9bba (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:50.963104  8166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dca4b8aebe74578b370a72879bb9bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.963174  8093 tablet_service.cc:1511] Processing CreateTablet for tablet 3e96746d2ece4e52ab82eca0737daf2e (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:50.964628  8093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e96746d2ece4e52ab82eca0737daf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.966256  8238 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf7f11a5f324770a352a6a29f56ebf4 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:50.966775  8171 tablet_service.cc:1511] Processing CreateTablet for tablet 3e96746d2ece4e52ab82eca0737daf2e (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:50.967788  8243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5247aeecdc5c4ebf8516da3b94073f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.968223  8171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e96746d2ece4e52ab82eca0737daf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.968884  8096 tablet_service.cc:1511] Processing CreateTablet for tablet 8dca4b8aebe74578b370a72879bb9bba (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:50.970249  8096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dca4b8aebe74578b370a72879bb9bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.970731  8165 tablet_service.cc:1511] Processing CreateTablet for tablet e0aa1a34518f4bbdb1d1676b4a1541d8 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:50.973480  8165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0aa1a34518f4bbdb1d1676b4a1541d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.974090  8094 tablet_service.cc:1511] Processing CreateTablet for tablet e0aa1a34518f4bbdb1d1676b4a1541d8 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:50.975452  8094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0aa1a34518f4bbdb1d1676b4a1541d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.977893  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf7f11a5f324770a352a6a29f56ebf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.978657  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd85d0f27664dc8a33e2cdf0fd4ebdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.980172  8239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e96746d2ece4e52ab82eca0737daf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.981665  8242 tablet_service.cc:1511] Processing CreateTablet for tablet 8dca4b8aebe74578b370a72879bb9bba (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:50.983383  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dca4b8aebe74578b370a72879bb9bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:50.984308  8297 tablet_bootstrap.cc:492] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:50.987602  8170 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf7f11a5f324770a352a6a29f56ebf4 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:50.990082  8298 tablet_bootstrap.cc:492] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:50.997447  8298 ts_tablet_manager.cc:1403] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.182s	user 0.015s	sys 0.002s
I20260709 13:15:50.999601  8173 tablet_service.cc:1511] Processing CreateTablet for tablet fbd85d0f27664dc8a33e2cdf0fd4ebdb (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:50.992655  8299 tablet_bootstrap.cc:654] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:50.964915  8097 tablet_service.cc:1511] Processing CreateTablet for tablet 5247aeecdc5c4ebf8516da3b94073f35 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:51.008564  8097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5247aeecdc5c4ebf8516da3b94073f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.000274  8298 raft_consensus.cc:359] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.008977  8298 raft_consensus.cc:385] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:51.009280  8298 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:51.009994  8298 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:50.990022  8091 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf7f11a5f324770a352a6a29f56ebf4 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:51.002058  8297 ts_tablet_manager.cc:1403] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.180s	user 0.005s	sys 0.012s
I20260709 13:15:51.013752  8091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf7f11a5f324770a352a6a29f56ebf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.014099  8297 raft_consensus.cc:359] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.014848  8297 raft_consensus.cc:385] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:51.000555  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf7f11a5f324770a352a6a29f56ebf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.025528  8297 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:51.026582  8297 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.030086  8173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd85d0f27664dc8a33e2cdf0fd4ebdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.067152  8298 ts_tablet_manager.cc:1434] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.069s	user 0.018s	sys 0.005s
I20260709 13:15:51.067092  8208 heartbeater.cc:499] Master 127.6.214.190:45311 was elected leader, sending a full tablet report...
I20260709 13:15:51.078923  8297 ts_tablet_manager.cc:1434] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.067s	user 0.016s	sys 0.029s
W20260709 13:15:51.082291  8054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:51.083264  8282 heartbeater.cc:499] Master 127.6.214.190:45311 was elected leader, sending a full tablet report...
I20260709 13:15:51.080358  8298 tablet_bootstrap.cc:492] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:51.094992  8172 tablet_service.cc:1511] Processing CreateTablet for tablet 5247aeecdc5c4ebf8516da3b94073f35 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:51.095733  8299 tablet_bootstrap.cc:492] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:51.096268  8172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5247aeecdc5c4ebf8516da3b94073f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.096300  8299 ts_tablet_manager.cc:1403] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.181s	user 0.018s	sys 0.015s
I20260709 13:15:51.100051  8299 raft_consensus.cc:359] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.101744  8245 tablet_service.cc:1511] Processing CreateTablet for tablet c0190f54981846a5a2a1df128af42b35 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:51.107689  8245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0190f54981846a5a2a1df128af42b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.106129  8166 tablet_service.cc:1511] Processing CreateTablet for tablet aacbbdcc46cd40c0bf26d6ceb75d464d (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:51.102401  8096 tablet_service.cc:1511] Processing CreateTablet for tablet aacbbdcc46cd40c0bf26d6ceb75d464d (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:51.114876  8096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aacbbdcc46cd40c0bf26d6ceb75d464d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.113801  8304 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.116496  8304 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.117172  8168 tablet_service.cc:1511] Processing CreateTablet for tablet 09ff07a1f02d49f0923422e378a20d4a (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:51.119182  8167 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea7d5dc3d1d486a8f4ff9478d8fcefb (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:51.120138  8090 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea7d5dc3d1d486a8f4ff9478d8fcefb (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:51.121376  8090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea7d5dc3d1d486a8f4ff9478d8fcefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.122087  8089 tablet_service.cc:1511] Processing CreateTablet for tablet 6353b347875648eda7077a6a3bc633fd (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:51.122236  8170 tablet_service.cc:1511] Processing CreateTablet for tablet 6353b347875648eda7077a6a3bc633fd (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:51.119182  8244 tablet_service.cc:1511] Processing CreateTablet for tablet 09ff07a1f02d49f0923422e378a20d4a (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:51.123416  8089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6353b347875648eda7077a6a3bc633fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.123634  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ff07a1f02d49f0923422e378a20d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.125602  8095 tablet_service.cc:1511] Processing CreateTablet for tablet 440543aae4b54ad6aaca74cda8e88fb0 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:51.125746  8094 tablet_service.cc:1511] Processing CreateTablet for tablet 09ff07a1f02d49f0923422e378a20d4a (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:51.126264  8164 tablet_service.cc:1511] Processing CreateTablet for tablet 440543aae4b54ad6aaca74cda8e88fb0 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:51.127008  8095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440543aae4b54ad6aaca74cda8e88fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.128970  8241 tablet_service.cc:1511] Processing CreateTablet for tablet 440543aae4b54ad6aaca74cda8e88fb0 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:51.130932  8247 tablet_service.cc:1511] Processing CreateTablet for tablet 6353b347875648eda7077a6a3bc633fd (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:51.132761  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440543aae4b54ad6aaca74cda8e88fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.133785  8168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ff07a1f02d49f0923422e378a20d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.135131  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6353b347875648eda7077a6a3bc633fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.136492  8164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440543aae4b54ad6aaca74cda8e88fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.137933  8167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea7d5dc3d1d486a8f4ff9478d8fcefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.117201  8240 tablet_service.cc:1511] Processing CreateTablet for tablet aacbbdcc46cd40c0bf26d6ceb75d464d (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:51.140024  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aacbbdcc46cd40c0bf26d6ceb75d464d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.119283  8239 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea7d5dc3d1d486a8f4ff9478d8fcefb (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:51.142064  8094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09ff07a1f02d49f0923422e378a20d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.142386  8239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea7d5dc3d1d486a8f4ff9478d8fcefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.142536  8304 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:51.142891  8298 tablet_bootstrap.cc:654] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:51.144021  8299 raft_consensus.cc:385] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:51.144375  8299 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:51.146518  8247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6353b347875648eda7077a6a3bc633fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.146332  8299 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.165755  8297 tablet_bootstrap.cc:492] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:51.172032  8297 tablet_bootstrap.cc:654] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:51.179422  8091 tablet_service.cc:1511] Processing CreateTablet for tablet 264ed863486e43df8dfe1478dfb034ee (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:51.181298  8091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264ed863486e43df8dfe1478dfb034ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.176432  8166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aacbbdcc46cd40c0bf26d6ceb75d464d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.210340  8242 tablet_service.cc:1511] Processing CreateTablet for tablet e0aa1a34518f4bbdb1d1676b4a1541d8 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:51.233846  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0aa1a34518f4bbdb1d1676b4a1541d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.235612  8167 tablet_service.cc:1511] Processing CreateTablet for tablet 264ed863486e43df8dfe1478dfb034ee (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:51.237208  8167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264ed863486e43df8dfe1478dfb034ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.252825  8244 tablet_service.cc:1511] Processing CreateTablet for tablet 264ed863486e43df8dfe1478dfb034ee (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:51.254253  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264ed863486e43df8dfe1478dfb034ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.268739  8090 tablet_service.cc:1511] Processing CreateTablet for tablet bf53fff91826424990da23103f484232 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:51.270082  8090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf53fff91826424990da23103f484232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.270418  8238 tablet_service.cc:1511] Processing CreateTablet for tablet f3f32037b7b54a0c991d35bbea1b786b (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:51.268764  8169 tablet_service.cc:1511] Processing CreateTablet for tablet f3f32037b7b54a0c991d35bbea1b786b (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:51.271968  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f32037b7b54a0c991d35bbea1b786b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.272473  8169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f32037b7b54a0c991d35bbea1b786b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.273065  8240 tablet_service.cc:1511] Processing CreateTablet for tablet 45c332ea272c465d9e07083a06e802e7 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:51.274435  8089 tablet_service.cc:1511] Processing CreateTablet for tablet be8c836876cb41918064b2082dd48efe (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:51.274493  8243 tablet_service.cc:1511] Processing CreateTablet for tablet be8c836876cb41918064b2082dd48efe (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:51.275764  8089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be8c836876cb41918064b2082dd48efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.275456  8171 tablet_service.cc:1511] Processing CreateTablet for tablet be8c836876cb41918064b2082dd48efe (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:51.276643  8171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be8c836876cb41918064b2082dd48efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.270572  8093 tablet_service.cc:1511] Processing CreateTablet for tablet 98857d2610494fdda88f0508d2370cd7 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:51.278487  8098 tablet_service.cc:1511] Processing CreateTablet for tablet c362335b215641d38dd0c651acfb8fbb (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:51.278733  8165 tablet_service.cc:1511] Processing CreateTablet for tablet 98857d2610494fdda88f0508d2370cd7 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:51.279703  8093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98857d2610494fdda88f0508d2370cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.279942  8133 heartbeater.cc:499] Master 127.6.214.190:45311 was elected leader, sending a full tablet report...
I20260709 13:15:51.280249  8165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98857d2610494fdda88f0508d2370cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.276772  8246 tablet_service.cc:1511] Processing CreateTablet for tablet 98857d2610494fdda88f0508d2370cd7 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:51.278487  8092 tablet_service.cc:1511] Processing CreateTablet for tablet 45c332ea272c465d9e07083a06e802e7 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:51.282523  8092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c332ea272c465d9e07083a06e802e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.274427  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c332ea272c465d9e07083a06e802e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.285789  8098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c362335b215641d38dd0c651acfb8fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.286360  8243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be8c836876cb41918064b2082dd48efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.289821  8246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98857d2610494fdda88f0508d2370cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.294196  8096 tablet_service.cc:1511] Processing CreateTablet for tablet f3f32037b7b54a0c991d35bbea1b786b (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:51.295938  8096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f32037b7b54a0c991d35bbea1b786b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.302348  8241 tablet_service.cc:1511] Processing CreateTablet for tablet bf53fff91826424990da23103f484232 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:51.303704  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf53fff91826424990da23103f484232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.309504  8170 tablet_service.cc:1511] Processing CreateTablet for tablet 45c332ea272c465d9e07083a06e802e7 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:51.311268  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c332ea272c465d9e07083a06e802e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.318321  8173 tablet_service.cc:1511] Processing CreateTablet for tablet bf53fff91826424990da23103f484232 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:51.319656  8173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf53fff91826424990da23103f484232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.328495  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:15:51.330312  8223 leader_election.cc:343] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.343585  8298 tablet_bootstrap.cc:492] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:51.344097  8298 ts_tablet_manager.cc:1403] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.270s	user 0.019s	sys 0.007s
I20260709 13:15:51.347059  8298 raft_consensus.cc:359] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.353577  8298 raft_consensus.cc:385] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:51.353971  8298 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:51.354916  8298 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.355396  8164 tablet_service.cc:1511] Processing CreateTablet for tablet c362335b215641d38dd0c651acfb8fbb (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:51.356937  8164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c362335b215641d38dd0c651acfb8fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.363440  8239 tablet_service.cc:1511] Processing CreateTablet for tablet c362335b215641d38dd0c651acfb8fbb (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:51.364933  8239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c362335b215641d38dd0c651acfb8fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.369307  8097 tablet_service.cc:1511] Processing CreateTablet for tablet 6855110231054b5fa91235e8a822e101 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:51.363997  8298 ts_tablet_manager.cc:1434] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:15:51.399402  8310 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.399923  8310 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.402676  8299 ts_tablet_manager.cc:1434] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.305s	user 0.005s	sys 0.017s
I20260709 13:15:51.403689  8299 tablet_bootstrap.cc:492] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:51.411252  8245 tablet_service.cc:1511] Processing CreateTablet for tablet 6855110231054b5fa91235e8a822e101 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:51.412531  8245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6855110231054b5fa91235e8a822e101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.414541  8310 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:51.415235  8172 tablet_service.cc:1511] Processing CreateTablet for tablet 6855110231054b5fa91235e8a822e101 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:51.417623  8172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6855110231054b5fa91235e8a822e101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.417495  8089 tablet_service.cc:1511] Processing CreateTablet for tablet d3456040ac8e456eabcfa4db8a2b5510 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:51.417996  8298 tablet_bootstrap.cc:492] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:51.418570  8246 tablet_service.cc:1511] Processing CreateTablet for tablet 7c962bcd58c74013abdb370fa758d500 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:51.420214  8094 tablet_service.cc:1511] Processing CreateTablet for tablet cd035b4a624c4c7aa2257c2821868021 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:51.423436  8096 tablet_service.cc:1511] Processing CreateTablet for tablet 7c962bcd58c74013abdb370fa758d500 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:51.425001  8242 tablet_service.cc:1511] Processing CreateTablet for tablet d3456040ac8e456eabcfa4db8a2b5510 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:51.433599  8097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6855110231054b5fa91235e8a822e101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.434273  8094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd035b4a624c4c7aa2257c2821868021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.437704  8089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3456040ac8e456eabcfa4db8a2b5510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.441718  8303 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.442211  8303 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.453015  8246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c962bcd58c74013abdb370fa758d500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.472743  8303 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:51.472407  8241 tablet_service.cc:1511] Processing CreateTablet for tablet cd035b4a624c4c7aa2257c2821868021 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:51.473205  8297 tablet_bootstrap.cc:492] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:51.473765  8297 ts_tablet_manager.cc:1403] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.308s	user 0.003s	sys 0.009s
I20260709 13:15:51.475286  8298 tablet_bootstrap.cc:654] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:51.475831  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd035b4a624c4c7aa2257c2821868021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.476764  8297 raft_consensus.cc:359] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } }
I20260709 13:15:51.477545  8297 raft_consensus.cc:385] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:51.477852  8297 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:51.478664  8297 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } }
I20260709 13:15:51.481067  8297 ts_tablet_manager.cc:1434] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:15:51.482357  8247 tablet_service.cc:1511] Processing CreateTablet for tablet d0adcb7796ea47a4be5ddd094575ed19 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:51.485203  8090 tablet_service.cc:1511] Processing CreateTablet for tablet 6e8201b083554b0cb094760a4ff0fd39 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:51.487403  8247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0adcb7796ea47a4be5ddd094575ed19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.487273  8244 tablet_service.cc:1511] Processing CreateTablet for tablet eb334e41695d4d8c8d5de4eb668cd421 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:51.488492  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb334e41695d4d8c8d5de4eb668cd421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.489001  8297 tablet_bootstrap.cc:492] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:51.489837  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3456040ac8e456eabcfa4db8a2b5510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.490599  8091 tablet_service.cc:1511] Processing CreateTablet for tablet eb334e41695d4d8c8d5de4eb668cd421 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:51.456593  8096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c962bcd58c74013abdb370fa758d500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.506048  8092 tablet_service.cc:1511] Processing CreateTablet for tablet 5590746c03af49c9a057629ee7fe6bfb (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:51.509250  8303 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.509859  8303 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.511948  8303 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:51.512495  8297 tablet_bootstrap.cc:654] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:51.514276  8098 tablet_service.cc:1511] Processing CreateTablet for tablet d0adcb7796ea47a4be5ddd094575ed19 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:51.522194  8240 tablet_service.cc:1511] Processing CreateTablet for tablet 9abaa411847e4bf9907f7af5e2689c7b (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:51.522805  8095 tablet_service.cc:1511] Processing CreateTablet for tablet 32f0b0ff1e4f482fbd5d5bb078488de9 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:51.523502  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abaa411847e4bf9907f7af5e2689c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.524328  8093 tablet_service.cc:1511] Processing CreateTablet for tablet 9abaa411847e4bf9907f7af5e2689c7b (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:51.526271  8243 tablet_service.cc:1511] Processing CreateTablet for tablet 5590746c03af49c9a057629ee7fe6bfb (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:51.527526  8243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5590746c03af49c9a057629ee7fe6bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.531404  8245 tablet_service.cc:1511] Processing CreateTablet for tablet 6e8201b083554b0cb094760a4ff0fd39 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:51.542826  8245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e8201b083554b0cb094760a4ff0fd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.537348  8090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e8201b083554b0cb094760a4ff0fd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.554189  8098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0adcb7796ea47a4be5ddd094575ed19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.554872  8165 tablet_service.cc:1511] Processing CreateTablet for tablet d3456040ac8e456eabcfa4db8a2b5510 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:51.556138  8165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3456040ac8e456eabcfa4db8a2b5510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.577863  8173 tablet_service.cc:1511] Processing CreateTablet for tablet cd035b4a624c4c7aa2257c2821868021 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:51.579180  8173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd035b4a624c4c7aa2257c2821868021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.567521  8164 tablet_service.cc:1511] Processing CreateTablet for tablet 5590746c03af49c9a057629ee7fe6bfb (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:51.580902  8091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb334e41695d4d8c8d5de4eb668cd421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.580155  8304 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.589288  8167 tablet_service.cc:1511] Processing CreateTablet for tablet 6e8201b083554b0cb094760a4ff0fd39 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:51.590036  8164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5590746c03af49c9a057629ee7fe6bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.590417  8168 tablet_service.cc:1511] Processing CreateTablet for tablet 6e624c9e6425410d86ead659c0c8db59 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:51.593299  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:51.593484  8166 tablet_service.cc:1511] Processing CreateTablet for tablet 32f0b0ff1e4f482fbd5d5bb078488de9 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 13:15:51.594909  8223 leader_election.cc:343] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.595351  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:51.599294  8241 tablet_service.cc:1511] Processing CreateTablet for tablet 32f0b0ff1e4f482fbd5d5bb078488de9 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:51.599771  8170 tablet_service.cc:1511] Processing CreateTablet for tablet eb334e41695d4d8c8d5de4eb668cd421 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:51.600591  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f0b0ff1e4f482fbd5d5bb078488de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.601382  8169 tablet_service.cc:1511] Processing CreateTablet for tablet 9abaa411847e4bf9907f7af5e2689c7b (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:51.592723  8304 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } }
I20260709 13:15:51.604329  8304 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:51.604799  8304 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:51.599251  8171 tablet_service.cc:1511] Processing CreateTablet for tablet d0adcb7796ea47a4be5ddd094575ed19 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:51.590430  8172 tablet_service.cc:1511] Processing CreateTablet for tablet 7c962bcd58c74013abdb370fa758d500 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:51.608785  8166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f0b0ff1e4f482fbd5d5bb078488de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.609728  8171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0adcb7796ea47a4be5ddd094575ed19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.612600  8167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e8201b083554b0cb094760a4ff0fd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.613991  8172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c962bcd58c74013abdb370fa758d500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.611697  8089 tablet_service.cc:1511] Processing CreateTablet for tablet 6e624c9e6425410d86ead659c0c8db59 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:51.616940  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb334e41695d4d8c8d5de4eb668cd421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.617729  8168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e624c9e6425410d86ead659c0c8db59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.618386  8169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abaa411847e4bf9907f7af5e2689c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.634173  8093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abaa411847e4bf9907f7af5e2689c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.642020  8299 tablet_bootstrap.cc:654] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:51.664542  8244 tablet_service.cc:1511] Processing CreateTablet for tablet 6e624c9e6425410d86ead659c0c8db59 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:51.665557  8297 tablet_bootstrap.cc:492] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:51.665903  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e624c9e6425410d86ead659c0c8db59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.666046  8297 ts_tablet_manager.cc:1403] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.177s	user 0.013s	sys 0.007s
I20260709 13:15:51.667249  8090 tablet_service.cc:1511] Processing CreateTablet for tablet c239eb8b961c4362b6e905c0fa6fbd98 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:51.666271  8095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f0b0ff1e4f482fbd5d5bb078488de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.670027  8090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c239eb8b961c4362b6e905c0fa6fbd98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.670961  8297 raft_consensus.cc:359] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.671756  8297 raft_consensus.cc:385] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:51.671993  8089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e624c9e6425410d86ead659c0c8db59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.672290  8297 raft_consensus.cc:740] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:51.673316  8092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5590746c03af49c9a057629ee7fe6bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.679311  8298 tablet_bootstrap.cc:492] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:51.679821  8298 ts_tablet_manager.cc:1403] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.262s	user 0.013s	sys 0.008s
I20260709 13:15:51.687770  8298 raft_consensus.cc:359] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.688561  8298 raft_consensus.cc:385] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:51.689812  8298 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:51.694531  8298 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.696712  8298 ts_tablet_manager.cc:1434] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:15:51.699605  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:51.700256  8183 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
W20260709 13:15:51.680781  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 68252.7us
I20260709 13:15:51.701592  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:51.702629  8309 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:51.703006  8309 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.703056  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:51.703413  8309 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:51.710201  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:51.690534  8297 consensus_queue.cc:260] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.716992  8297 ts_tablet_manager.cc:1434] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 13:15:51.729387  8297 tablet_bootstrap.cc:492] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:51.718546  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:51.719902  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:51.720363  8090 tablet_service.cc:1511] Processing CreateTablet for tablet d092bc636e5347e5a3f10441d996ec96 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:51.735080  8242 tablet_service.cc:1511] Processing CreateTablet for tablet d3439ee9684744c187e7b7e3627aecda (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:51.735601  8090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d092bc636e5347e5a3f10441d996ec96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.736297  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3439ee9684744c187e7b7e3627aecda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.739249  8238 tablet_service.cc:1511] Processing CreateTablet for tablet 8584c73fd4f14469baaaebe16617e775 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:51.740376  8297 tablet_bootstrap.cc:654] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:51.726996  8298 tablet_bootstrap.cc:492] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:51.722039  8095 tablet_service.cc:1511] Processing CreateTablet for tablet d3439ee9684744c187e7b7e3627aecda (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:51.742147  8095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3439ee9684744c187e7b7e3627aecda. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:51.717574  8223 leader_election.cc:343] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:51.746042  8223 leader_election.cc:343] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.746548  8223 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:15:51.747475  8149 leader_election.cc:343] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.747830  8318 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:51.746028  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:51.732949  8168 tablet_service.cc:1511] Processing CreateTablet for tablet c239eb8b961c4362b6e905c0fa6fbd98 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:51.749629  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:51.730448  8299 tablet_bootstrap.cc:492] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:51.750780  8168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c239eb8b961c4362b6e905c0fa6fbd98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.750878  8299 ts_tablet_manager.cc:1403] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.347s	user 0.022s	sys 0.002s
I20260709 13:15:51.751189  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:51.740502  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8584c73fd4f14469baaaebe16617e775. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:51.752308  8149 leader_election.cc:343] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:51.759021  8074 leader_election.cc:343] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:51.760620  8149 leader_election.cc:343] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.759254  8298 tablet_bootstrap.cc:654] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:51.761562  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:51.763192  8303 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:51.752363  8239 tablet_service.cc:1511] Processing CreateTablet for tablet d092bc636e5347e5a3f10441d996ec96 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:51.713404  8309 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.769542  8108 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 1: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:15:51.774343  8246 tablet_service.cc:1511] Processing CreateTablet for tablet c239eb8b961c4362b6e905c0fa6fbd98 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:51.774593  8299 raft_consensus.cc:359] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.775310  8299 raft_consensus.cc:385] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:51.775619  8299 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:51.776724  8309 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:51.776599  8299 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.778482  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:51.767277  8239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d092bc636e5347e5a3f10441d996ec96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.784389  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:51.785311  8183 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:51.782447  8074 leader_election.cc:343] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.801914  8246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c239eb8b961c4362b6e905c0fa6fbd98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.775573  8094 tablet_service.cc:1511] Processing CreateTablet for tablet 8584c73fd4f14469baaaebe16617e775 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:51.807842  8094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8584c73fd4f14469baaaebe16617e775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.821084  8089 tablet_service.cc:1511] Processing CreateTablet for tablet 6874782ad0e549bd89899c965cd46c33 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:51.822530  8089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6874782ad0e549bd89899c965cd46c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.831435  8173 tablet_service.cc:1511] Processing CreateTablet for tablet d092bc636e5347e5a3f10441d996ec96 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:51.832743  8173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d092bc636e5347e5a3f10441d996ec96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.833171  8183 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:51.784562  8164 tablet_service.cc:1511] Processing CreateTablet for tablet 8584c73fd4f14469baaaebe16617e775 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:51.834450  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:51.835685  8309 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:51.836148  8309 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:51.752363  8165 tablet_service.cc:1511] Processing CreateTablet for tablet d3439ee9684744c187e7b7e3627aecda (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:51.836992  8309 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.840093  8167 tablet_service.cc:1511] Processing CreateTablet for tablet 6874782ad0e549bd89899c965cd46c33 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:51.826751  8149 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:51.847791  8303 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:51.850283  8297 tablet_bootstrap.cc:492] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:51.850764  8297 ts_tablet_manager.cc:1403] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.122s	user 0.040s	sys 0.024s
I20260709 13:15:51.834430  8164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8584c73fd4f14469baaaebe16617e775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.854334  8165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3439ee9684744c187e7b7e3627aecda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.858386  8299 ts_tablet_manager.cc:1434] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.000s
I20260709 13:15:51.859501  8299 tablet_bootstrap.cc:492] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:51.860291  8167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6874782ad0e549bd89899c965cd46c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.876461  8005 catalog_manager.cc:5697] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:51.882413  8242 tablet_service.cc:1511] Processing CreateTablet for tablet 6874782ad0e549bd89899c965cd46c33 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:51.883749  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6874782ad0e549bd89899c965cd46c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.885957  8297 raft_consensus.cc:359] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.886729  8297 raft_consensus.cc:385] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:51.887034  8297 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:51.887847  8297 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.897593  8169 tablet_service.cc:1511] Processing CreateTablet for tablet 21cda219d2624c108a6700de24d60d86 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:51.898967  8169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21cda219d2624c108a6700de24d60d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.897593  8093 tablet_service.cc:1511] Processing CreateTablet for tablet 21cda219d2624c108a6700de24d60d86 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:51.904031  8093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21cda219d2624c108a6700de24d60d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.908187  8298 tablet_bootstrap.cc:492] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:51.908728  8298 ts_tablet_manager.cc:1403] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.182s	user 0.012s	sys 0.006s
I20260709 13:15:51.911690  8298 raft_consensus.cc:359] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.912354  8298 raft_consensus.cc:385] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:51.912623  8298 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:51.914574  8239 tablet_service.cc:1511] Processing CreateTablet for tablet 21cda219d2624c108a6700de24d60d86 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:51.915845  8297 ts_tablet_manager.cc:1434] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.065s	user 0.004s	sys 0.005s
I20260709 13:15:51.919199  8297 tablet_bootstrap.cc:492] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:51.915941  8239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21cda219d2624c108a6700de24d60d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.921459  8173 tablet_service.cc:1511] Processing CreateTablet for tablet b3279fc005d149f8aad5d0df46e09fda (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:51.922716  8173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3279fc005d149f8aad5d0df46e09fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.923414  8242 tablet_service.cc:1511] Processing CreateTablet for tablet b3279fc005d149f8aad5d0df46e09fda (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:51.931484  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3279fc005d149f8aad5d0df46e09fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.913343  8298 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:51.931663  8246 tablet_service.cc:1511] Processing CreateTablet for tablet e8a82de7cb524bf996a9df256baca3fd (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:51.933862  8241 tablet_service.cc:1511] Processing CreateTablet for tablet e05ca9fb2b7a4b46851675643729339f (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:51.934583  8246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8a82de7cb524bf996a9df256baca3fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.935983  8096 tablet_service.cc:1511] Processing CreateTablet for tablet ff9e97576a934b9dbf18f6ee6cc670af (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:51.937238  8096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9e97576a934b9dbf18f6ee6cc670af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.939337  8089 tablet_service.cc:1511] Processing CreateTablet for tablet e8a82de7cb524bf996a9df256baca3fd (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:51.941171  8089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8a82de7cb524bf996a9df256baca3fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.919839  8094 tablet_service.cc:1511] Processing CreateTablet for tablet b3279fc005d149f8aad5d0df46e09fda (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:51.931663  8169 tablet_service.cc:1511] Processing CreateTablet for tablet e8a82de7cb524bf996a9df256baca3fd (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:51.942179  8169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8a82de7cb524bf996a9df256baca3fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.942785  8095 tablet_service.cc:1511] Processing CreateTablet for tablet 7f981ef6ec7847cf851489769fac4dff (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:51.943097  8165 tablet_service.cc:1511] Processing CreateTablet for tablet 7f981ef6ec7847cf851489769fac4dff (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:51.938381  8091 tablet_service.cc:1511] Processing CreateTablet for tablet e05ca9fb2b7a4b46851675643729339f (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:51.944353  8165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f981ef6ec7847cf851489769fac4dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.936925  8238 tablet_service.cc:1511] Processing CreateTablet for tablet ff9e97576a934b9dbf18f6ee6cc670af (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:51.920915  8299 tablet_bootstrap.cc:654] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:51.938381  8167 tablet_service.cc:1511] Processing CreateTablet for tablet ff9e97576a934b9dbf18f6ee6cc670af (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:51.946357  8094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3279fc005d149f8aad5d0df46e09fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.946564  8167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9e97576a934b9dbf18f6ee6cc670af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.953742  8095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f981ef6ec7847cf851489769fac4dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.955318  8244 tablet_service.cc:1511] Processing CreateTablet for tablet 7f981ef6ec7847cf851489769fac4dff (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:51.956065  8097 tablet_service.cc:1511] Processing CreateTablet for tablet 43e4649131cb4b10a82b13d0d2b8e85a (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:51.957300  8097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e4649131cb4b10a82b13d0d2b8e85a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.957674  8245 tablet_service.cc:1511] Processing CreateTablet for tablet 43e4649131cb4b10a82b13d0d2b8e85a (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:51.958425  8170 tablet_service.cc:1511] Processing CreateTablet for tablet 43e4649131cb4b10a82b13d0d2b8e85a (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:51.959685  8090 tablet_service.cc:1511] Processing CreateTablet for tablet 3e54e69639dd478bb5f966d86c83c95d (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:51.939268  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05ca9fb2b7a4b46851675643729339f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.961081  8243 tablet_service.cc:1511] Processing CreateTablet for tablet 3e54e69639dd478bb5f966d86c83c95d (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:51.962327  8243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e54e69639dd478bb5f966d86c83c95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.961939  8092 tablet_service.cc:1511] Processing CreateTablet for tablet e1e020840d414fa992e8afcd5cffaad4 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:51.959605  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e4649131cb4b10a82b13d0d2b8e85a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.960028  8091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05ca9fb2b7a4b46851675643729339f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.965886  8245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e4649131cb4b10a82b13d0d2b8e85a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.967299  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f981ef6ec7847cf851489769fac4dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.968407  8166 tablet_service.cc:1511] Processing CreateTablet for tablet e1e020840d414fa992e8afcd5cffaad4 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:51.969651  8166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e020840d414fa992e8afcd5cffaad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.970278  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9e97576a934b9dbf18f6ee6cc670af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.966965  8090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e54e69639dd478bb5f966d86c83c95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.938943  8298 ts_tablet_manager.cc:1434] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:15:51.959954  8168 tablet_service.cc:1511] Processing CreateTablet for tablet 3e54e69639dd478bb5f966d86c83c95d (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:51.978325  8092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e020840d414fa992e8afcd5cffaad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.978729  8297 tablet_bootstrap.cc:654] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:51.994920  8247 tablet_service.cc:1511] Processing CreateTablet for tablet fa9dafbde3954b8487327ba47919b4d5 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:51.996258  8247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9dafbde3954b8487327ba47919b4d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:51.979171  8164 tablet_service.cc:1511] Processing CreateTablet for tablet e05ca9fb2b7a4b46851675643729339f (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:51.982393  8240 tablet_service.cc:1511] Processing CreateTablet for tablet e1e020840d414fa992e8afcd5cffaad4 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:51.984941  8098 tablet_service.cc:1511] Processing CreateTablet for tablet fa9dafbde3954b8487327ba47919b4d5 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:51.985754  8172 tablet_service.cc:1511] Processing CreateTablet for tablet fa9dafbde3954b8487327ba47919b4d5 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:51.999888  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e020840d414fa992e8afcd5cffaad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.000015  8172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9dafbde3954b8487327ba47919b4d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.000717  8098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9dafbde3954b8487327ba47919b4d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.001547  8168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e54e69639dd478bb5f966d86c83c95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.007333  8171 tablet_service.cc:1511] Processing CreateTablet for tablet ba766a24d6d541fcbbc260fd5545d9ca (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:52.008656  8171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba766a24d6d541fcbbc260fd5545d9ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.027962  8093 tablet_service.cc:1511] Processing CreateTablet for tablet 7e424b91f5394cedb3ad1923bab01174 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:52.029395  8093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e424b91f5394cedb3ad1923bab01174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.029616  8164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05ca9fb2b7a4b46851675643729339f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.067956  8298 tablet_bootstrap.cc:492] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
W20260709 13:15:52.133739  8054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:52.134361  8309 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.135038  8309 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:52.141989  7993 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 72271.7us
I20260709 13:15:52.155311  8318 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.156028  8318 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.176486  8303 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.177160  8303 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.181288  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:15:52.198173  8149 leader_election.cc:343] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:52.199185  8095 tablet_service.cc:1511] Processing CreateTablet for tablet ba766a24d6d541fcbbc260fd5545d9ca (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:52.202396  8095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba766a24d6d541fcbbc260fd5545d9ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.217190  8166 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1d160e7dbe4ab091e90aaddec43a43 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:52.219051  8166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1d160e7dbe4ab091e90aaddec43a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.232758  8242 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1d160e7dbe4ab091e90aaddec43a43 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:52.234936  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1d160e7dbe4ab091e90aaddec43a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.241917  8094 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1d160e7dbe4ab091e90aaddec43a43 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:52.246187  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:52.246894  8255 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:52.248291  8299 tablet_bootstrap.cc:492] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:52.248607  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:52.249692  8310 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:52.250021  8310 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.250331  8310 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.244874  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:52.253278  8240 tablet_service.cc:1511] Processing CreateTablet for tablet ba766a24d6d541fcbbc260fd5545d9ca (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:52.253795  8183 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:52.254554  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba766a24d6d541fcbbc260fd5545d9ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.261049  8173 tablet_service.cc:1511] Processing CreateTablet for tablet 7e424b91f5394cedb3ad1923bab01174 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:52.246158  8094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1d160e7dbe4ab091e90aaddec43a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.262430  8173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e424b91f5394cedb3ad1923bab01174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.243136  8309 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:52.274480  8310 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.248948  8299 ts_tablet_manager.cc:1403] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.390s	user 0.024s	sys 0.013s
I20260709 13:15:52.276839  8298 tablet_bootstrap.cc:654] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.282181  8303 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:52.294981  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:52.295017  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:52.298938  8255 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:52.300256  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:52.301462  8303 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:52.301863  8303 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.302273  8303 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.308391  8330 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.308938  8330 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.309870  8303 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.311146  8309 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:52.313402  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:52.313832  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:52.314466  8255 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.318359  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:52.319005  8182 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.321141  8303 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:52.316911  8241 tablet_service.cc:1511] Processing CreateTablet for tablet 7e424b91f5394cedb3ad1923bab01174 (DEFAULT_TABLE table=test-workload [id=fb9774bbc47c413b899a4135e9f64c03]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:52.323665  8255 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:52.324219  8299 raft_consensus.cc:359] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.324981  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:52.326190  8303 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:52.326720  8303 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:52.327242  8182 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:52.327713  8303 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.328586  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:52.329739  8318 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:52.325089  8299 raft_consensus.cc:385] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.332582  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e424b91f5394cedb3ad1923bab01174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.333057  8299 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.345528  8298 tablet_bootstrap.cc:492] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:52.350069  8298 ts_tablet_manager.cc:1403] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.312s	user 0.041s	sys 0.019s
W20260709 13:15:52.347100  8223 leader_election.cc:343] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:52.336241  8309 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:52.349320  8074 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.338292  8299 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.354362  8108 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.360914  8309 raft_consensus.cc:697] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:52.353259  8298 raft_consensus.cc:359] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.365381  8298 raft_consensus.cc:385] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.365877  8298 raft_consensus.cc:740] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.365978  8309 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.367082  8108 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:52.367101  8298 consensus_queue.cc:260] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.376425  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:52.377286  8255 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.379465  8297 tablet_bootstrap.cc:492] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:52.380009  8297 ts_tablet_manager.cc:1403] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.463s	user 0.007s	sys 0.029s
I20260709 13:15:52.365978  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:52.388026  8299 ts_tablet_manager.cc:1434] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.001s
I20260709 13:15:52.389715  8255 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:52.390758  8310 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:52.390868  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:52.409077  8223 leader_election.cc:343] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:52.409607  8223 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:52.410717  8318 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:52.417156  8299 tablet_bootstrap.cc:492] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:52.429365  8330 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:52.430685  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:52.431597  8182 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 1: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:15:52.432718  8223 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:52.436582  8330 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:52.450995  8298 ts_tablet_manager.cc:1434] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.101s	user 0.032s	sys 0.042s
I20260709 13:15:52.454574  8006 catalog_manager.cc:5697] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:52.462406  8297 raft_consensus.cc:359] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.463280  8297 raft_consensus.cc:385] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.463616  8297 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.464445  8297 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.478196  8299 tablet_bootstrap.cc:654] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.490561  8298 tablet_bootstrap.cc:492] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:52.500093  8298 tablet_bootstrap.cc:654] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.504937  8297 ts_tablet_manager.cc:1434] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.125s	user 0.006s	sys 0.001s
I20260709 13:15:52.509361  8297 tablet_bootstrap.cc:492] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:52.515616  8297 tablet_bootstrap.cc:654] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.517127  8004 catalog_manager.cc:5697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:52.537549  8299 tablet_bootstrap.cc:492] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:52.538086  8299 ts_tablet_manager.cc:1403] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.132s	user 0.014s	sys 0.013s
I20260709 13:15:52.540613  8299 raft_consensus.cc:359] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.541218  8299 raft_consensus.cc:385] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.541616  8299 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.542312  8299 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.543867  8299 ts_tablet_manager.cc:1434] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:52.545153  8299 tablet_bootstrap.cc:492] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:52.552034  8299 tablet_bootstrap.cc:654] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.557957  8297 tablet_bootstrap.cc:492] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:52.558231  8298 tablet_bootstrap.cc:492] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:52.558481  8297 ts_tablet_manager.cc:1403] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.008s
I20260709 13:15:52.558894  8298 ts_tablet_manager.cc:1403] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.016s
I20260709 13:15:52.562039  8297 raft_consensus.cc:359] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.562988  8297 raft_consensus.cc:385] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.562644  8298 raft_consensus.cc:359] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.563423  8297 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.563660  8298 raft_consensus.cc:385] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.564242  8298 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.564605  8297 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.565292  8298 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.570690  8297 ts_tablet_manager.cc:1434] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:15:52.571858  8297 tablet_bootstrap.cc:492] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:52.580804  8299 tablet_bootstrap.cc:492] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:52.581473  8299 ts_tablet_manager.cc:1403] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.000s
I20260709 13:15:52.584553  8299 raft_consensus.cc:359] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.585520  8299 raft_consensus.cc:385] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.585923  8299 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.593822  8298 ts_tablet_manager.cc:1434] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.003s
I20260709 13:15:52.586884  8299 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.595711  8297 tablet_bootstrap.cc:654] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.597997  8298 tablet_bootstrap.cc:492] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:52.599020  8299 ts_tablet_manager.cc:1434] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:15:52.601819  8299 tablet_bootstrap.cc:492] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:52.604768  8298 tablet_bootstrap.cc:654] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.608631  8299 tablet_bootstrap.cc:654] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.615628  8298 tablet_bootstrap.cc:492] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:52.616088  8298 ts_tablet_manager.cc:1403] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.002s
I20260709 13:15:52.613229  8297 tablet_bootstrap.cc:492] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:52.616617  8297 ts_tablet_manager.cc:1403] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.007s
I20260709 13:15:52.618650  8298 raft_consensus.cc:359] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.619204  8297 raft_consensus.cc:359] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.619855  8297 raft_consensus.cc:385] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.620129  8297 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.619436  8298 raft_consensus.cc:385] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.620574  8298 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.620937  8297 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.621500  8298 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.623325  8297 ts_tablet_manager.cc:1434] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:52.624433  8297 tablet_bootstrap.cc:492] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:52.629877  8298 ts_tablet_manager.cc:1434] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:15:52.630283  8297 tablet_bootstrap.cc:654] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.634933  8297 tablet_bootstrap.cc:492] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:52.635171  8299 tablet_bootstrap.cc:492] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:52.635591  8299 ts_tablet_manager.cc:1403] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:15:52.638294  8297 ts_tablet_manager.cc:1403] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.002s
I20260709 13:15:52.638461  8299 raft_consensus.cc:359] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.639205  8299 raft_consensus.cc:385] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.639498  8299 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.641319  8299 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.641738  8297 raft_consensus.cc:359] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.642479  8297 raft_consensus.cc:385] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.642812  8297 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.643482  8297 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.645462  8297 ts_tablet_manager.cc:1434] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:15:52.646301  8297 tablet_bootstrap.cc:492] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:52.646694  8299 ts_tablet_manager.cc:1434] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:15:52.647626  8299 tablet_bootstrap.cc:492] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:52.654137  8297 tablet_bootstrap.cc:654] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.662598  8298 tablet_bootstrap.cc:492] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:52.666137  8297 tablet_bootstrap.cc:492] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:52.666731  8297 ts_tablet_manager.cc:1403] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:15:52.669585  8297 raft_consensus.cc:359] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.670544  8297 raft_consensus.cc:385] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.670879  8297 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.671717  8297 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.673805  8297 ts_tablet_manager.cc:1434] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:52.669346  8298 tablet_bootstrap.cc:654] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.675333  8297 tablet_bootstrap.cc:492] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:52.675858  8299 tablet_bootstrap.cc:654] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.683547  8297 tablet_bootstrap.cc:654] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.685624  8298 tablet_bootstrap.cc:492] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:52.686069  8298 ts_tablet_manager.cc:1403] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 13:15:52.693023  8298 raft_consensus.cc:359] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } }
I20260709 13:15:52.693739  8298 raft_consensus.cc:385] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.694021  8298 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.694738  8298 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } }
I20260709 13:15:52.695461  8299 tablet_bootstrap.cc:492] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:52.695930  8299 ts_tablet_manager.cc:1403] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.006s
I20260709 13:15:52.698685  8299 raft_consensus.cc:359] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.699369  8299 raft_consensus.cc:385] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.699667  8299 raft_consensus.cc:740] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.700397  8299 consensus_queue.cc:260] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.702911  8299 ts_tablet_manager.cc:1434] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:15:52.703989  8298 ts_tablet_manager.cc:1434] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:15:52.704188  8299 tablet_bootstrap.cc:492] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:52.706043  8297 tablet_bootstrap.cc:492] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:52.706566  8297 ts_tablet_manager.cc:1403] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.010s
I20260709 13:15:52.706924  8335 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.707394  8335 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.709591  8335 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:52.709548  8297 raft_consensus.cc:359] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.710458  8297 raft_consensus.cc:385] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.710804  8297 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.711199  8299 tablet_bootstrap.cc:654] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.711571  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:52.711679  8297 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.711995  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:52.712272  8108 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:52.712641  8255 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:52.713841  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:52.715335  8335 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:52.715790  8335 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.716236  8335 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.723282  8297 ts_tablet_manager.cc:1434] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:15:52.726146  8330 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.726779  8330 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.726549  8335 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.731503  8318 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.731958  8318 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.729337  8330 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:52.732507  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:52.732682  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:52.733841  8318 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:52.734258  8297 tablet_bootstrap.cc:492] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:52.733942  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:52.735026  8108 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.735443  8223 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:52.737454  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:52.738790  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:52.740085  8223 leader_election.cc:343] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:52.740716  8297 tablet_bootstrap.cc:654] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:52.740721  8223 leader_election.cc:343] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:52.741262  8318 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:52.741307  8223 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:52.742257  8318 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:52.743168  8108 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:52.744834  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:52.746131  8303 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:52.746837  8303 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:52.747769  8303 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.750836  8298 tablet_bootstrap.cc:492] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:52.753387  8310 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:52.756906  8298 tablet_bootstrap.cc:654] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.757613  8332 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:52.762645  8297 tablet_bootstrap.cc:492] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:52.763258  8297 ts_tablet_manager.cc:1403] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.012s
I20260709 13:15:52.766726  8297 raft_consensus.cc:359] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.767508  8297 raft_consensus.cc:385] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.767882  8297 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.769455  8335 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:52.769249  8297 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.779145  8297 ts_tablet_manager.cc:1434] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:15:52.780205  8299 tablet_bootstrap.cc:492] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:52.780390  8297 tablet_bootstrap.cc:492] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:52.780670  8299 ts_tablet_manager.cc:1403] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.077s	user 0.032s	sys 0.007s
I20260709 13:15:52.783366  8299 raft_consensus.cc:359] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.784005  8299 raft_consensus.cc:385] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.784268  8299 raft_consensus.cc:740] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.784852  8299 consensus_queue.cc:260] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.786039  8309 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:52.788376  8299 ts_tablet_manager.cc:1434] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:52.789316  8299 tablet_bootstrap.cc:492] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:52.792726  8297 tablet_bootstrap.cc:654] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.794261  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:52.794852  8255 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.795648  8298 tablet_bootstrap.cc:492] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:52.796111  8298 ts_tablet_manager.cc:1403] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.000s
I20260709 13:15:52.800119  8299 tablet_bootstrap.cc:654] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.799860  8298 raft_consensus.cc:359] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.800735  8298 raft_consensus.cc:385] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.801122  8298 raft_consensus.cc:740] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.802047  8298 consensus_queue.cc:260] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.802546  8332 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:52.804363  8298 ts_tablet_manager.cc:1434] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:52.809072  8298 tablet_bootstrap.cc:492] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:52.809983  8332 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.810482  8006 catalog_manager.cc:5697] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:52.810459  8332 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.814962  8355 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.816378  8332 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:52.816170  8355 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } }
I20260709 13:15:52.818565  8298 tablet_bootstrap.cc:654] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.809077  8255 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:52.831418  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:52.834472  8310 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.835130  8310 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:52.836067  8149 leader_election.cc:343] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:52.837881  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:52.843324  8299 tablet_bootstrap.cc:492] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:52.843781  8299 ts_tablet_manager.cc:1403] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.020s
I20260709 13:15:52.845737  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:52.846378  8299 raft_consensus.cc:359] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.847038  8299 raft_consensus.cc:385] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.847322  8299 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.848282  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:52.848914  8257 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:52.849794  8107 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:52.847052  8310 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:52.851054  8149 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:15:52.851919  8074 leader_election.cc:343] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:52.852695  8303 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:52.853008  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:52.853227  8303 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.855018  8310 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:52.854496  8299 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.855372  8310 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.855741  8310 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.857487  8303 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.867244  8299 ts_tablet_manager.cc:1434] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:15:52.867385  8318 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.867864  8318 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.868319  8299 tablet_bootstrap.cc:492] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:52.869985  8318 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:52.873169  8309 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.881693  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:52.875074  8309 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.882669  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:52.883442  8107 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 0.
W20260709 13:15:52.884284  8149 leader_election.cc:343] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:52.882755  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:52.885178  8183 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 0.
I20260709 13:15:52.886849  8223 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:52.892906  8318 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:52.893321  8318 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.893687  8318 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.898880  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:52.899163  8309 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:52.899534  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:52.900206  8183 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:52.899605  8257 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:52.901288  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:52.906486  8074 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:52.906952  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:52.907770  8332 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:52.908120  8332 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.908448  8332 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.909328  8309 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:52.909768  8309 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.910120  8309 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.888334  8355 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:52.916242  8318 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.917393  8254 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 1: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:15:52.918686  8332 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } }
I20260709 13:15:52.919777  8318 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:52.923205  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:52.923811  8183 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.924316  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:52.927676  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:52.928234  8254 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.929020  8257 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.929687  8299 tablet_bootstrap.cc:654] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:52.933699  8149 leader_election.cc:343] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:52.933959  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:52.936453  8254 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:52.936558  8335 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.937098  8335 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.937693  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:52.939256  8335 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:52.939551  8183 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:15:52.939893  8335 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:52.940510  8335 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:52.940863  8223 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:52.945082  8309 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.947480  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:52.948105  8107 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:52.947794  8335 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } }
I20260709 13:15:52.948979  8310 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.951067  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:52.951663  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:52.951742  8255 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
W20260709 13:15:52.953055  8074 leader_election.cc:343] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:52.953146  8149 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:52.954276  8297 tablet_bootstrap.cc:492] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:52.954972  8297 ts_tablet_manager.cc:1403] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.175s	user 0.015s	sys 0.020s
I20260709 13:15:52.941681  8332 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:52.954030  8108 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 1: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:15:52.955798  8318 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:52.948127  8309 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:52.956189  8310 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:52.963738  8297 raft_consensus.cc:359] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.964859  8297 raft_consensus.cc:385] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.965121  8297 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.966248  8297 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.956238  8303 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.960966  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:52.962891  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:52.975703  8368 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:52.976300  8368 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.971086  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:52.976359  8298 tablet_bootstrap.cc:492] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:52.976891  8368 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.964473  8318 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:15:52.977357  8298 ts_tablet_manager.cc:1403] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.172s	user 0.012s	sys 0.002s
I20260709 13:15:52.973995  8303 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:52.971089  8183 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 1: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:15:52.967139  8332 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.977847  8256 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.987602  8297 ts_tablet_manager.cc:1434] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.009s
I20260709 13:15:52.988382  8297 tablet_bootstrap.cc:492] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:52.991192  8298 raft_consensus.cc:359] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.992209  8298 raft_consensus.cc:385] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.992601  8298 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.985093  8309 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.994094  8298 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:52.998822  8309 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.001720  8318 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.002383  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:52.985085  8332 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.008832  8183 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:53.009956  8332 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:53.010847  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:53.011118  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:53.011996  8255 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:53.012472  8310 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:53.012806  8330 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.012899  8310 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.012355  8005 catalog_manager.cc:5697] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.013370  8330 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.015550  8330 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:53.017868  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:53.020725  8298 ts_tablet_manager.cc:1434] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 13:15:53.020383  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:53.023252  8299 tablet_bootstrap.cc:492] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:53.020211  8256 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
W20260709 13:15:53.023340  8223 leader_election.cc:343] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.023787  8299 ts_tablet_manager.cc:1403] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.156s	user 0.008s	sys 0.005s
I20260709 13:15:53.013375  8310 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.018723  8309 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:15:53.027676  8223 leader_election.cc:343] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.030252  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:53.030339  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:53.028386  8299 raft_consensus.cc:359] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } }
I20260709 13:15:53.031375  8299 raft_consensus.cc:385] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.031708  8299 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.032207  8333 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:53.032702  8333 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:53.032568  8299 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } }
W20260709 13:15:52.998257  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45190.9us
I20260709 13:15:53.035724  8371 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:53.036386  8330 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.033530  8333 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.038283  8330 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.039800  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:53.040441  8108 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.040512  8330 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:53.041730  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:53.041989  8373 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.042243  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:53.042542  8373 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:53.043103  8223 leader_election.cc:343] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:53.043857  8223 leader_election.cc:343] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.043794  8074 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:53.044404  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:53.045151  8330 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:53.045382  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:53.047304  8309 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:53.049172  8298 tablet_bootstrap.cc:492] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:53.050699  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:53.053278  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:53.044833  8373 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:53.054035  8254 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
W20260709 13:15:53.054522  8149 leader_election.cc:343] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.053289  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:53.057983  8310 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.059326  8107 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 1: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:15:53.063104  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:53.063158  8006 catalog_manager.cc:5697] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.063905  8183 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:53.063875  8149 leader_election.cc:343] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.065846  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:53.062672  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:53.078006  8333 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:53.077929  8149 leader_election.cc:343] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.078600  8149 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:53.079612  8373 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:53.084463  8183 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:53.085392  8310 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:53.086328  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:53.078580  8333 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } }
I20260709 13:15:53.092499  8299 ts_tablet_manager.cc:1434] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.007s
I20260709 13:15:53.092092  8310 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:53.093160  8310 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:53.094822  8297 tablet_bootstrap.cc:654] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.094229  8310 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.092347  8372 raft_consensus.cc:2764] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:15:53.099154  8333 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:53.100700  8299 tablet_bootstrap.cc:492] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:53.101250  8298 tablet_bootstrap.cc:654] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.101725  8108 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:53.096875  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:53.106930  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:53.110996  8256 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.109772  8368 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.112223  8257 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 1: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:15:53.113236  8006 catalog_manager.cc:5697] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.115868  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:53.118489  8074 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:53.115959  8149 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:53.122691  8372 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:53.123179  8372 raft_consensus.cc:697] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:53.124933  8333 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.125386  8297 tablet_bootstrap.cc:492] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:53.125885  8297 ts_tablet_manager.cc:1403] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.138s	user 0.012s	sys 0.001s
I20260709 13:15:53.125885  8256 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:53.123975  8372 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.130427  8299 tablet_bootstrap.cc:654] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.135978  8297 raft_consensus.cc:359] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.137669  8297 raft_consensus.cc:385] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.138019  8297 raft_consensus.cc:740] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.138787  8297 consensus_queue.cc:260] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.139587  8368 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:53.140811  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:53.141470  8108 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.141800  8297 ts_tablet_manager.cc:1434] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:15:53.143216  8297 tablet_bootstrap.cc:492] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:53.154691  8005 catalog_manager.cc:5697] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:53.157109  8054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:53.164475  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:53.166113  8256 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.191326  8108 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:53.197240  8149 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:53.198194  8368 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:53.198659  8333 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:53.198889  8368 raft_consensus.cc:697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:53.199872  8368 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.202677  8256 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:53.207924  8372 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:53.210115  8297 tablet_bootstrap.cc:654] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.212889  8298 tablet_bootstrap.cc:492] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:53.214730  8298 ts_tablet_manager.cc:1403] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.005s
I20260709 13:15:53.215016  8005 catalog_manager.cc:5697] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.218847  8298 raft_consensus.cc:359] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.234159  8298 raft_consensus.cc:385] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.234706  8298 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.236121  8299 tablet_bootstrap.cc:492] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:53.236618  8299 ts_tablet_manager.cc:1403] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.136s	user 0.020s	sys 0.014s
I20260709 13:15:53.235968  8298 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.238719  8299 raft_consensus.cc:359] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.239209  8299 raft_consensus.cc:385] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.239447  8299 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.240039  8299 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.241663  8299 ts_tablet_manager.cc:1434] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:15:53.242631  8299 tablet_bootstrap.cc:492] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:53.246023  8330 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.246523  8330 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.248584  8330 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:53.249763  8298 ts_tablet_manager.cc:1434] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 13:15:53.251173  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:53.252336  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:53.253757  8223 leader_election.cc:343] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:53.254679  8223 leader_election.cc:343] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.255277  8223 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:53.255512  8005 catalog_manager.cc:5697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.256762  8330 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:53.252345  8298 tablet_bootstrap.cc:492] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:53.258752  8373 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:53.259896  8297 tablet_bootstrap.cc:492] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:53.261168  8297 ts_tablet_manager.cc:1403] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.006s
I20260709 13:15:53.264674  8299 tablet_bootstrap.cc:654] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.264850  8298 tablet_bootstrap.cc:654] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.264560  8297 raft_consensus.cc:359] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.265347  8297 raft_consensus.cc:385] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.265703  8297 raft_consensus.cc:740] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.266610  8297 consensus_queue.cc:260] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.268321  8297 ts_tablet_manager.cc:1434] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:53.269536  8297 tablet_bootstrap.cc:492] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:53.276463  8297 tablet_bootstrap.cc:654] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.289875  8298 tablet_bootstrap.cc:492] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:53.290369  8298 ts_tablet_manager.cc:1403] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.038s	user 0.003s	sys 0.012s
I20260709 13:15:53.290846  8297 tablet_bootstrap.cc:492] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:53.291458  8297 ts_tablet_manager.cc:1403] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 13:15:53.293447  8298 raft_consensus.cc:359] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.294909  8297 raft_consensus.cc:359] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.295673  8298 raft_consensus.cc:385] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.295876  8297 raft_consensus.cc:385] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.296113  8298 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.296325  8297 raft_consensus.cc:740] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.296977  8298 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.297247  8297 consensus_queue.cc:260] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.299026  8298 ts_tablet_manager.cc:1434] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:53.299865  8298 tablet_bootstrap.cc:492] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:53.300477  8297 ts_tablet_manager.cc:1434] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:15:53.301684  8297 tablet_bootstrap.cc:492] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:53.305927  8298 tablet_bootstrap.cc:654] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.312209  8297 tablet_bootstrap.cc:654] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.325088  8297 tablet_bootstrap.cc:492] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:53.325711  8297 ts_tablet_manager.cc:1403] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.014s
I20260709 13:15:53.328789  8297 raft_consensus.cc:359] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.329475  8297 raft_consensus.cc:385] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.329743  8297 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.330137  8298 tablet_bootstrap.cc:492] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:53.330144  8299 tablet_bootstrap.cc:492] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:53.330847  8298 ts_tablet_manager.cc:1403] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.012s
I20260709 13:15:53.330394  8297 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.330892  8299 ts_tablet_manager.cc:1403] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.088s	user 0.028s	sys 0.033s
I20260709 13:15:53.332931  8297 ts_tablet_manager.cc:1434] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:15:53.333797  8297 tablet_bootstrap.cc:492] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:53.334389  8298 raft_consensus.cc:359] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.335121  8298 raft_consensus.cc:385] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.335425  8298 raft_consensus.cc:740] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.336112  8298 consensus_queue.cc:260] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.338536  8298 ts_tablet_manager.cc:1434] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:53.339442  8298 tablet_bootstrap.cc:492] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:53.340374  8299 raft_consensus.cc:359] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.341537  8299 raft_consensus.cc:385] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.341789  8299 raft_consensus.cc:740] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.342372  8297 tablet_bootstrap.cc:654] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.342372  8299 consensus_queue.cc:260] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.344427  8299 ts_tablet_manager.cc:1434] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.000s
I20260709 13:15:53.345274  8299 tablet_bootstrap.cc:492] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:53.347944  8298 tablet_bootstrap.cc:654] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.348258  8297 tablet_bootstrap.cc:492] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:53.348768  8297 ts_tablet_manager.cc:1403] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.015s	user 0.002s	sys 0.007s
I20260709 13:15:53.351130  8299 tablet_bootstrap.cc:654] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.351603  8297 raft_consensus.cc:359] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.352370  8297 raft_consensus.cc:385] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.352650  8297 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.353498  8297 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.355913  8297 ts_tablet_manager.cc:1434] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:53.357153  8297 tablet_bootstrap.cc:492] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:53.363742  8297 tablet_bootstrap.cc:654] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.366487  8368 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:53.424012  8333 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.424582  8333 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.426810  8333 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:53.428077  8330 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:53.429857  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:15:53.431357  8074 leader_election.cc:343] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.436038  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:53.437776  8074 leader_election.cc:343] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.438268  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:53.439791  8377 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:53.440598  8310 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.441108  8310 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.443354  8310 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:53.443928  8332 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:53.445209  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:53.445926  8257 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:53.452498  8371 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.453078  8371 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.455063  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:53.455304  8371 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:53.455760  8183 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:53.459245  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:53.460134  8108 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 1: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:15:53.461309  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:53.463344  8330 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:53.463982  8333 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:53.464399  8333 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.464764  8333 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.464622  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:53.476953  8332 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.477486  8332 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.482199  8332 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:53.482368  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:53.483180  8256 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 1: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:15:53.484054  8223 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:53.485944  8371 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.489720  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:53.491693  8149 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:53.492851  8332 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.500346  8332 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:53.507524  8371 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:53.515000  8372 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:53.536414  8310 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:53.561488  8298 tablet_bootstrap.cc:492] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:53.562168  8298 ts_tablet_manager.cc:1403] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.223s	user 0.071s	sys 0.132s
I20260709 13:15:53.569167  8372 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:53.520650  8333 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.574455  8333 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:53.576354  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:53.577030  8297 tablet_bootstrap.cc:492] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:53.582028  8299 tablet_bootstrap.cc:492] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:53.594234  8297 ts_tablet_manager.cc:1403] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.237s	user 0.042s	sys 0.064s
I20260709 13:15:53.586442  8298 raft_consensus.cc:359] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.594607  8298 raft_consensus.cc:385] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.594827  8299 ts_tablet_manager.cc:1403] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.250s	user 0.061s	sys 0.155s
I20260709 13:15:53.594959  8298 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.578487  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:53.597882  8255 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.577171  8183 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.596462  8298 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.605140  8299 raft_consensus.cc:359] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.606201  8299 raft_consensus.cc:385] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.606563  8299 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.607383  8299 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.611011  8299 ts_tablet_manager.cc:1434] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:15:53.612177  8299 tablet_bootstrap.cc:492] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:53.619804  8183 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:53.620782  8297 raft_consensus.cc:359] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.623277  8297 raft_consensus.cc:385] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.623606  8297 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.624650  8297 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.621546  8298 ts_tablet_manager.cc:1434] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.059s	user 0.010s	sys 0.016s
I20260709 13:15:53.627907  8333 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:53.628239  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:53.628825  8299 tablet_bootstrap.cc:654] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.629139  8310 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:53.631726  8310 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:53.633204  8298 tablet_bootstrap.cc:492] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:53.632654  8310 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.630745  8297 ts_tablet_manager.cc:1434] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.003s
I20260709 13:15:53.637570  8297 tablet_bootstrap.cc:492] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:53.644932  8371 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.645449  8371 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.652788  8297 tablet_bootstrap.cc:654] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.653198  8255 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:53.658443  8298 tablet_bootstrap.cc:654] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.660702  8330 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.663280  8371 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:53.664279  8310 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:53.663972  8330 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.652947  8005 catalog_manager.cc:5697] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.667441  8330 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:53.669453  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:53.670347  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:53.671355  8368 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:53.672115  8223 leader_election.cc:343] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.672407  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:53.673218  8223 leader_election.cc:343] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.674502  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:53.679328  8223 leader_election.cc:343] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.679991  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:53.681479  8310 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:53.693984  8330 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:53.699898  8223 leader_election.cc:343] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.700523  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:53.702107  8371 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:53.710168  8299 tablet_bootstrap.cc:492] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:53.710682  8299 ts_tablet_manager.cc:1403] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.099s	user 0.007s	sys 0.006s
I20260709 13:15:53.714247  8299 raft_consensus.cc:359] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.715243  8299 raft_consensus.cc:385] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.715672  8299 raft_consensus.cc:740] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.716632  8299 consensus_queue.cc:260] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.720124  8299 ts_tablet_manager.cc:1434] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:15:53.721868  8299 tablet_bootstrap.cc:492] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:53.726261  8298 tablet_bootstrap.cc:492] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:53.726770  8298 ts_tablet_manager.cc:1403] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.094s	user 0.006s	sys 0.013s
I20260709 13:15:53.729612  8298 raft_consensus.cc:359] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.730185  8299 tablet_bootstrap.cc:654] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.730363  8298 raft_consensus.cc:385] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.730692  8298 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.731752  8298 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.733933  8368 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.734630  8368 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.739154  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:53.739907  8107 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:53.740129  8368 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:53.741417  8149 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:53.741675  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:53.742463  8254 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:53.742470  8368 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:53.744290  8297 tablet_bootstrap.cc:492] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:53.743160  8368 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.741479  8298 ts_tablet_manager.cc:1434] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:15:53.744913  8368 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.745749  8298 tablet_bootstrap.cc:492] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:53.752416  8299 tablet_bootstrap.cc:492] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:53.752938  8299 ts_tablet_manager.cc:1403] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.001s
I20260709 13:15:53.753737  8371 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.754266  8371 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.753718  8298 tablet_bootstrap.cc:654] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.756450  8371 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:53.757521  8299 raft_consensus.cc:359] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.758905  8299 raft_consensus.cc:385] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.759647  8299 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.759331  8297 ts_tablet_manager.cc:1403] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.122s	user 0.012s	sys 0.008s
I20260709 13:15:53.762832  8299 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.766848  8299 ts_tablet_manager.cc:1434] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 13:15:53.763990  8368 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.768445  8297 raft_consensus.cc:359] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.769923  8297 raft_consensus.cc:385] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.770875  8297 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.770591  8299 tablet_bootstrap.cc:492] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:53.771559  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:53.772179  8368 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:53.772228  8108 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.772873  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:53.773343  8254 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.763322  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:53.776556  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:15:53.778921  8223 leader_election.cc:343] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:53.779644  8223 leader_election.cc:343] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.779940  8108 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:53.780567  8254 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:53.780112  8223 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:53.781251  8149 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:53.781571  8371 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:53.782387  8297 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.782713  8372 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:53.787055  8368 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:53.788326  8368 raft_consensus.cc:697] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:53.789291  8368 consensus_queue.cc:237] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.790711  8298 tablet_bootstrap.cc:492] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:53.791230  8298 ts_tablet_manager.cc:1403] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.004s
I20260709 13:15:53.794360  8297 ts_tablet_manager.cc:1434] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 13:15:53.795403  8297 tablet_bootstrap.cc:492] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:53.794847  8298 raft_consensus.cc:359] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.796393  8298 raft_consensus.cc:385] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.796895  8371 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.797041  8298 raft_consensus.cc:740] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.797453  8371 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.798065  8298 consensus_queue.cc:260] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.799712  8371 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:53.800630  8298 ts_tablet_manager.cc:1434] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:15:53.801994  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:53.802161  8298 tablet_bootstrap.cc:492] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:53.802155  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:53.802728  8183 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 0.
I20260709 13:15:53.804045  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:53.804329  8299 tablet_bootstrap.cc:654] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.804909  8371 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:53.805045  8223 leader_election.cc:343] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.805454  8371 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.805841  8371 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.822817  8371 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.826179  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:15:53.828205  8223 leader_election.cc:343] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.839193  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:53.839820  8183 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.841697  8371 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:53.844790  8298 tablet_bootstrap.cc:654] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.851727  8333 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.852303  8333 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.853020  8183 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:15:53.854424  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:53.854882  8333 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:53.855683  8371 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:53.856528  8371 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:15:53.857518  8371 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.863451  8297 tablet_bootstrap.cc:654] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.860359  8299 tablet_bootstrap.cc:492] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:53.864328  8299 ts_tablet_manager.cc:1403] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.013s
I20260709 13:15:53.863793  8004 catalog_manager.cc:5697] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.866997  8299 raft_consensus.cc:359] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.867643  8299 raft_consensus.cc:385] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.860844  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:53.868222  8183 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:53.868923  8299 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.869637  8299 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.870180  8298 tablet_bootstrap.cc:492] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:53.870788  8298 ts_tablet_manager.cc:1403] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.069s	user 0.008s	sys 0.005s
I20260709 13:15:53.870642  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:53.871755  8377 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:53.872182  8377 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.872534  8377 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.874185  8298 raft_consensus.cc:359] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.860792  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:53.874964  8298 raft_consensus.cc:385] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.875326  8298 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.876051  8298 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:53.876590  8074 leader_election.cc:343] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.878497  8297 tablet_bootstrap.cc:492] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:53.879002  8297 ts_tablet_manager.cc:1403] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.002s
I20260709 13:15:53.880044  8005 catalog_manager.cc:5697] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.881743  8377 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.884142  8298 ts_tablet_manager.cc:1434] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:15:53.871774  8299 ts_tablet_manager.cc:1434] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:53.885242  8298 tablet_bootstrap.cc:492] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:53.885818  8299 tablet_bootstrap.cc:492] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:53.884068  8377 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:53.881999  8297 raft_consensus.cc:359] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.887818  8297 raft_consensus.cc:385] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.888147  8297 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.888962  8297 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.890282  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:53.891315  8297 ts_tablet_manager.cc:1434] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 13:15:53.891747  8074 leader_election.cc:343] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.892328  8297 tablet_bootstrap.cc:492] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:53.893181  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:53.893675  8299 tablet_bootstrap.cc:654] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.893761  8183 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.901831  8297 tablet_bootstrap.cc:654] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.903206  8183 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:53.906658  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:53.907609  8299 tablet_bootstrap.cc:492] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:53.907557  8377 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:53.908143  8299 ts_tablet_manager.cc:1403] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:15:53.908622  8368 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.908164  8377 raft_consensus.cc:697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:53.909340  8368 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.909922  8377 consensus_queue.cc:237] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.911536  8299 raft_consensus.cc:359] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.912180  8299 raft_consensus.cc:385] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.912461  8299 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.913169  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:53.913635  8299 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.914462  8108 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:53.914534  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:53.915624  8299 ts_tablet_manager.cc:1434] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:53.915483  8257 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:53.915933  8149 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:53.916589  8299 tablet_bootstrap.cc:492] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:53.916760  8372 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:53.917165  8372 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.917526  8372 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.917461  8368 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:53.905313  8298 tablet_bootstrap.cc:654] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.923236  8299 tablet_bootstrap.cc:654] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.927522  8372 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.931990  8297 tablet_bootstrap.cc:492] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:53.932581  8297 ts_tablet_manager.cc:1403] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.013s
I20260709 13:15:53.934783  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:53.935413  8297 raft_consensus.cc:359] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.935525  8108 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.938567  8298 tablet_bootstrap.cc:492] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:53.938800  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:53.939131  8298 ts_tablet_manager.cc:1403] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.003s
I20260709 13:15:53.939606  8257 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.942795  8298 raft_consensus.cc:359] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.943625  8298 raft_consensus.cc:385] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.943977  8298 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.944633  8108 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:53.944900  8298 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.945762  8149 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:53.946645  8368 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:53.947116  8368 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:53.947956  8368 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.951228  8298 ts_tablet_manager.cc:1434] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:53.952308  8298 tablet_bootstrap.cc:492] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:53.953826  8297 raft_consensus.cc:385] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.954154  8297 raft_consensus.cc:740] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.954866  8297 consensus_queue.cc:260] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.957142  8297 ts_tablet_manager.cc:1434] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.000s
I20260709 13:15:53.959625  8257 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:53.959894  8298 tablet_bootstrap.cc:654] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.961406  8372 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:53.962059  8297 tablet_bootstrap.cc:492] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:53.979574  8297 tablet_bootstrap.cc:654] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.976781  8006 catalog_manager.cc:5697] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.979925  8299 tablet_bootstrap.cc:492] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:53.980394  8299 ts_tablet_manager.cc:1403] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.020s
I20260709 13:15:53.983251  8299 raft_consensus.cc:359] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.984134  8299 raft_consensus.cc:385] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.984395  8299 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.983134  8003 catalog_manager.cc:5697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.985157  8299 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.987169  8299 ts_tablet_manager.cc:1434] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:53.988041  8299 tablet_bootstrap.cc:492] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:53.989828  8298 tablet_bootstrap.cc:492] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:53.990449  8298 ts_tablet_manager.cc:1403] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.008s
I20260709 13:15:53.994115  8298 raft_consensus.cc:359] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.994768  8297 tablet_bootstrap.cc:492] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:53.995060  8298 raft_consensus.cc:385] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.995273  8297 ts_tablet_manager.cc:1403] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.009s
I20260709 13:15:53.995332  8299 tablet_bootstrap.cc:654] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.995337  8298 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.997962  8297 raft_consensus.cc:359] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.998631  8297 raft_consensus.cc:385] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.998903  8297 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.999897  8298 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:53.999897  8297 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.002082  8298 ts_tablet_manager.cc:1434] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:15:54.003731  8297 ts_tablet_manager.cc:1434] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:54.005885  8297 tablet_bootstrap.cc:492] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:54.010848  8299 tablet_bootstrap.cc:492] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:54.011313  8299 ts_tablet_manager.cc:1403] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.005s
I20260709 13:15:54.011749  8297 tablet_bootstrap.cc:654] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.014259  8377 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.014060  8299 raft_consensus.cc:359] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.014772  8299 raft_consensus.cc:385] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.014703  8377 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.015091  8299 raft_consensus.cc:740] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.015901  8299 consensus_queue.cc:260] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.016317  8333 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:54.016724  8377 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.018705  8299 ts_tablet_manager.cc:1434] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 13:15:54.020292  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:54.025170  8298 tablet_bootstrap.cc:492] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:54.025900  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:54.027882  8074 leader_election.cc:343] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.028131  8297 tablet_bootstrap.cc:492] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:54.028755  8297 ts_tablet_manager.cc:1403] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.007s
I20260709 13:15:54.028792  8299 tablet_bootstrap.cc:492] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
W20260709 13:15:54.030402  8074 leader_election.cc:343] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.030838  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:54.031653  8333 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:54.031761  8297 raft_consensus.cc:359] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.031051  8298 tablet_bootstrap.cc:654] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.032428  8297 raft_consensus.cc:385] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.032720  8297 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.033452  8297 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.035935  8297 ts_tablet_manager.cc:1434] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:15:54.039448  8297 tablet_bootstrap.cc:492] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:54.044476  8310 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:54.044939  8297 tablet_bootstrap.cc:654] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.045023  8299 tablet_bootstrap.cc:654] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.049494  8373 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.050077  8373 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.052229  8373 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.059187  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:15:54.061106  8149 leader_election.cc:343] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.062309  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:54.063191  8257 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:54.064400  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:54.065495  8373 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:54.065862  8373 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.066205  8373 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.076186  8298 tablet_bootstrap.cc:492] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:54.076715  8298 ts_tablet_manager.cc:1403] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.004s
I20260709 13:15:54.078245  8373 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.082847  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:54.084331  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:54.084900  8254 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:54.088642  8149 leader_election.cc:343] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.092254  8298 raft_consensus.cc:359] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.094378  8298 raft_consensus.cc:385] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.095023  8298 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.096014  8298 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.099623  8298 ts_tablet_manager.cc:1434] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.003s
I20260709 13:15:54.101320  8298 tablet_bootstrap.cc:492] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:54.092552  8373 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.112514  8254 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:54.112957  8298 tablet_bootstrap.cc:654] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.113801  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:54.114619  8373 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:54.115083  8373 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:54.115808  8373 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.119976  8330 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.120462  8330 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.122401  8330 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:54.123096  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:54.123361  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:54.124459  8223 leader_election.cc:343] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:54.125022  8223 leader_election.cc:343] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.125029  8373 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.125388  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:54.125697  8373 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.125029  8003 catalog_manager.cc:5697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.126379  8330 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:54.127260  8372 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.127787  8372 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.129637  8373 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.129895  8372 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.130935  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:54.131357  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:54.131654  8254 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:54.132000  8257 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:54.132364  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:54.133018  8107 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:54.134014  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:54.134624  8108 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:54.136334  8299 tablet_bootstrap.cc:492] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:54.136786  8299 ts_tablet_manager.cc:1403] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.108s	user 0.009s	sys 0.022s
I20260709 13:15:54.138091  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:54.139061  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:54.139523  8298 tablet_bootstrap.cc:492] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:54.139276  8299 raft_consensus.cc:359] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.139851  8297 tablet_bootstrap.cc:492] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:54.139989  8298 ts_tablet_manager.cc:1403] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.002s
I20260709 13:15:54.140013  8299 raft_consensus.cc:385] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.140632  8299 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.140725  8372 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:54.141117  8372 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.140336  8297 ts_tablet_manager.cc:1403] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.101s	user 0.025s	sys 0.031s
I20260709 13:15:54.141342  8373 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:54.141779  8373 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.141502  8299 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.142191  8373 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.141528  8372 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.143405  8298 raft_consensus.cc:359] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.144119  8298 raft_consensus.cc:385] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.144570  8298 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.144129  8297 raft_consensus.cc:359] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.145092  8297 raft_consensus.cc:385] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.145483  8297 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.145570  8298 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.146375  8297 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.148875  8373 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.149333  8372 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.151613  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:54.152201  8108 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.152426  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:54.152997  8257 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.156397  8298 ts_tablet_manager.cc:1434] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:15:54.157451  8298 tablet_bootstrap.cc:492] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:54.162789  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:54.163352  8107 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.168169  8298 tablet_bootstrap.cc:654] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.168685  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:54.169306  8254 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.173327  8107 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:54.158530  8297 ts_tablet_manager.cc:1434] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:15:54.158913  8299 ts_tablet_manager.cc:1434] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 13:15:54.177522  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:54.178347  8299 tablet_bootstrap.cc:492] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:54.159749  8373 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.160732  8108 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:54.161743  8372 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.179857  8297 tablet_bootstrap.cc:492] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:54.178296  8332 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:54.180959  8332 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:54.181785  8332 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.182411  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:54.184053  8372 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:54.184540  8372 raft_consensus.cc:697] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:54.185352  8372 consensus_queue.cc:237] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.186899  8297 tablet_bootstrap.cc:654] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.193441  8299 tablet_bootstrap.cc:654] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.196913  8254 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:54.159345  8257 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:54.197631  8310 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.198108  8310 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.200089  8310 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.202374  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:54.203430  8183 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 1: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:15:54.202374  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:54.211046  8299 tablet_bootstrap.cc:492] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:54.211525  8299 ts_tablet_manager.cc:1403] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.005s
I20260709 13:15:54.211841  8074 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:54.213016  8310 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:54.216514  8054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:54.220166  8298 tablet_bootstrap.cc:492] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:54.220606  8298 ts_tablet_manager.cc:1403] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.010s
I20260709 13:15:54.220700  8310 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:54.222441  8299 raft_consensus.cc:359] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.223179  8299 raft_consensus.cc:385] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.223640  8299 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.223232  8298 raft_consensus.cc:359] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.224175  8298 raft_consensus.cc:385] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.224469  8298 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.224490  8299 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.225169  8298 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.226724  8299 ts_tablet_manager.cc:1434] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:15:54.227001  8298 ts_tablet_manager.cc:1434] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:54.227706  8299 tablet_bootstrap.cc:492] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:54.228037  8297 tablet_bootstrap.cc:492] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:54.228514  8297 ts_tablet_manager.cc:1403] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.004s
I20260709 13:15:54.229179  8298 tablet_bootstrap.cc:492] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:54.269091  8297 raft_consensus.cc:359] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.271452  8297 raft_consensus.cc:385] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.271615  8299 tablet_bootstrap.cc:654] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.274284  8330 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.275260  8330 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.277215  8297 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.287055  8372 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:54.287629  8330 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:54.289798  8297 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.289776  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:54.293191  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:54.291587  8330 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.295431  8223 leader_election.cc:343] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:54.296391  8223 leader_election.cc:343] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.296926  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:54.289148  8332 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.302588  8372 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:54.302053  8006 catalog_manager.cc:5697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.303936  8371 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:54.304446  8330 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.307062  8330 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:54.307719  8309 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:54.309072  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:54.310458  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:54.311736  8372 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.304090  8006 catalog_manager.cc:5697] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:54.313911  8223 leader_election.cc:343] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.314034  8332 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:54.315074  8223 leader_election.cc:343] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.315557  8223 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:54.317468  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:54.321835  8332 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.317515  8318 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:54.321174  8330 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.322085  8107 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:54.325634  8330 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.326596  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:54.326745  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:54.327479  8257 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:54.328266  8373 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:54.328696  8373 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.329104  8373 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.329283  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:15:54.330981  8223 leader_election.cc:343] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.317471  8372 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.334463  8372 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.335588  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:15:54.349777  8149 leader_election.cc:343] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.336781  8299 tablet_bootstrap.cc:492] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:54.337718  8309 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.340513  8298 tablet_bootstrap.cc:654] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.356153  8309 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.360272  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:54.362093  8299 ts_tablet_manager.cc:1403] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.135s	user 0.014s	sys 0.006s
I20260709 13:15:54.362449  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:54.363868  8297 ts_tablet_manager.cc:1434] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.135s	user 0.015s	sys 0.000s
I20260709 13:15:54.363052  8330 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:54.365806  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:54.366461  8074 leader_election.cc:343] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.363582  8257 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:54.363948  8309 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.374574  8368 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.375958  8223 leader_election.cc:343] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.375566  8368 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.376518  8223 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:54.378985  8368 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.380821  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:54.381114  8330 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:54.383407  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:15:54.383920  8149 leader_election.cc:343] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.385128  8309 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:54.385620  8309 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.386019  8309 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.386418  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:54.387367  8257 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
W20260709 13:15:54.389024  8074 consensus_peers.cc:597] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:54.389611  8297 tablet_bootstrap.cc:492] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:54.391782  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:54.392678  8332 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:54.394677  8299 raft_consensus.cc:359] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.395443  8299 raft_consensus.cc:385] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.395756  8299 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.396467  8299 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.393087  8332 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.397948  8332 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.401635  8330 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:54.401748  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:54.404803  8254 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:54.403652  8373 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.406842  8309 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.414274  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:15:54.416180  8074 leader_election.cc:343] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.421330  8149 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:54.422524  8372 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:54.423023  8372 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.423473  8372 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.430689  8298 tablet_bootstrap.cc:492] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:54.433060  8309 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.431895  8330 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.435896  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:54.435962  8330 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.436898  8254 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.438658  8298 ts_tablet_manager.cc:1403] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.210s	user 0.023s	sys 0.011s
I20260709 13:15:54.441860  8299 ts_tablet_manager.cc:1434] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 13:15:54.443075  8298 raft_consensus.cc:359] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.443833  8298 raft_consensus.cc:385] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.444268  8298 raft_consensus.cc:740] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.445755  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:54.426398  8332 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:54.447202  8223 leader_election.cc:343] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.448668  8332 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.445245  8298 consensus_queue.cc:260] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.443797  8299 tablet_bootstrap.cc:492] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:54.449038  8330 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:54.451957  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:54.453488  8223 leader_election.cc:343] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.453966  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:54.455046  8318 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:54.465720  8373 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.468701  8297 tablet_bootstrap.cc:654] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.468391  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:54.470713  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:54.474707  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:54.485203  8107 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.487566  8318 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:54.483924  8368 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.489533  8255 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.489315  8368 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.490955  8298 ts_tablet_manager.cc:1434] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 13:15:54.493399  8368 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.483000  8108 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.500034  8372 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.504958  8298 tablet_bootstrap.cc:492] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:54.508497  8369 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:54.510150  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:54.520872  8257 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.524341  8108 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:54.530000  8368 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.531368  8368 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.536257  8368 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.539887  8255 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:54.542311  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:54.543128  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:54.546787  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:54.552703  8108 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 1: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:15:54.553771  8254 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:54.555960  8298 tablet_bootstrap.cc:654] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.554798  8107 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:54.555303  8297 tablet_bootstrap.cc:492] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:54.556571  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:54.551781  8257 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:54.558315  8297 ts_tablet_manager.cc:1403] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.193s	user 0.007s	sys 0.010s
I20260709 13:15:54.558583  8309 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:54.559128  8309 raft_consensus.cc:697] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:54.559325  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:54.560079  8107 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:54.561396  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:54.561722  8310 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.566195  8310 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.569187  8310 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.570242  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:54.571786  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:54.563784  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:54.564586  8299 tablet_bootstrap.cc:654] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.572888  8254 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 1: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:15:54.573002  8373 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:54.573902  8373 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:54.574229  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:54.560133  8309 consensus_queue.cc:237] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.574887  8373 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.575552  8310 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:54.580273  8149 leader_election.cc:343] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.585788  8368 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:54.588055  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:54.584195  8297 raft_consensus.cc:359] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.589648  8297 raft_consensus.cc:385] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.590042  8297 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.593614  8310 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:54.575520  8372 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.601130  8368 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:54.601990  8368 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:54.603307  8368 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.604545  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:54.607062  8332 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:54.607609  8332 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.608072  8332 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.612272  8005 catalog_manager.cc:5697] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.615403  8003 catalog_manager.cc:5697] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.621883  8297 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.629740  8297 ts_tablet_manager.cc:1434] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.002s
I20260709 13:15:54.630822  8297 tablet_bootstrap.cc:492] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:54.638360  8332 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.697700  8332 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.698621  8297 tablet_bootstrap.cc:654] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:54.700743  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 75313.1us
I20260709 13:15:54.701881  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:15:54.703481  8149 leader_election.cc:343] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.707178  8299 tablet_bootstrap.cc:492] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:54.707674  8298 tablet_bootstrap.cc:492] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:54.708221  8298 ts_tablet_manager.cc:1403] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.204s	user 0.027s	sys 0.038s
I20260709 13:15:54.710634  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:54.711298  8257 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.712508  8372 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.715516  8298 raft_consensus.cc:359] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.717104  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:54.716285  8298 raft_consensus.cc:385] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.718140  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:54.718798  8105 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.720346  8298 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.725683  8298 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.707652  8299 ts_tablet_manager.cc:1403] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.264s	user 0.021s	sys 0.019s
I20260709 13:15:54.741616  8373 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:54.742601  8368 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:54.744935  8298 ts_tablet_manager.cc:1434] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
W20260709 13:15:54.746903  8149 leader_election.cc:343] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.746201  8298 tablet_bootstrap.cc:492] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:54.748356  8369 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:54.753185  8297 tablet_bootstrap.cc:492] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:54.754281  8297 ts_tablet_manager.cc:1403] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.124s	user 0.022s	sys 0.009s
I20260709 13:15:54.738466  8372 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:54.758083  8297 raft_consensus.cc:359] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.762688  8373 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:54.763324  8332 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:54.768086  8003 catalog_manager.cc:5697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.773332  8369 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:54.772095  8297 raft_consensus.cc:385] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.776208  8297 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.770169  8299 raft_consensus.cc:359] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.763746  8105 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:54.777537  8299 raft_consensus.cc:385] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.777942  8299 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.771196  8257 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:54.782275  8298 tablet_bootstrap.cc:654] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.783097  8297 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.784451  8299 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.786437  8149 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:54.787627  8297 ts_tablet_manager.cc:1434] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
I20260709 13:15:54.788225  8372 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:54.788838  8372 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:54.789937  8299 ts_tablet_manager.cc:1434] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:15:54.790534  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:54.791127  8299 tablet_bootstrap.cc:492] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:54.791678  8369 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:54.792135  8369 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:54.800138  8369 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.789938  8372 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.829831  8297 tablet_bootstrap.cc:492] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:54.844854  8299 tablet_bootstrap.cc:654] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.846745  8298 tablet_bootstrap.cc:492] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:54.849370  8298 ts_tablet_manager.cc:1403] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.002s
I20260709 13:15:54.851982  8298 raft_consensus.cc:359] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.851738  8006 catalog_manager.cc:5697] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.852671  8298 raft_consensus.cc:385] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.853014  8298 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.853761  8298 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.853482  8006 catalog_manager.cc:5697] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.855039  8254 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.856396  8298 ts_tablet_manager.cc:1434] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:15:54.857579  8298 tablet_bootstrap.cc:492] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:54.863420  8318 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.864210  8298 tablet_bootstrap.cc:654] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.863927  8318 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.866115  8318 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:54.874137  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:54.891980  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:54.885241  8223 leader_election.cc:343] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:54.910369  8223 leader_election.cc:343] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.910928  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:54.912563  8318 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:54.925769  8297 tablet_bootstrap.cc:654] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.929472  8466 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.930172  8466 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.932775  8372 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.933352  8372 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.935487  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:54.936100  8257 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:54.936554  8466 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.937016  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:54.937320  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:54.937515  8149 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:54.939049  8466 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:54.940037  8466 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.940462  8466 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.946345  8299 tablet_bootstrap.cc:492] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:54.946918  8299 ts_tablet_manager.cc:1403] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.156s	user 0.021s	sys 0.043s
W20260709 13:15:54.945760  8149 leader_election.cc:343] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.947566  8372 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.952337  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:54.953068  8257 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
W20260709 13:15:54.956777  8149 leader_election.cc:343] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:54.957165  8299 raft_consensus.cc:359] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.957983  8299 raft_consensus.cc:385] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.957741  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:54.958313  8299 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.959146  8372 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:54.959831  8372 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.960284  8372 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.967630  8299 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.970177  8298 tablet_bootstrap.cc:492] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:54.970824  8299 ts_tablet_manager.cc:1434] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:15:54.971001  8298 ts_tablet_manager.cc:1403] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.114s	user 0.015s	sys 0.016s
I20260709 13:15:54.972561  8299 tablet_bootstrap.cc:492] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:54.974449  8298 raft_consensus.cc:359] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.975199  8298 raft_consensus.cc:385] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.975487  8298 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:54.975831  8297 tablet_bootstrap.cc:492] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:54.976104  8298 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.976294  8372 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.979851  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:54.980504  8106 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:54.981355  8372 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:54.981801  8298 ts_tablet_manager.cc:1434] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:54.986703  8298 tablet_bootstrap.cc:492] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:54.988266  8299 tablet_bootstrap.cc:654] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.991391  8466 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.994704  8299 tablet_bootstrap.cc:492] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:54.995254  8299 ts_tablet_manager.cc:1403] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.007s
I20260709 13:15:54.976387  8297 ts_tablet_manager.cc:1403] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.188s	user 0.011s	sys 0.011s
I20260709 13:15:54.998214  8299 raft_consensus.cc:359] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.999112  8298 tablet_bootstrap.cc:654] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:54.999104  8299 raft_consensus.cc:385] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:54.999915  8299 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.000815  8299 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:54.993782  8466 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.001125  8297 raft_consensus.cc:359] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.001860  8297 raft_consensus.cc:385] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.002177  8297 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.003681  8299 ts_tablet_manager.cc:1434] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:55.004796  8299 tablet_bootstrap.cc:492] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:55.011102  8299 tablet_bootstrap.cc:654] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.022104  8297 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.022614  8299 tablet_bootstrap.cc:492] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:55.023180  8299 ts_tablet_manager.cc:1403] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:15:55.024334  8297 ts_tablet_manager.cc:1434] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 13:15:55.025902  8299 raft_consensus.cc:359] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.026624  8299 raft_consensus.cc:385] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.026927  8299 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.027230  8106 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:55.027722  8299 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.029170  8297 tablet_bootstrap.cc:492] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:55.029343  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:55.030237  8107 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.033344  8299 ts_tablet_manager.cc:1434] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:55.034482  8299 tablet_bootstrap.cc:492] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:55.035395  8297 tablet_bootstrap.cc:654] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.037303  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:55.038139  8257 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.041738  8298 tablet_bootstrap.cc:492] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:55.042351  8298 ts_tablet_manager.cc:1403] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.024s
I20260709 13:15:55.043200  8299 tablet_bootstrap.cc:654] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.044687  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:55.044729  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:55.047436  8466 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:55.047920  8466 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:55.048785  8466 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.045323  8254 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.054600  8372 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:55.057191  8298 raft_consensus.cc:359] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.057893  8298 raft_consensus.cc:385] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.058179  8298 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.065986  8257 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:55.069289  8298 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.072585  8298 ts_tablet_manager.cc:1434] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:15:55.076041  8297 tablet_bootstrap.cc:492] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:55.076565  8297 ts_tablet_manager.cc:1403] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.004s
I20260709 13:15:55.068306  8254 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:55.079631  8298 tablet_bootstrap.cc:492] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:55.085527  8372 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.085891  8297 raft_consensus.cc:359] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.086058  8372 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.086735  8297 raft_consensus.cc:385] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.087077  8297 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.084154  8107 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:55.087911  8297 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.088270  8372 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.091733  8297 ts_tablet_manager.cc:1434] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:15:55.091284  8003 catalog_manager.cc:5697] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.092996  8297 tablet_bootstrap.cc:492] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:55.094170  8298 tablet_bootstrap.cc:654] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.083966  8149 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:55.105252  8372 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:55.107676  8297 tablet_bootstrap.cc:654] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.115309  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:55.116011  8257 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:55.118172  8373 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:55.118770  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:55.119423  8108 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:55.119464  8369 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:55.119863  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:55.120831  8373 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:55.121253  8373 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.121670  8373 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.130359  8368 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:55.106029  8372 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:55.132249  8372 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.132704  8373 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.134835  8373 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.137998  8299 tablet_bootstrap.cc:492] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:55.138597  8299 ts_tablet_manager.cc:1403] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.104s	user 0.009s	sys 0.004s
I20260709 13:15:55.138985  8297 tablet_bootstrap.cc:492] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:55.139475  8297 ts_tablet_manager.cc:1403] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.000s
I20260709 13:15:55.141543  8299 raft_consensus.cc:359] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.142467  8299 raft_consensus.cc:385] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.144361  8299 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.145625  8299 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.146858  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:55.148088  8257 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.148707  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:55.149441  8106 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.149893  8299 ts_tablet_manager.cc:1434] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:15:55.151016  8299 tablet_bootstrap.cc:492] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:55.155714  8257 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:55.157178  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:55.158068  8373 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:55.158277  8309 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:55.158686  8373 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:55.159588  8373 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.142087  8297 raft_consensus.cc:359] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.167146  8297 raft_consensus.cc:385] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.167479  8297 raft_consensus.cc:740] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.168747  8309 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.168229  8297 consensus_queue.cc:260] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.169950  8309 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.172931  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:55.173246  8297 ts_tablet_manager.cc:1434] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:15:55.173854  8106 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:55.174582  8297 tablet_bootstrap.cc:492] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:55.175602  8309 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.169938  8299 tablet_bootstrap.cc:654] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.179378  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:55.180531  8254 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 1: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:15:55.184398  8074 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:55.185266  8309 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.194207  8318 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.194770  8318 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.203449  8298 tablet_bootstrap.cc:492] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:55.203981  8298 ts_tablet_manager.cc:1403] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.131s	user 0.026s	sys 0.024s
I20260709 13:15:55.204241  8309 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:55.204959  8309 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:55.205513  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:55.206772  8298 raft_consensus.cc:359] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.207494  8298 raft_consensus.cc:385] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.207772  8298 raft_consensus.cc:740] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.208505  8298 consensus_queue.cc:260] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.197480  8318 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:55.210376  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:55.211215  8108 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 1: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:15:55.212666  8298 ts_tablet_manager.cc:1434] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:15:55.212584  8223 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:55.213900  8298 tablet_bootstrap.cc:492] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:55.214324  8318 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.216055  8003 catalog_manager.cc:5697] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.222157  8318 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:55.242686  8438 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:55.249158  8299 tablet_bootstrap.cc:492] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:55.249725  8299 ts_tablet_manager.cc:1403] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.099s	user 0.023s	sys 0.016s
I20260709 13:15:55.250092  8298 tablet_bootstrap.cc:654] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.251927  8297 tablet_bootstrap.cc:654] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.254462  8299 raft_consensus.cc:359] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.255213  8299 raft_consensus.cc:385] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.255511  8299 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.256465  8299 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.259603  8299 ts_tablet_manager.cc:1434] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:55.262816  8299 tablet_bootstrap.cc:492] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:55.263234  8372 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:55.289707  8298 tablet_bootstrap.cc:492] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:55.290203  8298 ts_tablet_manager.cc:1403] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.077s	user 0.011s	sys 0.003s
I20260709 13:15:55.289222  8005 catalog_manager.cc:5697] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.292644  8372 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.293141  8298 raft_consensus.cc:359] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.294112  8298 raft_consensus.cc:385] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.293576  8372 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.299520  8372 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.300179  8372 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.301188  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:55.300712  8372 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:55.303180  8149 leader_election.cc:343] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:55.303823  8372 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.304448  8298 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.305154  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:55.305920  8107 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:55.307775  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:55.308490  8254 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:55.308730  8299 tablet_bootstrap.cc:654] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.310031  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:55.311393  8373 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:55.311827  8373 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.305392  8298 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.312196  8373 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.313951  8298 ts_tablet_manager.cc:1434] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:15:55.313910  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:15:55.315853  8149 leader_election.cc:343] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:55.316298  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:55.317306  8372 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:55.317682  8466 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:55.321887  8298 tablet_bootstrap.cc:492] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:55.330910  8298 tablet_bootstrap.cc:654] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.354178  8298 tablet_bootstrap.cc:492] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:55.354795  8298 ts_tablet_manager.cc:1403] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.002s
I20260709 13:15:55.358244  8298 raft_consensus.cc:359] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.359140  8298 raft_consensus.cc:385] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.359494  8298 raft_consensus.cc:740] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.360126  8298 consensus_queue.cc:260] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.362573  8298 ts_tablet_manager.cc:1434] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:55.363525  8298 tablet_bootstrap.cc:492] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:55.363663  8299 tablet_bootstrap.cc:492] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:55.364069  8299 ts_tablet_manager.cc:1403] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.011s
I20260709 13:15:55.367095  8299 raft_consensus.cc:359] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.367830  8299 raft_consensus.cc:385] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.368163  8299 raft_consensus.cc:740] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.368903  8299 consensus_queue.cc:260] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.370321  8438 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:55.370775  8299 ts_tablet_manager.cc:1434] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:55.372263  8299 tablet_bootstrap.cc:492] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:55.373059  8298 tablet_bootstrap.cc:654] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.373219  8373 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.376405  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:55.377358  8106 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.382777  8299 tablet_bootstrap.cc:654] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.385901  8297 tablet_bootstrap.cc:492] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:55.386502  8297 ts_tablet_manager.cc:1403] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.212s	user 0.042s	sys 0.030s
I20260709 13:15:55.387115  8106 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:55.391909  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:55.391785  8297 raft_consensus.cc:359] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.393007  8297 raft_consensus.cc:385] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.393201  8298 tablet_bootstrap.cc:492] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:55.393318  8297 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.393903  8298 ts_tablet_manager.cc:1403] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.000s
I20260709 13:15:55.394230  8297 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.395364  8438 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:55.396145  8438 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:55.396334  8297 ts_tablet_manager.cc:1434] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:55.396821  8298 raft_consensus.cc:359] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.397393  8297 tablet_bootstrap.cc:492] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:55.397595  8298 raft_consensus.cc:385] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.397153  8438 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.397981  8298 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.398725  8298 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.401331  8298 ts_tablet_manager.cc:1434] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:15:55.407979  8298 tablet_bootstrap.cc:492] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:55.410920  8373 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.415621  8299 tablet_bootstrap.cc:492] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:55.416168  8299 ts_tablet_manager.cc:1403] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.010s
I20260709 13:15:55.420779  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:55.421875  8254 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:55.423655  8054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:55.424813  8298 tablet_bootstrap.cc:654] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.424337  8299 raft_consensus.cc:359] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.425239  8299 raft_consensus.cc:385] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.425594  8299 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.427834  8299 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.435498  8299 ts_tablet_manager.cc:1434] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:15:55.437652  8297 tablet_bootstrap.cc:654] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.447139  8373 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.449918  8373 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.452571  8373 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.453577  8299 tablet_bootstrap.cc:492] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:55.463653  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:55.464439  8255 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:55.465346  8254 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:55.467589  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:55.468327  8108 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:55.469887  8318 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.470530  8318 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.473662  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:55.474404  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:55.476683  8373 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:55.476804  8223 leader_election.cc:343] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:55.477207  8373 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.478587  8373 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.479897  8318 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:55.481683  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:55.482424  8183 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 0.
I20260709 13:15:55.483559  8309 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.484010  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:55.484027  8309 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.484952  8330 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:55.485302  8330 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.485651  8330 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.486169  8309 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.487962  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:55.488547  8254 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:55.489624  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:55.490617  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:55.490100  8298 tablet_bootstrap.cc:492] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:55.491230  8183 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:55.491585  8298 ts_tablet_manager.cc:1403] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.001s
I20260709 13:15:55.492415  8490 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:55.492830  8490 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.493155  8490 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.495477  8330 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.496143  8297 tablet_bootstrap.cc:492] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:55.496626  8297 ts_tablet_manager.cc:1403] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.099s	user 0.010s	sys 0.008s
I20260709 13:15:55.489382  8373 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.498155  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:55.498327  8372 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:55.499493  8373 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:15:55.500042  8223 leader_election.cc:343] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:55.501197  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:55.501878  8107 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.504873  8490 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.506172  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:55.506902  8297 raft_consensus.cc:359] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.501237  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:55.507647  8297 raft_consensus.cc:385] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.507278  8183 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.507318  8298 raft_consensus.cc:359] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.510774  8298 raft_consensus.cc:385] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.511102  8298 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.511813  8298 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.514003  8298 ts_tablet_manager.cc:1434] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.005s
I20260709 13:15:55.515008  8298 tablet_bootstrap.cc:492] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:55.498607  8330 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:55.507835  8255 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.507975  8297 raft_consensus.cc:740] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.517048  8297 consensus_queue.cc:260] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.508709  8490 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.509689  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:55.519762  8254 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.519413  8107 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:55.522773  8183 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:15:55.510149  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:55.523833  8182 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.524165  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:55.525652  8330 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:55.526909  8330 raft_consensus.cc:697] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:15:55.527837  8330 consensus_queue.cc:237] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.528535  8254 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:55.530098  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:55.530946  8490 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:55.532572  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:55.533288  8490 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:55.533494  8466 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:55.534047  8466 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:55.534248  8490 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.535264  8466 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.519394  8297 ts_tablet_manager.cc:1434] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:15:55.538165  8255 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:55.538218  8182 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:55.540714  8298 tablet_bootstrap.cc:654] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.539072  8299 tablet_bootstrap.cc:654] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.545536  8297 tablet_bootstrap.cc:492] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:55.560144  8298 tablet_bootstrap.cc:492] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:55.560729  8298 ts_tablet_manager.cc:1403] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.001s
I20260709 13:15:55.563412  8298 raft_consensus.cc:359] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.564154  8298 raft_consensus.cc:385] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.564469  8298 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.565281  8298 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.567309  8298 ts_tablet_manager.cc:1434] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:55.567042  8005 catalog_manager.cc:5697] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.568401  8298 tablet_bootstrap.cc:492] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:55.568832  8297 tablet_bootstrap.cc:654] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.568921  8466 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:55.590061  8297 tablet_bootstrap.cc:492] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:55.590618  8298 tablet_bootstrap.cc:654] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.590701  8297 ts_tablet_manager.cc:1403] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.004s
I20260709 13:15:55.591387  8299 tablet_bootstrap.cc:492] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:55.591933  8299 ts_tablet_manager.cc:1403] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.139s	user 0.017s	sys 0.001s
I20260709 13:15:55.592502  8006 catalog_manager.cc:5697] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:55.594225  8297 raft_consensus.cc:359] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.594919  8297 raft_consensus.cc:385] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.595230  8297 raft_consensus.cc:740] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.595170  8299 raft_consensus.cc:359] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.596165  8299 raft_consensus.cc:385] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.596480  8299 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.596351  8297 consensus_queue.cc:260] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.599011  8003 catalog_manager.cc:5697] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.597259  8299 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.601687  8299 ts_tablet_manager.cc:1434] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:15:55.604566  8299 tablet_bootstrap.cc:492] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:55.603509  8297 ts_tablet_manager.cc:1434] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:55.606684  8332 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:55.608516  8297 tablet_bootstrap.cc:492] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:55.615521  8368 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:15:55.635500  8298 tablet_bootstrap.cc:492] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:55.636864  8298 ts_tablet_manager.cc:1403] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.012s
I20260709 13:15:55.639237  8006 catalog_manager.cc:5697] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.648625  8490 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.649339  8490 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.653510  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:55.654161  8182 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:55.655431  8074 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:55.655604  8490 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.656186  8490 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:55.656562  8490 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.656479  8368 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:55.657143  8490 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.657243  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:55.658115  8254 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:55.675560  8299 tablet_bootstrap.cc:654] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.676504  8490 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.678951  8490 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.681581  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:55.682183  8254 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.682116  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:55.685719  8182 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.686358  8297 tablet_bootstrap.cc:654] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.689172  8298 raft_consensus.cc:359] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.713186  8298 raft_consensus.cc:385] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.713662  8298 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.688838  8330 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.714389  8298 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.716686  8298 ts_tablet_manager.cc:1434] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.000s
I20260709 13:15:55.716918  8254 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:55.714478  8330 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.717800  8298 tablet_bootstrap.cc:492] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:55.720032  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:15:55.721702  8223 leader_election.cc:343] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:55.724388  8298 tablet_bootstrap.cc:654] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.725381  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:55.727463  8223 leader_election.cc:343] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:55.728120  8223 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:55.729194  8318 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:55.733634  8330 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:55.735724  8074 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:55.737030  8309 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:55.737800  8309 raft_consensus.cc:697] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:55.738869  8309 consensus_queue.cc:237] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.743731  8298 tablet_bootstrap.cc:492] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:55.744266  8298 ts_tablet_manager.cc:1403] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 13:15:55.746430  8182 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:55.751919  8299 tablet_bootstrap.cc:492] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:55.752413  8299 ts_tablet_manager.cc:1403] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.148s	user 0.017s	sys 0.018s
I20260709 13:15:55.753041  8297 tablet_bootstrap.cc:492] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:55.753572  8297 ts_tablet_manager.cc:1403] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.145s	user 0.023s	sys 0.013s
I20260709 13:15:55.755486  8299 raft_consensus.cc:359] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.756160  8299 raft_consensus.cc:385] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.755918  8297 raft_consensus.cc:359] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.756456  8299 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.756812  8297 raft_consensus.cc:385] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.757141  8297 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.757237  8299 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.758037  8297 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.758590  8491 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.759068  8491 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.760875  8297 ts_tablet_manager.cc:1434] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:15:55.761150  8491 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.761835  8297 tablet_bootstrap.cc:492] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:55.762753  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:55.767757  8074 leader_election.cc:343] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:55.771819  8297 tablet_bootstrap.cc:654] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.776365  8298 raft_consensus.cc:359] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.775599  8005 catalog_manager.cc:5697] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.776957  8298 raft_consensus.cc:385] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.778117  8298 raft_consensus.cc:740] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.778962  8298 consensus_queue.cc:260] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.781247  8298 ts_tablet_manager.cc:1434] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 13:15:55.782280  8298 tablet_bootstrap.cc:492] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:55.786639  8330 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.762740  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:55.764467  8438 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:55.787117  8330 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.789158  8298 tablet_bootstrap.cc:654] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.789177  8330 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:55.790905  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:15:55.792613  8223 leader_election.cc:343] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:55.793654  8368 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:55.793916  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:55.795105  8182 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 0.
I20260709 13:15:55.796702  8223 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:55.797818  8330 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:55.798171  8330 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.798485  8330 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:55.803531  8074 leader_election.cc:343] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:55.804009  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:55.813009  8299 ts_tablet_manager.cc:1434] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.001s
I20260709 13:15:55.814127  8299 tablet_bootstrap.cc:492] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:55.814471  8373 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:55.815106  8330 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.822397  8490 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.822777  8309 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:55.822996  8490 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.825515  8299 tablet_bootstrap.cc:654] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.825342  8490 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.826635  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:15:55.827947  8223 leader_election.cc:343] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:55.829665  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:55.830466  8182 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:55.833061  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:55.839248  8183 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.840777  8298 tablet_bootstrap.cc:492] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:55.841338  8298 ts_tablet_manager.cc:1403] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.015s
I20260709 13:15:55.843914  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:55.837399  8330 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:55.844594  8254 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:55.845628  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:55.846684  8491 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:55.847230  8491 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.847757  8491 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.864207  8298 raft_consensus.cc:359] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.865177  8298 raft_consensus.cc:385] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.865583  8298 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.866997  8298 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.875627  8299 tablet_bootstrap.cc:492] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:55.876415  8299 ts_tablet_manager.cc:1403] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.024s
I20260709 13:15:55.876917  8183 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:15:55.877290  8438 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.877835  8438 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.878204  8223 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:55.879467  8299 raft_consensus.cc:359] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.879984  8438 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.880244  8299 raft_consensus.cc:385] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.880568  8299 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.881246  8299 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.882727  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:55.883456  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:55.883795  8299 ts_tablet_manager.cc:1434] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 13:15:55.885015  8149 leader_election.cc:343] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:55.889617  8526 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:55.890288  8526 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:15:55.891259  8368 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.891116  8526 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:55.892424  8149 leader_election.cc:343] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:55.892863  8149 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:55.891767  8368 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.894919  8373 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:55.897538  8298 ts_tablet_manager.cc:1434] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.056s	user 0.004s	sys 0.004s
I20260709 13:15:55.896611  8491 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.901175  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:55.901979  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:55.902963  8491 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.903069  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:55.903652  8183 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.908272  8298 tablet_bootstrap.cc:492] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:55.909910  8297 tablet_bootstrap.cc:492] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:55.910408  8297 ts_tablet_manager.cc:1403] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.149s	user 0.016s	sys 0.024s
I20260709 13:15:55.896632  8368 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:55.912561  8183 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:55.912976  8299 tablet_bootstrap.cc:492] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
W20260709 13:15:55.913841  8149 leader_election.cc:343] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:55.914395  8149 leader_election.cc:343] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:55.914661  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:55.920248  8372 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:55.933781  8297 raft_consensus.cc:359] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.934788  8297 raft_consensus.cc:385] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.935130  8297 raft_consensus.cc:740] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.912599  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:55.936487  8255 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:55.941785  8297 consensus_queue.cc:260] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.943197  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:55.952324  8298 tablet_bootstrap.cc:654] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.958978  8528 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:55.956489  8297 ts_tablet_manager.cc:1434] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:15:55.961833  8528 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:55.965569  8528 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.971871  8438 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:55.973564  8299 tablet_bootstrap.cc:654] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.974733  8297 tablet_bootstrap.cc:492] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:55.977284  8298 tablet_bootstrap.cc:492] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:55.977761  8298 ts_tablet_manager.cc:1403] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.001s
I20260709 13:15:55.977803  8255 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:55.981060  8005 catalog_manager.cc:5697] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:55.992115  8297 tablet_bootstrap.cc:654] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:55.993291  8298 raft_consensus.cc:359] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.995230  8298 raft_consensus.cc:385] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:55.995688  8298 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:55.996698  8298 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:55.998252  8299 tablet_bootstrap.cc:492] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:55.998700  8299 ts_tablet_manager.cc:1403] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.005s
I20260709 13:15:56.000435  8298 ts_tablet_manager.cc:1434] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:15:56.000563  8299 raft_consensus.cc:359] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.001857  8298 tablet_bootstrap.cc:492] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:56.001255  8299 raft_consensus.cc:385] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.004887  8299 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.013711  8299 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.018810  8299 ts_tablet_manager.cc:1434] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.003s
I20260709 13:15:56.019888  8299 tablet_bootstrap.cc:492] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:56.041705  8299 tablet_bootstrap.cc:654] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.041249  8004 catalog_manager.cc:5697] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.043007  8373 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:56.044890  8438 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.046262  8438 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.056044  8299 tablet_bootstrap.cc:492] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:56.056561  8299 ts_tablet_manager.cc:1403] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.004s
I20260709 13:15:56.059787  8438 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.060994  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:56.061771  8107 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:56.062212  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:56.062353  8299 raft_consensus.cc:359] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.063015  8299 raft_consensus.cc:385] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.063304  8299 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
W20260709 13:15:56.063644  8149 leader_election.cc:343] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:56.063913  8299 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.065146  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:56.065872  8373 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:56.066159  8299 ts_tablet_manager.cc:1434] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:15:56.066515  8373 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.066949  8373 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.067490  8299 tablet_bootstrap.cc:492] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:56.068919  8297 tablet_bootstrap.cc:492] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:56.069387  8297 ts_tablet_manager.cc:1403] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.029s
I20260709 13:15:56.071933  8297 raft_consensus.cc:359] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.072585  8297 raft_consensus.cc:385] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.072853  8297 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.073786  8297 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.075189  8373 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.081722  8297 ts_tablet_manager.cc:1434] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:15:56.082410  8318 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:56.084187  8299 tablet_bootstrap.cc:654] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.069350  8298 tablet_bootstrap.cc:654] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.094821  8297 tablet_bootstrap.cc:492] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
W20260709 13:15:56.098001  8223 consensus_peers.cc:597] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:56.100483  8297 tablet_bootstrap.cc:654] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.108193  8528 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:56.124506  8298 tablet_bootstrap.cc:492] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:56.125291  8298 ts_tablet_manager.cc:1403] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.124s	user 0.020s	sys 0.002s
I20260709 13:15:56.126953  8309 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:56.133240  8298 raft_consensus.cc:359] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.134284  8298 raft_consensus.cc:385] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.134656  8298 raft_consensus.cc:740] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.135489  8298 consensus_queue.cc:260] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.137512  8298 ts_tablet_manager.cc:1434] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:15:56.138561  8298 tablet_bootstrap.cc:492] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:56.145682  8298 tablet_bootstrap.cc:654] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.159858  8298 tablet_bootstrap.cc:492] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:56.160472  8298 ts_tablet_manager.cc:1403] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.013s
I20260709 13:15:56.164093  8298 raft_consensus.cc:359] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.164958  8298 raft_consensus.cc:385] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.165233  8298 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.166100  8298 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.169018  8298 ts_tablet_manager.cc:1434] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:56.170266  8298 tablet_bootstrap.cc:492] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:56.179322  8298 tablet_bootstrap.cc:654] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.191660  8298 tablet_bootstrap.cc:492] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:56.197039  8299 tablet_bootstrap.cc:492] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:56.197590  8299 ts_tablet_manager.cc:1403] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.130s	user 0.039s	sys 0.030s
I20260709 13:15:56.199635  8528 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:56.200801  8299 raft_consensus.cc:359] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.201633  8299 raft_consensus.cc:385] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.201613  8528 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:56.202096  8299 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.202654  8330 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.202885  8299 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.203123  8330 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.205271  8299 ts_tablet_manager.cc:1434] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:15:56.205385  8330 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:56.206214  8299 tablet_bootstrap.cc:492] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:56.212134  8299 tablet_bootstrap.cc:654] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.212049  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:15:56.216722  8223 leader_election.cc:343] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:56.218046  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:56.218976  8181 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 0.
I20260709 13:15:56.220750  8223 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:56.221835  8330 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:56.222219  8330 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.222581  8330 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.224203  8299 tablet_bootstrap.cc:492] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:56.224649  8299 ts_tablet_manager.cc:1403] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 13:15:56.227082  8299 raft_consensus.cc:359] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.227754  8299 raft_consensus.cc:385] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.228031  8299 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.228818  8299 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.230415  8330 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.231150  8299 ts_tablet_manager.cc:1434] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:15:56.231232  8372 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.231797  8372 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.232363  8330 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:56.236249  8298 ts_tablet_manager.cc:1403] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.006s
I20260709 13:15:56.233827  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:56.239773  8528 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.246150  8299 tablet_bootstrap.cc:492] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:56.252948  8298 raft_consensus.cc:359] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:56.253671  8223 leader_election.cc:343] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:56.258886  8298 raft_consensus.cc:385] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.259267  8298 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.261343  8372 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.264322  8299 tablet_bootstrap.cc:654] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.264889  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:56.255638  8373 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.265594  8107 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.234773  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:56.251543  8528 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.268002  8528 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.268782  8181 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.262253  8298 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.276108  8298 ts_tablet_manager.cc:1434] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:15:56.279577  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:56.281702  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:56.282650  8297 tablet_bootstrap.cc:492] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:56.283918  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:56.287890  8297 ts_tablet_manager.cc:1403] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.205s	user 0.047s	sys 0.069s
W20260709 13:15:56.290797  8149 leader_election.cc:343] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:56.291574  8149 leader_election.cc:343] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:56.294361  8107 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:56.295730  8298 tablet_bootstrap.cc:492] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:56.298273  8491 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.298807  8491 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.300426  8297 raft_consensus.cc:359] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.301020  8491 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.301184  8297 raft_consensus.cc:385] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.307564  8297 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
W20260709 13:15:56.307039  8149 leader_election.cc:343] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:56.308344  8149 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:56.309695  8373 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:56.311985  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:56.313102  8297 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.315771  8297 ts_tablet_manager.cc:1434] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:15:56.316115  8298 tablet_bootstrap.cc:654] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.316355  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:56.316855  8297 tablet_bootstrap.cc:492] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:56.317049  8182 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:56.317632  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:56.318001  8372 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:56.318574  8372 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:56.319407  8372 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.320499  8299 tablet_bootstrap.cc:492] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:56.322257  8299 ts_tablet_manager.cc:1403] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.076s	user 0.028s	sys 0.030s
I20260709 13:15:56.323560  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:56.324167  8182 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:56.325042  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:56.325721  8253 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:56.326781  8299 raft_consensus.cc:359] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.327483  8299 raft_consensus.cc:385] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.327742  8299 raft_consensus.cc:740] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.328365  8299 consensus_queue.cc:260] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.331271  8299 ts_tablet_manager.cc:1434] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:15:56.338703  8107 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.351588  8299 tablet_bootstrap.cc:492] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:56.354555  8181 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:15:56.355553  8074 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:56.361634  8528 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:56.362068  8528 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.364009  8528 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.365127  8223 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:56.360312  8490 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.365864  8490 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.366243  8526 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:56.366730  8526 raft_consensus.cc:697] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:15:56.367761  8490 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.367507  8526 consensus_queue.cc:237] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.371651  8299 tablet_bootstrap.cc:654] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.372255  8005 catalog_manager.cc:5697] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.381734  8309 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.382236  8309 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.384119  8309 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.396348  8298 tablet_bootstrap.cc:492] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:56.396903  8298 ts_tablet_manager.cc:1403] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.009s
I20260709 13:15:56.399855  8297 tablet_bootstrap.cc:654] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.399960  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:56.404886  8490 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:56.410233  8490 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.413775  8490 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.416595  8528 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.420024  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:56.422703  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:56.427667  8490 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.429191  8309 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.435438  8309 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.447842  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:56.474735  8183 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
W20260709 13:15:56.473829  8074 leader_election.cc:343] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:56.449229  8330 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:15:56.461225  8526 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.480729  8526 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.467387  8490 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.486443  8298 raft_consensus.cc:359] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.487119  8298 raft_consensus.cc:385] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.487378  8298 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.487984  8298 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:56.488355  8074 leader_election.cc:343] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:56.489817  8555 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.490464  8298 ts_tablet_manager.cc:1434] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.002s
I20260709 13:15:56.483022  8309 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.490275  8555 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.487752  8005 catalog_manager.cc:5697] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:56.494745  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:56.495432  8526 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:56.495944  8555 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.497566  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:56.505478  8182 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:56.507033  8223 leader_election.cc:343] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:56.498703  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:56.508005  8181 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 0.
I20260709 13:15:56.507934  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:56.508613  8528 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.509770  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:56.504160  8297 tablet_bootstrap.cc:492] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:56.512759  8297 ts_tablet_manager.cc:1403] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.196s	user 0.010s	sys 0.010s
I20260709 13:15:56.513022  8526 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:56.513397  8526 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.513736  8526 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.519299  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:56.519814  8254 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.520627  8298 tablet_bootstrap.cc:492] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:56.521947  8297 raft_consensus.cc:359] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.522626  8297 raft_consensus.cc:385] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.522853  8297 raft_consensus.cc:740] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.523310  8297 consensus_queue.cc:260] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.531827  8299 tablet_bootstrap.cc:492] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:56.532295  8299 ts_tablet_manager.cc:1403] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.181s	user 0.010s	sys 0.004s
I20260709 13:15:56.534914  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:56.535537  8180 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
W20260709 13:15:56.532200  8074 leader_election.cc:343] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:56.537345  8254 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:56.539484  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:56.543365  8179 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.543402  8299 raft_consensus.cc:359] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.544267  8299 raft_consensus.cc:385] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.544543  8299 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.539613  8182 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:56.540361  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:56.541005  8526 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.522120  8368 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.542663  8297 ts_tablet_manager.cc:1434] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.030s	user 0.001s	sys 0.005s
I20260709 13:15:56.545131  8299 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.546454  8330 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:56.546620  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:56.560006  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:15:56.561841  8223 leader_election.cc:343] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:56.563475  8297 tablet_bootstrap.cc:492] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:56.557617  8528 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:56.566278  8299 ts_tablet_manager.cc:1434] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.001s
I20260709 13:15:56.552569  8368 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.568076  8368 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.599131  8526 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:56.607589  8297 tablet_bootstrap.cc:654] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.610162  8299 tablet_bootstrap.cc:492] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:56.610663  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:56.611953  8107 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:56.624402  8299 tablet_bootstrap.cc:654] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.625627  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:56.628659  8298 tablet_bootstrap.cc:654] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.620009  8179 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:56.629968  8555 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:56.630357  8555 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.630793  8555 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:56.637663  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 69495.7us
I20260709 13:15:56.639304  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:56.640811  8299 tablet_bootstrap.cc:492] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:56.641260  8299 ts_tablet_manager.cc:1403] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.004s
I20260709 13:15:56.644546  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:56.645129  8179 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.647379  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:56.648923  8549 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:56.649314  8549 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.649682  8549 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.646896  8299 raft_consensus.cc:359] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.652629  8299 raft_consensus.cc:385] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.652989  8299 raft_consensus.cc:740] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.653126  8179 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:15:56.655511  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:56.656742  8526 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:56.655447  8298 tablet_bootstrap.cc:492] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:56.657289  8526 raft_consensus.cc:697] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:15:56.657764  8298 ts_tablet_manager.cc:1403] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.141s	user 0.012s	sys 0.004s
I20260709 13:15:56.658152  8526 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.661288  8298 raft_consensus.cc:359] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.643841  8555 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.663614  8298 raft_consensus.cc:385] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.664000  8298 raft_consensus.cc:740] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.664752  8297 tablet_bootstrap.cc:492] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:56.665262  8297 ts_tablet_manager.cc:1403] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.015s
I20260709 13:15:56.664927  8299 consensus_queue.cc:260] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.665835  8555 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.667639  8297 raft_consensus.cc:359] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.668288  8297 raft_consensus.cc:385] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.668530  8297 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.664772  8298 consensus_queue.cc:260] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.671710  8298 ts_tablet_manager.cc:1434] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:15:56.672719  8298 tablet_bootstrap.cc:492] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:56.675799  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:56.678277  8298 tablet_bootstrap.cc:654] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.680992  8297 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.683144  8297 ts_tablet_manager.cc:1434] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260709 13:15:56.659919  8549 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.688401  8297 tablet_bootstrap.cc:492] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:56.692983  8528 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.693574  8528 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:15:56.694041  8297 tablet_bootstrap.cc:654] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.694070  8528 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.694485  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:56.699030  8298 tablet_bootstrap.cc:492] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:56.699503  8298 ts_tablet_manager.cc:1403] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:15:56.701386  8528 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.702109  8298 raft_consensus.cc:359] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.702747  8298 raft_consensus.cc:385] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.703006  8298 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.703795  8528 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.703644  8298 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.705380  8298 ts_tablet_manager.cc:1434] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
W20260709 13:15:56.705518  8149 leader_election.cc:343] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:56.706329  8298 tablet_bootstrap.cc:492] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:56.707188  8491 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:56.707659  8491 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:56.708577  8074 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:56.708478  8491 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.709175  8297 tablet_bootstrap.cc:492] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:56.687629  8549 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.709625  8555 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:56.712134  8299 ts_tablet_manager.cc:1434] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:15:56.712839  8555 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:56.710095  8297 ts_tablet_manager.cc:1403] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:15:56.713912  8555 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.715963  8297 raft_consensus.cc:359] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.716578  8297 raft_consensus.cc:385] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.716816  8297 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.717422  8297 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.717557  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:56.718327  8255 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:56.719986  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:56.720199  8299 tablet_bootstrap.cc:492] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:56.720703  8297 ts_tablet_manager.cc:1434] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:56.720573  8179 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:56.723732  8297 tablet_bootstrap.cc:492] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:56.725026  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:56.729313  8297 tablet_bootstrap.cc:654] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.731452  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:56.732089  8106 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.735978  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:56.739663  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:56.740249  8179 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.736707  8003 catalog_manager.cc:5697] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:56.742391  8106 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:56.731447  8298 tablet_bootstrap.cc:654] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.731488  8526 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.745808  8526 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.747872  8526 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:56.749413  8299 tablet_bootstrap.cc:654] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.751161  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:56.751187  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:56.777186  8106 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 1: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:15:56.753161  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:56.778474  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:56.779878  8330 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.757614  8179 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:56.757633  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:56.759608  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:15:56.764498  8054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:56.786657  8299 tablet_bootstrap.cc:492] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:56.786640  8330 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:56.787247  8299 ts_tablet_manager.cc:1403] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.001s
I20260709 13:15:56.787578  8297 tablet_bootstrap.cc:492] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:56.788028  8297 ts_tablet_manager.cc:1403] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.065s	user 0.028s	sys 0.024s
I20260709 13:15:56.788349  8005 catalog_manager.cc:5697] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.789937  8005 catalog_manager.cc:5697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.790396  8299 raft_consensus.cc:359] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.791250  8299 raft_consensus.cc:385] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.790977  8297 raft_consensus.cc:359] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.791543  8299 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.791644  8297 raft_consensus.cc:385] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.791916  8297 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
W20260709 13:15:56.771488  8074 leader_election.cc:343] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:56.772055  8372 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:56.792169  8299 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.792529  8297 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.773078  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:56.773648  8526 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.793495  8528 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:56.793889  8526 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.794219  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:56.794467  8297 ts_tablet_manager.cc:1434] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
W20260709 13:15:56.794966  8074 leader_election.cc:343] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:56.795398  8297 tablet_bootstrap.cc:492] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:56.795783  8299 ts_tablet_manager.cc:1434] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:15:56.795895  8526 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:56.796494  8255 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.796684  8299 tablet_bootstrap.cc:492] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:56.801990  8297 tablet_bootstrap.cc:654] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.782824  8298 tablet_bootstrap.cc:492] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:56.802495  8555 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:56.802701  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:56.802898  8555 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.803378  8555 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.803575  8106 raft_consensus.cc:2393] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 1: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:15:56.804929  8255 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:56.802933  8298 ts_tablet_manager.cc:1403] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.010s
I20260709 13:15:56.808010  8298 raft_consensus.cc:359] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.808607  8298 raft_consensus.cc:385] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.808851  8298 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.809495  8298 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.811431  8298 ts_tablet_manager.cc:1434] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:56.812289  8298 tablet_bootstrap.cc:492] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:56.813781  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:56.814510  8179 raft_consensus.cc:2393] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 1: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:15:56.816756  8223 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:56.819146  8318 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:56.823233  8223 consensus_peers.cc:597] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:56.829396  8528 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:56.832218  8372 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:56.832723  8372 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:56.833678  8372 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:56.836496  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 63527.1us
I20260709 13:15:56.843115  8299 tablet_bootstrap.cc:654] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.847196  8555 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.851439  8555 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.866196  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:56.867669  8490 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:56.868218  8490 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:56.869005  8490 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.871013  8003 catalog_manager.cc:5697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.873117  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:56.875396  8298 tablet_bootstrap.cc:654] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.875102  8330 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:56.878144  8528 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.884904  8299 tablet_bootstrap.cc:492] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:56.885553  8299 ts_tablet_manager.cc:1403] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.089s	user 0.011s	sys 0.002s
I20260709 13:15:56.892884  8299 raft_consensus.cc:359] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:56.893857  8149 leader_election.cc:343] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:56.893857  8299 raft_consensus.cc:385] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.894928  8299 raft_consensus.cc:740] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.895709  8299 consensus_queue.cc:260] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.898581  8299 ts_tablet_manager.cc:1434] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:15:56.899691  8299 tablet_bootstrap.cc:492] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:56.900130  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:56.900797  8181 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.916404  8181 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:56.920671  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:56.921856  8490 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.923466  8490 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.921357  8253 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:56.925760  8490 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.937673  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:56.941082  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:56.943113  8006 catalog_manager.cc:5697] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.949882  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:56.952363  8438 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.952879  8438 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.953640  8490 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:56.955943  8438 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.956053  8490 raft_consensus.cc:697] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:56.957486  8490 consensus_queue.cc:237] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.959617  8298 tablet_bootstrap.cc:492] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:56.960079  8298 ts_tablet_manager.cc:1403] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.148s	user 0.007s	sys 0.004s
I20260709 13:15:56.962817  8298 raft_consensus.cc:359] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.965013  8555 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.968534  8555 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.969457  8298 raft_consensus.cc:385] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.969867  8298 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.970531  8298 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.973610  8298 ts_tablet_manager.cc:1434] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:15:56.971711  8074 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:56.974401  8491 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:56.971284  8555 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.974611  8298 tablet_bootstrap.cc:492] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:56.967679  8299 tablet_bootstrap.cc:654] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.982964  8253 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:56.985978  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:56.986680  8181 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:56.987650  8528 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.988211  8528 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.989399  8299 tablet_bootstrap.cc:492] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:56.989843  8298 tablet_bootstrap.cc:654] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:56.990206  8299 ts_tablet_manager.cc:1403] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.091s	user 0.006s	sys 0.007s
I20260709 13:15:56.990299  8528 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:56.991770  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:56.994459  8299 raft_consensus.cc:359] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:56.995196  8299 raft_consensus.cc:385] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:56.996009  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:56.996716  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:56.997566  8179 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:56.994578  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:56.999799  8309 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:56.995462  8299 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:57.000308  8309 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.000774  8309 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:57.000826  8299 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.003099  8299 ts_tablet_manager.cc:1434] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:15:57.003810  8297 tablet_bootstrap.cc:492] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:57.004022  8299 tablet_bootstrap.cc:492] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:57.004246  8297 ts_tablet_manager.cc:1403] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.209s	user 0.069s	sys 0.105s
I20260709 13:15:57.006637  8297 raft_consensus.cc:359] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.008553  8297 raft_consensus.cc:385] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:57.008836  8297 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:57.009469  8297 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.010224  8074 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:57.012604  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:57.014977  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:57.011595  8528 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:57.016040  8528 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.016404  8528 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:57.017714  8297 ts_tablet_manager.cc:1434] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:15:57.018270  8299 tablet_bootstrap.cc:654] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:57.019752  8297 tablet_bootstrap.cc:492] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
W20260709 13:15:57.023720  8074 leader_election.cc:343] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:57.024644  8074 leader_election.cc:343] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:56.993283  8006 catalog_manager.cc:5697] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.021996  8298 tablet_bootstrap.cc:492] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:57.025911  8298 ts_tablet_manager.cc:1403] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.052s	user 0.023s	sys 0.007s
I20260709 13:15:57.026469  8309 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.027690  8103 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 1: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:15:57.026818  8528 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.028710  8309 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:57.030632  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:57.031857  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:57.032349  8528 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:57.032439  8181 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:57.033236  8074 leader_election.cc:343] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:57.033185  8372 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:57.032084  8297 tablet_bootstrap.cc:654] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:57.033545  8298 raft_consensus.cc:359] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.034193  8298 raft_consensus.cc:385] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:57.034466  8298 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
W20260709 13:15:57.034724  8149 leader_election.cc:343] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:57.035087  8298 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.038417  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:57.030598  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:57.039769  8179 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:57.040369  8074 leader_election.cc:343] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:57.043665  8298 ts_tablet_manager.cc:1434] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:15:57.044153  8297 tablet_bootstrap.cc:492] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:57.044164  8181 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:57.044656  8298 tablet_bootstrap.cc:492] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:57.045809  8074 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:57.046634  8179 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:57.046736  8528 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:57.047724  8528 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:57.048004  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:57.048781  8309 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:57.044660  8297 ts_tablet_manager.cc:1403] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.006s
I20260709 13:15:57.052021  8298 tablet_bootstrap.cc:654] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:57.049296  8309 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:57.053519  8309 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.054488  8297 raft_consensus.cc:359] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.055166  8297 raft_consensus.cc:385] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:57.055444  8297 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:57.056058  8297 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.050271  8299 tablet_bootstrap.cc:492] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:57.057777  8299 ts_tablet_manager.cc:1403] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.000s
I20260709 13:15:57.058444  8297 ts_tablet_manager.cc:1434] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:57.058465  8330 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.059146  8330 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.059677  8297 tablet_bootstrap.cc:492] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:57.049840  8528 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.063619  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:15:57.065356  8223 leader_election.cc:343] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:57.065955  8330 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:57.066210  8297 tablet_bootstrap.cc:654] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:57.071920  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:57.076530  8179 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 0.
I20260709 13:15:57.080862  8223 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:57.082463  8330 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:57.082983  8330 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.083487  8330 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:57.078639  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:57.096926  8549 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:57.099712  8299 raft_consensus.cc:359] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.104274  8299 raft_consensus.cc:385] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:57.109719  8299 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:57.110625  8299 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.116767  8299 ts_tablet_manager.cc:1434] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:15:57.121235  8299 tablet_bootstrap.cc:492] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:57.122982  8309 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.123471  8309 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.131232  8309 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:57.134205  8330 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.134511  8438 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.135224  8438 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.135772  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:57.140007  8299 tablet_bootstrap.cc:654] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:57.136461  8330 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:57.137897  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:57.146903  8103 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:57.155184  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:57.159780  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:57.165717  8149 leader_election.cc:343] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:57.168414  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:57.169173  8309 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:57.169088  8438 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:57.171401  8005 catalog_manager.cc:5697] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.174893  8297 tablet_bootstrap.cc:492] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:57.175287  8297 ts_tablet_manager.cc:1403] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.116s	user 0.031s	sys 0.070s
I20260709 13:15:57.177163  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:57.174734  8005 catalog_manager.cc:5697] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.177419  8297 raft_consensus.cc:359] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.178179  8297 raft_consensus.cc:385] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:57.178406  8297 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:57.179114  8297 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.179823  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:57.180395  8254 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:57.177791  8181 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:57.182269  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:57.182979  8438 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:57.183362  8438 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:57.184044  8209 tablet.cc:2406] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:57.184118  8297 ts_tablet_manager.cc:1434] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:15:57.187685  8297 tablet_bootstrap.cc:492] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:57.189649  8438 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:57.190908  8106 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:57.192874  8330 consensus_queue.cc:1059] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.194813  8309 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:57.203235  8103 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:15:57.204532  8309 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:57.205775  8297 tablet_bootstrap.cc:654] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:57.196377  8318 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:57.211733  8298 tablet_bootstrap.cc:492] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:57.212143  8298 ts_tablet_manager.cc:1403] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.168s	user 0.019s	sys 0.065s
I20260709 13:15:57.208632  8318 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:15:57.213474  8372 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.213886  8372 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.214178  8318 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.216069  8318 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.217588  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:57.219431  8223 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:15:57.219447  8149 leader_election.cc:343] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:57.218760  8372 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:57.221005  8526 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:57.251982  8181 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:15:57.251235  8298 raft_consensus.cc:359] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.255214  8298 raft_consensus.cc:385] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:57.255611  8298 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:57.257995  8298 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.258533  8297 tablet_bootstrap.cc:492] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:57.252912  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:57.262048  8298 ts_tablet_manager.cc:1434] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.004s
I20260709 13:15:57.262301  8438 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:57.266587  8149 leader_election.cc:343] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:57.267148  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:57.273157  8298 tablet_bootstrap.cc:492] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:57.270627  8526 raft_consensus.cc:697] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:15:57.282835  8254 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:57.283491  8108 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:57.271306  8549 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:57.287322  8438 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:57.289165  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:57.289809  8257 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:57.307168  8528 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:57.326391  8297 ts_tablet_manager.cc:1403] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.004s
I20260709 13:15:57.331856  8299 tablet_bootstrap.cc:492] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:57.332459  8299 ts_tablet_manager.cc:1403] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.212s	user 0.020s	sys 0.013s
I20260709 13:15:57.335597  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:57.329737  8257 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:57.330366  8491 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.356420  8491 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.359472  8297 raft_consensus.cc:359] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.360247  8297 raft_consensus.cc:385] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:57.360325  8491 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:57.360529  8297 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:57.328583  8526 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.361227  8297 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.368316  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:57.370187  8438 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:57.370434  8255 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:57.373558  8297 ts_tablet_manager.cc:1434] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.003s
I20260709 13:15:57.377096  8297 tablet_bootstrap.cc:492] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:57.381922  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:57.372895  8438 raft_consensus.cc:697] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:57.390075  8107 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:57.389740  8584 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260709 13:15:57.401873  8593 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:15:57.408245  8299 raft_consensus.cc:359] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.409214  8299 raft_consensus.cc:385] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:57.409610  8299 raft_consensus.cc:740] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:57.410267  8299 consensus_queue.cc:260] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.411834  8299 ts_tablet_manager.cc:1434] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.001s
I20260709 13:15:57.412864  8299 tablet_bootstrap.cc:492] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:57.413785  8438 consensus_queue.cc:237] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.420681  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:57.421540  8183 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 1: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:15:57.425745  8104 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:57.429687  8602 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:15:57.433933  8107 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:57.436738  8368 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:57.445641  8555 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:15:57.447860  8372 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:57.464645  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:57.468214  8298 tablet_bootstrap.cc:654] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:57.467638  8555 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:57.484172  8005 catalog_manager.cc:5697] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:57.557984  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 88142.2us
I20260709 13:15:57.540510  8330 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:15:57.566423  8598 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.567950  8526 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.573642  8299 tablet_bootstrap.cc:654] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:57.578154  8603 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:15:57.566959  8598 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.570803  8526 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.616671  8299 tablet_bootstrap.cc:492] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:57.617156  8299 ts_tablet_manager.cc:1403] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.205s	user 0.014s	sys 0.002s
I20260709 13:15:57.617858  8309 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:57.619135  8250 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:57.620543  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:57.622906  8598 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:57.623204  8104 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:57.628430  8297 tablet_bootstrap.cc:654] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:57.634791  8252 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:57.638340  8526 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:57.641852  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:57.654217  8006 catalog_manager.cc:5697] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.944737  8298 tablet_bootstrap.cc:492] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:57.945677  8298 ts_tablet_manager.cc:1403] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.683s	user 0.042s	sys 0.039s
I20260709 13:15:57.947538  8297 tablet_bootstrap.cc:492] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:57.948096  8297 ts_tablet_manager.cc:1403] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.571s	user 0.016s	sys 0.015s
I20260709 13:15:57.950868  8297 raft_consensus.cc:359] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.951512  8297 raft_consensus.cc:385] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:57.951753  8297 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:57.952323  8297 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.953935  8297 ts_tablet_manager.cc:1434] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:15:57.955029  8297 tablet_bootstrap.cc:492] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:57.955039  8299 raft_consensus.cc:359] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.957648  8299 raft_consensus.cc:385] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:57.957921  8299 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:57.958573  8299 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.961653  8297 tablet_bootstrap.cc:654] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:57.963075  8299 ts_tablet_manager.cc:1434] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.346s	user 0.018s	sys 0.026s
I20260709 13:15:57.963585  8490 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:57.964057  8299 tablet_bootstrap.cc:492] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:57.965723  8309 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:57.970127  8297 tablet_bootstrap.cc:492] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:57.970592  8297 ts_tablet_manager.cc:1403] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.005s
I20260709 13:15:57.974083  8297 raft_consensus.cc:359] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.974809  8297 raft_consensus.cc:385] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:57.975077  8297 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:57.975680  8297 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.977756  8297 ts_tablet_manager.cc:1434] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:57.979302  8297 tablet_bootstrap.cc:492] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:57.981662  8298 raft_consensus.cc:359] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.982733  8299 tablet_bootstrap.cc:654] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:57.985096  8298 raft_consensus.cc:385] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:57.986581  8298 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:57.987447  8297 tablet_bootstrap.cc:654] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:57.988314  8298 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.996060  8299 tablet_bootstrap.cc:492] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:57.996533  8299 ts_tablet_manager.cc:1403] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.005s
I20260709 13:15:57.998943  8526 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:58.002239  8299 raft_consensus.cc:359] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.003314  8297 tablet_bootstrap.cc:492] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:58.003916  8297 ts_tablet_manager.cc:1403] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.002s
I20260709 13:15:58.002905  8299 raft_consensus.cc:385] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.004637  8299 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.005296  8299 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.006889  8297 raft_consensus.cc:359] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:57.993309  8298 ts_tablet_manager.cc:1434] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.002s
I20260709 13:15:58.007753  8297 raft_consensus.cc:385] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.008118  8297 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.008931  8297 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.010082  8298 tablet_bootstrap.cc:492] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:58.010560  8299 ts_tablet_manager.cc:1434] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:15:58.011325  8297 ts_tablet_manager.cc:1434] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:58.011431  8299 tablet_bootstrap.cc:492] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:58.011724  8619 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.012301  8297 tablet_bootstrap.cc:492] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:58.012295  8619 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.014914  8619 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:58.021561  8297 tablet_bootstrap.cc:654] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.025974  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:58.044171  8178 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 1: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:15:58.043171  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:58.049327  8177 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 1: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:15:58.051232  8223 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:58.052132  8594 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:58.055112  8298 tablet_bootstrap.cc:654] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.060369  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:58.061355  8600 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.064121  8600 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.065590  8598 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:58.066339  8598 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:58.069300  8600 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:58.102335  8299 tablet_bootstrap.cc:654] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.104677  8298 tablet_bootstrap.cc:492] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:58.109776  8298 ts_tablet_manager.cc:1403] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.100s	user 0.020s	sys 0.000s
W20260709 13:15:58.109630  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 379729us
I20260709 13:15:58.111966  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:58.112609  8183 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:58.106053  8549 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.130388  8549 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.132347  8549 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:58.119155  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:58.137665  8256 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:58.140125  8330 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:15:58.169749  8368 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:58.173784  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:58.174639  8309 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:58.174955  8309 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.175237  8309 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:58.173720  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:58.180877  8298 raft_consensus.cc:359] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.182878  8309 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.185691  8298 raft_consensus.cc:385] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.184477  8297 tablet_bootstrap.cc:492] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:58.185993  8298 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.186396  8297 ts_tablet_manager.cc:1403] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.174s	user 0.048s	sys 0.048s
I20260709 13:15:58.187598  8490 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:15:58.188148  8298 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.186735  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:58.182353  8616 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:15:58.192555  8298 ts_tablet_manager.cc:1434] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.000s
I20260709 13:15:58.192716  8616 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.193642  8298 tablet_bootstrap.cc:492] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:58.196734  8309 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:58.200429  8616 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:58.201088  8490 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:58.211808  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:58.229475  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:58.271687  8608 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:58.276835  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:58.277505  8254 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:15:58.265538  8252 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
W20260709 13:15:58.281915  8149 leader_election.cc:343] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.284010  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:58.284832  8103 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 2: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:15:58.293936  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:58.288764  8299 tablet_bootstrap.cc:492] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:58.294438  8183 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:58.294938  8299 ts_tablet_manager.cc:1403] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.284s	user 0.009s	sys 0.015s
I20260709 13:15:58.295903  8634 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.296394  8634 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.301683  8298 tablet_bootstrap.cc:654] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.303242  8183 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:58.305676  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:58.266474  8528 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
W20260709 13:15:58.305872  8149 leader_election.cc:343] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.293304  8617 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:15:58.309828  8634 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:58.310619  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:58.311200  8183 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 0.
I20260709 13:15:58.308660  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:58.311726  8297 raft_consensus.cc:359] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.312458  8297 raft_consensus.cc:385] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.312696  8297 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.312191  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:58.313162  8297 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.316300  8490 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:58.322520  8054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:58.322887  8297 ts_tablet_manager.cc:1434] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.136s	user 0.004s	sys 0.008s
I20260709 13:15:58.324713  8368 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:58.325251  8149 leader_election.cc:343] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.329126  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:58.329840  8297 tablet_bootstrap.cc:492] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:58.329918  8255 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:58.318838  8634 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:58.335101  8634 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.335489  8634 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:58.341470  8149 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:58.342852  8368 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:58.343339  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:58.343463  8368 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:15:58.344020  8368 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:58.344091  8373 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:58.344525  8373 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.344867  8373 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:58.336055  8490 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:58.350067  8490 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.356585  8299 raft_consensus.cc:359] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.360075  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:58.361275  8299 raft_consensus.cc:385] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.361744  8299 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
W20260709 13:15:58.366519  8223 leader_election.cc:343] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.436296  8299 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.457005  8255 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:58.458285  8608 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.463382  8608 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.472564  8608 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:58.486991  8634 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.488479  8297 tablet_bootstrap.cc:654] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.491514  8330 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.492251  8330 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.496222  8299 ts_tablet_manager.cc:1434] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.201s	user 0.009s	sys 0.001s
I20260709 13:15:58.497524  8299 tablet_bootstrap.cc:492] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:58.498219  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:58.498876  8330 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:15:58.499871  8223 leader_election.cc:343] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.504143  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:58.505887  8223 leader_election.cc:343] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.506287  8223 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:58.507190  8330 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:58.512444  8368 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.514971  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:58.515739  8104 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 2: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:15:58.516037  8297 tablet_bootstrap.cc:492] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:58.516629  8297 ts_tablet_manager.cc:1403] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.187s	user 0.014s	sys 0.010s
I20260709 13:15:58.520140  8297 raft_consensus.cc:359] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.520942  8297 raft_consensus.cc:385] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.521315  8297 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.522120  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:58.522436  8368 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:58.522149  8297 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:58.523095  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 184153us
I20260709 13:15:58.524235  8297 ts_tablet_manager.cc:1434] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:15:58.525472  8297 tablet_bootstrap.cc:492] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:58.526994  8298 tablet_bootstrap.cc:492] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:58.527487  8298 ts_tablet_manager.cc:1403] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.334s	user 0.018s	sys 0.004s
I20260709 13:15:58.543130  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:15:58.544883  8223 leader_election.cc:343] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.548813  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:58.550534  8634 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:58.467821  8373 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.559177  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:58.561483  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:15:58.563386  8149 leader_election.cc:343] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.567519  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:58.568068  8257 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:58.568439  8373 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:58.569968  8298 raft_consensus.cc:359] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.572001  8298 raft_consensus.cc:385] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.572288  8298 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.572990  8298 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.574283  8297 tablet_bootstrap.cc:654] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.580106  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:58.580741  8177 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:58.574780  8298 ts_tablet_manager.cc:1434] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:15:58.583290  8298 tablet_bootstrap.cc:492] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:58.575647  8299 tablet_bootstrap.cc:654] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.569151  8255 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:15:58.587944  8177 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:15:58.589552  8149 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:58.589702  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:58.590754  8330 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:58.591179  8330 raft_consensus.cc:697] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:15:58.591441  8616 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:58.591861  8490 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.591993  8616 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:58.592374  8490 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.592984  8616 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.594345  8490 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:58.594516  8298 tablet_bootstrap.cc:654] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.598179  8257 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:58.591895  8330 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.596172  8003 catalog_manager.cc:5697] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.601837  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:58.604212  8617 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:58.604915  8299 tablet_bootstrap.cc:492] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:58.604859  8617 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:58.605567  8299 ts_tablet_manager.cc:1403] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.001s
I20260709 13:15:58.605935  8617 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:58.609274  8074 leader_election.cc:343] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.608742  8299 raft_consensus.cc:359] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.609836  8299 raft_consensus.cc:385] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.610244  8299 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.611126  8299 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.616987  8297 tablet_bootstrap.cc:492] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:58.617218  8299 ts_tablet_manager.cc:1434] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:15:58.617615  8297 ts_tablet_manager.cc:1403] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.092s	user 0.006s	sys 0.006s
I20260709 13:15:58.621307  8297 raft_consensus.cc:359] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.622182  8297 raft_consensus.cc:385] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.622517  8297 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
W20260709 13:15:58.629312  8074 leader_election.cc:343] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.629411  8297 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.629925  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:58.631347  8645 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:58.631349  8006 catalog_manager.cc:5697] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:58.639654  8297 ts_tablet_manager.cc:1434] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:15:58.654526  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:58.632632  8299 tablet_bootstrap.cc:492] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:58.711352  8177 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:58.711933  8297 tablet_bootstrap.cc:492] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:58.643436  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:58.713547  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:58.714650  8490 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:58.715003  8490 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.715312  8490 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:58.725862  8298 tablet_bootstrap.cc:492] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:58.726384  8298 ts_tablet_manager.cc:1403] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.143s	user 0.030s	sys 0.031s
W20260709 13:15:58.720942  8656 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:15:58.643725  8644 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.733033  8644 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.735364  8644 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:58.735623  8005 catalog_manager.cc:5697] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 2, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.736500  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:58.736903  8298 raft_consensus.cc:359] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.737388  8181 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 1: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:15:58.737624  8298 raft_consensus.cc:385] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.737965  8298 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.737802  8005 catalog_manager.cc:5697] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.738564  8298 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.740645  8298 ts_tablet_manager.cc:1434] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:15:58.747967  8299 tablet_bootstrap.cc:654] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.747658  8490 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.754362  8298 tablet_bootstrap.cc:492] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:58.755539  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:58.757495  8490 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:58.759752  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:58.762187  8297 tablet_bootstrap.cc:654] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.760673  8178 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:58.763475  8074 leader_election.cc:343] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.767026  8634 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.767515  8634 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.769629  8634 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:58.770339  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:58.771011  8107 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 0.
I20260709 13:15:58.772540  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:58.772569  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:58.773517  8645 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:58.773615  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:58.773877  8634 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:58.774310  8634 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.774699  8634 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:58.780741  8617 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.780691  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:58.782371  8223 leader_election.cc:343] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:58.780153  8074 leader_election.cc:343] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.776918  8178 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:58.798625  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:58.781373  8617 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.812721  8309 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:58.813227  8309 raft_consensus.cc:697] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:58.817088  8299 tablet_bootstrap.cc:492] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:58.816846  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:58.817607  8299 ts_tablet_manager.cc:1403] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.200s	user 0.013s	sys 0.015s
I20260709 13:15:58.813959  8309 consensus_queue.cc:237] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.820225  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:15:58.821568  8149 leader_election.cc:343] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:58.824239  8149 leader_election.cc:343] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.824644  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:58.825361  8373 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:58.820662  8617 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:58.820683  8633 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.826982  8299 raft_consensus.cc:359] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.827685  8299 raft_consensus.cc:385] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.827227  8633 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.827886  8299 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.828485  8299 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.829759  8633 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:58.830209  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:58.830611  8299 ts_tablet_manager.cc:1434] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:15:58.831676  8299 tablet_bootstrap.cc:492] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:58.831965  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:58.832561  8257 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:15:58.833559  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:58.834126  8634 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.835071  8633 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:58.836293  8634 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:58.788810  8645 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:58.838099  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:58.839041  8298 tablet_bootstrap.cc:654] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.838807  8108 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:58.838017  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:58.841595  8297 tablet_bootstrap.cc:492] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:58.842121  8297 ts_tablet_manager.cc:1403] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.130s	user 0.014s	sys 0.002s
I20260709 13:15:58.835691  8633 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:58.843403  8223 leader_election.cc:343] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.850112  8108 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:15:58.845759  8633 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.853235  8297 raft_consensus.cc:359] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.854205  8297 raft_consensus.cc:385] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.854470  8297 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.855294  8297 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.856002  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:58.857613  8330 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:58.858078  8330 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:15:58.858666  8299 tablet_bootstrap.cc:654] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.858815  8330 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.859905  8297 ts_tablet_manager.cc:1434] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:15:58.862164  8297 tablet_bootstrap.cc:492] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:58.864256  8633 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.866912  8633 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:58.871423  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:58.872889  8299 tablet_bootstrap.cc:492] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:58.873503  8299 ts_tablet_manager.cc:1403] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.002s
I20260709 13:15:58.875516  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:58.876144  8257 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.880254  8617 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.881716  8617 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.891139  8617 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:58.896546  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:58.896385  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:15:58.898847  8149 leader_election.cc:343] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:58.900472  8149 leader_election.cc:343] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.895838  8257 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:15:58.902529  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:58.900918  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:58.903838  8633 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:58.904404  8633 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:58.904533  8645 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:58.906033  8617 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:58.909013  8299 raft_consensus.cc:359] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.909778  8299 raft_consensus.cc:385] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.910072  8299 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.912900  8299 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.905385  8633 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.917147  8298 tablet_bootstrap.cc:492] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:58.917701  8298 ts_tablet_manager.cc:1403] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.173s	user 0.015s	sys 0.018s
I20260709 13:15:58.920327  8299 ts_tablet_manager.cc:1434] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:15:58.924892  8299 tablet_bootstrap.cc:492] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:58.936766  8600 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:58.940588  8297 tablet_bootstrap.cc:654] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.948094  8298 raft_consensus.cc:359] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.948995  8298 raft_consensus.cc:385] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:58.949314  8298 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.963928  8003 catalog_manager.cc:5697] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.966747  8634 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.967439  8634 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.972777  8298 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:58.980216  8299 tablet_bootstrap.cc:654] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:58.982348  8298 ts_tablet_manager.cc:1434] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:15:58.986021  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:15:58.987726  8223 leader_election.cc:343] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:58.989248  8298 tablet_bootstrap.cc:492] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:58.996814  8373 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:59.001957  8600 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.001042  8006 catalog_manager.cc:5697] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:59.012024  8634 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:59.013706  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:59.010426  8600 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:59.015527  8223 leader_election.cc:343] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.015903  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:59.016866  8600 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:59.019598  8330 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:59.032114  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:15:59.035655  8074 leader_election.cc:343] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.036571  8297 tablet_bootstrap.cc:492] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:59.037060  8297 ts_tablet_manager.cc:1403] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.175s	user 0.022s	sys 0.010s
I20260709 13:15:59.044992  8257 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:59.048549  8298 tablet_bootstrap.cc:654] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.051241  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:59.058317  8634 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:59.058898  8617 consensus_queue.cc:1059] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:59.055555  8149 consensus_peers.cc:597] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:59.076361  8003 catalog_manager.cc:5697] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 2 to 3, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 3 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:59.093848  8297 raft_consensus.cc:359] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.094940  8297 raft_consensus.cc:385] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.095290  8297 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.111775  8297 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.114727  8297 ts_tablet_manager.cc:1434] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.077s	user 0.015s	sys 0.001s
I20260709 13:15:59.111707  8373 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:59.115435  8373 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:59.116340  8373 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.118973  8373 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.139350  8299 tablet_bootstrap.cc:492] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:59.140012  8299 ts_tablet_manager.cc:1403] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.215s	user 0.016s	sys 0.000s
I20260709 13:15:59.159344  8297 tablet_bootstrap.cc:492] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:59.174034  8645 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.174711  8645 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.184260  8618 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.184813  8618 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.187119  8618 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:59.189262  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:59.190204  8104 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 1: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:15:59.191311  8299 raft_consensus.cc:359] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.192592  8299 raft_consensus.cc:385] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.193209  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:59.194454  8299 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.195323  8299 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.198989  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:15:59.199802  8618 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.201925  8299 ts_tablet_manager.cc:1434] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 13:15:59.152643  8250 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:59.205293  8297 tablet_bootstrap.cc:654] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.210999  8645 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:59.213420  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:59.214282  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:59.214911  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:59.217617  8299 tablet_bootstrap.cc:492] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
W20260709 13:15:59.208791  8671 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.117s	user 0.002s	sys 0.002s
I20260709 13:15:59.215937  8179 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:15:59.222115  8600 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:59.223611  8600 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.224160  8600 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.247363  8298 tablet_bootstrap.cc:492] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:59.247917  8298 ts_tablet_manager.cc:1403] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.259s	user 0.042s	sys 0.016s
W20260709 13:15:59.302459  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 88258.6us
I20260709 13:15:59.307772  8074 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:15:59.308804  8309 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:59.308944  8074 leader_election.cc:343] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.309317  8309 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.309787  8309 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.310957  8298 raft_consensus.cc:359] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.311656  8298 raft_consensus.cc:385] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.311910  8298 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.313170  8526 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:59.313364  8298 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.335875  8297 tablet_bootstrap.cc:492] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:59.336463  8297 ts_tablet_manager.cc:1403] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.178s	user 0.014s	sys 0.007s
I20260709 13:15:59.336265  8309 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.342716  8298 ts_tablet_manager.cc:1434] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.007s
I20260709 13:15:59.340180  8526 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.346772  8526 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.349145  8526 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:59.333866  8594 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260709 13:15:59.383885  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 48039.9us
I20260709 13:15:59.390342  8309 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:15:59.401693  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 51355.4us
W20260709 13:15:59.410086  8054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:59.411830  8298 tablet_bootstrap.cc:492] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:59.393747  8251 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.404366  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:59.431010  8182 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:15:59.438508  8177 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 1: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:15:59.441977  8182 pending_rounds.cc:85] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 1
I20260709 13:15:59.478713  8182 pending_rounds.cc:107] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:15:59.479254  8182 raft_consensus.cc:2889] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:59.487218  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:59.488118  8257 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:59.496299  8633 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:59.500530  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:59.532102  8373 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.532807  8373 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.535709  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:59.539613  8309 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:59.543346  8373 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:59.552647  8618 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:59.501422  8180 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.530966  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:59.587437  8600 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.588450  8634 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:59.596026  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:59.597869  8600 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:59.600062  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:15:59.600874  8254 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:15:59.604233  8180 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:59.608995  8108 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:59.608995  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 67444.5us
I20260709 13:15:59.611519  8074 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:15:59.616739  8074 leader_election.cc:343] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.618534  8680 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:59.621191  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:15:59.622234  8687 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:59.622685  8687 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.622746  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:15:59.623186  8687 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.631811  8680 raft_consensus.cc:697] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:15:59.688488  8298 tablet_bootstrap.cc:654] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:59.691112  8074 leader_election.cc:343] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:59.692397  8149 leader_election.cc:343] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.616653  8600 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.072s
I20260709 13:15:59.696491  8297 raft_consensus.cc:359] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.698103  8297 raft_consensus.cc:385] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.698311  8297 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.702256  8299 tablet_bootstrap.cc:654] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.699185  8633 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:15:59.703830  8297 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.718071  8297 ts_tablet_manager.cc:1434] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.374s	user 0.011s	sys 0.009s
I20260709 13:15:59.725651  8297 tablet_bootstrap.cc:492] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:15:59.709636  8680 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.761322  8297 tablet_bootstrap.cc:654] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.773816  8298 tablet_bootstrap.cc:492] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:15:59.774451  8298 ts_tablet_manager.cc:1403] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.363s	user 0.041s	sys 0.045s
I20260709 13:15:59.767715  8526 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
W20260709 13:15:59.786914  8692 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:15:59.877018  8687 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.879254  8687 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:15:59.880514  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:59.881735  8299 tablet_bootstrap.cc:492] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:59.882332  8299 ts_tablet_manager.cc:1403] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.672s	user 0.030s	sys 0.047s
I20260709 13:15:59.881803  8297 tablet_bootstrap.cc:492] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:15:59.881181  8252 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.883100  8297 ts_tablet_manager.cc:1403] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.158s	user 0.015s	sys 0.021s
I20260709 13:15:59.883742  8298 raft_consensus.cc:359] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.886466  8298 raft_consensus.cc:385] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.886855  8298 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.882958  8634 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.892881  8634 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.895030  8634 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:15:59.896773  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:15:59.898191  8297 raft_consensus.cc:359] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:15:59.898702  8223 leader_election.cc:343] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.902081  8299 raft_consensus.cc:359] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.898890  8297 raft_consensus.cc:385] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.903112  8299 raft_consensus.cc:385] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.903249  8297 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.903555  8299 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.904413  8299 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.911597  8252 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:15:59.912519  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:15:59.904155  8297 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.917398  8297 ts_tablet_manager.cc:1434] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:15:59.915355  8298 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.917817  8299 ts_tablet_manager.cc:1434] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:15:59.919178  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:15:59.920184  8299 tablet_bootstrap.cc:492] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:15:59.920749  8298 ts_tablet_manager.cc:1434] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.146s	user 0.006s	sys 0.004s
I20260709 13:15:59.920976  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:15:59.921571  8252 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:59.926771  8299 tablet_bootstrap.cc:654] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:59.935987  8223 leader_election.cc:343] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.936409  8223 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:15:59.937502  8297 tablet_bootstrap.cc:492] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
W20260709 13:15:59.944785  8149 leader_election.cc:343] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:59.945817  8298 tablet_bootstrap.cc:492] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:15:59.956677  8297 tablet_bootstrap.cc:654] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.957077  8005 catalog_manager.cc:5697] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:59.962719  8594 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:59.958549  8252 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:15:59.959620  8298 tablet_bootstrap.cc:654] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:59.983873  8299 tablet_bootstrap.cc:492] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:15:59.984345  8299 ts_tablet_manager.cc:1403] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.064s	user 0.038s	sys 0.023s
W20260709 13:15:59.986313  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 50380.2us
I20260709 13:15:59.987243  8299 raft_consensus.cc:359] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.988245  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:15:59.988521  8299 raft_consensus.cc:385] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:59.988859  8299 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.988988  8702 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:59.989446  8702 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:15:59.989990  8299 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.990273  8702 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:15:59.992964  8299 ts_tablet_manager.cc:1434] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:15:59.994082  8299 tablet_bootstrap.cc:492] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:16:00.000468  8299 tablet_bootstrap.cc:654] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:00.014050  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 125264us
I20260709 13:16:00.049414  8297 tablet_bootstrap.cc:492] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:16:00.050576  8297 ts_tablet_manager.cc:1403] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.113s	user 0.020s	sys 0.011s
I20260709 13:16:00.053685  8297 raft_consensus.cc:359] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.057390  8297 raft_consensus.cc:385] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.058246  8297 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.059332  8297 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.090915  8297 ts_tablet_manager.cc:1434] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.002s
I20260709 13:16:00.067559  8298 tablet_bootstrap.cc:492] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:16:00.091523  8298 ts_tablet_manager.cc:1403] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.146s	user 0.009s	sys 0.023s
I20260709 13:16:00.091948  8297 tablet_bootstrap.cc:492] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:16:00.094579  8298 raft_consensus.cc:359] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.069373  8299 tablet_bootstrap.cc:492] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:16:00.095242  8298 raft_consensus.cc:385] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.074990  8004 catalog_manager.cc:5697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.095546  8299 ts_tablet_manager.cc:1403] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.102s	user 0.018s	sys 0.042s
I20260709 13:16:00.095595  8298 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.096433  8298 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.097501  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:00.098039  8299 raft_consensus.cc:359] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.098417  8708 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.099222  8299 raft_consensus.cc:385] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.099519  8299 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.098456  8298 ts_tablet_manager.cc:1434] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:00.100138  8299 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.101255  8298 tablet_bootstrap.cc:492] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:16:00.106654  8594 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.107198  8594 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.108237  8708 raft_consensus.cc:697] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:00.109011  8298 tablet_bootstrap.cc:654] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.110775  8299 ts_tablet_manager.cc:1434] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:16:00.110885  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:00.139772  8299 tablet_bootstrap.cc:492] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:16:00.113389  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:00.140255  8223 leader_election.cc:343] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.140761  8179 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 0.
I20260709 13:16:00.141981  8223 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:00.109179  8708 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.142868  8634 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.143280  8634 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.143649  8634 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.152884  8634 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.155748  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:00.156214  8299 tablet_bootstrap.cc:654] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.156355  8297 tablet_bootstrap.cc:654] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:00.157462  8223 leader_election.cc:343] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.161288  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:00.165673  8179 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.109401  8594 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:00.169004  8634 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:00.176800  8179 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:00.178651  8223 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:00.179605  8526 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.180195  8526 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:00.181183  8526 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.184892  8299 tablet_bootstrap.cc:492] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:16:00.185362  8299 ts_tablet_manager.cc:1403] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.008s
I20260709 13:16:00.187887  8299 raft_consensus.cc:359] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.188547  8299 raft_consensus.cc:385] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.188807  8299 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.189394  8299 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.203389  8299 ts_tablet_manager.cc:1434] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:16:00.204274  8299 tablet_bootstrap.cc:492] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:16:00.233650  8298 tablet_bootstrap.cc:492] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:16:00.234140  8298 ts_tablet_manager.cc:1403] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.133s	user 0.030s	sys 0.026s
I20260709 13:16:00.230710  8004 catalog_manager.cc:5697] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:00.238422  8006 catalog_manager.cc:5697] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.248823  8680 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.250114  8680 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.247866  8617 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.259479  8617 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.261473  8617 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:00.255796  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:00.265643  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:00.267028  8149 leader_election.cc:343] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:00.256608  8074 consensus_peers.cc:597] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.267849  8297 tablet_bootstrap.cc:492] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:16:00.268316  8297 ts_tablet_manager.cc:1403] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.177s	user 0.021s	sys 0.005s
W20260709 13:16:00.269268  8074 leader_election.cc:343] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.267378  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:00.278424  8297 raft_consensus.cc:359] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.279870  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:00.288832  8297 raft_consensus.cc:385] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.289114  8255 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:16:00.282441  8298 raft_consensus.cc:359] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.290192  8298 raft_consensus.cc:385] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.290494  8298 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.290621  8074 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:00.291164  8298 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.291613  8708 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.286783  8680 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:00.289153  8149 leader_election.cc:343] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.292335  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:00.292114  8708 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.294018  8298 ts_tablet_manager.cc:1434] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.001s
I20260709 13:16:00.294114  8708 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.294442  8368 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:00.295771  8298 tablet_bootstrap.cc:492] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:16:00.289170  8297 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.280377  8299 tablet_bootstrap.cc:654] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.302657  8297 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.305040  8297 ts_tablet_manager.cc:1434] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:16:00.306612  8297 tablet_bootstrap.cc:492] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:16:00.310583  8298 tablet_bootstrap.cc:654] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.311260  8708 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.313413  8680 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:00.318892  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:00.319876  8708 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:00.341606  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:00.324255  8680 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.370651  8255 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.370745  8680 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.344020  8297 tablet_bootstrap.cc:654] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.355429  8299 tablet_bootstrap.cc:492] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:16:00.373040  8299 ts_tablet_manager.cc:1403] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.169s	user 0.015s	sys 0.000s
I20260709 13:16:00.362861  8298 tablet_bootstrap.cc:492] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
W20260709 13:16:00.320459  8074 leader_election.cc:343] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.374305  8680 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:00.374773  8298 ts_tablet_manager.cc:1403] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.015s
W20260709 13:16:00.374084  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 53662.2us
I20260709 13:16:00.379138  8255 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:00.380327  8074 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:00.380890  8618 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.383376  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:00.382453  8633 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.384079  8618 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.388156  8299 raft_consensus.cc:359] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.388722  8299 raft_consensus.cc:385] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.389009  8299 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.389753  8299 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:00.392619  8149 consensus_peers.cc:597] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:00.383015  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:00.393342  8179 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:16:00.393769  8251 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:16:00.394616  8618 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:00.395766  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:00.396332  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:00.396993  8251 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:16:00.397946  8299 ts_tablet_manager.cc:1434] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:16:00.398061  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:00.398937  8299 tablet_bootstrap.cc:492] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:16:00.399093  8702 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.399502  8702 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.399847  8702 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.399947  8298 raft_consensus.cc:359] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.400689  8298 raft_consensus.cc:385] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.400992  8298 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.396485  8102 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 0.
I20260709 13:16:00.401302  8633 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:00.402297  8633 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.402501  8298 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.403555  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:00.404489  8680 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.404860  8680 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.405223  8680 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.412361  8298 ts_tablet_manager.cc:1434] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.004s
I20260709 13:16:00.413605  8298 tablet_bootstrap.cc:492] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:16:00.418995  8680 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.416744  8683 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.427987  8683 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.431468  8680 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:00.431594  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:00.433717  8702 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.434383  8297 tablet_bootstrap.cc:492] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:16:00.437831  8297 ts_tablet_manager.cc:1403] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.131s	user 0.016s	sys 0.007s
I20260709 13:16:00.439020  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:00.436515  8683 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:00.436949  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:00.440021  8255 raft_consensus.cc:2393] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 1: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:00.440088  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:00.440984  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:00.441084  8251 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.439386  8298 tablet_bootstrap.cc:654] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.441277  8297 raft_consensus.cc:359] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.455277  8179 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 1: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:00.460551  8297 raft_consensus.cc:385] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:16:00.460724  8054 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:00.461645  8297 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.462419  8297 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.464592  8297 ts_tablet_manager.cc:1434] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.002s
I20260709 13:16:00.454862  8683 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.470669  8298 tablet_bootstrap.cc:492] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:16:00.471464  8298 ts_tablet_manager.cc:1403] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.005s
I20260709 13:16:00.480073  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:00.480919  8102 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 1: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:00.481564  8251 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:00.471863  8299 tablet_bootstrap.cc:654] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.465333  8702 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:00.474352  8683 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:00.477598  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:00.487149  8298 raft_consensus.cc:359] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.487788  8255 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 1: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:00.487946  8298 raft_consensus.cc:385] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.488315  8298 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.488554  8645 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.489110  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:00.489018  8298 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.489089  8645 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.490466  8618 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:00.491550  8645 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:00.492022  8298 ts_tablet_manager.cc:1434] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:16:00.488535  8702 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:16:00.492926  8298 tablet_bootstrap.cc:492] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8: Bootstrap starting.
I20260709 13:16:00.479449  8297 tablet_bootstrap.cc:492] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091: Bootstrap starting.
I20260709 13:16:00.504740  8298 tablet_bootstrap.cc:654] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.507431  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:00.508761  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:00.507961  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:00.509804  8179 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:16:00.509958  8633 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.517004  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:00.530108  8633 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:00.535436  8633 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.526561  8248 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:16:00.527323  8691 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.541127  8691 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.541527  8691 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.546075  8644 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:16:00.555361  8298 tablet_bootstrap.cc:492] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8: No bootstrap required, opened a new log
I20260709 13:16:00.555864  8298 ts_tablet_manager.cc:1403] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8: Time spent bootstrapping tablet: real 0.063s	user 0.004s	sys 0.023s
I20260709 13:16:00.563853  8691 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.567087  8299 tablet_bootstrap.cc:492] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:16:00.573623  8691 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:00.580020  8299 ts_tablet_manager.cc:1403] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.181s	user 0.011s	sys 0.015s
I20260709 13:16:00.583995  8299 raft_consensus.cc:359] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.584864  8299 raft_consensus.cc:385] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.585402  8299 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.586187  8299 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.589823  8299 ts_tablet_manager.cc:1434] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:16:00.590190  8297 tablet_bootstrap.cc:654] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.590174  8691 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.591018  8299 tablet_bootstrap.cc:492] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Bootstrap starting.
I20260709 13:16:00.590786  8691 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.595921  8691 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:00.596071  8298 raft_consensus.cc:359] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.596840  8298 raft_consensus.cc:385] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.597172  8298 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.597924  8299 tablet_bootstrap.cc:654] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:00.602035  8297 tablet_bootstrap.cc:492] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091: No bootstrap required, opened a new log
I20260709 13:16:00.602452  8297 ts_tablet_manager.cc:1403] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091: Time spent bootstrapping tablet: real 0.123s	user 0.002s	sys 0.024s
I20260709 13:16:00.602265  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:00.603101  8255 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.605798  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:00.605533  8297 raft_consensus.cc:359] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.606469  8179 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.606586  8297 raft_consensus.cc:385] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.606925  8297 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.607563  8297 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.609895  8297 ts_tablet_manager.cc:1434] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:16:00.612519  8255 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:00.617707  8179 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:00.632033  8634 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.632606  8634 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.634518  8634 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:00.635422  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:00.636157  8252 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:16:00.636173  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:00.637979  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:00.640586  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:00.641250  8178 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:16:00.644443  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:00.645942  8223 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:00.646003  8298 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.646786  8634 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:00.648103  8298 ts_tablet_manager.cc:1434] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8: Time spent starting tablet: real 0.092s	user 0.004s	sys 0.004s
I20260709 13:16:00.648453  8644 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.648550  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:00.655368  8644 raft_consensus.cc:697] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:00.655740  8633 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.656122  8633 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.656332  8644 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.656490  8633 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.661387  8255 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.653023  8683 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.662314  8683 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.663810  8179 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.664279  8683 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:00.665458  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:00.669284  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:00.670378  8600 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.669503  8633 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.670905  8600 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.671882  8526 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:00.672356  8633 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:00.673009  8600 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:00.678182  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:00.678798  8149 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:00.678835  8178 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.649791  8004 catalog_manager.cc:5697] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.680207  8702 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:00.683243  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:00.685792  8252 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.687268  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:00.687968  8176 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:16:00.688068  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:00.688691  8251 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 0.
I20260709 13:16:00.692957  8252 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:00.693300  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:00.694024  8644 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:00.694422  8644 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.694662  8178 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:00.694810  8644 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.653578  8299 tablet_bootstrap.cc:492] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: No bootstrap required, opened a new log
I20260709 13:16:00.697347  8600 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:00.698743  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:00.702560  8600 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.703091  8600 raft_consensus.cc:697] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:00.702935  8644 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.703991  8600 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.705107  8644 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:00.705346  8299 ts_tablet_manager.cc:1403] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Time spent bootstrapping tablet: real 0.115s	user 0.030s	sys 0.015s
I20260709 13:16:00.711179  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:00.711948  8251 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.712006  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:00.712661  8176 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.722126  8176 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:00.728186  8251 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:00.731999  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:00.732909  8600 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:00.733618  8600 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:00.734350  8600 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.749605  8299 raft_consensus.cc:359] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.750137  8299 raft_consensus.cc:385] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:00.750363  8299 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.755105  8299 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:00.757216  8299 ts_tablet_manager.cc:1434] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.000s
I20260709 13:16:00.758635  8106 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.766323  8102 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:00.771405  8594 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:00.791011  8006 catalog_manager.cc:5697] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.792325  8006 catalog_manager.cc:5697] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.793678  8006 catalog_manager.cc:5697] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.794780  8006 catalog_manager.cc:5697] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.843567  8644 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:00.853296  8680 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:00.892947  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:00.903012  8744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:00.907378  8743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:00.907297  8746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:00.907574  7002 server_base.cc:1061] running on GCE node
I20260709 13:16:00.910156  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:00.910429  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:00.910655  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783602960910634 us; error 0 us; skew 500 ppm
I20260709 13:16:00.911255  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:00.917721  7002 webserver.cc:533] Webserver started at http://127.6.214.132:38019/ using document root <none> and password file <none>
I20260709 13:16:00.918277  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:00.918519  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:00.918855  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:00.920107  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-3-root/instance:
uuid: "5033fc7e66374940a203908ea8b0078f"
format_stamp: "Formatted at 2026-07-09 13:16:00 on dist-test-slave-rnv4"
I20260709 13:16:00.924930  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.006s
I20260709 13:16:00.928218  8751 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:00.928929  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:00.929301  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-3-root
uuid: "5033fc7e66374940a203908ea8b0078f"
format_stamp: "Formatted at 2026-07-09 13:16:00 on dist-test-slave-rnv4"
I20260709 13:16:00.929657  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:00.962857  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:00.964628  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:00.966332  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:00.969520  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:00.969835  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:00.970147  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:00.970350  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:00.976162  8680 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.011886  8680 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:01.067306  8680 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.099309  8680 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.129103  8680 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:01.197733  8633 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.204595  8633 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.239025  8680 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:01.337862  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.132:45917
I20260709 13:16:01.337988  8823 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.132:45917 every 8 connection(s)
I20260709 13:16:01.345063  7002 auto_leader_rebalancer-test.cc:384] add a tserver: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:01.363317  8824 heartbeater.cc:344] Connected to a master server at 127.6.214.190:45311
I20260709 13:16:01.363804  8824 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:01.364720  8824 heartbeater.cc:507] Master 127.6.214.190:45311 requested a full tablet report, sending...
I20260709 13:16:01.366842  8004 ts_manager.cc:194] Registered new tserver with Master: 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:01.368479  8004 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36106
I20260709 13:16:01.548543  8255 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:01.554216  8179 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:01.554479  8106 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:01.556185  8634 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.557680  8808 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:01.568507  8634 raft_consensus.cc:2955] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:01.570638  8179 raft_consensus.cc:2955] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:01.572902  8102 raft_consensus.cc:2955] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
W20260709 13:16:01.585196  8221 consensus_peers.cc:597] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82a8e4371bab42f3a4d150da194ce8bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:01.590868  8252 consensus_queue.cc:237] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:01.593081  8006 catalog_manager.cc:5697] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.618541  8102 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:01.618649  8221 consensus_peers.cc:597] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c962bcd58c74013abdb370fa758d500. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:01.620293  8179 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:01.621945  8809 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.623775  8809 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.638969  8809 raft_consensus.cc:2955] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:01.640671  8102 raft_consensus.cc:2955] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:01.642506  8179 raft_consensus.cc:2955] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:01.662964  8005 catalog_manager.cc:5697] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:01.673707  8175 consensus_queue.cc:237] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:01.686663  8252 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:01.688122  8702 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.694075  8102 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:01.696131  8702 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.703927  8616 raft_consensus.cc:2955] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
W20260709 13:16:01.711462  8147 consensus_peers.cc:597] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb334e41695d4d8c8d5de4eb668cd421. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:01.714206  8252 raft_consensus.cc:2955] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:01.793445  8004 catalog_manager.cc:5697] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.810606  8102 raft_consensus.cc:2955] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:01.814544  8178 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
W20260709 13:16:01.836081  8147 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45c332ea272c465d9e07083a06e802e7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:01.837134  8252 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:01.837338  8102 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:01.838518  8617 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.839396  8847 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.846678  8847 raft_consensus.cc:2955] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:01.848884  8252 raft_consensus.cc:2955] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:01.849287  8102 raft_consensus.cc:2955] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:01.871968  8004 catalog_manager.cc:5697] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:02.127139  8851 ts_tablet_manager.cc:933] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:02.134239  8851 tablet_copy_client.cc:323] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.131:45561
I20260709 13:16:02.166435  8856 ts_tablet_manager.cc:933] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:02.168898  8852 ts_tablet_manager.cc:933] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:02.172744  8856 tablet_copy_client.cc:323] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.130:46389
I20260709 13:16:02.194741  8267 tablet_copy_service.cc:140] P a0f96c12124b4e1a816d9fa970464091: Received BeginTabletCopySession request for tablet 7c962bcd58c74013abdb370fa758d500 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:60806)
I20260709 13:16:02.195441  8267 tablet_copy_service.cc:161] P a0f96c12124b4e1a816d9fa970464091: Beginning new tablet copy session on tablet 7c962bcd58c74013abdb370fa758d500 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:60806: session id = 5033fc7e66374940a203908ea8b0078f-7c962bcd58c74013abdb370fa758d500
I20260709 13:16:02.199570  8852 tablet_copy_client.cc:323] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.131:45561
I20260709 13:16:02.203517  8266 tablet_copy_service.cc:140] P a0f96c12124b4e1a816d9fa970464091: Received BeginTabletCopySession request for tablet 82a8e4371bab42f3a4d150da194ce8bd from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:60806)
I20260709 13:16:02.204097  8266 tablet_copy_service.cc:161] P a0f96c12124b4e1a816d9fa970464091: Beginning new tablet copy session on tablet 82a8e4371bab42f3a4d150da194ce8bd from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:60806: session id = 5033fc7e66374940a203908ea8b0078f-82a8e4371bab42f3a4d150da194ce8bd
I20260709 13:16:02.208178  8267 tablet_copy_source_session.cc:215] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:02.211673  8266 tablet_copy_source_session.cc:215] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:02.213253  8193 tablet_copy_service.cc:140] P 9bd264598fd2483e9e17674bab9ba4e8: Received BeginTabletCopySession request for tablet eb334e41695d4d8c8d5de4eb668cd421 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:37206)
I20260709 13:16:02.213855  8193 tablet_copy_service.cc:161] P 9bd264598fd2483e9e17674bab9ba4e8: Beginning new tablet copy session on tablet eb334e41695d4d8c8d5de4eb668cd421 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:37206: session id = 5033fc7e66374940a203908ea8b0078f-eb334e41695d4d8c8d5de4eb668cd421
I20260709 13:16:02.215924  8851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c962bcd58c74013abdb370fa758d500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:02.219255  8193 tablet_copy_source_session.cc:215] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:02.222098  8852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82a8e4371bab42f3a4d150da194ce8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:02.222822  8856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb334e41695d4d8c8d5de4eb668cd421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:02.234056  8851 tablet_copy_client.cc:806] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:02.234794  8851 tablet_copy_client.cc:670] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:02.240360  8852 tablet_copy_client.cc:806] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:02.240902  8852 tablet_copy_client.cc:670] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:02.241623  8851 tablet_copy_client.cc:538] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:02.246171  8852 tablet_copy_client.cc:538] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:02.249424  8856 tablet_copy_client.cc:806] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:02.250064  8856 tablet_copy_client.cc:670] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:02.253976  8856 tablet_copy_client.cc:538] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:02.261826  8851 tablet_bootstrap.cc:492] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:02.262025  8856 tablet_bootstrap.cc:492] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:02.262108  8852 tablet_bootstrap.cc:492] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:02.297935  8852 tablet_bootstrap.cc:492] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:02.299222  8852 tablet_bootstrap.cc:492] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:02.300128  8852 ts_tablet_manager.cc:1403] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.008s
I20260709 13:16:02.304026  8852 raft_consensus.cc:359] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:02.305080  8852 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:02.305886  8852 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:02.313978  8856 tablet_bootstrap.cc:492] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:02.315168  8856 tablet_bootstrap.cc:492] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:02.315925  8856 ts_tablet_manager.cc:1403] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.054s	user 0.026s	sys 0.017s
I20260709 13:16:02.318781  8852 ts_tablet_manager.cc:1434] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.006s
I20260709 13:16:02.318881  8856 raft_consensus.cc:359] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:02.319736  8824 heartbeater.cc:499] Master 127.6.214.190:45311 was elected leader, sending a full tablet report...
I20260709 13:16:02.319933  8856 raft_consensus.cc:740] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:02.320968  8266 tablet_copy_service.cc:342] P a0f96c12124b4e1a816d9fa970464091: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-82a8e4371bab42f3a4d150da194ce8bd received from {username='slave'} at 127.0.0.1:60806
I20260709 13:16:02.320581  8856 consensus_queue.cc:260] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:02.322901  8266 tablet_copy_service.cc:434] P a0f96c12124b4e1a816d9fa970464091: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-82a8e4371bab42f3a4d150da194ce8bd on tablet 82a8e4371bab42f3a4d150da194ce8bd with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:02.355163  8851 tablet_bootstrap.cc:492] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:02.359757  8851 tablet_bootstrap.cc:492] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:02.360566  8851 ts_tablet_manager.cc:1403] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.099s	user 0.020s	sys 0.010s
I20260709 13:16:02.363655  8851 raft_consensus.cc:359] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:02.364874  8851 raft_consensus.cc:740] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:02.365809  8851 consensus_queue.cc:260] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:02.374293  8856 ts_tablet_manager.cc:1434] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.012s
I20260709 13:16:02.378252  8851 ts_tablet_manager.cc:1434] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:16:02.379984  8266 tablet_copy_service.cc:342] P a0f96c12124b4e1a816d9fa970464091: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-7c962bcd58c74013abdb370fa758d500 received from {username='slave'} at 127.0.0.1:60806
I20260709 13:16:02.380481  8266 tablet_copy_service.cc:434] P a0f96c12124b4e1a816d9fa970464091: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-7c962bcd58c74013abdb370fa758d500 on tablet 7c962bcd58c74013abdb370fa758d500 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:02.384501  8193 tablet_copy_service.cc:342] P 9bd264598fd2483e9e17674bab9ba4e8: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-eb334e41695d4d8c8d5de4eb668cd421 received from {username='slave'} at 127.0.0.1:37206
I20260709 13:16:02.384927  8193 tablet_copy_service.cc:434] P 9bd264598fd2483e9e17674bab9ba4e8: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-eb334e41695d4d8c8d5de4eb668cd421 on tablet eb334e41695d4d8c8d5de4eb668cd421 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:02.429374  8856 ts_tablet_manager.cc:933] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:02.431440  8856 tablet_copy_client.cc:323] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.130:46389
I20260709 13:16:02.432998  8193 tablet_copy_service.cc:140] P 9bd264598fd2483e9e17674bab9ba4e8: Received BeginTabletCopySession request for tablet 45c332ea272c465d9e07083a06e802e7 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:37206)
I20260709 13:16:02.433591  8193 tablet_copy_service.cc:161] P 9bd264598fd2483e9e17674bab9ba4e8: Beginning new tablet copy session on tablet 45c332ea272c465d9e07083a06e802e7 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:37206: session id = 5033fc7e66374940a203908ea8b0078f-45c332ea272c465d9e07083a06e802e7
I20260709 13:16:02.439003  8193 tablet_copy_source_session.cc:215] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:02.441576  8856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c332ea272c465d9e07083a06e802e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:02.452149  8856 tablet_copy_client.cc:806] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:02.452744  8856 tablet_copy_client.cc:670] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:02.456596  8856 tablet_copy_client.cc:538] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:02.465144  8856 tablet_bootstrap.cc:492] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:02.486070  8856 tablet_bootstrap.cc:492] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:02.486984  8856 tablet_bootstrap.cc:492] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:02.487574  8856 ts_tablet_manager.cc:1403] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.010s
I20260709 13:16:02.490207  8856 raft_consensus.cc:359] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:02.491137  8856 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:02.491731  8856 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:02.494297  8856 ts_tablet_manager.cc:1434] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:16:02.495857  8193 tablet_copy_service.cc:342] P 9bd264598fd2483e9e17674bab9ba4e8: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-45c332ea272c465d9e07083a06e802e7 received from {username='slave'} at 127.0.0.1:37206
I20260709 13:16:02.496234  8193 tablet_copy_service.cc:434] P 9bd264598fd2483e9e17674bab9ba4e8: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-45c332ea272c465d9e07083a06e802e7 on tablet 45c332ea272c465d9e07083a06e802e7 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:02.662869  8791 raft_consensus.cc:1217] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:02.680549  8791 raft_consensus.cc:1217] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:02.750509  8791 raft_consensus.cc:1217] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:02.880692  8791 raft_consensus.cc:1217] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:03.164381  8869 raft_consensus.cc:1064] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:03.167542  8869 consensus_queue.cc:237] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:03.177142  8791 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.178082  8178 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.177413  8102 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.184667  8870 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:16:03.186791  8809 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.233482  8594 raft_consensus.cc:1064] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:03.235858  8594 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:03.246380  8791 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.246598  8869 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.253908  8877 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.254745  8178 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.268997  8104 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.281455  8877 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:03.284746  8877 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.288436  8869 raft_consensus.cc:2955] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.297745  8178 raft_consensus.cc:2955] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.300920  8790 raft_consensus.cc:2955] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.315498  8872 raft_consensus.cc:1064] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:03.316208  8004 catalog_manager.cc:5697] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:03.318138  8872 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:03.317942  8104 raft_consensus.cc:2955] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.318320  8880 raft_consensus.cc:2955] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.330500  8106 raft_consensus.cc:2955] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.343760  8791 raft_consensus.cc:2955] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.350507  8702 raft_consensus.cc:1064] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:03.353130  8702 consensus_queue.cc:237] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:03.372807  8791 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.372789  8251 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.374544  8872 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.376930  8847 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.379424  8106 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.381475  8175 raft_consensus.cc:2955] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.383765  8790 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.385380  8702 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.391943  8255 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.394297  8106 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.394544  8872 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.409622  8872 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.413049  8872 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:03.442448  8702 raft_consensus.cc:2955] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.462445  8005 catalog_manager.cc:5697] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.462671  8252 consensus_queue.cc:237] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:03.470109  8790 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.470757  8106 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.472162  8880 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:03.478309  8869 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:03.483538  8106 raft_consensus.cc:2955] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.481051  8869 raft_consensus.cc:2955] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.489907  8847 raft_consensus.cc:2955] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.498523  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c962bcd58c74013abdb370fa758d500 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:03.510859  8790 raft_consensus.cc:2955] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.512274  8791 raft_consensus.cc:2955] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.519544  8102 raft_consensus.cc:2955] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.521643  8003 catalog_manager.cc:5697] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:03.527311  8789 raft_consensus.cc:2955] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.528228  8255 raft_consensus.cc:2955] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.530336  8248 raft_consensus.cc:2955] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.548448  8003 catalog_manager.cc:5697] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:03.576380  8178 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:03.550452  8004 catalog_manager.cc:5697] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.566999  8251 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:03.581017  7993 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 7c962bcd58c74013abdb370fa758d500 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:16:03.596496  8179 consensus_queue.cc:237] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:03.597640  8790 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.600162  8175 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.601289  8869 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:03.602273  8870 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:03.603608  8790 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.605515  8170 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c962bcd58c74013abdb370fa758d500 with delete_type TABLET_DATA_TOMBSTONED (TS 9bd264598fd2483e9e17674bab9ba4e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46048
I20260709 13:16:03.609325  8102 raft_consensus.cc:2955] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.612491  8870 raft_consensus.cc:2955] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.614825  8702 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:03.620218  8107 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.620395  8178 raft_consensus.cc:2955] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.623378  8791 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.625723  8872 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:03.635721  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 82a8e4371bab42f3a4d150da194ce8bd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:03.636288  8791 raft_consensus.cc:2955] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.638929  8789 raft_consensus.cc:2955] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.641897  8897 tablet_replica.cc:333] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:16:03.636161  8617 raft_consensus.cc:2955] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.650908  8872 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:03.644873  8897 raft_consensus.cc:2243] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.661022  8002 catalog_manager.cc:5697] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.664449  8897 raft_consensus.cc:2272] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.667193  8108 raft_consensus.cc:2955] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.670246  8106 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.678422  8897 ts_tablet_manager.cc:1916] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:03.679970  8847 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:03.689508  8094 tablet_service.cc:1558] Processing DeleteTablet for tablet 82a8e4371bab42f3a4d150da194ce8bd with delete_type TABLET_DATA_TOMBSTONED (TS 9480609eccc44250a4d7fcc9686e76cf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44046
I20260709 13:16:03.692373  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 45c332ea272c465d9e07083a06e802e7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:03.695765  8702 raft_consensus.cc:2955] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.706221  8003 catalog_manager.cc:5697] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.715780  8900 tablet_replica.cc:333] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:16:03.717893  8790 raft_consensus.cc:2955] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.719607  8241 tablet_service.cc:1558] Processing DeleteTablet for tablet 45c332ea272c465d9e07083a06e802e7 with delete_type TABLET_DATA_TOMBSTONED (TS a0f96c12124b4e1a816d9fa970464091 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57550
I20260709 13:16:03.733237  8900 raft_consensus.cc:2243] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.734017  8900 raft_consensus.cc:2272] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.737171  8900 ts_tablet_manager.cc:1916] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:03.741139  8897 ts_tablet_manager.cc:1929] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:03.741765  8897 log.cc:1199] T 7c962bcd58c74013abdb370fa758d500 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-1-root/wals/7c962bcd58c74013abdb370fa758d500
W20260709 13:16:03.724046  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 43492us
I20260709 13:16:03.724223  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eb334e41695d4d8c8d5de4eb668cd421 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:03.744802  7993 catalog_manager.cc:5028] TS 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): tablet 7c962bcd58c74013abdb370fa758d500 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
W20260709 13:16:03.809015  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 60324us
I20260709 13:16:03.822070  8003 catalog_manager.cc:5697] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.833482  8240 tablet_service.cc:1558] Processing DeleteTablet for tablet eb334e41695d4d8c8d5de4eb668cd421 with delete_type TABLET_DATA_TOMBSTONED (TS a0f96c12124b4e1a816d9fa970464091 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57550
I20260709 13:16:03.837005  8900 ts_tablet_manager.cc:1929] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:03.841153  8900 log.cc:1199] T 82a8e4371bab42f3a4d150da194ce8bd P 9480609eccc44250a4d7fcc9686e76cf: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/wals/82a8e4371bab42f3a4d150da194ce8bd
I20260709 13:16:03.848428  7993 catalog_manager.cc:5028] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): tablet 82a8e4371bab42f3a4d150da194ce8bd (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:03.862535  8901 tablet_replica.cc:333] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:16:03.877933  8901 raft_consensus.cc:2243] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.878804  8901 raft_consensus.cc:2272] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.878787  8102 raft_consensus.cc:2955] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:03.884359  8901 ts_tablet_manager.cc:1916] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:03.902005  8901 ts_tablet_manager.cc:1929] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:03.902380  8901 log.cc:1199] T 45c332ea272c465d9e07083a06e802e7 P a0f96c12124b4e1a816d9fa970464091: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-2-root/wals/45c332ea272c465d9e07083a06e802e7
I20260709 13:16:03.903961  8901 tablet_replica.cc:333] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:16:03.903854  7993 catalog_manager.cc:5028] TS a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): tablet 45c332ea272c465d9e07083a06e802e7 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:03.904978  8901 raft_consensus.cc:2243] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.906515  8901 raft_consensus.cc:2272] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.909250  8901 ts_tablet_manager.cc:1916] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:03.921172  8901 ts_tablet_manager.cc:1929] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:03.921607  8901 log.cc:1199] T eb334e41695d4d8c8d5de4eb668cd421 P a0f96c12124b4e1a816d9fa970464091: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-2-root/wals/eb334e41695d4d8c8d5de4eb668cd421
I20260709 13:16:03.922983  7993 catalog_manager.cc:5028] TS a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): tablet eb334e41695d4d8c8d5de4eb668cd421 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:04.927416  8106 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:04.934301  8248 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:04.935256  8178 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:04.936807  8633 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:04.937844  8708 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:04.948532  8072 consensus_peers.cc:597] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d69cb3874984241afb1521d6e9178f2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:04.950008  8708 raft_consensus.cc:2955] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:04.951884  8178 raft_consensus.cc:2955] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:04.952157  8248 raft_consensus.cc:2955] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:04.970381  8003 catalog_manager.cc:5697] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:04.974113  8178 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
W20260709 13:16:04.991833  8147 consensus_peers.cc:597] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17d4c6719ffc4a51a444f84eff0c28b7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:05.024123  8248 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:05.027571  8102 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:05.029302  8617 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:05.031558  8872 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:05.040014  8617 raft_consensus.cc:2955] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:05.045259  8252 raft_consensus.cc:2955] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:05.063508  8102 raft_consensus.cc:2955] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:05.072216  8106 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
W20260709 13:16:05.088047  8072 consensus_peers.cc:597] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a64e531fcf0742cd8db17f008824d588. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:05.090401  8252 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:05.094559  8708 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.096520  8178 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:05.098009  8003 catalog_manager.cc:5697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.100562  8708 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.106707  8904 raft_consensus.cc:2955] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:05.108191  8252 raft_consensus.cc:2955] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:05.110925  8178 raft_consensus.cc:2955] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:05.124336  8102 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:05.134516  8004 catalog_manager.cc:5697] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
W20260709 13:16:05.139205  8072 consensus_peers.cc:597] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e54e69639dd478bb5f966d86c83c95d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:05.140038  8178 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:05.141306  8252 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:05.141496  8904 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.142825  8708 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.154206  8708 raft_consensus.cc:2955] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:05.156068  8178 raft_consensus.cc:2955] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:05.167752  8252 raft_consensus.cc:2955] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:05.172837  8004 catalog_manager.cc:5697] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.405970  8929 ts_tablet_manager.cc:933] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:05.407858  8929 tablet_copy_client.cc:323] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.130:46389
I20260709 13:16:05.409852  8193 tablet_copy_service.cc:140] P 9bd264598fd2483e9e17674bab9ba4e8: Received BeginTabletCopySession request for tablet 17d4c6719ffc4a51a444f84eff0c28b7 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:37206)
I20260709 13:16:05.410445  8193 tablet_copy_service.cc:161] P 9bd264598fd2483e9e17674bab9ba4e8: Beginning new tablet copy session on tablet 17d4c6719ffc4a51a444f84eff0c28b7 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:37206: session id = 5033fc7e66374940a203908ea8b0078f-17d4c6719ffc4a51a444f84eff0c28b7
I20260709 13:16:05.418941  8193 tablet_copy_source_session.cc:215] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:05.422472  8929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d4c6719ffc4a51a444f84eff0c28b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:05.441962  8929 tablet_copy_client.cc:806] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:05.443212  8929 tablet_copy_client.cc:670] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:05.447717  8929 tablet_copy_client.cc:538] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:05.457958  8929 tablet_bootstrap.cc:492] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:05.478196  8929 tablet_bootstrap.cc:492] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:05.478955  8929 tablet_bootstrap.cc:492] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:05.479496  8929 ts_tablet_manager.cc:1403] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 13:16:05.482833  8929 raft_consensus.cc:359] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:05.483752  8929 raft_consensus.cc:740] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:05.484565  8929 consensus_queue.cc:260] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:05.488876  8929 ts_tablet_manager.cc:1434] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.007s
I20260709 13:16:05.490728  8193 tablet_copy_service.cc:342] P 9bd264598fd2483e9e17674bab9ba4e8: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-17d4c6719ffc4a51a444f84eff0c28b7 received from {username='slave'} at 127.0.0.1:37206
I20260709 13:16:05.491226  8193 tablet_copy_service.cc:434] P 9bd264598fd2483e9e17674bab9ba4e8: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-17d4c6719ffc4a51a444f84eff0c28b7 on tablet 17d4c6719ffc4a51a444f84eff0c28b7 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:05.521097  8929 ts_tablet_manager.cc:933] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123)
I20260709 13:16:05.526855  8929 tablet_copy_client.cc:323] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.129:45123
I20260709 13:16:05.538684  8118 tablet_copy_service.cc:140] P 9480609eccc44250a4d7fcc9686e76cf: Received BeginTabletCopySession request for tablet 5d69cb3874984241afb1521d6e9178f2 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:49218)
I20260709 13:16:05.539229  8118 tablet_copy_service.cc:161] P 9480609eccc44250a4d7fcc9686e76cf: Beginning new tablet copy session on tablet 5d69cb3874984241afb1521d6e9178f2 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:49218: session id = 5033fc7e66374940a203908ea8b0078f-5d69cb3874984241afb1521d6e9178f2
I20260709 13:16:05.544420  8118 tablet_copy_source_session.cc:215] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:05.546962  8929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d69cb3874984241afb1521d6e9178f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:05.563153  8929 tablet_copy_client.cc:806] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:05.563709  8929 tablet_copy_client.cc:670] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:05.567873  8929 tablet_copy_client.cc:538] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:05.577967  8929 tablet_bootstrap.cc:492] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:05.630494  8937 ts_tablet_manager.cc:933] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123)
I20260709 13:16:05.632570  8937 tablet_copy_client.cc:323] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.129:45123
I20260709 13:16:05.635138  8118 tablet_copy_service.cc:140] P 9480609eccc44250a4d7fcc9686e76cf: Received BeginTabletCopySession request for tablet 3e54e69639dd478bb5f966d86c83c95d from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:49218)
I20260709 13:16:05.635664  8118 tablet_copy_service.cc:161] P 9480609eccc44250a4d7fcc9686e76cf: Beginning new tablet copy session on tablet 3e54e69639dd478bb5f966d86c83c95d from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:49218: session id = 5033fc7e66374940a203908ea8b0078f-3e54e69639dd478bb5f966d86c83c95d
I20260709 13:16:05.636368  8929 tablet_bootstrap.cc:492] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:05.637251  8929 tablet_bootstrap.cc:492] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:05.637907  8929 ts_tablet_manager.cc:1403] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.060s	user 0.025s	sys 0.010s
I20260709 13:16:05.641546  8929 raft_consensus.cc:359] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:05.642351  8929 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:05.642974  8929 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:05.644748  8118 tablet_copy_source_session.cc:215] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:05.645252  8929 ts_tablet_manager.cc:1434] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:05.658751  8939 ts_tablet_manager.cc:933] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123)
I20260709 13:16:05.660118  8118 tablet_copy_service.cc:342] P 9480609eccc44250a4d7fcc9686e76cf: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-5d69cb3874984241afb1521d6e9178f2 received from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:05.660607  8118 tablet_copy_service.cc:434] P 9480609eccc44250a4d7fcc9686e76cf: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-5d69cb3874984241afb1521d6e9178f2 on tablet 5d69cb3874984241afb1521d6e9178f2 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:05.660979  8937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e54e69639dd478bb5f966d86c83c95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:05.662479  8939 tablet_copy_client.cc:323] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.129:45123
I20260709 13:16:05.663982  8118 tablet_copy_service.cc:140] P 9480609eccc44250a4d7fcc9686e76cf: Received BeginTabletCopySession request for tablet a64e531fcf0742cd8db17f008824d588 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:49218)
I20260709 13:16:05.664491  8118 tablet_copy_service.cc:161] P 9480609eccc44250a4d7fcc9686e76cf: Beginning new tablet copy session on tablet a64e531fcf0742cd8db17f008824d588 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:49218: session id = 5033fc7e66374940a203908ea8b0078f-a64e531fcf0742cd8db17f008824d588
I20260709 13:16:05.671749  8118 tablet_copy_source_session.cc:215] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:05.677534  8937 tablet_copy_client.cc:806] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:05.678206  8937 tablet_copy_client.cc:670] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:05.678843  8939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a64e531fcf0742cd8db17f008824d588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:05.682245  8937 tablet_copy_client.cc:538] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:05.691437  8937 tablet_bootstrap.cc:492] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:05.695457  8939 tablet_copy_client.cc:806] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:05.696066  8939 tablet_copy_client.cc:670] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:05.707047  8939 tablet_copy_client.cc:538] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:05.714672  8937 tablet_bootstrap.cc:492] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:05.715585  8937 tablet_bootstrap.cc:492] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:05.716246  8937 ts_tablet_manager.cc:1403] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
I20260709 13:16:05.716289  8939 tablet_bootstrap.cc:492] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:05.719357  8937 raft_consensus.cc:359] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:05.720329  8937 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:05.721052  8937 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:05.723455  8937 ts_tablet_manager.cc:1434] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:05.725713  8118 tablet_copy_service.cc:342] P 9480609eccc44250a4d7fcc9686e76cf: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-3e54e69639dd478bb5f966d86c83c95d received from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:05.726125  8118 tablet_copy_service.cc:434] P 9480609eccc44250a4d7fcc9686e76cf: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-3e54e69639dd478bb5f966d86c83c95d on tablet 3e54e69639dd478bb5f966d86c83c95d with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:05.740787  8939 tablet_bootstrap.cc:492] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:05.741727  8939 tablet_bootstrap.cc:492] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:05.742393  8939 ts_tablet_manager.cc:1403] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.011s
I20260709 13:16:05.745281  8939 raft_consensus.cc:359] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:05.745951  8939 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:05.746548  8939 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:05.748540  8939 ts_tablet_manager.cc:1434] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:16:05.750214  8118 tablet_copy_service.cc:342] P 9480609eccc44250a4d7fcc9686e76cf: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-a64e531fcf0742cd8db17f008824d588 received from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:05.750660  8118 tablet_copy_service.cc:434] P 9480609eccc44250a4d7fcc9686e76cf: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-a64e531fcf0742cd8db17f008824d588 on tablet a64e531fcf0742cd8db17f008824d588 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:05.850477  8790 raft_consensus.cc:1217] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:05.911490  8790 raft_consensus.cc:1217] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:06.014109  8790 raft_consensus.cc:1217] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:06.071105  8790 raft_consensus.cc:1217] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:06.256131  8617 raft_consensus.cc:1064] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:06.258581  8617 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:06.265165  8790 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.267167  8252 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.267371  8108 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.268134  8617 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.268992  8920 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.270128  8847 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.291991  8847 raft_consensus.cc:2955] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.298529  8790 raft_consensus.cc:2955] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.304425  8108 raft_consensus.cc:2955] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.310685  8251 raft_consensus.cc:2955] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.314638  8004 catalog_manager.cc:5697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.350941  8178 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:06.358873  8790 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:06.358987  8251 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:06.360592  8847 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:06.369192  8847 raft_consensus.cc:2955] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.376801  8617 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:06.381664  8789 raft_consensus.cc:2955] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.397328  8252 raft_consensus.cc:2955] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.421205  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 17d4c6719ffc4a51a444f84eff0c28b7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:06.421590  8003 catalog_manager.cc:5697] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.432538  8094 tablet_service.cc:1558] Processing DeleteTablet for tablet 17d4c6719ffc4a51a444f84eff0c28b7 with delete_type TABLET_DATA_TOMBSTONED (TS 9480609eccc44250a4d7fcc9686e76cf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44046
I20260709 13:16:06.435456  8955 tablet_replica.cc:333] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:16:06.436615  8955 raft_consensus.cc:2243] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:06.437275  8955 raft_consensus.cc:2272] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.440070  8955 ts_tablet_manager.cc:1916] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:06.452608  8955 ts_tablet_manager.cc:1929] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:06.453002  8955 log.cc:1199] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9480609eccc44250a4d7fcc9686e76cf: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/wals/17d4c6719ffc4a51a444f84eff0c28b7
I20260709 13:16:06.454631  7993 catalog_manager.cc:5028] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): tablet 17d4c6719ffc4a51a444f84eff0c28b7 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:06.479544  8902 raft_consensus.cc:1064] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:06.482216  8902 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:06.490522  8789 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.491187  8178 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.492200  8252 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.492069  8708 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.493587  8904 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.496574  8708 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.514499  8708 raft_consensus.cc:2955] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.516146  8789 raft_consensus.cc:2955] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.520378  8252 raft_consensus.cc:2955] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.537549  8178 raft_consensus.cc:2955] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.540246  8006 catalog_manager.cc:5697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.556258  8108 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:06.566951  8251 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:06.568985  8902 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:06.576148  8789 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:06.580230  8708 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:06.583369  8708 raft_consensus.cc:2955] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.585914  8252 raft_consensus.cc:2955] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.603883  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d69cb3874984241afb1521d6e9178f2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:06.606809  8904 raft_consensus.cc:1064] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:06.609320  8904 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:06.622522  8789 raft_consensus.cc:2955] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.623153  8006 catalog_manager.cc:5697] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:06.624228  8790 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.625883  8902 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:06.628388  8252 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.639501  8175 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.640676  8708 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.647231  8170 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d69cb3874984241afb1521d6e9178f2 with delete_type TABLET_DATA_TOMBSTONED (TS 9bd264598fd2483e9e17674bab9ba4e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46048
I20260709 13:16:06.656143  8963 tablet_replica.cc:333] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:16:06.657449  8961 raft_consensus.cc:1064] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:06.662299  8708 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.668579  8961 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:06.696935  8963 raft_consensus.cc:2243] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:06.697727  8963 raft_consensus.cc:2272] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.697669  8902 raft_consensus.cc:2955] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.699085  8252 raft_consensus.cc:2955] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.701541  8963 ts_tablet_manager.cc:1916] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:06.713384  8789 raft_consensus.cc:2955] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.714170  8178 raft_consensus.cc:2955] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:06.721805  8003 catalog_manager.cc:5697] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:06.735932  8963 ts_tablet_manager.cc:1929] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:06.745229  8963 log.cc:1199] T 5d69cb3874984241afb1521d6e9178f2 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-1-root/wals/5d69cb3874984241afb1521d6e9178f2
I20260709 13:16:06.758128  8789 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.754961  7993 catalog_manager.cc:5028] TS 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): tablet 5d69cb3874984241afb1521d6e9178f2 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:06.759682  8175 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.761153  8252 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.761191  8708 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:06.765019  8708 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.777976  8708 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:07.032670  8966 raft_consensus.cc:2955] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:07.052335  8179 raft_consensus.cc:2955] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:07.108812  8791 raft_consensus.cc:2955] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:07.137919  8251 raft_consensus.cc:2955] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:07.164568  8004 catalog_manager.cc:5697] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:07.187610  8106 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:07.194157  8108 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:07.199344  8789 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:07.202193  8708 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:07.203387  8791 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:07.206332  8978 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:07.214541  8708 raft_consensus.cc:2955] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:07.218990  8175 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:07.221101  8961 raft_consensus.cc:2955] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:07.222333  8789 raft_consensus.cc:2955] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:07.226225  8791 raft_consensus.cc:2955] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:07.235335  8004 catalog_manager.cc:5697] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:07.236227  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a64e531fcf0742cd8db17f008824d588 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:07.238134  8902 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:07.248512  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3e54e69639dd478bb5f966d86c83c95d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:07.248749  8251 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:07.256945  8175 raft_consensus.cc:2955] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:07.265651  8005 catalog_manager.cc:5697] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:07.269655  8708 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:16:07.277235  8241 tablet_service.cc:1558] Processing DeleteTablet for tablet a64e531fcf0742cd8db17f008824d588 with delete_type TABLET_DATA_TOMBSTONED (TS a0f96c12124b4e1a816d9fa970464091 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57550
I20260709 13:16:07.280939  8980 tablet_replica.cc:333] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:16:07.282228  8980 raft_consensus.cc:2243] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.283140  8980 raft_consensus.cc:2272] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.284762  8170 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e54e69639dd478bb5f966d86c83c95d with delete_type TABLET_DATA_TOMBSTONED (TS 9bd264598fd2483e9e17674bab9ba4e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46048
I20260709 13:16:07.286732  8980 ts_tablet_manager.cc:1916] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:07.288537  8252 raft_consensus.cc:2955] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:07.294528  8981 tablet_replica.cc:333] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:16:07.295607  8981 raft_consensus.cc:2243] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:07.296304  8981 raft_consensus.cc:2272] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:07.300441  8981 ts_tablet_manager.cc:1916] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:07.306079  8980 ts_tablet_manager.cc:1929] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:07.306651  8980 log.cc:1199] T a64e531fcf0742cd8db17f008824d588 P a0f96c12124b4e1a816d9fa970464091: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-2-root/wals/a64e531fcf0742cd8db17f008824d588
I20260709 13:16:07.308425  7993 catalog_manager.cc:5028] TS a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): tablet a64e531fcf0742cd8db17f008824d588 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:07.316907  8981 ts_tablet_manager.cc:1929] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:07.317350  8981 log.cc:1199] T 3e54e69639dd478bb5f966d86c83c95d P 9bd264598fd2483e9e17674bab9ba4e8: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-1-root/wals/3e54e69639dd478bb5f966d86c83c95d
I20260709 13:16:07.318925  7993 catalog_manager.cc:5028] TS 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): tablet 3e54e69639dd478bb5f966d86c83c95d (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
W20260709 13:16:07.955796  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08001d2a40 after lost signal to thread 7005
W20260709 13:16:07.956781  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08001ba160 after lost signal to thread 8040
W20260709 13:16:07.957779  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08002dba60 after lost signal to thread 8132
W20260709 13:16:07.958664  8129 debug-util.cc:398] Leaking SignalData structure 0x7b0800116e00 after lost signal to thread 8207
W20260709 13:16:07.959517  8129 debug-util.cc:398] Leaking SignalData structure 0x7b0800319140 after lost signal to thread 8281
W20260709 13:16:07.960397  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08002c37c0 after lost signal to thread 8823
I20260709 13:16:08.375272  8255 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:08.388141  8108 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:08.389089  8174 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:08.391340  8982 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:16:08.393986  8221 consensus_peers.cc:597] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8a82de7cb524bf996a9df256baca3fd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:08.395498  8982 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:08.416332  8944 raft_consensus.cc:2955] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:08.420085  8106 raft_consensus.cc:2955] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:08.424922  8174 raft_consensus.cc:2955] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:08.437690  8004 catalog_manager.cc:5697] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.448122  8174 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:08.458216  8255 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:08.458779  8106 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:08.460649  8147 consensus_peers.cc:597] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 440543aae4b54ad6aaca74cda8e88fb0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:08.462334  8920 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.463459  8975 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.488340  8983 raft_consensus.cc:2955] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:08.497328  8255 raft_consensus.cc:2955] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:08.492002  8106 raft_consensus.cc:2955] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:08.516922  8108 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:08.552161  8003 catalog_manager.cc:5697] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.561112  8255 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:08.561525  8174 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:08.562912  8072 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dded0a12a5b14bc38c2b5ac21e951545. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:08.564512  8984 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.567164  8972 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.578099  8708 raft_consensus.cc:2955] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:08.606781  8252 raft_consensus.cc:2955] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:08.613644  8108 consensus_queue.cc:237] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:08.632441  8003 catalog_manager.cc:5697] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.675218  8179 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:08.676404  8252 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:08.677670  8072 consensus_peers.cc:597] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5590746c03af49c9a057629ee7fe6bfb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:08.680738  8708 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.681782  9000 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:08.692485  8179 raft_consensus.cc:2955] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:08.710358  8708 raft_consensus.cc:2955] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:08.713500  8176 raft_consensus.cc:2955] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:08.722486  8252 raft_consensus.cc:2955] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:08.734047  8004 catalog_manager.cc:5697] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:08.993849  9007 ts_tablet_manager.cc:933] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:09.005813  9006 ts_tablet_manager.cc:933] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123)
I20260709 13:16:09.008320  9006 tablet_copy_client.cc:323] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.129:45123
I20260709 13:16:09.009898  8118 tablet_copy_service.cc:140] P 9480609eccc44250a4d7fcc9686e76cf: Received BeginTabletCopySession request for tablet dded0a12a5b14bc38c2b5ac21e951545 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:49218)
I20260709 13:16:09.010408  8118 tablet_copy_service.cc:161] P 9480609eccc44250a4d7fcc9686e76cf: Beginning new tablet copy session on tablet dded0a12a5b14bc38c2b5ac21e951545 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:49218: session id = 5033fc7e66374940a203908ea8b0078f-dded0a12a5b14bc38c2b5ac21e951545
I20260709 13:16:09.018115  9007 tablet_copy_client.cc:323] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.131:45561
I20260709 13:16:09.020462  8266 tablet_copy_service.cc:140] P a0f96c12124b4e1a816d9fa970464091: Received BeginTabletCopySession request for tablet e8a82de7cb524bf996a9df256baca3fd from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:60806)
I20260709 13:16:09.021054  8266 tablet_copy_service.cc:161] P a0f96c12124b4e1a816d9fa970464091: Beginning new tablet copy session on tablet e8a82de7cb524bf996a9df256baca3fd from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:60806: session id = 5033fc7e66374940a203908ea8b0078f-e8a82de7cb524bf996a9df256baca3fd
I20260709 13:16:09.021474  8118 tablet_copy_source_session.cc:215] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:09.025713  9006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dded0a12a5b14bc38c2b5ac21e951545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:09.039954  8266 tablet_copy_source_session.cc:215] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:09.043562  9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8a82de7cb524bf996a9df256baca3fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:09.061410  9006 tablet_copy_client.cc:806] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:09.062172  9006 tablet_copy_client.cc:670] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:09.065632  9007 tablet_copy_client.cc:806] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:09.066241  9007 tablet_copy_client.cc:670] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:09.071540  9006 tablet_copy_client.cc:538] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:09.130522  9010 ts_tablet_manager.cc:933] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:09.134645  9006 tablet_bootstrap.cc:492] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:09.137149  9007 tablet_copy_client.cc:538] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:09.207015  9010 tablet_copy_client.cc:323] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.130:46389
I20260709 13:16:09.212344  8193 tablet_copy_service.cc:140] P 9bd264598fd2483e9e17674bab9ba4e8: Received BeginTabletCopySession request for tablet 440543aae4b54ad6aaca74cda8e88fb0 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:37206)
I20260709 13:16:09.212966  8193 tablet_copy_service.cc:161] P 9bd264598fd2483e9e17674bab9ba4e8: Beginning new tablet copy session on tablet 440543aae4b54ad6aaca74cda8e88fb0 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:37206: session id = 5033fc7e66374940a203908ea8b0078f-440543aae4b54ad6aaca74cda8e88fb0
I20260709 13:16:09.215440  9006 tablet_bootstrap.cc:492] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:09.216440  9006 tablet_bootstrap.cc:492] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:09.217196  9006 ts_tablet_manager.cc:1403] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.088s	user 0.021s	sys 0.003s
I20260709 13:16:09.220610  9006 raft_consensus.cc:359] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:09.221650  9006 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:09.222646  9006 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:09.269089  8193 tablet_copy_source_session.cc:215] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:09.296403  9007 tablet_bootstrap.cc:492] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:09.296440  9010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 440543aae4b54ad6aaca74cda8e88fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:09.313794  9015 ts_tablet_manager.cc:933] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123)
I20260709 13:16:09.317260  9006 ts_tablet_manager.cc:1434] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.100s	user 0.032s	sys 0.030s
I20260709 13:16:09.320322  8118 tablet_copy_service.cc:342] P 9480609eccc44250a4d7fcc9686e76cf: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-dded0a12a5b14bc38c2b5ac21e951545 received from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:09.320775  8118 tablet_copy_service.cc:434] P 9480609eccc44250a4d7fcc9686e76cf: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-dded0a12a5b14bc38c2b5ac21e951545 on tablet dded0a12a5b14bc38c2b5ac21e951545 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:09.332093  9015 tablet_copy_client.cc:323] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.129:45123
I20260709 13:16:09.334012  8118 tablet_copy_service.cc:140] P 9480609eccc44250a4d7fcc9686e76cf: Received BeginTabletCopySession request for tablet 5590746c03af49c9a057629ee7fe6bfb from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:49218)
I20260709 13:16:09.334594  8118 tablet_copy_service.cc:161] P 9480609eccc44250a4d7fcc9686e76cf: Beginning new tablet copy session on tablet 5590746c03af49c9a057629ee7fe6bfb from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:49218: session id = 5033fc7e66374940a203908ea8b0078f-5590746c03af49c9a057629ee7fe6bfb
I20260709 13:16:09.335157  9007 tablet_bootstrap.cc:492] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:09.336071  9007 tablet_bootstrap.cc:492] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:09.346259  8118 tablet_copy_source_session.cc:215] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:09.350878  9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5590746c03af49c9a057629ee7fe6bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:09.353796  9007 ts_tablet_manager.cc:1403] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.007s
I20260709 13:16:09.356904  9007 raft_consensus.cc:359] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:09.357538  9010 tablet_copy_client.cc:806] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:09.357793  9007 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:09.358222  9010 tablet_copy_client.cc:670] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:09.362109  9010 tablet_copy_client.cc:538] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:09.358534  9007 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:09.367581  9007 ts_tablet_manager.cc:1434] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:16:09.369341  8266 tablet_copy_service.cc:342] P a0f96c12124b4e1a816d9fa970464091: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-e8a82de7cb524bf996a9df256baca3fd received from {username='slave'} at 127.0.0.1:60806
I20260709 13:16:09.369778  8266 tablet_copy_service.cc:434] P a0f96c12124b4e1a816d9fa970464091: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-e8a82de7cb524bf996a9df256baca3fd on tablet e8a82de7cb524bf996a9df256baca3fd with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:09.377295  9015 tablet_copy_client.cc:806] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:09.377919  9015 tablet_copy_client.cc:670] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:09.379990  9010 tablet_bootstrap.cc:492] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:09.383258  9015 tablet_copy_client.cc:538] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:09.404697  9015 tablet_bootstrap.cc:492] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:09.420193  8791 raft_consensus.cc:1217] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:09.439460  9010 tablet_bootstrap.cc:492] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:09.440409  9010 tablet_bootstrap.cc:492] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:09.441123  9010 ts_tablet_manager.cc:1403] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.004s
I20260709 13:16:09.446177  9010 raft_consensus.cc:359] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:09.447132  9010 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:09.447896  9010 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:09.451558  9010 ts_tablet_manager.cc:1434] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:16:09.453852  8193 tablet_copy_service.cc:342] P 9bd264598fd2483e9e17674bab9ba4e8: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-440543aae4b54ad6aaca74cda8e88fb0 received from {username='slave'} at 127.0.0.1:37206
I20260709 13:16:09.454288  8193 tablet_copy_service.cc:434] P 9bd264598fd2483e9e17674bab9ba4e8: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-440543aae4b54ad6aaca74cda8e88fb0 on tablet 440543aae4b54ad6aaca74cda8e88fb0 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:09.466856  9015 tablet_bootstrap.cc:492] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:09.467958  9015 tablet_bootstrap.cc:492] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:09.468779  9015 ts_tablet_manager.cc:1403] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.064s	user 0.024s	sys 0.001s
I20260709 13:16:09.471603  9015 raft_consensus.cc:359] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:09.472412  9015 raft_consensus.cc:740] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:09.474825  9015 consensus_queue.cc:260] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:09.477698  9015 ts_tablet_manager.cc:1434] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 13:16:09.479266  8118 tablet_copy_service.cc:342] P 9480609eccc44250a4d7fcc9686e76cf: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-5590746c03af49c9a057629ee7fe6bfb received from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:09.479689  8118 tablet_copy_service.cc:434] P 9480609eccc44250a4d7fcc9686e76cf: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-5590746c03af49c9a057629ee7fe6bfb on tablet 5590746c03af49c9a057629ee7fe6bfb with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:09.558296  8791 raft_consensus.cc:1217] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:09.576189  8791 raft_consensus.cc:1217] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:09.627599  8791 raft_consensus.cc:1217] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:09.902863  8984 raft_consensus.cc:1064] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:09.905225  8984 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:09.922046  8791 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:09.923772  9012 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.943769  8251 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:09.945535  8175 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:09.947101  9022 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.949977  9012 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:10.095791  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 125876us
I20260709 13:16:10.165953  9029 raft_consensus.cc:1064] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:10.168393  9029 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:10.193686  9022 raft_consensus.cc:2955] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.238034  9001 raft_consensus.cc:1064] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:10.238116  8003 catalog_manager.cc:5697] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.244385  9001 consensus_queue.cc:237] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:10.271497  8789 raft_consensus.cc:2955] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:16:10.294955  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 81968.4us
I20260709 13:16:10.309067  8944 raft_consensus.cc:1064] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:10.332091  8791 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:10.361334  8789 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:10.365760  8108 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:10.383097  8920 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:10.384768  8920 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:10.365226  8175 raft_consensus.cc:2955] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.367745  8252 raft_consensus.cc:2955] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.372584  8251 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:10.388757  9026 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:10.422219  8920 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:10.442445  8975 raft_consensus.cc:2955] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.449446  8106 raft_consensus.cc:2955] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.460371  8944 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:10.465231  8174 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:10.466532  8108 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:10.466949  8251 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:10.487249  8006 catalog_manager.cc:5697] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.515048  8789 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:10.533330  9027 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:10.545501  9022 raft_consensus.cc:2955] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.550252  8790 raft_consensus.cc:2955] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.472442  8791 raft_consensus.cc:2955] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.567780  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dded0a12a5b14bc38c2b5ac21e951545 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:10.571835  9027 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:10.577123  8257 raft_consensus.cc:2955] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.578960  8005 catalog_manager.cc:5697] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.591328  8170 tablet_service.cc:1558] Processing DeleteTablet for tablet dded0a12a5b14bc38c2b5ac21e951545 with delete_type TABLET_DATA_TOMBSTONED (TS 9bd264598fd2483e9e17674bab9ba4e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46048
I20260709 13:16:10.592356  8175 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:10.593295  8789 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:10.595045  9032 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:10.606637  8255 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:10.609508  8175 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:10.611595  8944 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:10.612301  8975 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:10.616765  8788 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:10.618809  9051 tablet_replica.cc:333] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:16:10.621752  9051 raft_consensus.cc:2243] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.623116  9051 raft_consensus.cc:2272] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.627827  9051 ts_tablet_manager.cc:1916] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:10.628438  9029 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:10.629043  8108 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:10.631007  8975 raft_consensus.cc:2955] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.637012  8944 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:10.641400  9049 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:10.641446  8257 raft_consensus.cc:2955] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.645738  8787 raft_consensus.cc:2955] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.650630  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 440543aae4b54ad6aaca74cda8e88fb0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:10.652881  9032 raft_consensus.cc:2955] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.658072  8175 raft_consensus.cc:2955] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.658118  8255 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:10.661115  9051 ts_tablet_manager.cc:1929] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:10.679816  9051 log.cc:1199] T dded0a12a5b14bc38c2b5ac21e951545 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-1-root/wals/dded0a12a5b14bc38c2b5ac21e951545
I20260709 13:16:10.701903  8106 raft_consensus.cc:2955] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.705557  8790 raft_consensus.cc:2955] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.707427  7993 catalog_manager.cc:5028] TS 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): tablet dded0a12a5b14bc38c2b5ac21e951545 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:10.709642  8006 catalog_manager.cc:5697] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.730841  8094 tablet_service.cc:1558] Processing DeleteTablet for tablet 440543aae4b54ad6aaca74cda8e88fb0 with delete_type TABLET_DATA_TOMBSTONED (TS 9480609eccc44250a4d7fcc9686e76cf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44046
I20260709 13:16:10.746306  8003 catalog_manager.cc:5697] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.749879  9001 raft_consensus.cc:2955] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.805830  9057 tablet_replica.cc:333] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:16:10.821081  8255 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:10.827885  8790 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:10.829589  9041 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:10.834860  9049 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:10.839859  8179 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:10.839986  9032 raft_consensus.cc:2955] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.838645  8002 catalog_manager.cc:5697] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.841809  8787 raft_consensus.cc:2955] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.847576  9041 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:10.856225  8175 raft_consensus.cc:2955] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.858836  8257 raft_consensus.cc:2955] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.865890  9057 raft_consensus.cc:2243] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.865181  8790 raft_consensus.cc:2955] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.869280  9057 raft_consensus.cc:2272] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.863334  8248 raft_consensus.cc:2955] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.897997  8174 raft_consensus.cc:2955] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.915249  9057 ts_tablet_manager.cc:1916] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:10.925681  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e8a82de7cb524bf996a9df256baca3fd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:10.931746  8108 consensus_queue.cc:237] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:10.944141  9057 ts_tablet_manager.cc:1929] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:10.944712  9057 log.cc:1199] T 440543aae4b54ad6aaca74cda8e88fb0 P 9480609eccc44250a4d7fcc9686e76cf: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/wals/440543aae4b54ad6aaca74cda8e88fb0
I20260709 13:16:10.946652  7993 catalog_manager.cc:5028] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): tablet 440543aae4b54ad6aaca74cda8e88fb0 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:10.951717  8787 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:10.962345  8003 catalog_manager.cc:5697] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.969568  8174 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:10.971148  9027 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:10.977116  9026 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:10.979502  8094 tablet_service.cc:1558] Processing DeleteTablet for tablet e8a82de7cb524bf996a9df256baca3fd with delete_type TABLET_DATA_TOMBSTONED (TS 9480609eccc44250a4d7fcc9686e76cf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44046
I20260709 13:16:10.980526  9057 tablet_replica.cc:333] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:16:10.981654  9057 raft_consensus.cc:2243] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.982362  9057 raft_consensus.cc:2272] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.985980  9057 ts_tablet_manager.cc:1916] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:10.986023  9026 raft_consensus.cc:2955] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.990052  8790 raft_consensus.cc:2955] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:10.999548  8174 raft_consensus.cc:2955] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:11.007031  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5590746c03af49c9a057629ee7fe6bfb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:11.019562  9057 ts_tablet_manager.cc:1929] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:11.020119  9057 log.cc:1199] T e8a82de7cb524bf996a9df256baca3fd P 9480609eccc44250a4d7fcc9686e76cf: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/wals/e8a82de7cb524bf996a9df256baca3fd
I20260709 13:16:11.021875  7993 catalog_manager.cc:5028] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): tablet e8a82de7cb524bf996a9df256baca3fd (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:11.028379  8002 catalog_manager.cc:5697] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:11.050602  8241 tablet_service.cc:1558] Processing DeleteTablet for tablet 5590746c03af49c9a057629ee7fe6bfb with delete_type TABLET_DATA_TOMBSTONED (TS a0f96c12124b4e1a816d9fa970464091 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57550
I20260709 13:16:11.053892  9058 tablet_replica.cc:333] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:16:11.055323  9058 raft_consensus.cc:2243] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:11.056875  9058 raft_consensus.cc:2272] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:11.061901  9058 ts_tablet_manager.cc:1916] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:11.082141  9058 ts_tablet_manager.cc:1929] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:11.082787  9058 log.cc:1199] T 5590746c03af49c9a057629ee7fe6bfb P a0f96c12124b4e1a816d9fa970464091: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-2-root/wals/5590746c03af49c9a057629ee7fe6bfb
I20260709 13:16:11.084610  7993 catalog_manager.cc:5028] TS a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): tablet 5590746c03af49c9a057629ee7fe6bfb (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:12.127537  8179 consensus_queue.cc:237] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
W20260709 13:16:12.135972  8147 consensus_peers.cc:597] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8dca4b8aebe74578b370a72879bb9bba. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:12.136466  8106 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:12.137462  8248 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:12.137955  8920 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:12.138965  9029 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:12.150740  9029 raft_consensus.cc:2955] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:12.153635  8248 raft_consensus.cc:2955] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:12.156268  8108 raft_consensus.cc:2955] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:12.168983  8107 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:12.175483  8003 catalog_manager.cc:5697] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:12.266218  8072 consensus_peers.cc:597] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e624c9e6425410d86ead659c0c8db59. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:12.270068  8179 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:12.281811  9021 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:12.291585  8255 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:12.299909  9022 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:12.332306  9071 raft_consensus.cc:2955] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:12.349956  8174 raft_consensus.cc:2955] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:12.352960  8255 raft_consensus.cc:2955] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:12.359992  8107 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:12.359678  8002 catalog_manager.cc:5697] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:12.400614  8072 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cd035b4a624c4c7aa2257c2821868021. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:12.401983  8248 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:12.402195  8174 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:12.403577  9026 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:12.404541  9022 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:12.425205  8255 raft_consensus.cc:2955] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:12.425555  8174 raft_consensus.cc:2955] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:12.422583  9022 raft_consensus.cc:2955] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:12.442226  8005 catalog_manager.cc:5697] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index -1 to 3, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 3 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:12.452826  8108 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
W20260709 13:16:12.465919  8072 consensus_peers.cc:597] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff9e97576a934b9dbf18f6ee6cc670af. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:12.471077  8174 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:12.473857  9074 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:12.476970  8255 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:12.478840  9026 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:12.518397  9074 raft_consensus.cc:2955] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:12.521829  8174 raft_consensus.cc:2955] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:12.523159  8255 raft_consensus.cc:2955] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:12.551134  8002 catalog_manager.cc:5697] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:12.606701  9085 ts_tablet_manager.cc:933] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:12.609090  9085 tablet_copy_client.cc:323] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.130:46389
I20260709 13:16:12.612859  8193 tablet_copy_service.cc:140] P 9bd264598fd2483e9e17674bab9ba4e8: Received BeginTabletCopySession request for tablet 8dca4b8aebe74578b370a72879bb9bba from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:37206)
I20260709 13:16:12.613456  8193 tablet_copy_service.cc:161] P 9bd264598fd2483e9e17674bab9ba4e8: Beginning new tablet copy session on tablet 8dca4b8aebe74578b370a72879bb9bba from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:37206: session id = 5033fc7e66374940a203908ea8b0078f-8dca4b8aebe74578b370a72879bb9bba
I20260709 13:16:12.619462  8193 tablet_copy_source_session.cc:215] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:12.624910  9085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dca4b8aebe74578b370a72879bb9bba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:12.641103  9085 tablet_copy_client.cc:806] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:12.641964  9085 tablet_copy_client.cc:670] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:12.651767  9085 tablet_copy_client.cc:538] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:12.661514  9085 tablet_bootstrap.cc:492] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:12.688956  9085 tablet_bootstrap.cc:492] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:12.689972  9085 tablet_bootstrap.cc:492] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:12.692075  9085 ts_tablet_manager.cc:1403] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.009s
I20260709 13:16:12.695488  9085 raft_consensus.cc:359] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:12.696404  9085 raft_consensus.cc:740] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:12.697116  9085 consensus_queue.cc:260] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:12.705099  9085 ts_tablet_manager.cc:1434] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:16:12.708920  8193 tablet_copy_service.cc:342] P 9bd264598fd2483e9e17674bab9ba4e8: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-8dca4b8aebe74578b370a72879bb9bba received from {username='slave'} at 127.0.0.1:37206
I20260709 13:16:12.709450  8193 tablet_copy_service.cc:434] P 9bd264598fd2483e9e17674bab9ba4e8: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-8dca4b8aebe74578b370a72879bb9bba on tablet 8dca4b8aebe74578b370a72879bb9bba with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:12.812266  9085 ts_tablet_manager.cc:933] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123)
I20260709 13:16:12.841722  9085 tablet_copy_client.cc:323] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.129:45123
I20260709 13:16:12.843600  8118 tablet_copy_service.cc:140] P 9480609eccc44250a4d7fcc9686e76cf: Received BeginTabletCopySession request for tablet cd035b4a624c4c7aa2257c2821868021 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:49218)
I20260709 13:16:12.844251  8118 tablet_copy_service.cc:161] P 9480609eccc44250a4d7fcc9686e76cf: Beginning new tablet copy session on tablet cd035b4a624c4c7aa2257c2821868021 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:49218: session id = 5033fc7e66374940a203908ea8b0078f-cd035b4a624c4c7aa2257c2821868021
I20260709 13:16:12.854996  8118 tablet_copy_source_session.cc:215] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:12.858868  9085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd035b4a624c4c7aa2257c2821868021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:12.871852  9090 ts_tablet_manager.cc:933] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123)
I20260709 13:16:12.885663  9085 tablet_copy_client.cc:806] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:12.886402  9085 tablet_copy_client.cc:670] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:12.890846  9085 tablet_copy_client.cc:538] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:12.892936  9090 tablet_copy_client.cc:323] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.129:45123
I20260709 13:16:12.894954  8118 tablet_copy_service.cc:140] P 9480609eccc44250a4d7fcc9686e76cf: Received BeginTabletCopySession request for tablet 6e624c9e6425410d86ead659c0c8db59 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:49218)
I20260709 13:16:12.895568  8118 tablet_copy_service.cc:161] P 9480609eccc44250a4d7fcc9686e76cf: Beginning new tablet copy session on tablet 6e624c9e6425410d86ead659c0c8db59 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:49218: session id = 5033fc7e66374940a203908ea8b0078f-6e624c9e6425410d86ead659c0c8db59
I20260709 13:16:12.903344  9085 tablet_bootstrap.cc:492] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:12.944558  8118 tablet_copy_source_session.cc:215] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:12.948715  9090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e624c9e6425410d86ead659c0c8db59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:12.958365  9085 tablet_bootstrap.cc:492] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:12.980109  9085 tablet_bootstrap.cc:492] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:12.981146  9085 ts_tablet_manager.cc:1403] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.078s	user 0.037s	sys 0.001s
I20260709 13:16:12.982735  8787 raft_consensus.cc:1217] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:12.984911  9085 raft_consensus.cc:359] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:12.986084  9085 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:12.986869  9085 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:12.998400  9090 tablet_copy_client.cc:806] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:12.999048  9090 tablet_copy_client.cc:670] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:13.005502  9085 ts_tablet_manager.cc:1434] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:16:13.006119  9093 ts_tablet_manager.cc:933] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123)
I20260709 13:16:13.014449  9093 tablet_copy_client.cc:323] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.129:45123
I20260709 13:16:13.017669  8117 tablet_copy_service.cc:342] P 9480609eccc44250a4d7fcc9686e76cf: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-cd035b4a624c4c7aa2257c2821868021 received from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:13.018102  8117 tablet_copy_service.cc:434] P 9480609eccc44250a4d7fcc9686e76cf: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-cd035b4a624c4c7aa2257c2821868021 on tablet cd035b4a624c4c7aa2257c2821868021 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:13.018522  8116 tablet_copy_service.cc:140] P 9480609eccc44250a4d7fcc9686e76cf: Received BeginTabletCopySession request for tablet ff9e97576a934b9dbf18f6ee6cc670af from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:49218)
I20260709 13:16:13.019070  8116 tablet_copy_service.cc:161] P 9480609eccc44250a4d7fcc9686e76cf: Beginning new tablet copy session on tablet ff9e97576a934b9dbf18f6ee6cc670af from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:49218: session id = 5033fc7e66374940a203908ea8b0078f-ff9e97576a934b9dbf18f6ee6cc670af
I20260709 13:16:13.026579  8116 tablet_copy_source_session.cc:215] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:13.035516  9090 tablet_copy_client.cc:538] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:13.036866  9093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9e97576a934b9dbf18f6ee6cc670af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:13.052487  9093 tablet_copy_client.cc:806] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:13.053059  9093 tablet_copy_client.cc:670] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:13.058234  9093 tablet_copy_client.cc:538] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:13.075891  9093 tablet_bootstrap.cc:492] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:13.101791  9090 tablet_bootstrap.cc:492] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:13.125010  9093 tablet_bootstrap.cc:492] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:13.126082  9093 tablet_bootstrap.cc:492] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:13.126812  9093 ts_tablet_manager.cc:1403] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.002s
I20260709 13:16:13.130156  9093 raft_consensus.cc:359] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:13.131083  9093 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:13.138303  9093 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:13.141083  9093 ts_tablet_manager.cc:1434] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:16:13.147511  8116 tablet_copy_service.cc:342] P 9480609eccc44250a4d7fcc9686e76cf: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-ff9e97576a934b9dbf18f6ee6cc670af received from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:13.147960  8116 tablet_copy_service.cc:434] P 9480609eccc44250a4d7fcc9686e76cf: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-ff9e97576a934b9dbf18f6ee6cc670af on tablet ff9e97576a934b9dbf18f6ee6cc670af with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:13.229224  9090 tablet_bootstrap.cc:492] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:13.230320  9090 tablet_bootstrap.cc:492] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:13.231096  9090 ts_tablet_manager.cc:1403] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.130s	user 0.032s	sys 0.026s
I20260709 13:16:13.233809  9090 raft_consensus.cc:359] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:13.234833  9090 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:13.236093  9090 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:13.238055  8790 raft_consensus.cc:1217] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:13.239440  9090 ts_tablet_manager.cc:1434] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:16:13.242607  8116 tablet_copy_service.cc:342] P 9480609eccc44250a4d7fcc9686e76cf: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-6e624c9e6425410d86ead659c0c8db59 received from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:13.243055  8116 tablet_copy_service.cc:434] P 9480609eccc44250a4d7fcc9686e76cf: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-6e624c9e6425410d86ead659c0c8db59 on tablet 6e624c9e6425410d86ead659c0c8db59 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:13.460642  8920 raft_consensus.cc:1064] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:13.463074  8920 consensus_queue.cc:237] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:13.503870  8790 raft_consensus.cc:1217] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:16:13.534180  8790 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:13.538102  9099 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:13.547273  8107 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:13.547437  8248 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:13.551095  8920 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:13.557020  9029 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:13.583701  8920 raft_consensus.cc:2955] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:13.595276  8248 raft_consensus.cc:2955] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:13.597456  8787 raft_consensus.cc:2955] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:13.625713  8003 catalog_manager.cc:5697] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:13.625896  8107 raft_consensus.cc:2955] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:13.670810  9100 raft_consensus.cc:1064] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:13.673421  9100 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:13.687729  8787 raft_consensus.cc:1217] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:13.697670  8787 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:13.699302  9109 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:16:13.723322  8248 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:13.726011  8174 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:13.730333  9084 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:13.738034  9084 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:13.803516  9084 raft_consensus.cc:2955] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:13.817049  8174 consensus_queue.cc:237] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:13.830214  8787 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:13.832286  8248 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:13.832121  8920 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:13.839640  9029 raft_consensus.cc:2955] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:13.846148  8920 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:13.858009  8251 raft_consensus.cc:2955] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:13.862522  8174 raft_consensus.cc:2955] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:13.842170  8787 raft_consensus.cc:2955] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:13.839167  8255 raft_consensus.cc:2955] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:13.869990  9072 raft_consensus.cc:1064] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:13.872622  9072 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:13.888221  8004 catalog_manager.cc:5697] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:13.908375  8790 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 3 LEARNER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:13.910964  9074 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:13.923724  8003 catalog_manager.cc:5697] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:13.927353  8175 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:13.932897  8251 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:13.938429  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8dca4b8aebe74578b370a72879bb9bba with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:13.942337  9109 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:13.947737  8791 raft_consensus.cc:2955] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:13.952611  9100 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:13.983031  8107 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:14.022022  8251 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:14.021041  9101 raft_consensus.cc:2955] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.026224  8094 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dca4b8aebe74578b370a72879bb9bba with delete_type TABLET_DATA_TOMBSTONED (TS 9480609eccc44250a4d7fcc9686e76cf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44046
I20260709 13:16:14.043972  8179 raft_consensus.cc:2955] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.050411  8248 raft_consensus.cc:2955] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.058131  9100 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:14.069756  8787 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:14.070892  8006 catalog_manager.cc:5697] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index 3 to 4, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.083163  9121 tablet_replica.cc:333] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:16:14.111284  9098 raft_consensus.cc:2955] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.124330  9084 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:14.123790  8787 raft_consensus.cc:2955] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.130487  9121 raft_consensus.cc:2243] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.131362  9121 raft_consensus.cc:2272] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.134874  9121 ts_tablet_manager.cc:1916] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:14.139739  8255 raft_consensus.cc:2955] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.141716  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6e624c9e6425410d86ead659c0c8db59 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:14.162555  8791 raft_consensus.cc:2955] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.184098  9121 ts_tablet_manager.cc:1929] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:14.184685  9121 log.cc:1199] T 8dca4b8aebe74578b370a72879bb9bba P 9480609eccc44250a4d7fcc9686e76cf: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/wals/8dca4b8aebe74578b370a72879bb9bba
I20260709 13:16:14.186700  7993 catalog_manager.cc:5028] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): tablet 8dca4b8aebe74578b370a72879bb9bba (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:14.186223  8003 catalog_manager.cc:5697] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:14.216545  8170 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e624c9e6425410d86ead659c0c8db59 with delete_type TABLET_DATA_TOMBSTONED (TS 9bd264598fd2483e9e17674bab9ba4e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46048
I20260709 13:16:14.223922  8108 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:14.230660  8791 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:14.231927  8174 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:14.238812  9098 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:14.239362  9125 tablet_replica.cc:333] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:16:14.246336  9125 raft_consensus.cc:2243] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.247015  9125 raft_consensus.cc:2272] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.246866  9098 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:14.251416  9074 raft_consensus.cc:2955] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.253021  8179 raft_consensus.cc:2955] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.262125  9125 ts_tablet_manager.cc:1916] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:14.272140  9120 raft_consensus.cc:1064] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:14.274631  9120 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:14.266913  8791 raft_consensus.cc:2955] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.278116  8003 catalog_manager.cc:5697] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index 4 to 5, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New cstate: current_term: 3 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.299516  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cd035b4a624c4c7aa2257c2821868021 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:14.300419  8241 tablet_service.cc:1558] Processing DeleteTablet for tablet cd035b4a624c4c7aa2257c2821868021 with delete_type TABLET_DATA_TOMBSTONED (TS a0f96c12124b4e1a816d9fa970464091 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:57550
I20260709 13:16:14.330825  9125 ts_tablet_manager.cc:1929] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:14.331446  9127 tablet_replica.cc:333] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:16:14.356262  9127 raft_consensus.cc:2243] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.356707  8255 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:14.357049  9127 raft_consensus.cc:2272] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.359181  8179 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:14.361822  8791 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:14.362102  9074 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:14.363487  9101 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:14.364689  9127 ts_tablet_manager.cc:1916] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:14.378532  9125 log.cc:1199] T 6e624c9e6425410d86ead659c0c8db59 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-1-root/wals/6e624c9e6425410d86ead659c0c8db59
I20260709 13:16:14.380963  7993 catalog_manager.cc:5028] TS 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): tablet 6e624c9e6425410d86ead659c0c8db59 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:14.385443  9074 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:14.413470  9127 ts_tablet_manager.cc:1929] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:16:14.414052  9127 log.cc:1199] T cd035b4a624c4c7aa2257c2821868021 P a0f96c12124b4e1a816d9fa970464091: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-2-root/wals/cd035b4a624c4c7aa2257c2821868021
I20260709 13:16:14.415794  7993 catalog_manager.cc:5028] TS a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): tablet cd035b4a624c4c7aa2257c2821868021 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:14.553791  8791 raft_consensus.cc:2955] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.562301  8251 raft_consensus.cc:2955] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.530836  9098 raft_consensus.cc:2955] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.633371  8005 catalog_manager.cc:5697] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.699952  8179 raft_consensus.cc:2955] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.735193  8107 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:14.754436  8791 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:14.756419  9120 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:14.778520  9119 raft_consensus.cc:2955] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.786264  8179 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:14.788432  9084 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:14.788210  8791 raft_consensus.cc:2955] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.793574  8174 raft_consensus.cc:2955] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:14.796720  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff9e97576a934b9dbf18f6ee6cc670af with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:14.807467  8005 catalog_manager.cc:5697] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:14.822968  8241 tablet_service.cc:1558] Processing DeleteTablet for tablet ff9e97576a934b9dbf18f6ee6cc670af with delete_type TABLET_DATA_TOMBSTONED (TS a0f96c12124b4e1a816d9fa970464091 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57550
I20260709 13:16:14.824785  9127 tablet_replica.cc:333] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:16:14.827497  9127 raft_consensus.cc:2243] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.828305  9127 raft_consensus.cc:2272] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.835351  9127 ts_tablet_manager.cc:1916] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:14.847616  9127 ts_tablet_manager.cc:1929] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:14.848027  9127 log.cc:1199] T ff9e97576a934b9dbf18f6ee6cc670af P a0f96c12124b4e1a816d9fa970464091: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-2-root/wals/ff9e97576a934b9dbf18f6ee6cc670af
I20260709 13:16:14.849946  7993 catalog_manager.cc:5028] TS a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): tablet ff9e97576a934b9dbf18f6ee6cc670af (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:15.904088  8174 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:15.910630  8257 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:15.913369  8147 consensus_peers.cc:597] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3f32037b7b54a0c991d35bbea1b786b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:15.914073  9135 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:15.914506  8107 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:15.915889  9029 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:15.922485  9099 raft_consensus.cc:2955] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:15.924815  8257 raft_consensus.cc:2955] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:15.933689  8107 raft_consensus.cc:2955] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:15.978888  8005 catalog_manager.cc:5697] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:15.975232  8106 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:16.004688  8251 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:16.006412  9119 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:16.011571  8072 consensus_peers.cc:597] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7588eb91ce3841808ca10d7985976be2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:16.016601  8174 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:16.018589  9098 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:16.024291  8251 raft_consensus.cc:2955] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:16.026623  9098 raft_consensus.cc:2955] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:16.042253  8002 catalog_manager.cc:5697] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:16.056299  8179 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
W20260709 13:16:16.067212  8147 consensus_peers.cc:597] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5328e1082b164f3dbf9bdbb846c37b26. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:16.072772  8106 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:16.073468  8251 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:16.072822  8179 raft_consensus.cc:2955] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:16.074699  9138 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:16.075730  9099 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:16.096871  9135 raft_consensus.cc:2955] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:16.110847  8108 raft_consensus.cc:2955] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:16.112586  8257 raft_consensus.cc:2955] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:16.128703  8106 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:16.128487  8002 catalog_manager.cc:5697] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
W20260709 13:16:16.142289  8072 consensus_peers.cc:597] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d092bc636e5347e5a3f10441d996ec96. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:16.145128  8179 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:16.145161  8251 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:16.146828  9098 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:16.147668  9084 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:16.161908  9119 raft_consensus.cc:2955] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:16.164173  8251 raft_consensus.cc:2955] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:16.167647  8174 raft_consensus.cc:2955] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:16.182745  8005 catalog_manager.cc:5697] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:16.461045  9153 ts_tablet_manager.cc:933] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:16.463104  9153 tablet_copy_client.cc:323] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.130:46389
I20260709 13:16:16.465385  8193 tablet_copy_service.cc:140] P 9bd264598fd2483e9e17674bab9ba4e8: Received BeginTabletCopySession request for tablet f3f32037b7b54a0c991d35bbea1b786b from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:37206)
I20260709 13:16:16.466008  8193 tablet_copy_service.cc:161] P 9bd264598fd2483e9e17674bab9ba4e8: Beginning new tablet copy session on tablet f3f32037b7b54a0c991d35bbea1b786b from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:37206: session id = 5033fc7e66374940a203908ea8b0078f-f3f32037b7b54a0c991d35bbea1b786b
I20260709 13:16:16.475634  8193 tablet_copy_source_session.cc:215] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:16.480808  9153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f32037b7b54a0c991d35bbea1b786b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.498662  9153 tablet_copy_client.cc:806] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:16.499404  9153 tablet_copy_client.cc:670] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:16.506026  9153 tablet_copy_client.cc:538] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:16.515885  9153 tablet_bootstrap.cc:492] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:16.533936  9153 tablet_bootstrap.cc:492] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:16.534905  9153 tablet_bootstrap.cc:492] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:16.535611  9153 ts_tablet_manager.cc:1403] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.020s	user 0.020s	sys 0.000s
I20260709 13:16:16.538856  9153 raft_consensus.cc:359] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:16.539606  9153 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:16.540130  9153 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:16.543016  9153 ts_tablet_manager.cc:1434] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:16.547715  8193 tablet_copy_service.cc:342] P 9bd264598fd2483e9e17674bab9ba4e8: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-f3f32037b7b54a0c991d35bbea1b786b received from {username='slave'} at 127.0.0.1:37206
I20260709 13:16:16.548156  8193 tablet_copy_service.cc:434] P 9bd264598fd2483e9e17674bab9ba4e8: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-f3f32037b7b54a0c991d35bbea1b786b on tablet f3f32037b7b54a0c991d35bbea1b786b with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:16.568790  9153 ts_tablet_manager.cc:933] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123)
I20260709 13:16:16.570989  9153 tablet_copy_client.cc:323] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.129:45123
I20260709 13:16:16.573028  8116 tablet_copy_service.cc:140] P 9480609eccc44250a4d7fcc9686e76cf: Received BeginTabletCopySession request for tablet 7588eb91ce3841808ca10d7985976be2 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:49218)
I20260709 13:16:16.573583  8116 tablet_copy_service.cc:161] P 9480609eccc44250a4d7fcc9686e76cf: Beginning new tablet copy session on tablet 7588eb91ce3841808ca10d7985976be2 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:49218: session id = 5033fc7e66374940a203908ea8b0078f-7588eb91ce3841808ca10d7985976be2
I20260709 13:16:16.580366  8116 tablet_copy_source_session.cc:215] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:16.583257  9153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7588eb91ce3841808ca10d7985976be2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.602246  9153 tablet_copy_client.cc:806] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:16.602972  9153 tablet_copy_client.cc:670] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:16.609279  9153 tablet_copy_client.cc:538] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:16.619699  9153 tablet_bootstrap.cc:492] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:16.649544  9158 ts_tablet_manager.cc:933] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:16.660265  9158 tablet_copy_client.cc:323] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.130:46389
I20260709 13:16:16.662549  8193 tablet_copy_service.cc:140] P 9bd264598fd2483e9e17674bab9ba4e8: Received BeginTabletCopySession request for tablet 5328e1082b164f3dbf9bdbb846c37b26 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:37206)
I20260709 13:16:16.663188  8193 tablet_copy_service.cc:161] P 9bd264598fd2483e9e17674bab9ba4e8: Beginning new tablet copy session on tablet 5328e1082b164f3dbf9bdbb846c37b26 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:37206: session id = 5033fc7e66374940a203908ea8b0078f-5328e1082b164f3dbf9bdbb846c37b26
I20260709 13:16:16.668506  9153 tablet_bootstrap.cc:492] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:16.669625  9153 tablet_bootstrap.cc:492] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:16.670354  9153 ts_tablet_manager.cc:1403] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.009s
I20260709 13:16:16.670907  8193 tablet_copy_source_session.cc:215] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:16.673729  9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5328e1082b164f3dbf9bdbb846c37b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.673645  9153 raft_consensus.cc:359] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:16.674717  9153 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:16.675436  9153 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:16.678287  9153 ts_tablet_manager.cc:1434] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:16:16.680167  8116 tablet_copy_service.cc:342] P 9480609eccc44250a4d7fcc9686e76cf: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-7588eb91ce3841808ca10d7985976be2 received from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:16.680615  8116 tablet_copy_service.cc:434] P 9480609eccc44250a4d7fcc9686e76cf: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-7588eb91ce3841808ca10d7985976be2 on tablet 7588eb91ce3841808ca10d7985976be2 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:16.691668  9158 tablet_copy_client.cc:806] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:16.692355  9158 tablet_copy_client.cc:670] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:16.697968  9153 ts_tablet_manager.cc:933] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123)
I20260709 13:16:16.698554  9158 tablet_copy_client.cc:538] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:16.708678  9158 tablet_bootstrap.cc:492] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:16.712688  9153 tablet_copy_client.cc:323] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.129:45123
I20260709 13:16:16.714448  8116 tablet_copy_service.cc:140] P 9480609eccc44250a4d7fcc9686e76cf: Received BeginTabletCopySession request for tablet d092bc636e5347e5a3f10441d996ec96 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:49218)
I20260709 13:16:16.714973  8116 tablet_copy_service.cc:161] P 9480609eccc44250a4d7fcc9686e76cf: Beginning new tablet copy session on tablet d092bc636e5347e5a3f10441d996ec96 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:49218: session id = 5033fc7e66374940a203908ea8b0078f-d092bc636e5347e5a3f10441d996ec96
I20260709 13:16:16.720512  8116 tablet_copy_source_session.cc:215] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:16.723383  9153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d092bc636e5347e5a3f10441d996ec96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.738261  9158 tablet_bootstrap.cc:492] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:16.739557  9158 tablet_bootstrap.cc:492] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:16.740404  9158 ts_tablet_manager.cc:1403] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.013s
I20260709 13:16:16.743996  9158 raft_consensus.cc:359] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:16.744949  9158 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:16.745669  9158 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:16.748366  9158 ts_tablet_manager.cc:1434] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:16.750136  8193 tablet_copy_service.cc:342] P 9bd264598fd2483e9e17674bab9ba4e8: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-5328e1082b164f3dbf9bdbb846c37b26 received from {username='slave'} at 127.0.0.1:37206
I20260709 13:16:16.750572  8193 tablet_copy_service.cc:434] P 9bd264598fd2483e9e17674bab9ba4e8: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-5328e1082b164f3dbf9bdbb846c37b26 on tablet 5328e1082b164f3dbf9bdbb846c37b26 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:16.764595  9153 tablet_copy_client.cc:806] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:16.765205  9153 tablet_copy_client.cc:670] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:16.769328  9153 tablet_copy_client.cc:538] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:16.777499  9153 tablet_bootstrap.cc:492] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:16.791236  9153 tablet_bootstrap.cc:492] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:16.792052  9153 tablet_bootstrap.cc:492] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:16.792721  9153 ts_tablet_manager.cc:1403] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.015s	user 0.015s	sys 0.003s
I20260709 13:16:16.795202  9153 raft_consensus.cc:359] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:16.795905  9153 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:16.796521  9153 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:16.798617  9153 ts_tablet_manager.cc:1434] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:16:16.807313  8116 tablet_copy_service.cc:342] P 9480609eccc44250a4d7fcc9686e76cf: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-d092bc636e5347e5a3f10441d996ec96 received from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:16.807770  8116 tablet_copy_service.cc:434] P 9480609eccc44250a4d7fcc9686e76cf: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-d092bc636e5347e5a3f10441d996ec96 on tablet d092bc636e5347e5a3f10441d996ec96 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:16.965418  8787 raft_consensus.cc:1217] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:17.000835  8787 raft_consensus.cc:1217] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:17.063225  8787 raft_consensus.cc:1217] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:17.103984  8787 raft_consensus.cc:1217] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:17.442173  9119 raft_consensus.cc:1064] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:17.456563  9119 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:17.469827  8791 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:17.470598  8174 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:17.471419  9084 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:17.472560  9098 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:17.474571  8251 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:17.478046  9098 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:17.502926  9084 raft_consensus.cc:2955] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.506273  8174 raft_consensus.cc:2955] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.505209  8791 raft_consensus.cc:2955] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.638334  9170 raft_consensus.cc:1064] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:17.647671  8003 catalog_manager.cc:5697] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:17.651944  9170 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:17.680255  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 169927us
I20260709 13:16:17.687683  8252 raft_consensus.cc:2955] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.691371  8791 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:17.695824  9177 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:17.710202  9174 raft_consensus.cc:1064] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:17.713164  9175 raft_consensus.cc:1064] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:17.715955  9175 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:17.712929  9174 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:17.730026  8257 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:16:17.741374  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 51312.2us
I20260709 13:16:17.741679  9170 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:17.758152  8791 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:17.757812  9172 raft_consensus.cc:2955] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.759580  8257 raft_consensus.cc:2955] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.761624  9135 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:17.787209  8174 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:17.809629  8106 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:17.814376  8257 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:17.818298  8253 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:17.822763  9179 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:17.825287  9179 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:17.826031  8787 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:17.829890  9174 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:17.833283  8107 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:17.838698  9175 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:17.858758  9135 raft_consensus.cc:2955] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.862306  9119 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:17.866879  9171 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:17.867147  8791 raft_consensus.cc:2955] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.880529  8257 raft_consensus.cc:2955] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.884984  9175 raft_consensus.cc:2955] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.891393  8107 raft_consensus.cc:2955] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.903123  8257 raft_consensus.cc:2955] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.915866  8791 raft_consensus.cc:2955] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.932044  8176 raft_consensus.cc:2955] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.940944  8791 raft_consensus.cc:2955] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.941663  8107 raft_consensus.cc:2955] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.952772  8005 catalog_manager.cc:5697] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.961925  8005 catalog_manager.cc:5697] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.963326  8106 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:17.973052  8791 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:17.974655  9177 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:17.977661  8253 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:17.980226  9177 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:17.983981  8002 catalog_manager.cc:5697] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.988256  9119 raft_consensus.cc:2955] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:17.990608  8787 raft_consensus.cc:2955] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:18.002099  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7588eb91ce3841808ca10d7985976be2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:18.002105  8253 raft_consensus.cc:2955] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:18.013581  8176 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:18.016242  8002 catalog_manager.cc:5697] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:18.024995  8253 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:18.028247  9173 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:18.029618  8787 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:18.031086  9173 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:16:18.037326  7993 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 7588eb91ce3841808ca10d7985976be2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:16:18.038533  9173 raft_consensus.cc:2955] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:18.041682  8170 tablet_service.cc:1558] Processing DeleteTablet for tablet 7588eb91ce3841808ca10d7985976be2 with delete_type TABLET_DATA_TOMBSTONED (TS 9bd264598fd2483e9e17674bab9ba4e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46048
I20260709 13:16:18.043102  8791 raft_consensus.cc:2955] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:18.055577  8175 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:18.062945  8788 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:18.062036  8253 raft_consensus.cc:2955] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:18.065304  9135 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:18.069779  8257 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:18.072767  9171 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:18.076427  8002 catalog_manager.cc:5697] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:18.081856  9175 raft_consensus.cc:2955] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:18.087407  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5328e1082b164f3dbf9bdbb846c37b26 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:18.099562  8094 tablet_service.cc:1558] Processing DeleteTablet for tablet 5328e1082b164f3dbf9bdbb846c37b26 with delete_type TABLET_DATA_TOMBSTONED (TS 9480609eccc44250a4d7fcc9686e76cf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44046
I20260709 13:16:18.094871  8788 raft_consensus.cc:2955] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:18.112293  8257 raft_consensus.cc:2955] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:18.122095  9198 tablet_replica.cc:333] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:16:18.127873  9198 raft_consensus.cc:2243] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.128679  9198 raft_consensus.cc:2272] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.125849  9199 tablet_replica.cc:333] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:16:18.130497  9199 raft_consensus.cc:2243] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.132490  9199 raft_consensus.cc:2272] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.136013  8003 catalog_manager.cc:5697] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:18.153502  9199 ts_tablet_manager.cc:1916] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:18.155929  8094 tablet_service.cc:1558] Processing DeleteTablet for tablet f3f32037b7b54a0c991d35bbea1b786b with delete_type TABLET_DATA_TOMBSTONED (TS 9480609eccc44250a4d7fcc9686e76cf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44046
I20260709 13:16:18.154160  9198 ts_tablet_manager.cc:1916] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:18.168126  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f3f32037b7b54a0c991d35bbea1b786b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:18.182327  9199 ts_tablet_manager.cc:1929] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:18.183624  9199 log.cc:1199] T 5328e1082b164f3dbf9bdbb846c37b26 P 9480609eccc44250a4d7fcc9686e76cf: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/wals/5328e1082b164f3dbf9bdbb846c37b26
I20260709 13:16:18.191126  9199 tablet_replica.cc:333] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:16:18.192090  7993 catalog_manager.cc:5028] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): tablet 5328e1082b164f3dbf9bdbb846c37b26 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:18.193221  9199 raft_consensus.cc:2243] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.195143  9199 raft_consensus.cc:2272] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.198230  9198 ts_tablet_manager.cc:1929] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:18.198257  9199 ts_tablet_manager.cc:1916] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:18.198779  9198 log.cc:1199] T 7588eb91ce3841808ca10d7985976be2 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-1-root/wals/7588eb91ce3841808ca10d7985976be2
I20260709 13:16:18.200317  7993 catalog_manager.cc:5028] TS 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): tablet 7588eb91ce3841808ca10d7985976be2 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:18.210062  9199 ts_tablet_manager.cc:1929] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:18.210461  9199 log.cc:1199] T f3f32037b7b54a0c991d35bbea1b786b P 9480609eccc44250a4d7fcc9686e76cf: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/wals/f3f32037b7b54a0c991d35bbea1b786b
I20260709 13:16:18.211733  7993 catalog_manager.cc:5028] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): tablet f3f32037b7b54a0c991d35bbea1b786b (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:18.347258  8106 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:18.351715  8176 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:18.352478  8788 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:18.352897  9177 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:18.354029  9170 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:18.359964  9177 raft_consensus.cc:2955] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:18.363765  8176 raft_consensus.cc:2955] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:18.373801  8788 raft_consensus.cc:2955] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:18.381472  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d092bc636e5347e5a3f10441d996ec96 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:18.394138  8002 catalog_manager.cc:5697] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:18.410567  8241 tablet_service.cc:1558] Processing DeleteTablet for tablet d092bc636e5347e5a3f10441d996ec96 with delete_type TABLET_DATA_TOMBSTONED (TS a0f96c12124b4e1a816d9fa970464091 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57550
I20260709 13:16:18.412446  9200 tablet_replica.cc:333] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:16:18.413506  9200 raft_consensus.cc:2243] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:18.414139  9200 raft_consensus.cc:2272] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:18.417315  9200 ts_tablet_manager.cc:1916] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:18.430258  9200 ts_tablet_manager.cc:1929] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:18.430671  9200 log.cc:1199] T d092bc636e5347e5a3f10441d996ec96 P a0f96c12124b4e1a816d9fa970464091: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-2-root/wals/d092bc636e5347e5a3f10441d996ec96
I20260709 13:16:18.432474  7993 catalog_manager.cc:5028] TS a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): tablet d092bc636e5347e5a3f10441d996ec96 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:19.474334  8107 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:19.481825  8257 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:19.482177  8174 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:19.482661  8072 consensus_peers.cc:597] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e424b91f5394cedb3ad1923bab01174. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:19.483747  9205 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.484997  9119 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.500241  9205 raft_consensus.cc:2955] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:19.501677  8174 raft_consensus.cc:2955] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:19.502631  8257 raft_consensus.cc:2955] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:19.518054  8107 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:19.517940  8003 catalog_manager.cc:5697] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:19.533365  8253 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:19.534060  8072 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43e4649131cb4b10a82b13d0d2b8e85a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:19.535483  9205 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.537948  8174 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:19.542869  9205 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.551307  8257 raft_consensus.cc:2955] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:19.555883  9170 raft_consensus.cc:2955] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:19.557848  8174 raft_consensus.cc:2955] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:19.574034  8176 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:19.579160  8005 catalog_manager.cc:5697] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
W20260709 13:16:19.594087  8147 consensus_peers.cc:597] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6353b347875648eda7077a6a3bc633fd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:19.594401  8107 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:19.595758  8257 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:19.597872  9175 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.598776  9201 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.606415  9201 raft_consensus.cc:2955] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:19.608162  8107 raft_consensus.cc:2955] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:19.613185  8252 raft_consensus.cc:2955] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:19.625265  8176 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:19.626065  8002 catalog_manager.cc:5697] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:19.663055  8107 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:19.664347  8252 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:19.664916  8147 consensus_peers.cc:597] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73b079a720af4d478dba8d608aeb9059. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:19.665864  9201 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.666720  9173 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.678195  9201 raft_consensus.cc:2955] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:19.681274  8253 raft_consensus.cc:2955] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:19.685448  8107 raft_consensus.cc:2955] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:19.700037  8005 catalog_manager.cc:5697] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:19.882694  9223 ts_tablet_manager.cc:933] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123)
I20260709 13:16:19.884714  9223 tablet_copy_client.cc:323] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.129:45123
I20260709 13:16:19.886152  8116 tablet_copy_service.cc:140] P 9480609eccc44250a4d7fcc9686e76cf: Received BeginTabletCopySession request for tablet 7e424b91f5394cedb3ad1923bab01174 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:49218)
I20260709 13:16:19.886584  8116 tablet_copy_service.cc:161] P 9480609eccc44250a4d7fcc9686e76cf: Beginning new tablet copy session on tablet 7e424b91f5394cedb3ad1923bab01174 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:49218: session id = 5033fc7e66374940a203908ea8b0078f-7e424b91f5394cedb3ad1923bab01174
I20260709 13:16:19.892580  8116 tablet_copy_source_session.cc:215] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:19.895401  9223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e424b91f5394cedb3ad1923bab01174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:19.911541  9223 tablet_copy_client.cc:806] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:19.912199  9223 tablet_copy_client.cc:670] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:19.916662  9223 tablet_copy_client.cc:538] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:19.927886  9223 tablet_bootstrap.cc:492] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:19.946771  9223 tablet_bootstrap.cc:492] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:19.948058  9223 tablet_bootstrap.cc:492] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:19.949558  9223 ts_tablet_manager.cc:1403] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.022s	user 0.023s	sys 0.000s
I20260709 13:16:19.954049  9223 raft_consensus.cc:359] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:19.955293  9223 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:19.956251  9223 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:19.967937  9223 ts_tablet_manager.cc:1434] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.008s
I20260709 13:16:19.970103  8116 tablet_copy_service.cc:342] P 9480609eccc44250a4d7fcc9686e76cf: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-7e424b91f5394cedb3ad1923bab01174 received from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:19.970587  8116 tablet_copy_service.cc:434] P 9480609eccc44250a4d7fcc9686e76cf: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-7e424b91f5394cedb3ad1923bab01174 on tablet 7e424b91f5394cedb3ad1923bab01174 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:20.186218  9223 ts_tablet_manager.cc:933] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123)
I20260709 13:16:20.188520  9223 tablet_copy_client.cc:323] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.129:45123
I20260709 13:16:20.191219  8116 tablet_copy_service.cc:140] P 9480609eccc44250a4d7fcc9686e76cf: Received BeginTabletCopySession request for tablet 43e4649131cb4b10a82b13d0d2b8e85a from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:49218)
I20260709 13:16:20.191756  8116 tablet_copy_service.cc:161] P 9480609eccc44250a4d7fcc9686e76cf: Beginning new tablet copy session on tablet 43e4649131cb4b10a82b13d0d2b8e85a from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:49218: session id = 5033fc7e66374940a203908ea8b0078f-43e4649131cb4b10a82b13d0d2b8e85a
I20260709 13:16:20.229316  9234 ts_tablet_manager.cc:933] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:20.239974  9234 tablet_copy_client.cc:323] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.130:46389
I20260709 13:16:20.242388  8193 tablet_copy_service.cc:140] P 9bd264598fd2483e9e17674bab9ba4e8: Received BeginTabletCopySession request for tablet 73b079a720af4d478dba8d608aeb9059 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:37206)
I20260709 13:16:20.242928  8193 tablet_copy_service.cc:161] P 9bd264598fd2483e9e17674bab9ba4e8: Beginning new tablet copy session on tablet 73b079a720af4d478dba8d608aeb9059 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:37206: session id = 5033fc7e66374940a203908ea8b0078f-73b079a720af4d478dba8d608aeb9059
I20260709 13:16:20.201611  8116 tablet_copy_source_session.cc:215] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:20.250918  8193 tablet_copy_source_session.cc:215] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:20.254235  9234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b079a720af4d478dba8d608aeb9059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:20.255311  9223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e4649131cb4b10a82b13d0d2b8e85a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:20.258364  9236 ts_tablet_manager.cc:933] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:20.270605  9234 tablet_copy_client.cc:806] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:20.273329  9234 tablet_copy_client.cc:670] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:20.276471  9236 tablet_copy_client.cc:323] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.130:46389
I20260709 13:16:20.276714  9234 tablet_copy_client.cc:538] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:20.280223  8193 tablet_copy_service.cc:140] P 9bd264598fd2483e9e17674bab9ba4e8: Received BeginTabletCopySession request for tablet 6353b347875648eda7077a6a3bc633fd from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:37206)
I20260709 13:16:20.280766  8193 tablet_copy_service.cc:161] P 9bd264598fd2483e9e17674bab9ba4e8: Beginning new tablet copy session on tablet 6353b347875648eda7077a6a3bc633fd from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:37206: session id = 5033fc7e66374940a203908ea8b0078f-6353b347875648eda7077a6a3bc633fd
I20260709 13:16:20.288321  9223 tablet_copy_client.cc:806] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:20.288887  9234 tablet_bootstrap.cc:492] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:20.289113  9223 tablet_copy_client.cc:670] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:20.291916  8193 tablet_copy_source_session.cc:215] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:20.295258  9236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6353b347875648eda7077a6a3bc633fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:20.318126  8790 raft_consensus.cc:1217] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:20.293221  9223 tablet_copy_client.cc:538] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:20.333714  9234 tablet_bootstrap.cc:492] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:20.335264  9234 tablet_bootstrap.cc:492] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:20.335990  9234 ts_tablet_manager.cc:1403] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.007s
I20260709 13:16:20.337654  9223 tablet_bootstrap.cc:492] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:20.339087  9234 raft_consensus.cc:359] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:20.339769  9236 tablet_copy_client.cc:806] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:20.339982  9234 raft_consensus.cc:740] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:20.340384  9236 tablet_copy_client.cc:670] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:20.340735  9234 consensus_queue.cc:260] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:20.343869  9234 ts_tablet_manager.cc:1434] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:20.344055  9236 tablet_copy_client.cc:538] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:20.345602  8193 tablet_copy_service.cc:342] P 9bd264598fd2483e9e17674bab9ba4e8: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-73b079a720af4d478dba8d608aeb9059 received from {username='slave'} at 127.0.0.1:37206
I20260709 13:16:20.346012  8193 tablet_copy_service.cc:434] P 9bd264598fd2483e9e17674bab9ba4e8: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-73b079a720af4d478dba8d608aeb9059 on tablet 73b079a720af4d478dba8d608aeb9059 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:20.361820  9236 tablet_bootstrap.cc:492] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:20.371479  9223 tablet_bootstrap.cc:492] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:20.372473  9223 tablet_bootstrap.cc:492] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:20.373698  9223 ts_tablet_manager.cc:1403] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.012s
I20260709 13:16:20.376516  9223 raft_consensus.cc:359] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:20.377391  9223 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:20.378022  9223 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:20.381340  9223 ts_tablet_manager.cc:1434] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:20.382957  8116 tablet_copy_service.cc:342] P 9480609eccc44250a4d7fcc9686e76cf: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-43e4649131cb4b10a82b13d0d2b8e85a received from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:20.383441  8116 tablet_copy_service.cc:434] P 9480609eccc44250a4d7fcc9686e76cf: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-43e4649131cb4b10a82b13d0d2b8e85a on tablet 43e4649131cb4b10a82b13d0d2b8e85a with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:20.389750  9236 tablet_bootstrap.cc:492] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:20.390987  9236 tablet_bootstrap.cc:492] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:20.391696  9236 ts_tablet_manager.cc:1403] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.004s
I20260709 13:16:20.394719  9236 raft_consensus.cc:359] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:20.395577  9236 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:20.396240  9236 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:20.398633  9236 ts_tablet_manager.cc:1434] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:20.402130  8193 tablet_copy_service.cc:342] P 9bd264598fd2483e9e17674bab9ba4e8: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-6353b347875648eda7077a6a3bc633fd received from {username='slave'} at 127.0.0.1:37206
I20260709 13:16:20.402576  8193 tablet_copy_service.cc:434] P 9bd264598fd2483e9e17674bab9ba4e8: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-6353b347875648eda7077a6a3bc633fd on tablet 6353b347875648eda7077a6a3bc633fd with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:20.527789  8790 raft_consensus.cc:1217] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:20.543104  8790 raft_consensus.cc:1217] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:20.636210  8790 raft_consensus.cc:1217] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:20.790995  9219 raft_consensus.cc:1064] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:20.794032  9219 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:20.801281  8252 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:20.801295  8790 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:20.803134  9119 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:20.803936  8174 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:20.805380  9119 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:20.806278  9219 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:20.819628  9119 raft_consensus.cc:2955] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:20.831676  8790 raft_consensus.cc:2955] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:20.833815  8181 raft_consensus.cc:2955] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:20.848038  8257 raft_consensus.cc:2955] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:20.872195  8002 catalog_manager.cc:5697] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:20.929270  8108 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:20.934652  8790 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:20.935823  9119 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:20.936519  8250 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:20.937986  9119 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:20.943413  9170 raft_consensus.cc:2955] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:20.947814  8250 raft_consensus.cc:2955] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:20.951481  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7e424b91f5394cedb3ad1923bab01174 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:20.954519  8790 raft_consensus.cc:2955] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:20.961768  8005 catalog_manager.cc:5697] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:20.980774  8170 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e424b91f5394cedb3ad1923bab01174 with delete_type TABLET_DATA_TOMBSTONED (TS 9bd264598fd2483e9e17674bab9ba4e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46048
I20260709 13:16:20.982700  9251 tablet_replica.cc:333] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:16:20.983752  9251 raft_consensus.cc:2243] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:20.984406  9251 raft_consensus.cc:2272] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:20.986928  9251 ts_tablet_manager.cc:1916] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:21.003575  9251 ts_tablet_manager.cc:1929] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:21.004714  9173 raft_consensus.cc:1064] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:21.007257  9173 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:21.004417  9251 log.cc:1199] T 7e424b91f5394cedb3ad1923bab01174 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-1-root/wals/7e424b91f5394cedb3ad1923bab01174
I20260709 13:16:21.010613  7993 catalog_manager.cc:5028] TS 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): tablet 7e424b91f5394cedb3ad1923bab01174 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:21.018643  8790 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:21.020133  9231 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.023169  8250 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:21.025174  9230 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.041057  8106 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:21.042732  9231 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.049613  9230 raft_consensus.cc:2955] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.056368  9170 raft_consensus.cc:1064] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:21.060933  8790 raft_consensus.cc:2955] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:16:21.061949  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3200 after lost signal to thread 7005
W20260709 13:16:21.063234  8129 debug-util.cc:398] Leaking SignalData structure 0x7b0800318ac0 after lost signal to thread 8040
W20260709 13:16:21.064630  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08000d6220 after lost signal to thread 8132
W20260709 13:16:21.065593  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08001b9f00 after lost signal to thread 8207
W20260709 13:16:21.066637  8129 debug-util.cc:398] Leaking SignalData structure 0x7b080023bea0 after lost signal to thread 8281
I20260709 13:16:21.075578  8250 raft_consensus.cc:2955] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.060333  9170 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:21.078924  8129 debug-util.cc:398] Leaking SignalData structure 0x7b0800249960 after lost signal to thread 8823
I20260709 13:16:21.089726  8106 raft_consensus.cc:2955] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.091738  8005 catalog_manager.cc:5697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.132779  8790 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:21.134416  9247 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.137501  8181 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:21.143074  8787 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:21.144556  9173 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:21.150118  8179 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:21.157783  8250 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:21.157995  9247 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.173413  8106 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:21.173635  9229 raft_consensus.cc:2955] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.175910  9245 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.177940  9175 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:21.181039  8787 raft_consensus.cc:2955] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.182202  8106 raft_consensus.cc:2955] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.187582  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6353b347875648eda7077a6a3bc633fd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:21.200078  8005 catalog_manager.cc:5697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.226045  9170 raft_consensus.cc:2955] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.230935  9229 raft_consensus.cc:1064] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:21.232296  8250 raft_consensus.cc:2955] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.233495  9229 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:21.245915  8787 raft_consensus.cc:2955] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.248754  8179 raft_consensus.cc:2955] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.268302  8257 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:21.270299  9229 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.267704  8787 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:21.274739  9231 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.279024  8241 tablet_service.cc:1558] Processing DeleteTablet for tablet 6353b347875648eda7077a6a3bc633fd with delete_type TABLET_DATA_TOMBSTONED (TS a0f96c12124b4e1a816d9fa970464091 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57550
I20260709 13:16:21.286691  8003 catalog_manager.cc:5697] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.327909  8106 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:21.343755  8106 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:21.351905  8787 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:21.353863  9245 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:21.358732  8250 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:21.360165  9170 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:21.372548  9262 tablet_replica.cc:333] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:16:21.372956  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:21.372575  9170 raft_consensus.cc:2955] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.373857  9262 raft_consensus.cc:2243] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:21.374745  9262 raft_consensus.cc:2272] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.378671  9262 ts_tablet_manager.cc:1916] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:21.383478  8787 raft_consensus.cc:2955] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.386941  9229 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.403782  8005 catalog_manager.cc:5697] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.404621  8250 raft_consensus.cc:2955] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.414407  9231 raft_consensus.cc:2955] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.418946  9262 ts_tablet_manager.cc:1929] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:21.423230  9262 log.cc:1199] T 6353b347875648eda7077a6a3bc633fd P a0f96c12124b4e1a816d9fa970464091: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-2-root/wals/6353b347875648eda7077a6a3bc633fd
I20260709 13:16:21.425190  7993 catalog_manager.cc:5028] TS a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): tablet 6353b347875648eda7077a6a3bc633fd (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:21.431442  8257 raft_consensus.cc:2955] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.435623  8170 tablet_service.cc:1558] Processing DeleteTablet for tablet 43e4649131cb4b10a82b13d0d2b8e85a with delete_type TABLET_DATA_TOMBSTONED (TS 9bd264598fd2483e9e17674bab9ba4e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46048
I20260709 13:16:21.438448  9251 tablet_replica.cc:333] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:16:21.439555  9251 raft_consensus.cc:2243] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:21.440359  9251 raft_consensus.cc:2272] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.445123  9251 ts_tablet_manager.cc:1916] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:21.451902  8106 raft_consensus.cc:2955] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.457552  8003 catalog_manager.cc:5697] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.466841  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 43e4649131cb4b10a82b13d0d2b8e85a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:21.476888  9251 ts_tablet_manager.cc:1929] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:21.477494  9251 log.cc:1199] T 43e4649131cb4b10a82b13d0d2b8e85a P 9bd264598fd2483e9e17674bab9ba4e8: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-1-root/wals/43e4649131cb4b10a82b13d0d2b8e85a
I20260709 13:16:21.482864  7993 catalog_manager.cc:5028] TS 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): tablet 43e4649131cb4b10a82b13d0d2b8e85a (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:21.488005  8787 raft_consensus.cc:2955] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.757694  8174 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:21.827097  8253 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:21.853044  9175 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:21.857151  8788 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:21.863782  9271 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:21.884146  9175 raft_consensus.cc:2955] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.885200  8791 raft_consensus.cc:2955] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.904001  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 73b079a720af4d478dba8d608aeb9059 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:21.911980  8002 catalog_manager.cc:5697] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.938993  8094 tablet_service.cc:1558] Processing DeleteTablet for tablet 73b079a720af4d478dba8d608aeb9059 with delete_type TABLET_DATA_TOMBSTONED (TS 9480609eccc44250a4d7fcc9686e76cf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44046
I20260709 13:16:21.949664  8255 raft_consensus.cc:2955] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:21.957275  9273 tablet_replica.cc:333] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:16:21.958488  9273 raft_consensus.cc:2243] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:21.961596  8108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:21.962363  8108 raft_consensus.cc:606] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:21.963804  9273 raft_consensus.cc:2272] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:21.967308  9273 ts_tablet_manager.cc:1916] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:21.970111  8108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:21.970845  8108 raft_consensus.cc:606] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:21.975423  8108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:21.976008  8108 raft_consensus.cc:606] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:21.978879  8108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:21.979444  8108 raft_consensus.cc:606] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:21.982131  9273 ts_tablet_manager.cc:1929] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:21.982635  9273 log.cc:1199] T 73b079a720af4d478dba8d608aeb9059 P 9480609eccc44250a4d7fcc9686e76cf: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/wals/73b079a720af4d478dba8d608aeb9059
I20260709 13:16:21.984273  7993 catalog_manager.cc:5028] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): tablet 73b079a720af4d478dba8d608aeb9059 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:21.992622  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:21.993193  8174 raft_consensus.cc:606] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:21.996109  8108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:21.996675  8108 raft_consensus.cc:606] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:21.997746  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:21.998906  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:22.142987  9247 raft_consensus.cc:993] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:22.143527  9245 raft_consensus.cc:1081] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Signalling peer 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:22.144881  8791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:50464
I20260709 13:16:22.145413  8791 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:22.145740  8791 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.150496  8791 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:22.152377  8791 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:22.153570  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:22.154186  8250 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.154157  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:22.154975  8108 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:22.155364  8108 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:22.156128  8108 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:22.157400  8108 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.161162  8250 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:22.162396  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:22.163213  9226 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.163797  8108 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:22.164393  9226 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:22.165331  9226 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:22.174901  8005 catalog_manager.cc:5697] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 2 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:22.288462  9272 raft_consensus.cc:993] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:22.289000  9247 raft_consensus.cc:1081] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Signalling peer 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:22.290549  9247 raft_consensus.cc:993] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:22.290738  8791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:50464
I20260709 13:16:22.291021  9245 raft_consensus.cc:1081] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:22.291416  8791 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:22.291843  8791 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.292640  8250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57556
I20260709 13:16:22.293221  8250 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:22.293606  8250 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.298874  8791 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:22.300323  8250 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:22.301280  8791 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:22.302127  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:22.302476  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:22.302785  8108 raft_consensus.cc:3055] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:22.303045  8174 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.303133  8108 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:22.303162  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:22.303915  8106 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:22.304253  8106 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:22.304363  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:22.304994  8181 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.304628  8108 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:22.305078  8106 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:22.306013  8108 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.306211  8106 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.310027  8174 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:22.311524  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:22.311852  8181 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:22.312445  9226 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.313028  9226 raft_consensus.cc:697] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:22.313942  9226 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:22.314488  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:22.314652  8108 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:22.315459  9260 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.303229  8250 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:22.315979  9260 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:22.318264  9260 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:22.320932  8106 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:22.326205  9272 raft_consensus.cc:993] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:22.326722  9170 raft_consensus.cc:1081] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:22.327924  8005 catalog_manager.cc:5697] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 2 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:22.332713  9170 raft_consensus.cc:993] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:22.335373  9272 raft_consensus.cc:1081] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Signalling peer 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:22.337237  8791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:50464
I20260709 13:16:22.337960  8791 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:22.338333  8791 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.340744  8250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57556
I20260709 13:16:22.341352  8250 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:22.341789  8250 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.345770  8791 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:22.348517  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:22.349072  8102 raft_consensus.cc:3055] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:22.349377  8102 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:22.350247  8102 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:22.351387  8102 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.353885  8791 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:22.352231  8250 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:22.355813  8250 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:22.357854  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:22.357553  8005 catalog_manager.cc:5697] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:22.358434  8251 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.363070  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:22.363673  8106 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:22.363933  8106 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:22.364707  8106 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:22.365927  8106 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.369601  8102 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:22.369771  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:22.370849  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:22.372961  9226 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.373487  9226 raft_consensus.cc:697] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:22.373586  8174 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.374428  9226 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:22.371456  8251 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:22.381815  8174 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:22.383005  8223 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:22.383260  8106 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:22.384029  9260 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.384811  9260 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:22.385670  9260 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:22.385615  8005 catalog_manager.cc:5697] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 2 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:22.393352  9231 raft_consensus.cc:993] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:22.393877  9271 raft_consensus.cc:1081] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Signalling peer 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:22.395540  8791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:48110
I20260709 13:16:22.396132  8791 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:22.396545  8791 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.399235  8002 catalog_manager.cc:5697] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:22.403548  8791 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:22.406793  8791 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:22.408103  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:22.408517  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:22.408664  8255 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.409128  8174 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:22.409523  8174 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:22.410279  8174 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:22.411513  8174 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.418370  8174 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:22.419459  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:22.420276  8255 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:22.420315  9226 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.421111  9226 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:22.422043  9226 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:22.430727  8002 catalog_manager.cc:5697] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 2 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:22.578390  8102 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:22.579591  9226 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:22.597637  8255 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:22.599023  9275 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:22.707528  8102 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:22.708822  9275 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:16:22.716007  8204 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4280 after lost signal to thread 7005
W20260709 13:16:22.717003  8204 debug-util.cc:398] Leaking SignalData structure 0x7b0800138540 after lost signal to thread 8040
W20260709 13:16:22.718156  8204 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb4e0 after lost signal to thread 8132
W20260709 13:16:22.719172  8204 debug-util.cc:398] Leaking SignalData structure 0x7b0800310d60 after lost signal to thread 8207
W20260709 13:16:22.720168  8204 debug-util.cc:398] Leaking SignalData structure 0x7b0800035ce0 after lost signal to thread 8281
I20260709 13:16:22.725389  8174 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:22.728369  9283 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:16:22.733438  8204 debug-util.cc:398] Leaking SignalData structure 0x7b0800323380 after lost signal to thread 8823
I20260709 13:16:22.771315  8102 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:22.772893  9233 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:22.791812  8179 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:22.793874  9122 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:22.796552  8106 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:22.798269  9283 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:22.836619  8255 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:22.837980  9226 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:22.870788  8255 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:22.873063  9226 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:22.888818  8181 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:22.894981  9283 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:22.923163  8174 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:22.925449  9122 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:22.942684  8106 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:22.944139  9122 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:22.999825  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:23.054119  8251 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
W20260709 13:16:23.061820  8221 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8584c73fd4f14469baaaebe16617e775. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.061971  8174 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:23.064095  8106 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:23.064981  9122 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.066196  9260 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.078967  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:23.085722  9122 raft_consensus.cc:2955] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.088528  8102 raft_consensus.cc:2955] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.109364  8005 catalog_manager.cc:5697] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.110078  8181 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
W20260709 13:16:23.136195  8147 consensus_peers.cc:597] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1e020840d414fa992e8afcd5cffaad4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.140466  8179 raft_consensus.cc:2955] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.156380  8250 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:23.157395  8106 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:23.159588  9230 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.161144  9271 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.183878  9299 raft_consensus.cc:2955] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.185942  8250 raft_consensus.cc:2955] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.192016  8108 raft_consensus.cc:2955] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.211133  8251 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:23.212788  8005 catalog_manager.cc:5697] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.234666  8108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:23.235339  8108 raft_consensus.cc:606] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:23.236722  8221 consensus_peers.cc:597] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0bf7f11a5f324770a352a6a29f56ebf4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.239091  8179 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:23.239943  8102 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:23.240167  8108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:23.240830  8108 raft_consensus.cc:606] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:23.242236  9260 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.243975  9122 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.253454  9296 raft_consensus.cc:993] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:23.254048  9296 raft_consensus.cc:1081] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Signalling peer 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:23.255656  8787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:50464
I20260709 13:16:23.256161  8787 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.256512  8787 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.262909  8108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:23.263482  8108 raft_consensus.cc:606] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:23.266351  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be8c836876cb41918064b2082dd48efe"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:23.267004  8174 raft_consensus.cc:606] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:23.271651  8108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:23.272179  8108 raft_consensus.cc:606] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:23.275882  8102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:23.276391  8102 raft_consensus.cc:606] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:23.276830  9272 raft_consensus.cc:993] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:23.277280  9272 raft_consensus.cc:1081] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:23.277824  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:23.279431  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:23.280010  8251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57556
I20260709 13:16:23.281049  8251 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.283440  9245 raft_consensus.cc:993] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:23.290581  9245 raft_consensus.cc:1081] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Signalling peer 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:23.292244  8251 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.292459  8791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:50464
I20260709 13:16:23.293001  8791 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.293368  8791 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:23.276796  8787 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:23.296173  8787 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:23.298049  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:23.298614  8102 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.298913  8102 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:23.299669  8102 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:23.300711  8102 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.302865  8251 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:23.305470  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:23.306164  8250 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.307909  8102 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:23.308876  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:23.309444  8174 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.314344  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:23.315623  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:23.316433  8107 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.316727  8107 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:23.317384  8107 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:23.318466  8107 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.326105  8174 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:23.327553  8251 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:23.328658  8223 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:23.329392  8107 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:23.329841  9260 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:23.330389  9260 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:23.331451  9226 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:23.331395  9260 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:23.332118  9226 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:23.333674  9226 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:23.326541  8250 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:23.346354  8791 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:23.348548  8791 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:23.361677  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:23.363238  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:23.370510  8181 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:23.370311  8102 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:23.390172  8102 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:23.393044  8102 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:23.381484  8181 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:23.403208  9260 raft_consensus.cc:2955] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.413529  8002 catalog_manager.cc:5697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:23.416791  8005 catalog_manager.cc:5697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 2 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:23.422860  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:23.423756  9226 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:23.424237  9226 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:23.424988  9226 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:23.425724  8176 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:23.438035  8106 raft_consensus.cc:2955] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.450218  8174 raft_consensus.cc:2955] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.477296  8003 catalog_manager.cc:5697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.466378  8102 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:23.516368  8002 catalog_manager.cc:5697] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 4, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 4 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:23.524098  8102 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
W20260709 13:16:23.525182  8147 consensus_peers.cc:597] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e96746d2ece4e52ab82eca0737daf2e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:23.526314  8106 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:23.523396  8251 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:23.528434  9299 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.534857  9230 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.544441  9272 raft_consensus.cc:993] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:23.544912  9272 raft_consensus.cc:1081] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:23.544677  9271 raft_consensus.cc:2955] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.546562  8251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57556
I20260709 13:16:23.547384  8251 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.547813  8251 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.550017  8250 raft_consensus.cc:2955] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.554584  8251 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:23.557337  8251 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:23.559795  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:23.560377  8791 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.561416  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:23.562093  8102 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.562352  8102 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:23.563009  8102 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:23.564077  8102 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.565207  8106 raft_consensus.cc:2955] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.569898  8791 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:23.571235  8221 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:23.572448  9122 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:23.572865  9122 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:23.573601  9122 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:23.585484  8002 catalog_manager.cc:5697] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:23.591259  8102 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:23.604907  9231 raft_consensus.cc:993] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:23.613267  9231 raft_consensus.cc:1081] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:23.618120  8255 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be8c836876cb41918064b2082dd48efe"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57566
I20260709 13:16:23.618711  8255 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.619068  8255 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.630378  8255 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:23.623749  8003 catalog_manager.cc:5697] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.646382  8255 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:23.647869  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:23.647951  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:23.648450  8102 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.648646  8176 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.648995  8176 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:23.649688  8176 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:23.650671  8176 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.656023  8102 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:23.657413  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:23.659039  9122 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:23.659533  9122 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:23.660768  9322 ts_tablet_manager.cc:933] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:23.660307  9122 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:23.665045  8176 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:23.674642  9323 ts_tablet_manager.cc:933] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:23.694372  9323 tablet_copy_client.cc:323] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.131:45561
I20260709 13:16:23.697041  8266 tablet_copy_service.cc:140] P a0f96c12124b4e1a816d9fa970464091: Received BeginTabletCopySession request for tablet 0bf7f11a5f324770a352a6a29f56ebf4 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:60806)
I20260709 13:16:23.697695  8266 tablet_copy_service.cc:161] P a0f96c12124b4e1a816d9fa970464091: Beginning new tablet copy session on tablet 0bf7f11a5f324770a352a6a29f56ebf4 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:60806: session id = 5033fc7e66374940a203908ea8b0078f-0bf7f11a5f324770a352a6a29f56ebf4
I20260709 13:16:23.706634  8266 tablet_copy_source_session.cc:215] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:23.711153  9323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf7f11a5f324770a352a6a29f56ebf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.715016  9322 tablet_copy_client.cc:323] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.131:45561
I20260709 13:16:23.717971  8002 catalog_manager.cc:5697] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:23.722427  8266 tablet_copy_service.cc:140] P a0f96c12124b4e1a816d9fa970464091: Received BeginTabletCopySession request for tablet 8584c73fd4f14469baaaebe16617e775 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:60806)
I20260709 13:16:23.723017  8266 tablet_copy_service.cc:161] P a0f96c12124b4e1a816d9fa970464091: Beginning new tablet copy session on tablet 8584c73fd4f14469baaaebe16617e775 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:60806: session id = 5033fc7e66374940a203908ea8b0078f-8584c73fd4f14469baaaebe16617e775
I20260709 13:16:23.733876  8266 tablet_copy_source_session.cc:215] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:23.812944  9323 tablet_copy_client.cc:806] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:23.813635  9323 tablet_copy_client.cc:670] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:23.821233  9322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8584c73fd4f14469baaaebe16617e775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.831214  9247 raft_consensus.cc:993] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:23.831962  9272 raft_consensus.cc:1081] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Signalling peer 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:23.833841  8787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:50464
I20260709 13:16:23.834421  8787 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.834879  8787 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.839336  9327 ts_tablet_manager.cc:933] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:23.854949  8255 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:23.859187  8102 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:23.865960  9122 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.868441  9327 tablet_copy_client.cc:323] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.130:46389
I20260709 13:16:23.871157  8193 tablet_copy_service.cc:140] P 9bd264598fd2483e9e17674bab9ba4e8: Received BeginTabletCopySession request for tablet e1e020840d414fa992e8afcd5cffaad4 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:37206)
I20260709 13:16:23.871690  8193 tablet_copy_service.cc:161] P 9bd264598fd2483e9e17674bab9ba4e8: Beginning new tablet copy session on tablet e1e020840d414fa992e8afcd5cffaad4 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:37206: session id = 5033fc7e66374940a203908ea8b0078f-e1e020840d414fa992e8afcd5cffaad4
I20260709 13:16:23.879047  9322 tablet_copy_client.cc:806] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:23.879770  9322 tablet_copy_client.cc:670] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:23.881422  8193 tablet_copy_source_session.cc:215] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:23.885493  9327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e020840d414fa992e8afcd5cffaad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:23.886824  9323 tablet_copy_client.cc:538] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:23.896257  8787 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:23.901613  9323 tablet_bootstrap.cc:492] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:23.902537  9226 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:23.920976  8787 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:23.922447  8174 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:23.924283  9327 tablet_copy_client.cc:806] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:23.924942  9327 tablet_copy_client.cc:670] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:23.925746  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:23.926332  8108 raft_consensus.cc:3055] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.926628  8108 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:23.927320  8108 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:23.928310  8108 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.935523  8108 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:23.937383  9322 tablet_copy_client.cc:538] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:23.944032  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:23.948951  9275 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:23.949522  9275 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:23.950445  9275 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:23.952973  9226 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:23.959592  9327 tablet_copy_client.cc:538] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:23.969501  9327 tablet_bootstrap.cc:492] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:23.978571  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:23.979270  8255 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.985973  8255 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:23.988744  9322 tablet_bootstrap.cc:492] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:23.988157  8002 catalog_manager.cc:5697] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 2 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:24.000856  8174 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.002653  9313 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:24.009630  8106 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:24.009837  8102 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:24.025661  9226 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:24.030931  9226 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:24.068069  8787 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:24.083086  8106 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:24.084751  9233 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:24.098145  9314 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:24.118175  8102 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.130930  9314 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:24.145491  8174 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.148629  9336 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:24.290177  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:24.302603  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 103872us
I20260709 13:16:24.322821  9346 ts_tablet_manager.cc:933] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:24.264995  9327 tablet_bootstrap.cc:492] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:24.332566  9327 tablet_bootstrap.cc:492] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:24.333316  9327 ts_tablet_manager.cc:1403] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.364s	user 0.031s	sys 0.000s
W20260709 13:16:24.347868  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 132286us
I20260709 13:16:24.367810  9346 tablet_copy_client.cc:323] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.130:46389
I20260709 13:16:24.369570  8193 tablet_copy_service.cc:140] P 9bd264598fd2483e9e17674bab9ba4e8: Received BeginTabletCopySession request for tablet 3e96746d2ece4e52ab82eca0737daf2e from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:37206)
I20260709 13:16:24.370134  8193 tablet_copy_service.cc:161] P 9bd264598fd2483e9e17674bab9ba4e8: Beginning new tablet copy session on tablet 3e96746d2ece4e52ab82eca0737daf2e from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:37206: session id = 5033fc7e66374940a203908ea8b0078f-3e96746d2ece4e52ab82eca0737daf2e
I20260709 13:16:24.378217  8193 tablet_copy_source_session.cc:215] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:24.422446  9346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e96746d2ece4e52ab82eca0737daf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:24.429353  9323 tablet_bootstrap.cc:492] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:24.430425  9323 tablet_bootstrap.cc:492] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:24.431185  9323 ts_tablet_manager.cc:1403] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.530s	user 0.059s	sys 0.077s
I20260709 13:16:24.430590  9327 raft_consensus.cc:359] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:24.431689  9327 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:24.433691  9327 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:24.438748  9323 raft_consensus.cc:359] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:24.456744  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:24.465977  9322 tablet_bootstrap.cc:492] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:24.468029  9323 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:24.482429  9323 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:24.494531  9323 ts_tablet_manager.cc:1434] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.002s
I20260709 13:16:24.507674  9322 tablet_bootstrap.cc:492] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:24.524389  8255 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:24.528489  8266 tablet_copy_service.cc:342] P a0f96c12124b4e1a816d9fa970464091: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-0bf7f11a5f324770a352a6a29f56ebf4 received from {username='slave'} at 127.0.0.1:60806
I20260709 13:16:24.528568  9226 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:24.529004  8266 tablet_copy_service.cc:434] P a0f96c12124b4e1a816d9fa970464091: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-0bf7f11a5f324770a352a6a29f56ebf4 on tablet 0bf7f11a5f324770a352a6a29f56ebf4 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:24.542184  9327 ts_tablet_manager.cc:1434] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.208s	user 0.003s	sys 0.005s
I20260709 13:16:24.536502  9322 ts_tablet_manager.cc:1403] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.548s	user 0.023s	sys 0.005s
I20260709 13:16:24.551367  8193 tablet_copy_service.cc:342] P 9bd264598fd2483e9e17674bab9ba4e8: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-e1e020840d414fa992e8afcd5cffaad4 received from {username='slave'} at 127.0.0.1:37206
I20260709 13:16:24.556991  8108 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:24.560401  8193 tablet_copy_service.cc:434] P 9bd264598fd2483e9e17674bab9ba4e8: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-e1e020840d414fa992e8afcd5cffaad4 on tablet e1e020840d414fa992e8afcd5cffaad4 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:24.562661  9283 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:16:24.704442  9359 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:16:24.801764  9322 raft_consensus.cc:359] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:24.807646  9322 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:24.808763  9322 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:24.841671  8791 raft_consensus.cc:1217] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:24.854097  9322 ts_tablet_manager.cc:1434] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.292s	user 0.012s	sys 0.000s
I20260709 13:16:24.862551  8791 raft_consensus.cc:1217] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:24.905045  8266 tablet_copy_service.cc:342] P a0f96c12124b4e1a816d9fa970464091: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-8584c73fd4f14469baaaebe16617e775 received from {username='slave'} at 127.0.0.1:60806
I20260709 13:16:24.905965  8266 tablet_copy_service.cc:434] P a0f96c12124b4e1a816d9fa970464091: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-8584c73fd4f14469baaaebe16617e775 on tablet 8584c73fd4f14469baaaebe16617e775 with peer 5033fc7e66374940a203908ea8b0078f
W20260709 13:16:24.917814  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 335045us
I20260709 13:16:24.956933  9346 tablet_copy_client.cc:806] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:24.957858  9346 tablet_copy_client.cc:670] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:24.994191  9346 tablet_copy_client.cc:538] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:25.043262  8791 raft_consensus.cc:1217] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:25.047170  8108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21cda219d2624c108a6700de24d60d86"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:25.047640  9346 tablet_bootstrap.cc:492] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:25.047989  8108 raft_consensus.cc:606] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:25.052673  8176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:25.053244  8176 raft_consensus.cc:606] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:25.071286  8176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:25.071950  8176 raft_consensus.cc:606] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:25.076818  8176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:25.077461  8176 raft_consensus.cc:606] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:25.081061  8176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:25.081956  8176 raft_consensus.cc:606] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:25.083285  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:25.086436  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:25.133646  9346 tablet_bootstrap.cc:492] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:25.135074  9346 tablet_bootstrap.cc:492] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:25.135864  9346 ts_tablet_manager.cc:1403] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.089s	user 0.020s	sys 0.010s
I20260709 13:16:25.139477  9346 raft_consensus.cc:359] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:25.140466  9346 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:25.141233  9346 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:25.149698  9346 ts_tablet_manager.cc:1434] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:16:25.156817  9299 raft_consensus.cc:993] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:25.157289  9299 raft_consensus.cc:1081] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:25.158519  8193 tablet_copy_service.cc:342] P 9bd264598fd2483e9e17674bab9ba4e8: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-3e96746d2ece4e52ab82eca0737daf2e received from {username='slave'} at 127.0.0.1:37206
I20260709 13:16:25.159247  8193 tablet_copy_service.cc:434] P 9bd264598fd2483e9e17674bab9ba4e8: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-3e96746d2ece4e52ab82eca0737daf2e on tablet 3e96746d2ece4e52ab82eca0737daf2e with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:25.170037  9299 raft_consensus.cc:993] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:16:25.170504  9299 raft_consensus.cc:1081] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Signalling peer 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:16:25.199545  8250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57566
I20260709 13:16:25.200147  8250 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:25.200546  8250 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.208087  8102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:16:25.208724  8102 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:25.209084  8102 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.209137  8250 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:25.222780  9358 raft_consensus.cc:993] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:25.223290  9358 raft_consensus.cc:1081] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:25.225143  8251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57566
I20260709 13:16:25.225666  8251 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:25.226013  8251 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.226569  8102 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:25.229270  8102 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:25.230916  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:25.231566  8176 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:25.231839  8176 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:25.232607  8176 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:25.234169  8176 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.236419  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:25.237005  8255 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.252864  8255 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:25.258936  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:25.259945  9352 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:25.260454  9352 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:25.261376  9352 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:25.268164  8791 raft_consensus.cc:1217] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:25.271772  8251 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:25.275293  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:25.276029  8108 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.277573  8176 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:25.282778  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:25.283447  8791 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.287101  9271 raft_consensus.cc:1064] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:25.290400  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:25.291018  8183 raft_consensus.cc:3055] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:25.291325  8183 raft_consensus.cc:740] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:25.292209  8183 consensus_queue.cc:260] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:25.294807  9271 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:25.293254  8183 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.304823  8251 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:25.314260  8002 catalog_manager.cc:5697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 2 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:25.320883  8183 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:25.320968  8108 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:25.322045  8791 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:25.324157  8250 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:25.326531  8223 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:25.328361  9122 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:25.328792  9122 raft_consensus.cc:697] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:25.329115  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:25.329658  9122 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:25.330094  8181 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:25.333042  8181 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:25.343043  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:25.359839  9354 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:25.364708  8787 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:25.365307  8102 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:25.347208  8181 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:25.367057  9358 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:25.367733  8181 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.370083  9366 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:16:25.373805  8255 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:25.375478  9366 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:25.371758  9354 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:25.378094  9354 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:25.416246  9336 raft_consensus.cc:1064] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:25.421573  9336 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:25.424449  8181 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
W20260709 13:16:25.454190  9371 log.cc:927] Time spent T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:16:25.463138  8004 catalog_manager.cc:5697] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:25.468921  9321 raft_consensus.cc:993] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:25.471220  9321 raft_consensus.cc:1081] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Signalling peer 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:25.474171  8791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:48110
I20260709 13:16:25.474781  8791 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:25.475164  8791 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.479708  9358 raft_consensus.cc:2955] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:25.486596  8102 raft_consensus.cc:2955] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:25.491339  8791 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:25.515246  9122 raft_consensus.cc:1064] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:25.511159  8251 raft_consensus.cc:2955] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:25.520316  8787 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:25.523447  9122 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:25.525869  9314 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:25.532123  8791 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:25.533766  8102 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:25.525924  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:25.539563  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:25.540081  8248 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.540225  8181 raft_consensus.cc:3055] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:25.540724  8181 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:25.542408  8181 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:25.547693  9352 raft_consensus.cc:993] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:25.547803  8181 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.548332  9352 raft_consensus.cc:1081] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:25.559875  8181 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:25.540339  9336 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:16:25.565799  8248 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:25.571071  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:25.572244  9275 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:25.572954  9275 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:25.573652  8183 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:25.574370  9275 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:25.575333  8108 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:25.578272  8183 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:25.580571  9313 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:25.585601  8791 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:25.591228  9122 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:16:25.601500  9354 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:16:25.616729  8248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21cda219d2624c108a6700de24d60d86"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57556
I20260709 13:16:25.617800  8248 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:25.618342  8248 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.615302  9314 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:16:25.700326  8248 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:25.715026  8248 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:25.719267  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:25.718569  8790 raft_consensus.cc:2955] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:25.719947  8181 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.718622  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:25.721351  8106 raft_consensus.cc:3055] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:25.721675  8106 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:25.722421  8106 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:25.723294  8106 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.729039  8176 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:25.737355  9314 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:25.775166  8181 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:25.778719  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:25.779914  9354 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:25.780459  9354 raft_consensus.cc:697] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:25.781360  9354 consensus_queue.cc:237] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:25.785591  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 73991.2us
I20260709 13:16:25.939741  8791 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:25.942061  9354 raft_consensus.cc:2955] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:25.952198  8106 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:25.955235  8004 catalog_manager.cc:5697] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 2 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:25.958168  8002 catalog_manager.cc:5697] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:25.955288  9233 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:16:25.983897  8005 catalog_manager.cc:5697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:25.996551  9364 raft_consensus.cc:1064] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:25.999423  9364 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:26.005605  8183 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:26.014155  8248 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:26.022150  8102 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:16:26.030231  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 68957.3us
I20260709 13:16:26.037742  8787 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:26.047662  8790 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:26.049160  8183 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:26.052083  8102 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:26.051493  9299 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:16:26.067535  9321 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:26.061570  9283 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:16:26.061712  8175 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:26.112542  8251 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:16:26.113282  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 54334.6us
W20260709 13:16:26.122560  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 85804.9us
W20260709 13:16:26.127873  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 113485us
I20260709 13:16:26.134802  8102 raft_consensus.cc:2955] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:26.151775  9230 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:16:26.152590  9401 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:26.161127  8106 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:26.155297  9271 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 13:16:26.194423  9400 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:16:26.204133  9352 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:26.227783  9122 raft_consensus.cc:2955] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:26.214510  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:26.251478  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 132112us
I20260709 13:16:26.247466  8002 catalog_manager.cc:5697] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:26.311069  8175 raft_consensus.cc:2955] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:16:26.349792  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 161913us
W20260709 13:16:26.358234  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 228352us
I20260709 13:16:26.365793  8108 raft_consensus.cc:2955] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:26.344048  9366 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:26.410238  8789 raft_consensus.cc:2955] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:16:26.435891  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 100572us
I20260709 13:16:26.444343  8003 catalog_manager.cc:5697] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:26.449174  8003 catalog_manager.cc:5697] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:26.411345  9358 raft_consensus.cc:2955] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:26.470407  8248 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:26.635325  8102 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:26.687007  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 76574.7us
I20260709 13:16:26.619272  9362 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
W20260709 13:16:26.768990  9377 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:16:26.730172  9313 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:16:26.777922  8788 raft_consensus.cc:2955] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:16:26.849170  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 217389us
I20260709 13:16:26.842938  8791 raft_consensus.cc:2955] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:26.855033  9362 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.880879  8103 raft_consensus.cc:2955] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:26.913240  8176 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:26.896034  9272 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:16:26.896799  9362 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:26.909271  8183 raft_consensus.cc:2955] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:16:27.037354  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 174190us
I20260709 13:16:27.044334  9313 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:27.044929  9313 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:27.047763  9313 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:27.044376  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 327494us
I20260709 13:16:27.049088  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e1e020840d414fa992e8afcd5cffaad4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:27.053004  9122 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:27.061439  8178 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:27.057291  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 177234us
I20260709 13:16:27.080821  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:27.089535  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:27.091882  8257 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:27.098887  9366 raft_consensus.cc:2955] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:27.100206  8003 catalog_manager.cc:5697] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:27.103538  9362 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:27.104487  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:27.102960  8250 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:27.135340  8221 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:27.162905  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:27.188789  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 47247.4us
I20260709 13:16:27.137555  9413 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:16:27.183743  9397 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:27.201699  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:27.214686  8178 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:27.252785  8256 raft_consensus.cc:2955] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:27.309706  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:27.312407  9336 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.322564  8106 raft_consensus.cc:2955] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:16:27.347515  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.414019  8241 tablet_service.cc:1558] Processing DeleteTablet for tablet e1e020840d414fa992e8afcd5cffaad4 with delete_type TABLET_DATA_TOMBSTONED (TS a0f96c12124b4e1a816d9fa970464091 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57550
I20260709 13:16:27.443578  8789 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:16:27.452378  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 131423us
W20260709 13:16:27.458668  9439 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:16:27.485239  9441 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:16:27.489845  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 180216us
I20260709 13:16:27.492662  8789 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:27.500594  8108 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:27.513415  9233 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:16:27.478211  9404 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:16:27.526515  9313 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:27.542963  8788 raft_consensus.cc:2955] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:27.577893  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:27.605895  9449 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:16:27.613847  9447 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:27.611961  9404 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:16:27.683138  8002 catalog_manager.cc:5697] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:16:27.688218  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 59240.8us
I20260709 13:16:27.696256  9448 tablet_replica.cc:333] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
W20260709 13:16:27.697659  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 72253.4us
I20260709 13:16:27.718478  9448 raft_consensus.cc:2243] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.719313  9448 raft_consensus.cc:2272] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.725054  9410 raft_consensus.cc:2955] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:27.731321  8181 raft_consensus.cc:2955] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:27.753357  9448 ts_tablet_manager.cc:1916] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:27.755859  8791 raft_consensus.cc:2955] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:27.756594  9233 raft_consensus.cc:2955] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:27.766225  8788 raft_consensus.cc:2955] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:27.797230  8107 raft_consensus.cc:2955] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:27.824853  9299 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:27.825410  9299 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:27.828137  9299 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:27.830010  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:27.830236  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:27.830529  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:27.832221  8149 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:27.833163  9409 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:27.850160  8182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:27.850790  8182 raft_consensus.cc:606] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:27.851858  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0bf7f11a5f324770a352a6a29f56ebf4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:27.859208  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8584c73fd4f14469baaaebe16617e775 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:27.866492  9296 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:27.867122  9296 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:27.871345  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:27.871444  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:27.871852  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:27.873202  8072 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:27.874009  9353 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:27.874018  9296 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:27.927053  9448 ts_tablet_manager.cc:1929] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:27.927666  9448 log.cc:1199] T e1e020840d414fa992e8afcd5cffaad4 P a0f96c12124b4e1a816d9fa970464091: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-2-root/wals/e1e020840d414fa992e8afcd5cffaad4
I20260709 13:16:27.929382  7993 catalog_manager.cc:5028] TS a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): tablet e1e020840d414fa992e8afcd5cffaad4 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:27.936748  8257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:47520
I20260709 13:16:27.937345  8257 raft_consensus.cc:606] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:27.941921  8257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
mode: GRACEFUL
new_leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
 from {username='slave'} at 127.0.0.1:47520
I20260709 13:16:27.941305  8002 catalog_manager.cc:5697] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 3 to 4, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:27.942484  8257 raft_consensus.cc:606] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Received request to transfer leadership to TS 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:27.945463  8107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:27.945966  8107 raft_consensus.cc:606] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:27.948614  8179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b491e7c261394e498f940b0169e957b6"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:27.949146  8179 raft_consensus.cc:606] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:27.950404  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:27.952073  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:27.957511  8179 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:27.963605  8788 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:27.965680  9364 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:27.968951  8257 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:27.971982  9409 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:27.979938  8170 tablet_service.cc:1558] Processing DeleteTablet for tablet 8584c73fd4f14469baaaebe16617e775 with delete_type TABLET_DATA_TOMBSTONED (TS 9bd264598fd2483e9e17674bab9ba4e8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46048
I20260709 13:16:27.980798  9364 raft_consensus.cc:2955] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:27.987623  8789 raft_consensus.cc:2955] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:27.988137  8006 catalog_manager.cc:5697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:27.986837  9456 tablet_replica.cc:333] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:16:27.997072  9456 raft_consensus.cc:2243] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.997890  9456 raft_consensus.cc:2272] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.000305  8252 raft_consensus.cc:2955] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:28.001693  9456 ts_tablet_manager.cc:1916] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:28.003142  8094 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bf7f11a5f324770a352a6a29f56ebf4 with delete_type TABLET_DATA_TOMBSTONED (TS 9480609eccc44250a4d7fcc9686e76cf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44046
I20260709 13:16:28.024066  8004 catalog_manager.cc:5697] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 3 to 4, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New cstate: current_term: 1 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:28.036759  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3e96746d2ece4e52ab82eca0737daf2e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:28.055938  8095 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e96746d2ece4e52ab82eca0737daf2e with delete_type TABLET_DATA_TOMBSTONED (TS 9480609eccc44250a4d7fcc9686e76cf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44046
I20260709 13:16:28.071732  9456 ts_tablet_manager.cc:1929] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:28.085896  9456 log.cc:1199] T 8584c73fd4f14469baaaebe16617e775 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-1-root/wals/8584c73fd4f14469baaaebe16617e775
I20260709 13:16:28.088390  9410 raft_consensus.cc:993] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: : Instructing follower 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:28.088974  9233 raft_consensus.cc:1081] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Signalling peer 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:28.089728  7993 catalog_manager.cc:5028] TS 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): tablet 8584c73fd4f14469baaaebe16617e775 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:28.090771  8789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:48096
I20260709 13:16:28.091383  8789 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:28.091784  8789 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.096302  9457 tablet_replica.cc:333] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:16:28.097512  9457 raft_consensus.cc:2243] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.098304  9457 raft_consensus.cc:2272] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.098872  8789 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:28.101083  8789 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:28.101361  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:28.101999  8107 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.102355  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:28.103044  8256 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:28.103406  8256 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:28.104323  8256 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:28.105916  8256 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.108305  8107 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:28.109360  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:28.110138  9428 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:28.110651  9428 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:28.111644  9428 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:28.113845  8256 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:28.127894  9457 ts_tablet_manager.cc:1916] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:28.127431  8006 catalog_manager.cc:5697] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 2 to 3, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 3 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.147792  9457 ts_tablet_manager.cc:1929] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:28.148242  9457 log.cc:1199] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9480609eccc44250a4d7fcc9686e76cf: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/wals/0bf7f11a5f324770a352a6a29f56ebf4
I20260709 13:16:28.150250  9457 tablet_replica.cc:333] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:16:28.150161  7993 catalog_manager.cc:5028] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): tablet 0bf7f11a5f324770a352a6a29f56ebf4 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:28.156406  9457 raft_consensus.cc:2243] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.157527  9457 raft_consensus.cc:2272] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.164803  9457 ts_tablet_manager.cc:1916] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:28.181955  9457 ts_tablet_manager.cc:1929] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:28.182410  9457 log.cc:1199] T 3e96746d2ece4e52ab82eca0737daf2e P 9480609eccc44250a4d7fcc9686e76cf: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/wals/3e96746d2ece4e52ab82eca0737daf2e
I20260709 13:16:28.184917  7993 catalog_manager.cc:5028] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): tablet 3e96746d2ece4e52ab82eca0737daf2e (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:28.254069  9409 raft_consensus.cc:993] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:16:28.254585  9364 raft_consensus.cc:1081] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Signalling peer 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:16:28.255918  8107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:16:28.256395  8107 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:28.256676  8107 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.262979  8107 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:28.265479  8107 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:28.265674  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:28.266544  8789 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.265612  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:28.272997  8179 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:28.275939  8179 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:28.274521  8789 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:28.276857  8179 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:28.278306  8072 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:28.278398  8179 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.279502  9399 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:28.279978  9399 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:28.280695  9399 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:28.291723  8006 catalog_manager.cc:5697] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 2 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.292623  8179 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:28.307375  9410 raft_consensus.cc:993] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: : Instructing follower 9bd264598fd2483e9e17674bab9ba4e8 to start an election
I20260709 13:16:28.307934  9410 raft_consensus.cc:1081] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Signalling peer 9bd264598fd2483e9e17674bab9ba4e8 to start an election
I20260709 13:16:28.309638  8179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
 from {username='slave'} at 127.0.0.1:46060
I20260709 13:16:28.310122  8179 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:28.310451  8179 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.317075  8179 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:28.319047  8179 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:28.320122  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:28.320722  8107 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.321761  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:28.322425  8251 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:28.322798  8251 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:28.323628  8251 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:28.325102  8251 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.327754  8107 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:28.332065  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:28.332839  9364 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:28.332931  8251 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:28.333473  9364 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:28.334436  9364 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:28.348603  8006 catalog_manager.cc:5697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 3, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.417025  9409 raft_consensus.cc:993] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:16:28.417500  9409 raft_consensus.cc:1081] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Signalling peer 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:16:28.423000  8107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b491e7c261394e498f940b0169e957b6"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:16:28.423648  8107 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:28.424064  8107 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.434293  8107 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:28.436973  8107 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:28.438089  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:28.438683  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:28.438793  8179 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:28.439410  8251 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.439631  8179 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:28.440603  8179 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:28.441843  8179 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.447265  8251 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:28.448433  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:28.449246  9352 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:28.449795  9352 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:28.450752  9352 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:28.454293  8179 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:28.472342  8006 catalog_manager.cc:5697] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 2 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.484639  9296 raft_consensus.cc:993] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:28.485231  9296 raft_consensus.cc:1081] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Signalling peer 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:28.486884  8789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:50464
I20260709 13:16:28.487484  8789 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:28.487823  8789 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.492391  8789 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:28.493865  8789 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:28.494727  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:28.495077  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:28.495318  8107 raft_consensus.cc:3055] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:28.495579  8179 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.495625  8107 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:28.496438  8107 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:28.497654  8107 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.509665  8179 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:28.511487  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:28.512290  9428 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:28.512785  9428 raft_consensus.cc:697] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:28.511070  8107 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:28.513559  9428 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:28.527740  8006 catalog_manager.cc:5697] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 2 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.655252  8251 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:28.656665  9428 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:28.692078  8107 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:28.705355  8179 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:28.705196  9428 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:28.707453  9296 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:28.729308  8105 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:28.730149  8789 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:28.732348  9296 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:28.735486  9299 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:28.820729  8251 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:28.824404  9299 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:28.953118  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:29.013206  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:29.038793  8251 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:29.040722  9296 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:29.060796  8181 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:29.063078  9296 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:29.079936  8181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:29.080694  8181 raft_consensus.cc:606] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:29.085222  8104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:29.085781  8181 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:29.085894  8104 raft_consensus.cc:606] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:29.088069  9466 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:29.091739  8181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:29.092504  8181 raft_consensus.cc:606] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:29.104354  8104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:29.105103  8104 raft_consensus.cc:606] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:29.106701  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:29.108796  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:29.119141  8104 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:29.124600  9466 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:29.190131  9399 raft_consensus.cc:993] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:29.190652  9399 raft_consensus.cc:1081] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:29.193038  8256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57556
I20260709 13:16:29.193660  8256 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:29.194048  8256 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.201603  8256 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:29.204690  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:29.205395  8105 raft_consensus.cc:3055] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:29.205649  9299 raft_consensus.cc:993] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:16:29.206279  9299 raft_consensus.cc:1081] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Signalling peer 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:16:29.205773  8105 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:29.209128  8104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:16:29.208209  8105 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:29.210237  8256 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:29.210875  8105 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.211386  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:29.211989  8788 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.219326  8788 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:29.219533  8105 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:29.210055  8104 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:29.220661  8104 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.220933  8223 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:29.222147  9410 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:29.222702  9410 raft_consensus.cc:697] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:29.223706  9410 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:29.249565  8104 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:29.253192  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:29.253921  8182 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:29.254314  8182 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:29.255368  8182 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:29.256693  8182 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.257957  8104 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:29.260252  8251 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:29.265489  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:29.265573  8182 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:29.266039  8256 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.268298  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:29.269219  9296 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:29.269796  9296 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:29.270758  9296 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:29.276126  8006 catalog_manager.cc:5697] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.306334  8256 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:29.308888  8004 catalog_manager.cc:5697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 2 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.323318  8182 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:29.325094  9481 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:29.326350  8104 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:16:29.328852  8221 consensus_peers.cc:597] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 32f0b0ff1e4f482fbd5d5bb078488de9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:29.328945  9481 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:29.349606  9410 raft_consensus.cc:2955] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:29.352934  8179 raft_consensus.cc:2955] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:29.388388  8105 consensus_queue.cc:237] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:29.393119  8006 catalog_manager.cc:5697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index -1 to 3, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.400067  8251 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:29.400825  8179 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:29.402954  9399 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:29.407440  9399 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:29.412163  8072 consensus_peers.cc:597] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c362335b215641d38dd0c651acfb8fbb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:29.420857  8104 raft_consensus.cc:2955] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:29.428745  9296 raft_consensus.cc:993] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:29.429327  9296 raft_consensus.cc:1081] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:29.431442  8256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57556
I20260709 13:16:29.432010  8256 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:29.432391  8256 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.441781  8256 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:29.445485  8256 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:29.450058  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:29.450613  8181 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.457266  8181 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:29.459692  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:29.460515  8105 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:29.460917  8105 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:29.461922  8105 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:29.466748  9490 raft_consensus.cc:993] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:29.467285  9299 raft_consensus.cc:1081] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:29.468880  8257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57566
I20260709 13:16:29.470988  8257 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:29.471437  8257 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.474539  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:29.475474  9410 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:29.476047  9410 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:29.477046  9410 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:29.463275  8105 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.519608  8006 catalog_manager.cc:5697] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:29.494902  8257 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:29.535528  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:29.536278  8182 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:29.536692  8182 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:29.539244  8182 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:29.559269  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:29.562084  8788 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.558086  8257 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:29.608107  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 44664.6us
I20260709 13:16:29.541054  8182 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.650137  8788 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:29.653396  9352 raft_consensus.cc:2955] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:29.660298  8105 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:29.663211  8179 raft_consensus.cc:2955] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:29.674568  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:29.684196  9233 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:16:29.732002  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 46687.2us
W20260709 13:16:29.740962  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 73624.4us
I20260709 13:16:29.750074  8004 catalog_manager.cc:5697] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:29.776365  8182 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:29.792083  9233 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:29.793355  9233 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:29.817708  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 84149.1us
W20260709 13:16:29.822244  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 89423.7us
W20260709 13:16:29.837796  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 96028.4us
I20260709 13:16:29.846403  8257 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:29.847525  8102 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:29.847681  8791 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:16:29.891919  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 149422us
I20260709 13:16:29.898878  8182 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:29.944265  9513 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:16:29.931371  9511 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:16:29.965945  9481 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:29.977622  8251 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:29.977787  8256 raft_consensus.cc:2955] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:29.981755  8006 catalog_manager.cc:5697] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.015681  9511 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:30.017720  8105 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:30.022579  8179 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:30.033383  9481 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:30.035329  9499 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:30.076206  8221 consensus_peers.cc:597] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e05ca9fb2b7a4b46851675643729339f. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:30.094326  9524 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:16:30.110344  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:30.114331  9525 ts_tablet_manager.cc:933] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:30.145663  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 43637.5us
I20260709 13:16:30.151882  8181 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:30.154209  9523 ts_tablet_manager.cc:933] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123)
I20260709 13:16:30.176442  9233 raft_consensus.cc:2955] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:30.197871  8105 raft_consensus.cc:2955] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:30.204207  8107 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:30.206377  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:30.219889  9532 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:16:30.220120  9525 tablet_copy_client.cc:323] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.131:45561
W20260709 13:16:30.224097  9531 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:16:30.229375  8250 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:30.233525  8266 tablet_copy_service.cc:140] P a0f96c12124b4e1a816d9fa970464091: Received BeginTabletCopySession request for tablet 32f0b0ff1e4f482fbd5d5bb078488de9 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:60806)
I20260709 13:16:30.234113  8266 tablet_copy_service.cc:161] P a0f96c12124b4e1a816d9fa970464091: Beginning new tablet copy session on tablet 32f0b0ff1e4f482fbd5d5bb078488de9 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:60806: session id = 5033fc7e66374940a203908ea8b0078f-32f0b0ff1e4f482fbd5d5bb078488de9
I20260709 13:16:30.218407  9506 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:16:30.244042  9233 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:30.246788  8266 tablet_copy_source_session.cc:215] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:30.255914  9525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f0b0ff1e4f482fbd5d5bb078488de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:30.252628  9523 tablet_copy_client.cc:323] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.129:45123
I20260709 13:16:30.264204  8788 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:30.267341  8116 tablet_copy_service.cc:140] P 9480609eccc44250a4d7fcc9686e76cf: Received BeginTabletCopySession request for tablet c362335b215641d38dd0c651acfb8fbb from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:49218)
I20260709 13:16:30.267983  8116 tablet_copy_service.cc:161] P 9480609eccc44250a4d7fcc9686e76cf: Beginning new tablet copy session on tablet c362335b215641d38dd0c651acfb8fbb from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:49218: session id = 5033fc7e66374940a203908ea8b0078f-c362335b215641d38dd0c651acfb8fbb
I20260709 13:16:30.270478  9506 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:30.284502  8182 raft_consensus.cc:2955] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:30.296202  8002 catalog_manager.cc:5697] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index -1 to 3, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.310709  8179 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:30.312657  9233 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:30.324563  8116 tablet_copy_source_session.cc:215] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:30.329735  8251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
mode: GRACEFUL
new_leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
 from {username='slave'} at 127.0.0.1:47520
I20260709 13:16:30.330682  8251 raft_consensus.cc:606] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Received request to transfer leadership to TS 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:30.335206  9525 tablet_copy_client.cc:806] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
W20260709 13:16:30.348951  9539 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:30.335363  9523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c362335b215641d38dd0c651acfb8fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:30.353412  8251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:47520
I20260709 13:16:30.354141  8251 raft_consensus.cc:606] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:30.364061  8102 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:30.369899  9530 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:30.373100  8182 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:30.378767  8102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:30.379426  8102 raft_consensus.cc:606] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:30.380788  9410 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:30.379989  9525 tablet_copy_client.cc:670] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
W20260709 13:16:30.388933  8221 consensus_peers.cc:597] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9abaa411847e4bf9907f7af5e2689c7b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:30.395170  8251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
mode: GRACEFUL
new_leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
 from {username='slave'} at 127.0.0.1:47520
I20260709 13:16:30.395782  8251 raft_consensus.cc:606] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Received request to transfer leadership to TS 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:30.401054  9525 tablet_copy_client.cc:538] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:30.406630  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:30.408305  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:30.421627  9506 raft_consensus.cc:993] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: : Instructing follower 9bd264598fd2483e9e17674bab9ba4e8 to start an election
I20260709 13:16:30.422196  9530 raft_consensus.cc:1081] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Signalling peer 9bd264598fd2483e9e17674bab9ba4e8 to start an election
I20260709 13:16:30.430672  8181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
 from {username='slave'} at 127.0.0.1:46060
I20260709 13:16:30.431327  8181 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:30.431686  8181 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.438171  9525 tablet_bootstrap.cc:492] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:30.439466  8181 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:30.444162  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:30.444832  8251 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:30.445201  8251 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:30.446628  8251 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:30.448071  8107 raft_consensus.cc:2955] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:30.448911  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:30.448992  8251 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.447846  9503 raft_consensus.cc:2955] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:30.449683  8791 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.450555  8181 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:30.458765  8791 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:30.460021  8147 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:30.462307  9508 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:30.462926  9508 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:30.463779  9508 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:30.465834  8251 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:30.467943  9523 tablet_copy_client.cc:806] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:30.468504  9523 tablet_copy_client.cc:670] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:30.499743  8179 raft_consensus.cc:2955] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:30.497258  8005 catalog_manager.cc:5697] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index -1 to 2, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:16:30.507467  9525 tablet_bootstrap.cc:492] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:30.508513  9525 tablet_bootstrap.cc:492] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:30.509184  9525 ts_tablet_manager.cc:1403] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.010s
I20260709 13:16:30.512434  9525 raft_consensus.cc:359] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:30.513236  9525 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:30.513871  9525 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:30.517524  9525 ts_tablet_manager.cc:1434] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:30.530829  9523 tablet_copy_client.cc:538] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:30.534790  8266 tablet_copy_service.cc:342] P a0f96c12124b4e1a816d9fa970464091: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-32f0b0ff1e4f482fbd5d5bb078488de9 received from {username='slave'} at 127.0.0.1:60806
I20260709 13:16:30.535286  8266 tablet_copy_service.cc:434] P a0f96c12124b4e1a816d9fa970464091: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-32f0b0ff1e4f482fbd5d5bb078488de9 on tablet 32f0b0ff1e4f482fbd5d5bb078488de9 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:30.544848  8788 raft_consensus.cc:1217] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:16:30.557845  9546 ts_tablet_manager.cc:933] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:30.558820  9499 raft_consensus.cc:993] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: : Instructing follower 9bd264598fd2483e9e17674bab9ba4e8 to start an election
I20260709 13:16:30.559329  9499 raft_consensus.cc:1081] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Signalling peer 9bd264598fd2483e9e17674bab9ba4e8 to start an election
I20260709 13:16:30.569399  9546 tablet_copy_client.cc:323] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.131:45561
I20260709 13:16:30.571410  8181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
 from {username='slave'} at 127.0.0.1:46060
I20260709 13:16:30.572045  8181 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:30.572427  8181 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.579380  8181 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:30.588989  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:30.589635  8251 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:30.589963  8251 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:30.590253  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:30.590852  8791 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.590736  8251 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:30.591971  8251 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.598045  8266 tablet_copy_service.cc:140] P a0f96c12124b4e1a816d9fa970464091: Received BeginTabletCopySession request for tablet e05ca9fb2b7a4b46851675643729339f from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:60806)
I20260709 13:16:30.598274  8791 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:30.598610  8266 tablet_copy_service.cc:161] P a0f96c12124b4e1a816d9fa970464091: Beginning new tablet copy session on tablet e05ca9fb2b7a4b46851675643729339f from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:60806: session id = 5033fc7e66374940a203908ea8b0078f-e05ca9fb2b7a4b46851675643729339f
I20260709 13:16:30.599552  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:30.601167  9502 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:30.602397  9502 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:30.603255  9502 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:30.605844  8251 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:30.606180  8181 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:30.611918  8266 tablet_copy_source_session.cc:215] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:30.612857  9503 raft_consensus.cc:993] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: : Instructing follower 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:16:30.613363  9503 raft_consensus.cc:1081] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Signalling peer 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:16:30.616250  8102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:44062
I20260709 13:16:30.616755  8102 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:30.617089  8102 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:30.624159  9523 tablet_bootstrap.cc:492] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:30.625317  8102 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:30.632953  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:30.633556  8179 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:30.633778  8102 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:30.638439  9546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05ca9fb2b7a4b46851675643729339f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:30.646482  9518 raft_consensus.cc:993] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower 9bd264598fd2483e9e17674bab9ba4e8 to start an election
I20260709 13:16:30.646993  9518 raft_consensus.cc:1081] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Signalling peer 9bd264598fd2483e9e17674bab9ba4e8 to start an election
I20260709 13:16:30.647769  8179 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:30.647332  8002 catalog_manager.cc:5697] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 2, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.649706  8181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
 from {username='slave'} at 127.0.0.1:46064
I20260709 13:16:30.650283  8181 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:30.650624  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:30.651101  8074 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:30.651293  8257 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:30.650646  8181 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.651680  8257 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:30.652680  8257 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:30.654237  8257 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:30.658437  8181 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:30.660957  9504 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:30.661124  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:30.661576  9504 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:30.661746  8102 raft_consensus.cc:3055] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:30.662252  8102 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:30.662672  9504 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:30.662952  8102 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:30.664140  8102 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.668454  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:30.669034  8791 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.672757  8102 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:30.681941  8149 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:30.682753  9502 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:30.683245  9502 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:30.675781  8181 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:30.684087  9502 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:30.684161  9546 tablet_copy_client.cc:806] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:30.688232  9546 tablet_copy_client.cc:670] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:30.688508  8791 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:30.702723  8257 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:30.706247  8006 catalog_manager.cc:5697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 2 to 3, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 3 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.708539  9546 tablet_copy_client.cc:538] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:30.727613  9546 tablet_bootstrap.cc:492] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:30.737883  9523 tablet_bootstrap.cc:492] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:30.738912  9523 tablet_bootstrap.cc:492] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:30.739699  9523 ts_tablet_manager.cc:1403] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.116s	user 0.039s	sys 0.007s
I20260709 13:16:30.738945  8006 catalog_manager.cc:5697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 2, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.742693  9523 raft_consensus.cc:359] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:30.744513  9523 raft_consensus.cc:740] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:30.740715  8006 catalog_manager.cc:5697] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.745419  9523 consensus_queue.cc:260] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:30.753186  9523 ts_tablet_manager.cc:1434] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:16:30.754786  8116 tablet_copy_service.cc:342] P 9480609eccc44250a4d7fcc9686e76cf: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-c362335b215641d38dd0c651acfb8fbb received from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:30.755210  8116 tablet_copy_service.cc:434] P 9480609eccc44250a4d7fcc9686e76cf: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-c362335b215641d38dd0c651acfb8fbb on tablet c362335b215641d38dd0c651acfb8fbb with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:30.777639  9546 tablet_bootstrap.cc:492] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:30.778640  9546 tablet_bootstrap.cc:492] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:30.779357  9546 ts_tablet_manager.cc:1403] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.015s
I20260709 13:16:30.782549  9546 raft_consensus.cc:359] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:30.784468  9546 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:30.785177  9546 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:30.796198  9546 ts_tablet_manager.cc:1434] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:16:30.797863  8266 tablet_copy_service.cc:342] P a0f96c12124b4e1a816d9fa970464091: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-e05ca9fb2b7a4b46851675643729339f received from {username='slave'} at 127.0.0.1:60806
I20260709 13:16:30.798306  8266 tablet_copy_service.cc:434] P a0f96c12124b4e1a816d9fa970464091: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-e05ca9fb2b7a4b46851675643729339f on tablet e05ca9fb2b7a4b46851675643729339f with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:30.860632  8791 raft_consensus.cc:1217] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:30.920326  9546 ts_tablet_manager.cc:933] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:30.943305  9546 tablet_copy_client.cc:323] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.131:45561
I20260709 13:16:30.945137  8266 tablet_copy_service.cc:140] P a0f96c12124b4e1a816d9fa970464091: Received BeginTabletCopySession request for tablet 9abaa411847e4bf9907f7af5e2689c7b from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:60806)
I20260709 13:16:30.945696  8266 tablet_copy_service.cc:161] P a0f96c12124b4e1a816d9fa970464091: Beginning new tablet copy session on tablet 9abaa411847e4bf9907f7af5e2689c7b from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:60806: session id = 5033fc7e66374940a203908ea8b0078f-9abaa411847e4bf9907f7af5e2689c7b
I20260709 13:16:30.953172  8266 tablet_copy_source_session.cc:215] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:30.956363  9546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abaa411847e4bf9907f7af5e2689c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:30.977619  9546 tablet_copy_client.cc:806] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:30.978276  9546 tablet_copy_client.cc:670] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:30.978623  8791 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:30.980163  9509 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:30.981961  9546 tablet_copy_client.cc:538] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:30.992074  9546 tablet_bootstrap.cc:492] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:16:31.027311  9546 tablet_bootstrap.cc:492] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:31.028257  9546 tablet_bootstrap.cc:492] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:16:31.029100  9546 ts_tablet_manager.cc:1403] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.037s	user 0.029s	sys 0.001s
I20260709 13:16:31.034049  9546 raft_consensus.cc:359] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:31.035024  9546 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:16:31.035781  9546 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:16:31.038815  9546 ts_tablet_manager.cc:1434] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:31.043828  8266 tablet_copy_service.cc:342] P a0f96c12124b4e1a816d9fa970464091: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-9abaa411847e4bf9907f7af5e2689c7b received from {username='slave'} at 127.0.0.1:60806
I20260709 13:16:31.044353  8266 tablet_copy_service.cc:434] P a0f96c12124b4e1a816d9fa970464091: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-9abaa411847e4bf9907f7af5e2689c7b on tablet 9abaa411847e4bf9907f7af5e2689c7b with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:31.074807  8790 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 2 LEARNER]: Advancing to term 3
I20260709 13:16:31.081641  8790 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 3 LEARNER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:31.082198  8257 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:31.083690  9518 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:31.087042  9509 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:31.113229  8789 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:31.115167  9502 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:31.118153  9504 raft_consensus.cc:1064] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
W20260709 13:16:31.118604  9504 raft_consensus.cc:1068] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Unable to promote non-voter 5033fc7e66374940a203908ea8b0078f: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:31.136746  8256 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:31.138553  8788 raft_consensus.cc:1217] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:16:31.141162  9510 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:31.227813  8257 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:31.231145  9518 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:31.264377  8179 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:31.266749  9504 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:31.274857  9518 raft_consensus.cc:1064] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:31.277482  9518 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:31.303529  8791 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:31.305385  9510 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:31.311247  8790 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 3 LEARNER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:31.313215  8102 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:31.315390  9504 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:31.317103  9508 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:31.336068  8257 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:31.337546  9504 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:31.354022  8251 raft_consensus.cc:2955] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:31.356667  9519 raft_consensus.cc:2955] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:31.393770  8006 catalog_manager.cc:5697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index 3 to 5, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:31.409188  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:31.428927  8178 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:16:31.447734  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 47110.5us
I20260709 13:16:31.446439  8790 raft_consensus.cc:2955] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:31.450533  9569 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:31.502080  8181 raft_consensus.cc:2955] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:31.508960  9504 raft_consensus.cc:1064] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:31.511850  9504 consensus_queue.cc:237] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:31.652133  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 51809.5us
I20260709 13:16:31.805648  8107 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:31.844714  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:31.895944  8791 raft_consensus.cc:1217] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:31.903801  9410 raft_consensus.cc:1064] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:31.907275  9410 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:32.083766  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 139206us
I20260709 13:16:32.093773  8789 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:32.099459  8789 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:32.106140  8177 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:32.111609  8177 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:16:32.114053  8105 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:16:32.114801  9503 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:32.118219  9584 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:32.119132  9519 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:32.122741  9519 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:32.124719  8789 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 2 LEARNER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:16:32.127797  9503 raft_consensus.cc:1064] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:16:32.130262  9503 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:32.131405  9410 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:32.158584  9580 raft_consensus.cc:2955] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.161378  8256 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:32.166095  8791 raft_consensus.cc:2955] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.192862  8177 raft_consensus.cc:2955] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.200969  9519 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:32.206427  9607 raft_consensus.cc:2955] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.207448  8006 catalog_manager.cc:5697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 3 to 4, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.215049  8106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:32.221928  9600 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:32.220947  8791 raft_consensus.cc:2955] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.235054  8181 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:32.235586  8790 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 1 LEARNER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:32.237005  9410 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:32.238528  8107 raft_consensus.cc:2955] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.251099  8251 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:32.257365  8106 raft_consensus.cc:606] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:32.272502  9587 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:32.274231  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 32f0b0ff1e4f482fbd5d5bb078488de9 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:32.289907  8181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:32.290617  8181 raft_consensus.cc:606] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:32.294898  8106 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:32.269964  9605 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:16:32.299368  8005 catalog_manager.cc:5697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 5 to 6, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New cstate: current_term: 3 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.309336  8256 raft_consensus.cc:2955] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.310611  8179 raft_consensus.cc:2955] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.318559  8182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:32.319428  8182 raft_consensus.cc:606] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:32.306502  9577 raft_consensus.cc:2955] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.321596  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:32.323146  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:32.341655  8251 raft_consensus.cc:2955] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.376353  8177 raft_consensus.cc:2955] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.382943  9603 raft_consensus.cc:993] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:32.383520  9603 raft_consensus.cc:1081] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
W20260709 13:16:32.383657  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 72643us
I20260709 13:16:32.394543  8790 raft_consensus.cc:2955] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.395347  8256 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:32.403846  8256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57556
I20260709 13:16:32.404428  8256 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:32.404860  8256 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.412456  8791 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:32.416023  9580 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:32.417584  8177 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:32.423074  9584 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:32.424651  8256 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:32.426452  9410 raft_consensus.cc:2955] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.427826  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:32.487015  8791 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.511860  9508 raft_consensus.cc:993] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower 9480609eccc44250a4d7fcc9686e76cf to start an election
W20260709 13:16:32.512917  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 58112.1us
I20260709 13:16:32.513787  9583 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:32.514024  9576 raft_consensus.cc:1081] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Signalling peer 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:16:32.516927  8107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:16:32.517841  8107 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:32.518224  8107 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.522626  8177 raft_consensus.cc:2955] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.528247  8170 tablet_service.cc:1558] Processing DeleteTablet for tablet 32f0b0ff1e4f482fbd5d5bb078488de9 with delete_type TABLET_DATA_TOMBSTONED (TS 9bd264598fd2483e9e17674bab9ba4e8 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:46048
I20260709 13:16:32.429960  8256 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:32.433957  8006 catalog_manager.cc:5697] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.533893  8006 catalog_manager.cc:5697] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.442625  9499 raft_consensus.cc:2955] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.462695  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:32.478418  8790 raft_consensus.cc:2955] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.479892  8105 raft_consensus.cc:2955] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:32.547924  9621 tablet_replica.cc:333] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:16:32.549535  9621 raft_consensus.cc:2243] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:32.549927  8106 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:32.550644  8106 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:32.551447  8106 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:32.552980  8106 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.553992  9621 raft_consensus.cc:2272] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:32.563346  9621 ts_tablet_manager.cc:1916] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:16:32.590577  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 60421.7us
I20260709 13:16:32.532773  8791 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:32.595487  8789 raft_consensus.cc:2955] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:16:33.172374  8107 consensus_meta.cc:287] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.654s	user 0.007s	sys 0.004s
I20260709 13:16:33.172849  8107 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:33.177995  8107 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:33.475684  8106 consensus_meta.cc:287] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.921s	user 0.005s	sys 0.007s
I20260709 13:16:33.476213  8106 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:33.476974  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 731) took 1021 ms. Trace:
I20260709 13:16:33.477550  8106 rpcz_store.cc:276] 0709 13:16:32.455437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.462426 (+  6989us) service_pool.cc:224] Handling call
0709 13:16:33.476863 (+1014437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.757910  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:44078 (request call id 1634) took 1241 ms. Trace:
I20260709 13:16:33.758739  9625 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:33.759824  9625 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:33.760586  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.759136  8107 rpcz_store.cc:276] 0709 13:16:32.516658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.516805 (+   147us) service_pool.cc:224] Handling call
0709 13:16:33.757817 (+1241012us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.766918  9627 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:33.774335  9624 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:33.774463  9626 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:33.775141  9622 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:33.775146  9626 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:33.775804  9622 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:33.777514  9626 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:33.777760  9622 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:33.778221  9624 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:33.779740  9622 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:33.780354  9624 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:33.780256  9622 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:33.767526  9627 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:33.782232  9626 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:33.782641  9622 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:33.782864  9627 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:33.782739  9626 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:33.783201  9622 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:33.783680  9622 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:33.784771  9626 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:33.785610  9622 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:33.786404  9624 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:33.787079  9622 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:33.786875  9626 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:33.787755  9622 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:33.787858  9626 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:33.787429  9624 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:33.791213  9625 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:33.790397  9626 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:33.791741  9582 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:33.794565  9582 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:33.792138  9624 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:33.796051  9628 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:33.790004  9622 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:33.794574  9625 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:33.799659  9625 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:33.802445  9625 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:33.797578  9582 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:33.800400  9628 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:33.806116  9629 raft_consensus.cc:993] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:33.806661  9629 raft_consensus.cc:1081] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:33.807245  9628 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:33.792939  9623 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:33.810913  9601 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:33.811025  9630 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:33.812314  9629 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:33.811467  9601 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:33.809051  9623 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:33.815359  9601 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:33.816417  9623 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:33.812832  9629 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:33.818439  9629 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:33.811621  9630 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:33.820546  9630 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:33.821898  9630 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:33.822412  9630 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:33.824465  9630 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:33.830689  9519 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:33.831398  9519 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:33.834419  9626 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:33.834997  9626 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:33.837128  9626 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:33.843897  8790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 277) took 1224 ms. Trace:
I20260709 13:16:33.844328  8790 rpcz_store.cc:276] 0709 13:16:32.619338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.843113 (+1223775us) service_pool.cc:224] Handling call
0709 13:16:33.843427 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.843597 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.843624 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.843664 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:33.843693 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.843744 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.843845 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.845937  9519 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:33.849963  9622 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:33.850483  9622 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:33.852579  9623 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:33.852644  9622 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:33.853209  9623 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:33.855417  9623 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:33.865231  9621 ts_tablet_manager.cc:1929] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:16:33.869108  9621 log.cc:1199] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9bd264598fd2483e9e17674bab9ba4e8: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-1-root/wals/32f0b0ff1e4f482fbd5d5bb078488de9
I20260709 13:16:33.873545  9582 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:33.874155  9582 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:33.876322  9582 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:33.876830  9582 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:33.878440  9629 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:33.877336  9582 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:33.879144  9630 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:33.879030  9629 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:33.879709  9630 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:33.881739  9630 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:33.870445  9621 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46048 (request call id 79) took 1342 ms. Trace:
I20260709 13:16:33.881886  9582 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:33.884593  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:33.884721  9626 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:33.891446  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:16:33.898425  7007 debug-util.cc:398] Leaking SignalData structure 0x7b080000f820 after lost signal to thread 8221
W20260709 13:16:33.898968  7007 kernel_stack_watchdog.cc:198] Thread 8221 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 280ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:16:33.890287  8790 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:33.883189  9621 rpcz_store.cc:276] 0709 13:16:32.527959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.528075 (+   116us) service_pool.cc:224] Handling call
0709 13:16:32.547555 (+ 19480us) ts_tablet_manager.cc:1151] Deleting tablet 32f0b0ff1e4f482fbd5d5bb078488de9
0709 13:16:32.547622 (+    67us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:16:32.600635 (+ 53013us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:33.865082 (+1264447us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:33.870353 (+  5271us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":18779,"thread_start_us":19836,"threads_started":1}
I20260709 13:16:33.915195  9569 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:33.916530  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:33.915897  9569 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:33.916808  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:34.267554  8105 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 1.
I20260709 13:16:34.267661  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:34.268009  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:33.968191  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:34.048036  9625 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:33.966336  9624 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:34.027357  9623 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:34.269448  9643 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:33.916728  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:34.135202  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3f00 after lost signal to thread 7005
I20260709 13:16:34.268633  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:33.904644  9629 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:33.910790  9627 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:34.268648  8789 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:34.273623  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:33.976965  9582 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:34.084753  9575 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:33.939157  9519 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:34.277546  8102 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 1.
W20260709 13:16:34.278187  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08002cac00 after lost signal to thread 8040
I20260709 13:16:34.249619  9633 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:34.282009  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:34.002413  9628 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.285125  8108 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:34.004288  9630 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.199949  9601 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:34.002174  9509 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:33.994436  9632 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:16:34.288650  8129 debug-util.cc:398] Leaking SignalData structure 0x7b0800318e60 after lost signal to thread 8132
W20260709 13:16:34.299513  8129 debug-util.cc:398] Leaking SignalData structure 0x7b0800318f40 after lost signal to thread 8133
W20260709 13:16:34.300576  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08002c36e0 after lost signal to thread 8207
W20260709 13:16:34.300887  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08002c37e0 after lost signal to thread 8208
W20260709 13:16:34.301188  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3780 after lost signal to thread 8220
I20260709 13:16:34.287627  9627 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.298945  9601 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.302330  9585 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:34.270287  9635 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.199929  9631 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:33.966125  9622 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:33.910030  9626 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.303887  8104 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 1.
I20260709 13:16:33.342100  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:34.307708  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3740 after lost signal to thread 8221
I20260709 13:16:34.287447  9582 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.277812  9625 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.312444  8006 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39814 (request call id 272) took 1876 ms. Trace:
W20260709 13:16:34.308835  8129 debug-util.cc:398] Leaking SignalData structure 0x7b0800318140 after lost signal to thread 8281
I20260709 13:16:34.291265  9629 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:34.284461  9624 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:34.313766  8129 debug-util.cc:398] Leaking SignalData structure 0x7b080031e5e0 after lost signal to thread 8282
I20260709 13:16:34.296222  9634 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:34.326076  9631 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.333782  9631 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.283694  9623 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.296530  9628 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.120311  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:34.334867  9627 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.336053  8791 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:34.328522  9642 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:16:34.328935  8129 debug-util.cc:398] Leaking SignalData structure 0x7b080033c2a0 after lost signal to thread 8823
W20260709 13:16:34.339380  8129 debug-util.cc:398] Leaking SignalData structure 0x7b0800320c00 after lost signal to thread 9499
I20260709 13:16:34.343294  8004 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39828 (request call id 269) took 1924 ms. Trace:
W20260709 13:16:34.349009  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 1.74792e+06us
I20260709 13:16:34.291445  9519 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.296226  9630 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.360584  9641 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.360606  9645 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.345577  8004 rpcz_store.cc:276] 0709 13:16:32.419205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.419336 (+   131us) service_pool.cc:224] Handling call
0709 13:16:34.343205 (+1923869us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":172220,"reported_tablets":3}
I20260709 13:16:34.361542  8002 catalog_manager.cc:5697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 4 to 5, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:34.300233  9509 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.387571  9509 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.299279  9633 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.393703  8104 consensus_queue.cc:237] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.395743  9633 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.312876  8006 rpcz_store.cc:276] 0709 13:16:32.430108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.430244 (+   136us) service_pool.cc:224] Handling call
0709 13:16:34.306525 (+1876281us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:32.537406 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:32.538161 (+   755us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:32.538224 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:16:32.538252 (+    28us) tablet.cc:662] Decoding operations
0709 13:16:32.538835 (+   583us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:32.538916 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:32.538957 (+    41us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:16:32.539297 (+   340us) tablet.cc:701] Row locks acquired
0709 13:16:32.539316 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:16:32.539504 (+   188us) write_op.cc:270] Start()
0709 13:16:32.539636 (+   132us) write_op.cc:276] Timestamp: P: 1783602992539448 usec, L: 0
0709 13:16:32.539661 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:16:32.540461 (+   800us) log.cc:844] Serialized 1045 byte log entry
0709 13:16:32.542746 (+  2285us) op_driver.cc:464] REPLICATION: finished
0709 13:16:32.543723 (+   977us) write_op.cc:301] APPLY: starting
0709 13:16:32.543791 (+    68us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:32.543898 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:32.543987 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:32.544291 (+   304us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:32.544452 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:16:32.544498 (+    46us) write_op.cc:312] APPLY: finished
0709 13:16:32.544661 (+   163us) log.cc:844] Serialized 29 byte log entry
0709 13:16:32.544798 (+   137us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:32.544872 (+    74us) write_op.cc:454] Released schema lock
0709 13:16:32.544906 (+    34us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:32.545915 (+  1009us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:32.545944 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":773,"apply.run_cpu_time_us":1433,"apply.run_wall_time_us":1433,"num_ops":2,"prepare.queue_time_us":416,"prepare.run_cpu_time_us":3369,"prepare.run_wall_time_us":8534,"replication_time_us":2964}]]}
I20260709 13:16:34.317694  9622 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.302928  9585 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.388921  9631 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.290534  9575 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.362812  9634 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.411389  9637 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.412164  9652 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.366763  9645 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.290818  9643 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.408299  9623 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:34.428973  9410 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:34.303606  9632 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.391491  9641 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.329195  9629 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.444221  9410 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.425959  9601 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.425917  9510 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:34.451293  9650 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.432052  9628 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.477820  9575 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.444060  9569 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.450021  9623 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.445530  9509 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.485708  9410 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:34.335675  9635 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.430936  9631 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.452914  9636 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.498032  9646 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:34.455041  9640 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:34.457321  9633 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.454253  9652 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.524087  9651 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.458312  9510 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:34.500449  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 1.88283e+06us
I20260709 13:16:34.487267  9601 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:34.508895  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:34.451853  9650 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.479485  9628 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:34.486199  9569 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.506250  9582 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.383592  9642 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.516153  9626 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.500196  9509 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.489261  9623 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.448539  9637 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.536713  9625 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.535137  9630 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.558287  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.537696  9519 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.527315  9633 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.527179  9636 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.564893  9410 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:34.567308  9410 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.537775  9601 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.550926  9569 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.534896  9646 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.536967  9640 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.565986  9583 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:34.546279  9628 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.554956  9648 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.565821  9622 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.586508  9641 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.587898  9643 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.561311  9647 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.567312  9503 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:34.524669  9651 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.594789  9645 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.595057  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.595434  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.600343  9661 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:34.567659  9638 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:34.577751  9580 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:34.615366  9499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:57550 (request call id 74) took 2222 ms. Trace:
I20260709 13:16:34.617810  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:34.596544  9585 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.621807  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.612479  9666 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:34.664707  9666 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.601289  9503 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.669780  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:16:34.671846  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 308023us
I20260709 13:16:34.618999  9644 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:34.681233  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:34.682127  8182 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:34.682533  8182 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:34.682610  9506 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:34.683578  8182 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.684675  8182 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.673763  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:34.616155  9499 rpcz_store.cc:276] 0709 13:16:32.392510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.392634 (+   124us) service_pool.cc:224] Handling call
0709 13:16:32.398100 (+  5466us) log.cc:844] Serialized 501 byte log entry
0709 13:16:34.615279 (+2217179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4617,"raft.run_cpu_time_us":992,"raft.run_wall_time_us":991}
I20260709 13:16:34.623741  9661 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.623690  9629 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.678248  7993 catalog_manager.cc:5028] TS 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): tablet 32f0b0ff1e4f482fbd5d5bb078488de9 (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:34.614888  9580 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.681387  9509 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.615036  9647 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.596349  9583 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.664408  9631 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.738903  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:34.751374  7993 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 73159.9us
I20260709 13:16:34.613493  9648 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.687278  9633 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.621928  9638 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.754632  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.755648  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.755821  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.757179  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.757898  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.758654  8180 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:34.758786  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.759526  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.759910  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.760375  9624 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.680356  9634 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.760639  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.687480  9644 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.761672  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.696617  9645 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:34.762646  9645 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:34.763059  9645 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.763120  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.757954  8174 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:34.767977  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.757262  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.769894  9585 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.770494  9585 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.771270  9645 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:34.772723  9585 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.773795  9645 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.774682  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:34.776309  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 87232.5us
I20260709 13:16:34.778787  9410 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.780207  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:34.783106  9644 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.783829  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.785406  9666 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.786312  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.787009  8176 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:34.789242  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.789944  8176 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:34.790738  9661 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:34.789878  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.791929  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.793700  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:34.793977  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.794529  8105 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 1.
I20260709 13:16:34.794590  8176 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:34.683319  9506 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.678593  9630 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:34.798604  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.797446  8181 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:34.775364  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:34.800614  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.687582  9632 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.747743  9650 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.747370  9637 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.759442  9510 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.809718  9635 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.886837  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:35.069474  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:34.801528  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:34.900161  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.934543  9410 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:16:34.900359  7007 debug-util.cc:398] Leaking SignalData structure 0x7b080000f660 after lost signal to thread 8221
I20260709 13:16:35.073220  9410 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:34.935074  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:34.823539  8182 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
W20260709 13:16:35.068396  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.935024  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:34.974730  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.831120  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:35.007905  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:34.911732  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 146785us
I20260709 13:16:35.072302  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.009812  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.076673  8104 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
W20260709 13:16:34.917338  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 137223us
I20260709 13:16:35.071805  8105 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:35.076851  8108 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:16:35.075760  8176 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 1.
I20260709 13:16:35.027050  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:34.797305  9654 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:16:35.090586  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:35.092059  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:35.096028  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:35.095902  8791 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:16:35.076143  8788 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:34.741554  9606 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:34.689219  9649 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:35.109015  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.692382  9667 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:35.092351  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:35.101964  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:35.013669  9638 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:35.117970  8181 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:34.674990  9657 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:35.102900  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:35.105203  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:34.888947  9644 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:35.113303  9410 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:35.115835  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:35.120739  8789 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:34.805318  9628 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:34.804566  9503 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:34.800290  9623 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:35.122198  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:34.932071  9584 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:34.806057  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:34.934749  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:34.802199  9656 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:34.935019  9499 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.809142  9569 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.929739  9601 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:34.807839  9506 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:35.162592  9662 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:35.163561  9649 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.207278  9662 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:35.207682  9662 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.931442  9640 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:35.070297  9652 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:35.165589  9670 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:35.165923  9636 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:35.164805  9669 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:34.930524  9651 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:34.953768  9668 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:34.931882  9605 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:35.169056  9644 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.171319  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:35.182142  9410 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:34.886317  9646 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:35.098420  9630 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.166052  9580 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:35.176385  9667 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.184360  9503 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:35.323730  9661 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:35.324313  9503 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.324612  9661 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.320223  9580 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:16:35.257864  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 89133.3us
I20260709 13:16:35.328091  9580 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.217343  9605 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.260622  8107 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:35.323079  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.336750  8223 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:35.317672  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.338452  9580 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:35.339321  8249 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:35.121802  8101 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 1.
I20260709 13:16:35.262630  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.351557  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.265376  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.354503  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.354864  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:35.356400  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.271991  8180 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:35.273448  8179 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:35.362161  8257 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:35.363607  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.280104  8100 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:35.281517  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.291688  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.365372  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.295567  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.365545  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.295946  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.297712  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.297797  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:35.300266  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:35.302102  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 134256us
I20260709 13:16:35.300498  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.206184  8785 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:35.369807  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:34.888579  9519 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:35.214623  9506 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:35.375706  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.378118  9506 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.222664  9583 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:35.368500  9683 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:35.341234  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.135429  9606 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.215986  9410 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.391460  9606 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:35.392400  9628 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:35.392907  9410 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:35.228428  9630 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:35.184597  9642 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:35.386634  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.394001  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.395364  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.395824  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:35.396257  8101 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:16:35.175427  9648 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:35.222920  9649 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:35.389075  9506 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:35.206302  9656 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.176978  9657 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.180930  9665 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:35.214824  9666 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:35.226150  9667 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:35.224080  9668 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.212177  9670 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:35.216964  9671 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:35.210801  9672 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:35.411620  9671 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.213173  9675 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:35.223237  9669 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.410063  9670 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.418094  8105 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:35.210224  9499 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.319875  9679 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:35.280432  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.322805  9676 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:35.191298  9584 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.327142  9503 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:35.256237  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 127229us
I20260709 13:16:35.106983  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:35.448906  9656 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:35.451071  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 344045us
I20260709 13:16:35.436199  9503 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:35.452543  9503 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.368074  8100 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:35.368089  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.332919  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:35.455054  9671 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:35.455269  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 122741us
I20260709 13:16:35.455724  9503 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:35.456415  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:35.457070  9656 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:35.372336  8256 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.457777  9682 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:35.374074  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.375694  9605 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:35.365262  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.380723  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.386554  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.327159  9661 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:35.388645  9519 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.464282  8107 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:35.464583  9519 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:35.393211  9628 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.228749  9644 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:35.395478  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.226480  9647 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:35.411101  9585 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:35.468484  9585 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:35.469069  9585 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.469626  9628 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:35.397408  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.474443  8101 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:16:35.409646  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:16:35.475689  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 78295.9us
I20260709 13:16:35.476626  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:35.477662  9623 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:35.478046  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:35.478166  8256 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:35.415454  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.417754  9666 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.305163  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.421173  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.421173  8257 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:35.480551  9666 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:35.427028  8253 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:35.397781  9683 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.482244  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.482908  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:35.433401  8149 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.131:45561 timed out after 1.553s (SENT) [suppressed 3 similar messages]
I20260709 13:16:35.434783  9676 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.415402  9672 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.443910  9657 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:35.483538  8253 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:35.484841  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.485184  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.445580  8147 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:35.485504  9683 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:35.486524  8147 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:35.445842  9584 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:35.433378  9675 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.487318  8252 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:35.446179  9499 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:35.447903  9669 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:35.448261  9668 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:35.437918  9580 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:35.456595  9643 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.457512  9656 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:35.371460  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.460971  9652 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:35.497622  9652 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:35.461283  8102 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:35.467335  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:35.480458  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.417527  9665 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.430315  9679 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.483419  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.479588  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.493896  9642 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:35.495355  8248 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:35.478048  9623 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:35.459627  8250 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:35.458603  9682 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.446595  9684 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:35.500691  9644 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:35.524106  9644 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:16:35.524443  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 57359.9us
W20260709 13:16:35.526096  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.525982  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:35.527136  8074 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:35.521509  8256 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:35.496160  9649 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:35.521944  9628 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:35.530990  9649 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:35.531565  9649 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.531798  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:35.524565  9644 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.531054  9628 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:35.577291  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:35.577627  9628 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.494587  8249 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:35.498732  9656 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.501734  9652 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.532826  8785 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:35.571156  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:35.510812  9580 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:35.522241  9623 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.523524  9679 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:35.577492  9662 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.578176  8789 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:16:35.518436  9642 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:35.584729  9669 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:35.598184  8254 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:35.605677  9639 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:35.606160  9639 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:16:35.611037  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.610210  9639 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.603354  9642 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.628697  8788 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:35.603152  9669 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:35.634784  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:16:35.619354  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 192311us
I20260709 13:16:35.606982  9676 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:35.638022  9519 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:35.632846  9669 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.644737  9519 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:35.645207  9580 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.646207  9647 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:35.636883  9675 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:16:35.652443  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 156728us
I20260709 13:16:35.599948  9684 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.662449  9519 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:35.663843  9682 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:35.652443  9647 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:35.672850  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:35.754889  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.785401  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:35.786194  9662 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:35.680639  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.755494  9672 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:35.807061  8252 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 1.
I20260709 13:16:35.762877  9647 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.819742  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.818143  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:35.823624  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.825560  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:35.825683  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.826484  8252 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:35.828526  8180 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:35.812924  9665 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:35.825217  8103 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:35.821895  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.841941  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.842947  8252 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 1.
I20260709 13:16:35.840960  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:35.845932  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:35.847992  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:35.848203  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.849725  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.850051  9585 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:35.851297  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:35.852102  8177 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:35.859081  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:35.878159  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.879125  8254 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 1.
I20260709 13:16:35.881038  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:35.883085  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:35.884982  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 47695.6us
I20260709 13:16:35.885756  8147 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:35.886693  9677 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:35.886972  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:35.887285  9677 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:35.887377  9646 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:35.887777  9677 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.887801  9646 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:35.888422  9646 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.907248  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:35.908262  9638 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:35.929947  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:35.959995  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 72636.5us
W20260709 13:16:35.963436  9670 consensus_meta.cc:287] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.545s	user 0.004s	sys 0.008s
I20260709 13:16:35.916332  9638 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:35.977690  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e05ca9fb2b7a4b46851675643729339f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:35.969139  9638 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.965396  9670 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:36.003115  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 262258us
I20260709 13:16:35.992823  9585 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:36.013757  8105 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:36.005765  9519 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:36.021806  9669 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:36.017398  9691 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:36.037256  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:36.037653  8102 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:36.035888  9669 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:36.038383  9519 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.039438  8002 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36106 (request call id 192) took 2180 ms. Trace:
I20260709 13:16:36.009660  9628 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.056655  9623 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.040836  9519 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:36.020885  9684 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:36.059288  9670 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:36.073717  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:36.039888  8002 rpcz_store.cc:276] 0709 13:16:33.859285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.859459 (+   174us) service_pool.cc:224] Handling call
0709 13:16:36.039239 (+2179780us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:34.522245 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:34.551601 (+ 29356us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:34.553678 (+  2077us) write_op.cc:435] Acquired schema lock
0709 13:16:34.554746 (+  1068us) tablet.cc:662] Decoding operations
0709 13:16:34.575074 (+ 20328us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:34.575199 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:34.575242 (+    43us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:34.601086 (+ 25844us) tablet.cc:701] Row locks acquired
0709 13:16:34.605672 (+  4586us) write_op.cc:260] PREPARE: finished
0709 13:16:34.623325 (+ 17653us) write_op.cc:270] Start()
0709 13:16:34.661698 (+ 38373us) write_op.cc:276] Timestamp: P: 1783602994621663 usec, L: 0
0709 13:16:34.664042 (+  2344us) op_driver.cc:348] REPLICATION: starting
0709 13:16:34.747735 (+ 83693us) log.cc:844] Serialized 536 byte log entry
0709 13:16:35.230977 (+483242us) op_driver.cc:464] REPLICATION: finished
0709 13:16:35.309051 (+ 78074us) write_op.cc:301] APPLY: starting
0709 13:16:35.309266 (+   215us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:35.309522 (+   256us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:35.318725 (+  9203us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:35.423822 (+105097us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:35.467592 (+ 43770us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:16:35.489487 (+ 21895us) write_op.cc:312] APPLY: finished
0709 13:16:35.587865 (+ 98378us) log.cc:844] Serialized 23 byte log entry
0709 13:16:35.617591 (+ 29726us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:35.617779 (+   188us) write_op.cc:454] Released schema lock
0709 13:16:35.628457 (+ 10678us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:35.680521 (+ 52064us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:35.703671 (+ 23150us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":450044,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":913,"apply.run_cpu_time_us":4290,"apply.run_wall_time_us":355247,"num_ops":1,"prepare.queue_time_us":107764,"prepare.run_cpu_time_us":18093,"prepare.run_wall_time_us":585388,"raft.queue_time_us":17540,"raft.run_cpu_time_us":1581,"raft.run_wall_time_us":78936,"replication_time_us":566802,"spinlock_wait_cycles":1628032,"thread_start_us":416344,"threads_started":4,"wal-append.queue_time_us":418405}]]}
W20260709 13:16:36.092540  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 80980.3us
W20260709 13:16:36.094259  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.075711  9585 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:16:36.065375  9649 consensus_meta.cc:287] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.020s
W20260709 13:16:36.112493  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45042.2us
I20260709 13:16:36.064330  9691 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.096624  9585 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:36.291602  9585 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.293093  8175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:36.293953  8175 raft_consensus.cc:606] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:36.295056  8256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57566
I20260709 13:16:36.295639  8256 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.295970  8256 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:36.203975  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 136533us
I20260709 13:16:36.298291  8149 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:16:36.299204  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.300341  9639 consensus_meta.cc:287] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.688s	user 0.007s	sys 0.025s
I20260709 13:16:36.301337  9648 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:36.303282  8006 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39814 (request call id 273) took 1526 ms. Trace:
I20260709 13:16:36.303625  8006 rpcz_store.cc:276] 0709 13:16:34.777186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.777303 (+   117us) service_pool.cc:224] Handling call
0709 13:16:35.270342 (+493039us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b540006a9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db6090 00007fa5a0e54f3a 00007fa5a6c0b1cc 00007fa5a6d0937e 00007fa5a51ca2a4 00007fa5a51ca232 00007fa5a51ca161 00007fa5a51ca0dc 00007fa5a51c9392 00007fa59f18748c 00007fa59f1868c6
0709 13:16:36.303094 (+1032752us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139110,"reported_tablets":1,"spinlock_wait_cycles":656101632}
I20260709 13:16:36.304116  9648 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:36.306542  9656 consensus_meta.cc:287] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.706s	user 0.017s	sys 0.019s
I20260709 13:16:36.307250  9632 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:36.308383  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:36.102784  8785 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:36.135946  8786 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:36.280036  9677 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.311640  9585 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.313681  9670 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.313989  9677 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:36.315758  9677 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:36.316157  9677 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:36.315981  9630 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:36.109575  9649 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.283988  9646 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.300825  9639 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:36.317376  9677 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.318960  9646 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:36.319258  9639 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:36.319947  8101 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:36.319999  8180 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:36.307029  9656 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.321421  9649 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:36.290900  9623 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:36.314087  9670 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:36.331312  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:36.326882  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.326815  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:36.331645  9656 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:36.332055  9687 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:36.332131  8788 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.331678  9670 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.332505  9687 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:36.332957  9687 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:36.334180  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 44381.9us
W20260709 13:16:36.330479  9692 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.185s	user 0.000s	sys 0.009s
I20260709 13:16:36.330868  9693 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:36.331104  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:16:36.316996  9642 consensus_meta.cc:287] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.682s	user 0.014s	sys 0.014s
I20260709 13:16:36.344051  8094 tablet_service.cc:1558] Processing DeleteTablet for tablet e05ca9fb2b7a4b46851675643729339f with delete_type TABLET_DATA_TOMBSTONED (TS 9480609eccc44250a4d7fcc9686e76cf not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:44046
I20260709 13:16:36.345255  8786 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.340498  8256 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:36.285389  9644 consensus_meta.cc:287] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.685s	user 0.019s	sys 0.007s
I20260709 13:16:36.317055  9630 consensus_queue.cc:1059] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 13:16:36.350711  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 50583.7us
I20260709 13:16:36.357836  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:36.358498  8785 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.352082  8788 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:36.338243  9693 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.364826  8256 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:36.370779  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.371407  8147 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:36.374686  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:36.376293  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.377856  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:36.379220  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:36.380861  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.384145  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.384859  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.385481  8250 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:36.388263  9691 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:36.389639  9652 consensus_meta.cc:287] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.801s	user 0.015s	sys 0.008s
I20260709 13:16:36.389858  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.390311  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.391392  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.392340  9652 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:36.392966  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:36.394182  8107 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:36.394629  9652 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:36.394991  8180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:36.395823  8180 raft_consensus.cc:606] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:36.396711  8786 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:36.397686  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.398065  9687 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.398873  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.399565  8249 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:36.400199  9687 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:36.400352  9628 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:36.367988  9693 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.405475  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:36.349673  9642 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.411250  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.402799  8180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf53fff91826424990da23103f484232"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:36.412024  8177 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:36.412281  8180 raft_consensus.cc:606] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:36.412964  9697 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:36.413630  9697 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:36.414520  9697 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.415742  9689 raft_consensus.cc:3055] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:36.416143  9689 raft_consensus.cc:740] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:36.417070  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.360657  9644 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.419512  9644 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:36.421368  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.421890  9639 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:36.422209  8179 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 2: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:36.422430  9639 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.383701  9585 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:36.408432  9630 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:36.428682  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:36.428620  9630 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.428933  8005 catalog_manager.cc:5697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 3 to 4, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 4 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:36.429342  8791 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.426486  9639 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:36.427390  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:36.430823  9630 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:36.432582  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.433274  8101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:36.433949  8101 raft_consensus.cc:606] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:36.434439  8101 raft_consensus.cc:630] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Rejecting request to transfer leadership because tablet server a0f96c12124b4e1a816d9fa970464091 is not a voter in the active config
I20260709 13:16:36.434918  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:36.436868  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:36.437789  9677 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.438687  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:36.442008  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.409741  9638 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:36.447817  9638 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:36.448122  8785 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:36.449601  8789 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:36.451618  9642 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:36.456584  8791 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
W20260709 13:16:36.506321  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 131752us
I20260709 13:16:36.508455  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.507485  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.511219  9698 tablet_replica.cc:333] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:16:36.511381  8101 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 1.
I20260709 13:16:36.517093  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.517251  8248 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:36.517552  9647 consensus_meta.cc:287] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.688s	user 0.013s	sys 0.010s
I20260709 13:16:36.416982  9689 consensus_queue.cc:260] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.518008  9647 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.519169  9689 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.508527  8254 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:36.453559  9696 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:16:36.520035  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 76336.1us
I20260709 13:16:36.511752  8149 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:36.519641  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.525928  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.532289  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.522032  9698 raft_consensus.cc:2243] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:36.540282  8790 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:36.540540  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.535531  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.541208  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.540314  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.542339  9638 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:36.542678  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:36.543440  9638 raft_consensus.cc:3055] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:36.541867  8105 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:36.543836  9638 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:36.545804  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.547844  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:36.545678  8147 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:36.546420  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.529042  9696 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:36.552109  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.522944  9649 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:36.555338  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.556617  8147 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:36.537832  9677 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:36.558657  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.563086  8072 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:36.549677  9647 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:36.555332  9630 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:36.555122  9695 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:36.565192  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.572175  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.572223  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.574052  8248 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:16:36.574190  9695 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:36.565294  9646 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:36.575624  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:36.576653  9646 raft_consensus.cc:697] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:36.568188  9630 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:36.579298  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.579380  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:36.579865  9696 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.579643  9630 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.571110  9698 raft_consensus.cc:2272] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:36.581949  9652 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:36.583087  9670 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:36.583544  9695 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.584700  9669 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.585565  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.585310  9646 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.590395  9693 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.591280  9669 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:36.592859  9669 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.594151  9638 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.595551  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:36.597368  9638 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.598172  9693 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:36.598260  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:36.605255  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.609617  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.613996  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.630122  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.614785  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.633949  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:36.635746  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.637809  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.638826  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.639132  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.640398  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.643920  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.633524  8175 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:36.640551  8182 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:36.645884  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:36.645905  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 68119.9us
W20260709 13:16:36.647847  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 88703.4us
I20260709 13:16:36.614673  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.653517  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.650729  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:36.651662  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.652452  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.652468  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.655561  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.657497  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.658613  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:36.659524  9700 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.660149  9700 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:36.660593  9700 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.663136  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.660414  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:36.668272  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.669646  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.672835  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.672276  9696 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:36.674520  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.674938  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.675992  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.676177  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.676976  8103 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:36.677289  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.677999  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.678668  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.679447  8100 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:36.679533  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.680488  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.681818  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.682629  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.683261  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.683401  9669 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.681761  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.684145  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.684819  8107 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:36.685778  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.686379  9646 raft_consensus.cc:993] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:36.686870  9689 raft_consensus.cc:1081] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Signalling peer 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:16:36.687157  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.687741  8105 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:36.662027  9648 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.690191  9648 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:36.678742  8103 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:36.700654  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:36.673036  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:36.703311  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:36.703368  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:36.646061  9644 consensus_queue.cc:1059] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:16:36.706012  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.693960  8786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:48110
I20260709 13:16:36.711328  8786 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.711787  8786 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.693984  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.696177  9670 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:36.711918  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:36.715235  8102 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:36.715902  8149 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:36.716485  9669 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:36.717195  9649 raft_consensus.cc:3055] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:36.717422  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:36.717653  9649 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:36.718284  9695 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:36.718680  9695 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:36.719105  9695 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.718743  9649 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.708932  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:36.701582  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:36.713222  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:36.721011  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:36.721719  8099 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 2: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:36.721652  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:36.722363  8074 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:36.723049  8074 raft_consensus.cc:2686] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:16:36.702005  9630 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.690600  9648 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.707531  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:36.708117  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.708990  9644 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.732235  8248 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 1.
I20260709 13:16:36.710196  8223 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:36.710327  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.720680  8182 raft_consensus.cc:3055] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:36.737869  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.725589  9696 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.712594  9698 ts_tablet_manager.cc:1916] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:36.726567  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:36.727478  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.729754  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:36.730535  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:36.709602  9652 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:36.723534  9649 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.733419  8072 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:36.723898  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:36.738090  8182 raft_consensus.cc:740] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:36.739284  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:36.743643  9665 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:36.747669  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:36.748018  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:36.748937  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.726924  9646 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:36.751971  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:36.739647  8755 connection.cc:256] RPC call timeout handler was delayed by -1.1236698580000848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 13:16:36.753149  8755 connection.cc:256] RPC call timeout handler was delayed by -1.1236698580000848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 13:16:36.753575  8755 connection.cc:256] RPC call timeout handler was delayed by -1.04806985800019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260709 13:16:36.753911  8755 connection.cc:256] RPC call timeout handler was delayed by -1.0426698580001812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:16:36.754225  8755 connection.cc:256] RPC call timeout handler was delayed by -1.0426698580001812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260709 13:16:36.749140  9652 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:36.755053  9652 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.756260  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:36.758971  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.760164  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:36.737769  9644 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:36.762403  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:36.750069  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:36.766055  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:36.739401  9696 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:36.767323  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:36.768589  8099 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 2: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:36.768693  8101 raft_consensus.cc:2393] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 2: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:36.769659  9580 consensus_queue.cc:1059] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:36.770239  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:36.749302  9693 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:36.771052  9693 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.772701  9639 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:36.772992  9693 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:36.766642  9669 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:36.774092  9669 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:36.774413  9669 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:36.774811  9669 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.776297  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.776836  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.766781  9644 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.777331  9691 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:36.777751  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.778935  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.780067  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.773190  9639 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:36.780871  9639 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.781105  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:36.749524  9665 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:36.784566  9665 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.789477  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.790612  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.791366  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:36.793761  9628 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.794659  8257 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:36.795845  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.797109  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:36.797695  8252 raft_consensus.cc:2376] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2. Re-sending same reply.
I20260709 13:16:36.797782  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.800966  8178 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:36.802846  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:36.804713  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:36.806836  8183 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:36.807550  8177 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:36.807847  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.808656  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:36.808945  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:36.809615  8180 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:36.809754  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.768770  9642 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:36.809196  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:36.811236  9642 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.809202  8177 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.794265  9628 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:36.814561  9628 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.814903  9630 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:36.785393  9696 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.818220  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:36.823331  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:36.831996  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 67687.5us
I20260709 13:16:36.832314  9706 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:36.832834  9706 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:36.835561  9706 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:36.813235  9642 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:36.840842  8177 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:36.842597  9632 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:36.842460  9648 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:36.818737  8182 consensus_queue.cc:260] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.830576  9684 raft_consensus.cc:3055] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:36.854873  9684 raft_consensus.cc:740] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:36.855973  9708 consensus_queue.cc:1059] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:36.855818  9684 consensus_queue.cc:260] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.856359  8182 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.857113  9684 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.857442  9708 raft_consensus.cc:3055] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:36.877290  9708 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:36.878561  9708 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:36.879395  9648 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:36.880266  9708 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.858470  9672 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:36.859468  8223 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:36.859525  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 60166.8us
I20260709 13:16:36.862406  9652 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:36.865563  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:36.885893  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 153600us
I20260709 13:16:36.846180  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:36.831271  9644 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:36.890789  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 59697.2us
I20260709 13:16:36.894541  8223 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:36.892743  9642 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:36.892587  9519 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:16:36.895655  9642 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:36.896092  9642 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.892066  8785 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.837306  9706 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:16:36.940461  8176 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
W20260709 13:16:36.916206  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 70960.6us
I20260709 13:16:36.937198  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:36.917095  9709 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.925874  9628 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.943879  9709 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:36.944272  9709 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.946076  8182 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:36.942819  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:36.948902  9585 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.949139  9628 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:36.949553  9585 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:36.950133  9585 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.927709  9706 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:36.936282  9580 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:36.927006  9644 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:36.942644  9684 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:36.971909  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.974982  9670 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:36.979287  9689 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.979825  9689 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:36.981786  9689 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:36.984185  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 89721.1us
I20260709 13:16:36.984601  8787 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:36.985132  8223 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:36.986016  9689 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:36.986378  9672 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.986898  9672 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:36.987251  9689 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:36.987286  9672 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.987877  9689 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:36.990942  9639 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:36.929708  9642 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.994356  9639 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:36.996804  9669 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.997673  9665 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:36.999574  9669 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:36.968405  9706 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:36.970675  9580 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:37.007550  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:37.009025  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:37.010210  8223 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:37.011214  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:36.973341  9684 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:37.013338  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.017916  8787 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:37.016809  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.017283  9647 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.019506  9693 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:37.020447  9693 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:37.020893  9693 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.022359  9647 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.022260  9700 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:37.024485  9700 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:37.024169  9639 raft_consensus.cc:2955] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:37.016290  9684 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.003870  9665 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:37.025880  9706 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:37.036145  9706 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.029196  9580 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:37.004254  9695 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:37.027454  9648 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.034219  9638 consensus_queue.cc:1059] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:37.041968  8074 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:37.018419  9652 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:37.047253  9642 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:37.051532  8786 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.050207  9585 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.048847  9695 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:37.061578  9711 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:37.062085  9711 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:37.062405  8791 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.049229  9696 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:37.049885  9580 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.038177  8006 catalog_manager.cc:5697] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 2 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.054807  8785 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:37.052556  8790 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:37.047194  9632 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:37.054139  9700 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:37.042424  9689 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.062683  9711 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.085230  9689 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.046531  9698 ts_tablet_manager.cc:1929] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:16:37.073375  9714 raft_consensus.cc:2764] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:16:37.074115  9648 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:37.092461  9648 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:37.092993  9648 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:37.094568  9648 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.095615  9698 log.cc:1199] T e05ca9fb2b7a4b46851675643729339f P 9480609eccc44250a4d7fcc9686e76cf: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/wals/e05ca9fb2b7a4b46851675643729339f
I20260709 13:16:37.096751  9648 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.082871  8790 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:37.083760  9695 consensus_queue.cc:1059] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:37.068874  8074 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:16:37.087309  9630 consensus_queue.cc:1175] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a0f96c12124b4e1a816d9fa970464091" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:16:37.097136  9698 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44046 (request call id 84) took 1023 ms. Trace:
I20260709 13:16:37.070466  9700 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:37.129818  9700 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.132467  9696 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:37.044557  9709 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.135492  9709 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:37.056049  9672 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.079118  8786 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:37.106232  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:37.107857  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:37.110759  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:37.138782  9672 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:37.105461  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.107784  9646 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:16:37.112900  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:37.116047  8174 raft_consensus.cc:2955] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:37.142815  9646 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.117646  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:37.108238  9647 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:37.144420  9647 raft_consensus.cc:697] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:37.108548  9698 rpcz_store.cc:276] 0709 13:16:36.142398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.343754 (+201356us) service_pool.cc:224] Handling call
0709 13:16:36.510762 (+167008us) ts_tablet_manager.cc:1151] Deleting tablet e05ca9fb2b7a4b46851675643729339f
0709 13:16:36.510889 (+   127us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:16:36.931978 (+421089us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:37.043188 (+111210us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:37.097046 (+ 53858us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":251,"tablet-delete.queue_time_us":165898,"thread_start_us":62654,"threads_started":1}
I20260709 13:16:37.145462  9647 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:37.147500  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.120692  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:37.121755  9684 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.150379  7993 catalog_manager.cc:5028] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): tablet e05ca9fb2b7a4b46851675643729339f (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:37.105847  9693 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.121417  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.105150  9695 raft_consensus.cc:3055] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:37.128814  8790 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:16:37.173800  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 163642us
I20260709 13:16:37.175539  8223 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:37.177817  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 77278.3us
W20260709 13:16:37.180905  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 116364us
W20260709 13:16:37.181368  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.181074  9646 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:37.183928  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:37.173926  9695 raft_consensus.cc:740] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:37.178817  9700 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.184937  9652 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:37.191009  9695 consensus_queue.cc:260] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.193082  9695 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.197542  9639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:44046 (request call id 83) took 2798 ms. Trace:
I20260709 13:16:37.197300  9580 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:16:37.205044  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 83688.2us
I20260709 13:16:37.200522  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:37.212740  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.210928  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.206303  9684 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:37.198158  9639 rpcz_store.cc:276] 0709 13:16:34.388421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.389849 (+  1428us) service_pool.cc:224] Handling call
0709 13:16:34.396354 (+  6505us) log.cc:844] Serialized 501 byte log entry
0709 13:16:37.182225 (+2785871us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140470,"raft.queue_time_us":224451,"raft.run_cpu_time_us":2657,"raft.run_wall_time_us":328277,"thread_start_us":351101,"threads_started":2,"wal-append.queue_time_us":22050,"wal-append.run_cpu_time_us":37460,"wal-append.run_wall_time_us":1858684}
I20260709 13:16:37.210891  8785 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:37.211391  9693 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:37.211797  8787 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:37.212777  8789 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.185827  9672 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:37.218272  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.212268  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.202679  9585 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:37.233932  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.217702  9652 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:37.236624  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.212432  9580 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:37.233199  9632 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.235898  8784 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:37.236785  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.225719  9709 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:37.237141  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.239809  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.226161  9672 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:37.240980  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.239686  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.242447  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c362335b215641d38dd0c651acfb8fbb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:37.239897  9669 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.242851  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.243388  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.245041  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.240180  9580 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.253240  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.254387  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.254941  8784 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:37.250093  9639 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.250123  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.249927  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.251024  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.251332  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.251886  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.261472  9639 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.261552  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.262660  9639 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.266525  8789 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:37.265664  8783 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.267891  8785 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:37.247102  9709 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:37.268603  9709 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.268774  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:37.247810  9672 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.247390  9708 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.269032  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:37.258236  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.270480  8791 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:37.271380  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:37.271584  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.274714  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.277722  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:37.279677  8782 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:37.286408  8787 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 2: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:37.286803  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.285502  9639 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:37.290409  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.291203  9719 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.291940  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.292734  9684 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:37.292690  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.293617  9719 raft_consensus.cc:2764] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:37.294466  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.298348  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.295643  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.296327  9639 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:37.297308  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.311442  9719 raft_consensus.cc:2764] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:16:37.289117  9648 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.313145  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.314016  9628 raft_consensus.cc:2764] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:37.298362  9580 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:37.299536  9684 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.318176  8252 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.318802  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.319937  9580 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:37.320182  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.300323  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.294529  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:37.322449  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:37.323673  9628 raft_consensus.cc:2764] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:37.323287  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:37.322943  9693 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.286558  9647 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.324731  9519 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.326592  9585 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:37.327184  9585 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:37.285336  9709 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:37.328327  9585 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.330518  9709 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:37.325048  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:16:37.325014  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 76702.6us
I20260709 13:16:37.323907  9719 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:37.334510  9693 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:37.334570  9719 raft_consensus.cc:697] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:37.335063  9693 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:37.338348  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.335698  9719 consensus_queue.cc:237] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.341774  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.342639  8784 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 2: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:37.341744  9712 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.336087  9693 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.347282  8790 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:37.336949  9580 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.349548  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.355578  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:37.352478  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.355024  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.362123  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:37.362502  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.362727  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:37.362916  9717 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:37.363678  8783 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 2: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:37.364014  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:37.365635  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:37.369218  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.349459  9689 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:16:37.363993  9717 raft_consensus.cc:3055] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:37.387934  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:37.353979  9711 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.378562  9717 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:37.392091  8790 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:37.398783  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.400820  8788 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.400698  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:37.402714  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 50299.1us
I20260709 13:16:37.405778  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.408051  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:37.403285  8005 catalog_manager.cc:5697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 2 to 3, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:37.408936  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:37.386742  9648 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.415082  8790 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 2: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:37.415139  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:37.415877  8102 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.419036  8106 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.391105  9639 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:37.400365  9706 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:37.420819  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.421962  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:37.431273  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:37.432147  8100 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:37.432379  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:37.433041  8101 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:37.432163  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:37.434226  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:37.425964  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.431176  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:37.433167  9717 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.426752  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.424911  9711 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:37.437620  9580 consensus_queue.cc:1059] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:37.404827  9632 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.411564  9652 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.414219  9712 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.461807  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:37.463344  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:37.456188  8181 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:37.457414  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:37.467252  8183 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 2: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:37.467911  9689 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.457641  9639 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.464073  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:37.477025  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 45902.9us
I20260709 13:16:37.439692  9706 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:16:37.485037  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 58364.3us
I20260709 13:16:37.495307  8178 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
W20260709 13:16:37.514248  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 122872us
I20260709 13:16:37.451438  9684 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:16:37.464274  9665 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.490489  9706 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.549324  8102 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
W20260709 13:16:37.558574  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 132672us
I20260709 13:16:37.568253  8175 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:37.490388  9713 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:37.557052  8182 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:37.548251  8180 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:37.604496  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:37.604317  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 114943us
I20260709 13:16:37.603793  9717 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:37.625168  9727 log.cc:927] Time spent T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:16:37.632752  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 119286us
W20260709 13:16:37.629915  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 176381us
I20260709 13:16:37.635630  8223 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.606237  9713 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:37.640638  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.658705  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.607606  9672 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.663533  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.665395  8072 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.669515  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.639432  9734 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.657399  9713 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:37.668838  9726 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.095s	user 0.003s	sys 0.000s
I20260709 13:16:37.664698  9689 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.674278  8072 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.660183  9580 consensus_queue.cc:1059] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:16:37.671825  9632 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.679162  8072 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.679795  9652 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.678897  9735 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:37.688099  9730 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:37.679886  9736 consensus_queue.cc:1059] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:16:37.687063  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.696905  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.677743  9737 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.697621  9689 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.688123  9672 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:37.687290  9729 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:16:37.713418  9672 raft_consensus.cc:3055] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:37.711474  9697 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.713833  9672 raft_consensus.cc:740] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:37.706177  9735 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.714886  9672 consensus_queue.cc:260] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.716267  9639 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:37.719614  9731 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.088s	user 0.000s	sys 0.002s
I20260709 13:16:37.720857  9706 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:37.706292  9652 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.723174  9706 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:37.677765  9684 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.711979  9736 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:37.726075  9736 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:37.726903  9736 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:37.537562  9709 consensus_queue.cc:1175] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5033fc7e66374940a203908ea8b0078f" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:37.728137  9736 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.713989  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.716089  9672 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:37.729658  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 66176us
I20260709 13:16:37.730535  8223 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:37.732142  8223 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:37.732892  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:37.733883  9697 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.734818  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:37.735137  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:37.735476  9684 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:37.735901  9684 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:37.736344  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:37.736662  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:37.737223  8251 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.736326  9684 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.738689  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:37.734850  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:37.742645  9740 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:37.743062  9740 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:37.743399  9740 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.745404  8149 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.746194  9697 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.746513  9708 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:37.746935  9708 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:37.748219  8251 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:37.753037  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:37.754176  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:37.755262  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:37.755259  8004 catalog_manager.cc:5697] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 2 to 3, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 3 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.757655  8004 catalog_manager.cc:5697] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New cstate: current_term: 1 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.759003  9740 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.761091  9740 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:37.763948  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:37.762063  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.764839  8251 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 2: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:37.765770  8256 raft_consensus.cc:2410] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:16:37.750166  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:37.750617  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:37.751595  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:37.752174  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:37.752490  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:37.762825  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:37.771904  8102 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:37.748026  9708 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.777712  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:37.775725  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:37.783118  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.784026  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:37.790223  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:37.800593  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.793537  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:37.804955  8254 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:37.805927  8257 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:37.807449  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.807755  8254 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:37.808364  8248 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:37.805125  8101 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:37.809957  9709 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.808264  8254 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:37.811088  8254 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.812731  8254 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.812040  9740 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.813804  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:37.818594  8253 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:37.818512  8002 catalog_manager.cc:5697] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 3, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:37.820304  8002 catalog_manager.cc:5697] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 2, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.821089  9709 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.822372  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.822301  8002 catalog_manager.cc:5697] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 3, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.823258  9709 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.824429  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.827314  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:37.828315  8223 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:37.828913  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 190528us
I20260709 13:16:37.825815  9708 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.830282  9713 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.826719  9665 raft_consensus.cc:3055] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:37.835594  9665 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:37.836722  8788 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:37.838207  9700 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:37.841352  8250 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:37.830941  9642 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.832821  9709 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.830387  8104 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 2: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:37.843581  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:37.844573  8105 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:37.842123  8256 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:16:37.848021  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 74492.9us
I20260709 13:16:37.848073  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:37.848573  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.849979  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.830849  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.855054  9665 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.856285  9665 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.831168  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:37.859771  8102 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:37.866118  8254 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:37.866870  8251 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:37.857633  9684 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.869230  9713 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:37.848830  8180 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:37.870774  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:37.872057  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.887437  9628 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.873706  8251 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.871815  9693 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.875032  8252 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.876029  9684 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:37.890924  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:37.877313  8255 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:37.891595  8100 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.880000  9709 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.880401  9697 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:37.880733  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 52501.6us
W20260709 13:16:37.882174  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 51418.8us
I20260709 13:16:37.883695  8177 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:37.894961  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.897650  9689 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.893383  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.889297  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.902209  9709 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.903292  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.903810  9693 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.904560  9709 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.907815  9696 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:37.909783  9696 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:37.910182  9696 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:37.910660  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.911073  9696 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:37.912361  9696 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.912950  9709 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.914110  8223 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.914674  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.915446  8241 tablet_service.cc:1558] Processing DeleteTablet for tablet c362335b215641d38dd0c651acfb8fbb with delete_type TABLET_DATA_TOMBSTONED (TS a0f96c12124b4e1a816d9fa970464091 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57550
I20260709 13:16:37.915518  9709 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.917029  8223 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.917718  9709 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.919764  9697 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.923341  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.921725  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.925981  9693 consensus_queue.cc:1059] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:37.926846  9693 consensus_queue.cc:1243] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:37.927304  9642 raft_consensus.cc:3055] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:37.927690  9642 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:37.928205  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:37.929019  9693 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:37.928653  9642 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.929535  9693 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:37.929968  9693 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.930053  9642 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.932633  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:37.934464  9743 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:37.935716  8072 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.937407  8250 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.938114  8223 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:37.940377  9712 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:37.941267  8100 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:37.941476  9712 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:37.941610  9743 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:37.941884  9712 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:37.942711  9743 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:37.942785  9712 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:37.946218  9709 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.946841  9745 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.944986  9712 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.948534  9665 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:37.952996  8105 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.953740  8102 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.954470  8250 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.955240  8106 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:37.957583  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:37.957201  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:37.961781  8004 catalog_manager.cc:5697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 2 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:37.963975  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:37.964215  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:37.964762  8105 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:37.935896  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.967579  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:37.968897  8182 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:37.970634  8250 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.971328  8256 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:37.971380  8251 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.967672  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.973222  8250 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.977363  8182 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.978600  8182 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.980039  8107 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:37.979964  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.980480  8182 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.985100  8176 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:37.981698  8177 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.964501  8004 catalog_manager.cc:5697] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 2 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:37.985733  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.950613  9696 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:37.984491  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:37.988758  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:37.990682  8106 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:37.987287  8004 catalog_manager.cc:5697] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 2 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:37.991940  8177 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.991308  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:37.995806  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:37.996803  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:37.997746  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:37.975209  9700 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:38.003388  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:38.004530  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:38.005259  9693 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.005777  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:37.959457  9745 consensus_queue.cc:1059] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:16:37.975399  9665 raft_consensus.cc:697] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:38.007701  9693 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:38.012769  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:37.986641  9646 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:38.021524  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:37.990159  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:37.990373  9689 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:38.030999  8223 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:38.024824  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:38.022961  9751 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:38.032125  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:38.033147  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:38.034546  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:38.001108  9695 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:38.036445  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:38.010319  9585 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:38.042040  8223 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:38.025223  9648 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:16:38.007984  9665 consensus_queue.cc:237] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.025893  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:38.027196  9672 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.027455  9713 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:38.043392  9735 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:38.012625  9709 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:16:38.055721  9628 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:38.059170  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:38.067973  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.042763  9750 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:38.048305  9745 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:38.047926  9700 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:38.046527  9706 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:38.057725  9580 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:38.064083  9689 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:16:38.091692  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 46875us
I20260709 13:16:38.047984  9708 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:16:38.047650  9693 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:16:38.085312  9519 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:16:38.044132  9743 consensus_queue.cc:1059] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:16:38.136037  9673 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:16:38.087850  9745 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:38.090255  9750 raft_consensus.cc:697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:38.077538  9672 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.093737  9736 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:16:38.148399  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 89337.8us
I20260709 13:16:38.093457  9700 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:38.144663  9752 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:38.150417  9747 tablet_replica.cc:333] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:16:38.143299  9689 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:38.165231  9750 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.151063  9745 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:38.144949  9740 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:16:38.135999  9741 consensus_queue.cc:1059] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.134s
I20260709 13:16:38.152344  9628 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:16:38.177052  9672 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:38.170883  9642 raft_consensus.cc:3055] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:38.172120  9752 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:38.173604  9741 raft_consensus.cc:3055] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:38.202059  9684 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:38.202663  9684 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:38.203804  9684 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:38.192682  9642 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:38.205384  9684 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.206414  9642 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.207687  9642 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.211179  9689 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:38.180528  9743 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:38.214417  9743 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:38.215260  9743 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:38.218320  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 86275.6us
I20260709 13:16:38.198866  9741 raft_consensus.cc:740] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:38.177537  9700 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:38.239015  9754 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:38.241109  9754 consensus_queue.cc:1059] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:38.243021  9754 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:38.248121  9752 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:38.250494  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:38.251967  8223 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:38.251284  8099 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:38.258318  9632 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:38.263958  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:38.264587  9711 raft_consensus.cc:3055] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:38.263787  9632 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.264978  9711 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:38.265882  9711 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.266886  9711 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:38.267005  9632 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:38.270706  9741 consensus_queue.cc:260] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:38.272167  9741 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:38.273051  8223 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:38.273953  8223 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:38.280272  9585 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:38.280728  9585 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:38.283567  9740 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:38.284004  9740 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.284346  9740 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.285537  9743 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.289494  8106 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:38.281603  9585 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.295809  9585 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.281603  9642 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:38.297887  9642 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:38.253918  9735 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:38.286557  9684 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:38.304102  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.337186  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.304747  9759 raft_consensus.cc:3055] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:16:38.359961  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 127134us
I20260709 13:16:38.361467  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:38.362501  8788 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:38.364642  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:38.365402  8789 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 2: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:38.373229  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:38.374439  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:38.378957  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:38.379017  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:38.359519  9759 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:38.387674  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:38.405366  8106 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:38.413712  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 330577us
I20260709 13:16:38.385609  9750 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:38.415704  8176 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:38.395051  9628 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:38.416290  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:38.398324  9754 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:16:38.417925  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 383427us
I20260709 13:16:38.401713  9709 raft_consensus.cc:3055] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:38.386164  9684 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:38.396081  9747 raft_consensus.cc:2243] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:38.401932  9693 raft_consensus.cc:3055] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:38.424232  9750 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:38.380436  9642 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.412441  9736 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:16:38.399888  9740 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.393364  9745 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.433115  9628 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:38.460628  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:38.433365  9709 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:38.445796  8786 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:38.455739  9693 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:38.474689  9747 raft_consensus.cc:2272] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:38.476779  8106 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: [1.4-1.4]
W20260709 13:16:38.477955  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.478536  8100 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:38.482168  9753 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:38.485934  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:38.458398  9684 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:38.510252  8251 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:38.464787  9648 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:16:38.464735  9696 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:16:38.498466  9753 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:38.532855  9753 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:38.503378  9708 raft_consensus.cc:3055] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:38.464905  9759 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.505652  9697 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:38.460305  9689 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
W20260709 13:16:38.558897  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.565141  9628 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.567327  9745 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:38.503450  9672 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:16:38.530244  9750 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.538486  9708 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:38.578719  8251 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:38.580444  9697 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:38.580325  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:38.590792  9708 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:38.592090  9708 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.592300  9773 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:38.593621  9762 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:38.593961  9762 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:38.584473  9759 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.560992  9693 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.595625  9750 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:38.609175  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.612319  9747 ts_tablet_manager.cc:1916] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:38.606464  9740 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:38.625651  9762 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:38.612555  9684 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:38.627358  9762 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:38.600903  8100 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:38.604991  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 74006.9us
W20260709 13:16:38.618167  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 233160us
I20260709 13:16:38.560814  9709 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.613950  9697 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:38.631083  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:38.641508  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:38.646106  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:38.635622  9741 consensus_queue.cc:1175] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9480609eccc44250a4d7fcc9686e76cf" responder_term: 2 status { last_received { term: 1 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: [1.4-1.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:38.647647  9743 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:38.656947  9761 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.657640  9761 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:38.659899  9761 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:38.635393  9709 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:38.641314  9693 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.662320  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:38.674559  9585 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:38.674196  9743 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:38.703836  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:38.703399  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:38.711441  8250 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:38.700369  8002 catalog_manager.cc:5697] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.706430  8176 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:38.688396  9775 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:38.698644  9642 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.704872  9700 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.700150  9754 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:16:38.732611  9775 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:38.717221  9585 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:38.759779  8100 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:38.778295  8223 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:38.786417  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:16:38.796448  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 121569us
I20260709 13:16:38.788836  8004 catalog_manager.cc:5697] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 3, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:38.806375  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.807824  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.807217  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:38.735975  9700 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.822403  8787 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:38.837222  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.810091  9740 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:38.793612  9689 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:16:38.835395  8100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:38.836782  9647 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:38.843878  9753 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:38.867791  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:38.833467  9766 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:16:38.872504  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.875788  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:38.868479  9647 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.861956  9740 raft_consensus.cc:697] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:38.869458  8786 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:38.831512  9743 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.872969  8100 raft_consensus.cc:606] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:38.862527  9775 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:38.892565  9779 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:16:38.893110  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:38.873327  8180 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:38.881786  9647 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.908926  8784 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:38.912380  8782 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:38.915738  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:38.917941  8176 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:38.918378  9756 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:38.917060  8786 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:38.924290  9756 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:38.921942  8178 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:38.925376  9752 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.926029  9752 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.922765  8782 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:38.925181  9756 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:38.855366  9585 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:38.939842  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.954739  8787 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
W20260709 13:16:38.958242  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.937964  9740 consensus_queue.cc:237] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:38.930388  9756 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:38.960139  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:16:38.963382  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 48340.5us
I20260709 13:16:38.928475  9752 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:38.988916  8784 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.916252  9647 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:38.990178  8072 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:38.991712  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.996363  8106 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:38.995442  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:39.003291  8255 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:39.003685  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.000164  8105 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:39.003217  8252 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:39.004820  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:16:39.004318  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.001929  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:39.007894  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:39.009153  8251 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:39.009268  8250 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:16:39.010599  8250 pending_rounds.cc:85] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 6
I20260709 13:16:39.010915  8250 pending_rounds.cc:107] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:16:39.014328  8250 raft_consensus.cc:2889] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:38.995536  9752 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.018160  8108 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:39.019375  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:39.011355  9665 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:39.024372  9752 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.024983  9656 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:38.999991  9774 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.992897  9696 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:39.028970  9774 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.029342  9696 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.030371  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:39.031740  9696 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.032255  9755 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:39.034720  8253 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:39.035506  8072 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:39.038607  8176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:39.039180  8176 raft_consensus.cc:606] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:39.039503  8176 raft_consensus.cc:614] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:39.043848  8176 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:39.044495  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:39.045953  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:39.049116  8789 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:39.003317  9709 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 13:16:39.053215  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.045804  8221 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:39.021049  8787 raft_consensus.cc:2955] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:39.071238  9774 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.067278  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:39.074345  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 61282.6us
I20260709 13:16:39.088836  9758 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:16:39.018290  9759 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:16:39.093226  8183 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:39.090025  9774 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.067257  9741 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:39.108644  8176 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:39.073861  9639 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:39.056015  9708 consensus_queue.cc:1059] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:16:39.066290  9754 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:16:39.089821  9763 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:16:39.090473  9672 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.100864  9766 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:39.061957  9642 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:16:39.135174  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:39.211616  8250 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:39.102255  9700 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.214540  9793 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:16:39.215385  9669 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.215925  9669 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.220019  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:39.123546  9741 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:39.138656  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:39.228587  8106 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:16:39.228770  9783 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:16:39.237799  9670 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.237919  9765 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.238544  9670 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:39.238801  9765 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:39.223551  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:39.241164  9670 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:39.230311  9752 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.224748  9628 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:16:39.255854  9670 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:39.258054  9670 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.268292  9741 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.109658  9774 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:39.280005  9774 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:39.281210  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 180490us
I20260709 13:16:39.282341  8072 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:39.284575  9691 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:39.115396  9695 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.178s
I20260709 13:16:39.234181  9768 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.206879  9797 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:39.261296  9670 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.297343  9684 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:39.298002  9684 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:39.300457  8106 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:39.300781  9684 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:39.303191  9709 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:39.305755  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:39.306638  8106 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 2: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:39.325273  9768 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.328080  9768 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:39.243036  9759 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:16:39.251194  8103 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:39.343035  9669 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:39.321286  9762 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.001s
I20260709 13:16:39.352141  8790 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:39.333820  9672 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.352634  9765 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:39.336659  8784 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
W20260709 13:16:39.362483  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 244395us
I20260709 13:16:39.385514  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:39.386544  8250 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:39.389410  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:39.390491  8250 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 4: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:39.393181  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:39.361133  9797 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.370699  9750 consensus_meta.cc:287] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.002s
I20260709 13:16:39.363965  9672 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.399442  8250 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:39.402869  9797 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.406324  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:39.407377  8250 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
W20260709 13:16:39.401525  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.399154  9796 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.413189  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:39.415058  8252 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
W20260709 13:16:39.412774  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 307613us
I20260709 13:16:39.429003  9756 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.432123  9756 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:39.432863  9753 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.002s
I20260709 13:16:39.425357  9796 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.435518  9756 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.436538  9796 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:39.462260  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:39.473230  9797 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.466936  9656 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:39.484454  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:39.484653  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:39.485900  8787 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
W20260709 13:16:39.484747  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 69976.3us
I20260709 13:16:39.488262  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:39.489009  8175 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:39.490100  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:39.491804  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:39.493498  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:39.493780  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:39.497460  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:39.498039  8182 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:39.483744  9762 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.502300  8175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:39.509543  8175 raft_consensus.cc:606] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:39.511683  8175 raft_consensus.cc:614] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:39.479746  9672 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:16:39.515370  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:39.519604  9648 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:39.512295  9656 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.515893  8147 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:39.524549  8182 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:39.500816  9793 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.520891  9656 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:39.515997  8175 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:39.502480  9740 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.526376  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:39.530321  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:39.540539  8176 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:39.541849  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:39.536525  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:39.521752  9797 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.543064  8791 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:39.512641  9737 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:39.544795  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:39.516544  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:39.520920  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:39.548707  9672 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:39.534427  9648 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:39.550310  9745 raft_consensus.cc:993] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:39.550493  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:39.563141  8105 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:39.564122  8105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:39.564764  8105 raft_consensus.cc:606] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:39.566665  8105 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:39.551487  8102 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:39.547652  9669 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.556352  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:39.577544  8179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:39.578158  8179 raft_consensus.cc:606] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:39.578395  8179 raft_consensus.cc:614] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:39.529546  9756 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.559145  8783 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:39.580679  9756 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.582904  9756 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.548537  9737 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:39.539608  9793 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:39.584766  9737 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:39.513528  9762 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.560356  9648 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.585803  9648 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:39.586174  9793 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:39.586666  9762 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.587662  9656 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:39.537674  9646 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:39.554270  9740 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:39.588559  9646 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.589881  9740 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:39.552222  8175 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:39.572964  9519 raft_consensus.cc:1081] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:39.557610  9672 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:39.612509  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:39.615684  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:39.617831  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:39.555030  9797 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:39.665055  9804 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:39.665654  9804 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.618809  9750 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:16:39.666047  9804 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:39.667531  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 44794.2us
I20260709 13:16:39.614895  9672 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.676208  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:39.590340  9669 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.685278  9646 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.685743  8108 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:39.666960  9689 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.667340  9740 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:16:39.710116  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 197406us
W20260709 13:16:39.714773  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 227649us
I20260709 13:16:39.621075  9759 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:16:39.676913  9585 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:16:39.716038  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:39.723950  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:39.737929  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:39.736123  9789 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:39.737622  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:39.748790  8074 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:39.753249  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:39.757673  8257 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:39.761721  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:39.764631  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:39.767433  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:39.768188  8102 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:39.768424  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:39.769307  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:39.771469  9795 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.609s	user 0.005s	sys 0.007s
I20260709 13:16:39.772398  8255 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:39.773939  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:39.778739  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:39.779563  8181 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:39.719041  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:39.710530  9689 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:39.792472  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:39.716279  9740 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.769855  9762 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:39.745020  9758 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:39.798249  8783 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:39.783867  9789 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.775763  9696 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:16:39.788290  9709 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.806124  9789 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:39.810004  8250 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:39.808683  9758 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.814078  9812 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.814819  9812 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.800981  9762 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:39.744451  9697 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:16:39.822649  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:39.827775  8179 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 2: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:39.830366  9801 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:39.831013  9801 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.831422  9801 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:39.831801  9740 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.812493  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:39.824015  9762 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:39.824828  9745 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:39.846561  9745 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.846627  9797 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:39.847039  9745 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:39.826521  9803 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.855242  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:39.834342  9802 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.811753  9709 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:39.875830  8072 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:39.857146  9642 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.850768  8180 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:39.881352  9740 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.920181  9737 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:39.920799  9737 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:39.923548  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:39.881150  9759 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:39.884218  9812 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.891543  9747 ts_tablet_manager.cc:1929] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:39.931694  9815 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.935684  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:39.921274  9737 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:39.897361  9669 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.940802  9708 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.943763  9747 log.cc:1199] T c362335b215641d38dd0c651acfb8fbb P a0f96c12124b4e1a816d9fa970464091: Deleting WAL directory at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0/minicluster-data/ts-2-root/wals/c362335b215641d38dd0c651acfb8fbb
I20260709 13:16:39.901396  9642 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.930210  9740 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:39.981691  8100 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.982477  9647 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:39.957540  9708 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.991107  9708 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.944486  9758 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:39.941350  9759 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.898245  9803 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:39.970224  9812 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:39.988243  9689 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:40.028435  8100 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:16:40.035990  9819 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:40.055482  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 219) took 1066 ms. Trace:
I20260709 13:16:40.056051  8100 rpcz_store.cc:276] 0709 13:16:38.991584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.000518 (+  8934us) service_pool.cc:224] Handling call
0709 13:16:39.975141 (+974623us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b5800002798. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:16:39.981541 (+  6400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.055093 (+ 73552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.055368 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48472320}
I20260709 13:16:40.045783  9759 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:40.048454  9812 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:40.050981  9740 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:39.886312  9802 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.038152  9709 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:40.062332  8107 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:40.078608  9665 raft_consensus.cc:3055] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:40.079041  9665 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:40.079566  9802 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:40.069824  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:40.074904  9758 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.079885  9665 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.080942  9665 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:40.080681  9758 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.081677  8180 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:40.082903  9758 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:40.082930  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:40.085049  9747 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57550 (request call id 76) took 2152 ms. Trace:
I20260709 13:16:40.085608  9747 rpcz_store.cc:276] 0709 13:16:37.908734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.915151 (+  6417us) service_pool.cc:224] Handling call
0709 13:16:38.047383 (+132232us) ts_tablet_manager.cc:1151] Deleting tablet c362335b215641d38dd0c651acfb8fbb
0709 13:16:38.047478 (+    95us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:16:39.327487 (+1280009us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:39.885030 (+557543us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:40.013327 (+128297us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":177614,"tablet-delete.queue_time_us":131106,"thread_start_us":109835,"threads_started":1}
I20260709 13:16:40.086542  9812 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:40.087076  9804 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:39.971657  9775 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:40.089949  9775 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.092715  8002 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39828 (request call id 273) took 1487 ms. Trace:
I20260709 13:16:40.093094  8002 rpcz_store.cc:276] 0709 13:16:38.605781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.605941 (+   160us) service_pool.cc:224] Handling call
0709 13:16:40.092657 (+1486716us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:38.961328 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:38.961922 (+   594us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:38.961962 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:16:38.961989 (+    27us) tablet.cc:662] Decoding operations
0709 13:16:38.962432 (+   443us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:38.962500 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:38.962564 (+    64us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:38.962759 (+   195us) tablet.cc:701] Row locks acquired
0709 13:16:38.962776 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:16:38.962908 (+   132us) write_op.cc:270] Start()
0709 13:16:38.963013 (+   105us) write_op.cc:276] Timestamp: P: 1783602998962868 usec, L: 0
0709 13:16:38.963031 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:16:38.963649 (+   618us) log.cc:844] Serialized 536 byte log entry
0709 13:16:39.016321 (+ 52672us) op_driver.cc:464] REPLICATION: finished
0709 13:16:39.234662 (+218341us) write_op.cc:301] APPLY: starting
0709 13:16:39.243669 (+  9007us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:39.248679 (+  5010us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:39.253128 (+  4449us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:39.330298 (+ 77170us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:39.330522 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:16:39.330598 (+    76us) write_op.cc:312] APPLY: finished
0709 13:16:39.337318 (+  6720us) log.cc:844] Serialized 23 byte log entry
0709 13:16:39.337532 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:39.337614 (+    82us) write_op.cc:454] Released schema lock
0709 13:16:39.337667 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:39.338003 (+   336us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:39.338030 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":208369,"apply.run_cpu_time_us":2618,"apply.run_wall_time_us":106872,"num_ops":1,"prepare.queue_time_us":168815,"prepare.run_cpu_time_us":2615,"prepare.run_wall_time_us":57287,"replication_time_us":53131,"thread_start_us":209726,"threads_started":2}]]}
I20260709 13:16:40.096630  9745 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:39.956327  9815 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:40.142155  9689 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.144222  9689 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:40.147013  9689 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:40.151078  9740 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.151763  9740 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.142251  9768 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.153162  9768 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.154443  9740 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:40.155463  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:40.172912  8253 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:40.156507  9768 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:40.173570  9750 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:40.174324  9750 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.158125  9736 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:40.164402  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:40.165654  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:40.167174  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:40.167902  8250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57556
I20260709 13:16:40.177131  8255 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 2: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:40.177029  8254 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:40.177366  8250 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:40.178134  8250 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:40.179278  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:40.180619  8004 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39814 (request call id 276) took 1563 ms. Trace:
I20260709 13:16:40.191542  9708 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:40.192608  9708 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:40.194156  9708 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.197341  9789 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:40.143016  9648 consensus_meta.cc:287] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.557s	user 0.006s	sys 0.005s
W20260709 13:16:40.384227  8175 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.012s	sys 0.100s
I20260709 13:16:40.224179  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:40.484313  8791 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:40.093132  9665 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.176319  9802 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:16:40.324915  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.219376  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:16:40.532248  8072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.001s	sys 0.001s
W20260709 13:16:40.607999  8072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.002s	sys 0.001s
I20260709 13:16:40.190397  9740 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:16:40.426627  8787 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.052s	sys 0.044s
I20260709 13:16:40.228776  8788 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:40.528703  8149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.006s	sys 0.039s
I20260709 13:16:40.482319  8221 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:16:40.560971  8175 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.014s	sys 0.107s
W20260709 13:16:40.572927  8177 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.009s	sys 0.003s
W20260709 13:16:40.590975  8252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.000s	sys 0.014s
I20260709 13:16:40.591150  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:40.589635  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:40.205159  9693 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:40.455483  9762 consensus_meta.cc:287] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.001s
I20260709 13:16:40.482685  9750 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:40.654021  8177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.011s	sys 0.009s
W20260709 13:16:40.205161  8182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.040s	sys 0.110s
W20260709 13:16:40.611193  8074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.004s	sys 0.011s
W20260709 13:16:40.611161  8148 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.006s	sys 0.012s
W20260709 13:16:40.402376  8101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.026s	sys 0.052s
I20260709 13:16:40.321215  9758 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.431421  9684 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:40.645990  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 770192us
W20260709 13:16:40.649221  8149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.006s	sys 0.054s
W20260709 13:16:40.650548  8787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.068s	sys 0.050s
W20260709 13:16:40.638252  8105 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.005s	sys 0.016s
I20260709 13:16:40.324663  8005 catalog_manager.cc:5697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 2 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:40.288640  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:40.652727  8252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.000s	sys 0.018s
I20260709 13:16:40.249562  9743 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.442s
W20260709 13:16:40.656783  8182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.047s	sys 0.121s
I20260709 13:16:40.427054  9709 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.652938  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:40.560258  9745 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:40.656822  8074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.005s	sys 0.011s
W20260709 13:16:40.657051  8148 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.007s	sys 0.012s
W20260709 13:16:40.655064  8100 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.000s	sys 0.013s
W20260709 13:16:40.606971  9783 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.003s	sys 0.008s
I20260709 13:16:40.248807  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:40.205557  9736 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.287639  9585 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:16:40.602519  9672 consensus_meta.cc:287] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.908s	user 0.008s	sys 0.005s
I20260709 13:16:40.671934  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:40.719027  8106 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:40.669981  8005 catalog_manager.cc:5697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 4 to 5, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 5 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:40.720679  8005 catalog_manager.cc:5697] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 2 to 3, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 3 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:40.667809  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 881392us
I20260709 13:16:40.722761  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:40.673041  8105 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.006s	sys 0.017s
I20260709 13:16:40.212481  9648 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.188707  8004 rpcz_store.cc:276] 0709 13:16:38.616880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.617319 (+   439us) service_pool.cc:224] Handling call
0709 13:16:40.180564 (+1563245us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:38.964076 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:38.964580 (+   504us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:38.964610 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:16:38.964630 (+    20us) tablet.cc:662] Decoding operations
0709 13:16:38.964919 (+   289us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:38.964961 (+    42us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:38.964987 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:38.965145 (+   158us) tablet.cc:701] Row locks acquired
0709 13:16:38.965163 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:16:38.965294 (+   131us) write_op.cc:270] Start()
0709 13:16:38.965401 (+   107us) write_op.cc:276] Timestamp: P: 1783602998965239 usec, L: 0
0709 13:16:38.965422 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:16:38.995313 (+ 29891us) log.cc:844] Serialized 541 byte log entry
0709 13:16:39.109361 (+114048us) op_driver.cc:464] REPLICATION: finished
0709 13:16:39.338333 (+228972us) write_op.cc:301] APPLY: starting
0709 13:16:39.338418 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:39.338519 (+   101us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:39.338619 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:39.338831 (+   212us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:39.338992 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:16:39.339054 (+    62us) write_op.cc:312] APPLY: finished
0709 13:16:39.339237 (+   183us) log.cc:844] Serialized 23 byte log entry
0709 13:16:39.339408 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:39.339486 (+    78us) write_op.cc:454] Released schema lock
0709 13:16:39.339526 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":757826,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":228746,"apply.run_cpu_time_us":1475,"apply.run_wall_time_us":1475,"num_ops":1,"prepare.queue_time_us":153082,"prepare.run_cpu_time_us":2584,"prepare.run_wall_time_us":31534,"replication_time_us":142173,"spinlock_wait_cycles":6912,"thread_start_us":291153,"threads_started":1}]]}
I20260709 13:16:40.612732  9766 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.647522  9789 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:40.664258  8101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.027s	sys 0.052s
I20260709 13:16:40.251557  9768 consensus_queue.cc:1059] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.420s
I20260709 13:16:40.407689  9803 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:16:40.699699  9783 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.006s	sys 0.016s
I20260709 13:16:40.671520  9754 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:40.663822  9812 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:16:40.700079  8100 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.000s	sys 0.013s
I20260709 13:16:40.664446  9750 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:40.776162  9812 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:40.776693  9750 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.727439  9672 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:40.778223  9812 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:40.744189  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:40.744367  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:40.779366  8107 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:40.779872  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:40.727216  9585 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.780289  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:40.779947  9672 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:40.780965  8107 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:40.756584  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:40.691917  9756 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:40.781494  9672 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.781908  9756 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.671437  9684 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:40.761909  8174 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:40.699929  9689 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:40.654740  9665 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.699957  8099 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:40.749615  9642 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:40.684158  9758 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.704591  9709 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.746974  9805 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:40.659449  9762 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.748039  9835 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:40.670524  9740 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:40.769779  9801 consensus_meta.cc:287] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.938s	user 0.014s	sys 0.000s
I20260709 13:16:40.769827  9803 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:40.770349  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:40.778754  9812 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:40.659871  9693 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.719089  8784 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:40.787621  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 828) took 1265 ms. Trace:
I20260709 13:16:40.769780  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:40.750062  9761 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:16:40.803879  8250 consensus_meta.cc:287] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.615s	user 0.005s	sys 0.004s
W20260709 13:16:40.813223  8179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.023s	sys 0.031s
I20260709 13:16:40.807600  8106 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:40.807862  9842 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.815030  8250 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:40.814050  8174 rpcz_store.cc:276] 0709 13:16:39.521990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.522133 (+   143us) service_pool.cc:224] Handling call
0709 13:16:39.539434 (+ 17301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:40.784523 (+1245089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.787374 (+  2851us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001c25d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:40.787545 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2810763136}
W20260709 13:16:40.808104  9711 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.007s	user 0.018s	sys 0.065s
I20260709 13:16:40.787662  9684 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:16:40.815565  8179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.023s	sys 0.031s
I20260709 13:16:40.795737  9775 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:40.664019  9802 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.786237  9665 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:40.788076  9758 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:40.788640  9648 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:41.234239  9648 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:41.234861  9648 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:41.235611  9820 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.336s	user 0.000s	sys 0.000s
I20260709 13:16:40.784029  9756 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:41.236964  9756 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:40.749827  9766 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:40.898572  9711 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.018s	sys 0.066s
I20260709 13:16:40.810451  9709 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:40.781975  9672 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.784857  9689 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:40.900462  9815 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:40.935868  8071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.000s	sys 0.012s
I20260709 13:16:40.813024  9801 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:40.816154  8753 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.006s	sys 0.035s
I20260709 13:16:40.821444  9803 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:40.940111  9831 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:16:40.898201  9812 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:40.906919  9761 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:40.783969  9696 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:41.184564  9842 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:41.023303  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 266820us
I20260709 13:16:41.106868  8183 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:41.110428  8250 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:40.811362  9835 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:40.820886  9745 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.812853  9830 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:16:40.802223  9796 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.029s	sys 0.050s
W20260709 13:16:41.200141  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 475484us
W20260709 13:16:41.206584  8148 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.013s	sys 0.012s
I20260709 13:16:41.103108  9743 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:16:41.186959  9763 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.044s	sys 0.075s
I20260709 13:16:41.184278  9684 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:16:41.276656  8005 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.001s	sys 0.031s
I20260709 13:16:41.728114  9756 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:41.715883  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 1762) took 1967 ms. Trace:
W20260709 13:16:41.878463  9822 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.536s	user 0.001s	sys 0.001s
W20260709 13:16:41.891148  9708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.674s	user 0.005s	sys 0.012s
W20260709 13:16:41.918357  8755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.257s	user 0.000s	sys 0.026s
W20260709 13:16:41.897217  8221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.247s	user 0.000s	sys 0.018s
W20260709 13:16:42.010667  8755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.349s	user 0.000s	sys 0.026s
W20260709 13:16:42.010864  8221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.361s	user 0.000s	sys 0.018s
I20260709 13:16:42.011065  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 169) took 2456 ms. Trace:
W20260709 13:16:42.011334  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 1.42173e+06us
W20260709 13:16:41.985555  8175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.322s	user 0.005s	sys 0.015s
W20260709 13:16:42.011607  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 1.52932e+06us
W20260709 13:16:42.012193  8175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.358s	user 0.005s	sys 0.015s
I20260709 13:16:42.012298  9745 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.013019  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 171) took 2336 ms. Trace:
I20260709 13:16:42.013182  9648 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:42.013594  8102 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
W20260709 13:16:41.335799  8147 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.019s	sys 0.022s
I20260709 13:16:42.006879  9693 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:42.014683  8147 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.331s	user 0.028s	sys 0.041s
I20260709 13:16:42.014797  9745 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:42.015558  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:57556 (request call id 1763) took 1850 ms. Trace:
W20260709 13:16:41.884879  9628 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.087s	user 0.045s	sys 0.108s
I20260709 13:16:41.642344  9736 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:41.636437  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 1764) took 1887 ms. Trace:
I20260709 13:16:42.016516  8104 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
W20260709 13:16:42.009011  8753 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.045s	user 0.024s	sys 0.093s
I20260709 13:16:41.638159  9762 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:41.232654  9800 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:41.229774  9775 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.743527  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 174) took 1797 ms. Trace:
W20260709 13:16:42.017776  9796 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.025s	user 0.031s	sys 0.059s
W20260709 13:16:41.679953  9737 consensus_meta.cc:287] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.723s	user 0.011s	sys 0.003s
I20260709 13:16:41.286947  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 233) took 1226 ms. Trace:
I20260709 13:16:41.651116  9802 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:41.298484  8220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.004s	sys 0.032s
I20260709 13:16:41.909618  9826 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:41.641695  9758 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:41.855651  8074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.126s	user 0.000s	sys 0.025s
W20260709 13:16:42.097533  8074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.368s	user 0.002s	sys 0.028s
I20260709 13:16:41.296960  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 830) took 1767 ms. Trace:
I20260709 13:16:42.012712  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:42.098050  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 1.36835e+06us
I20260709 13:16:42.098443  8182 rpcz_store.cc:276] 0709 13:16:39.530018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.530398 (+   380us) service_pool.cc:224] Handling call
0709 13:16:39.530680 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.587432 (+ 56752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.587461 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.587908 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:16:40.671107 (+1083199us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:40.671155 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.779762 (+108607us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b54000d75d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:40.779802 (+    40us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:41.237695 (+457893us) raft_consensus.cc:1685] finished
0709 13:16:41.237720 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.296854 (+ 59134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3402,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":25557,"spinlock_wait_cycles":129758976,"thread_start_us":1082860,"threads_started":1,"wal-append.queue_time_us":1149921}
W20260709 13:16:42.006916  8005 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.240s	user 0.031s	sys 0.037s
W20260709 13:16:42.020483  8148 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.328s	user 0.013s	sys 0.022s
I20260709 13:16:42.015666  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:42.011445  8176 rpcz_store.cc:276] 0709 13:16:39.554603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.554737 (+   134us) service_pool.cc:224] Handling call
0709 13:16:39.555023 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.555304 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.555329 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.555714 (+   385us) log.cc:844] Serialized 26 byte log entry
0709 13:16:39.845906 (+290192us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:39.845962 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.846050 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.010807 (+2164757us) raft_consensus.cc:1685] finished
0709 13:16:42.010829 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.010987 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":792,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":10570,"thread_start_us":252583,"threads_started":1,"wal-append.queue_time_us":860472}
I20260709 13:16:42.105620  8787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 486) took 2551 ms. Trace:
I20260709 13:16:42.105818  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:42.025384  8108 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:41.275454  9665 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:42.018699  8149 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:42.032730  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:42.020569  8071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.139s	user 0.000s	sys 0.024s
I20260709 13:16:42.108408  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:41.879740  9768 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.017s	sys 0.048s
W20260709 13:16:42.010191  9708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.812s	user 0.006s	sys 0.013s
I20260709 13:16:42.013516  8175 rpcz_store.cc:276] 0709 13:16:39.676480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.676623 (+   143us) service_pool.cc:224] Handling call
0709 13:16:39.676898 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:39.677097 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:40.653488 (+976391us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.012697 (+1359209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.012746 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:42.012787 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.012860 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.012967 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1072025,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1407,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":2325896,"threads_started":2}
I20260709 13:16:42.117419  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:42.008903  8252 rpcz_store.cc:276] 0709 13:16:39.748236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.751541 (+  3305us) service_pool.cc:224] Handling call
0709 13:16:39.751930 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.752338 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.752380 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.776631 (+ 24251us) log.cc:844] Serialized 26 byte log entry
0709 13:16:40.670574 (+893943us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:40.670617 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.670688 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:41.715610 (+1044922us) raft_consensus.cc:1685] finished
0709 13:16:41.715643 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.715810 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13477,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":20505,"thread_start_us":860830,"threads_started":1,"wal-append.queue_time_us":1912099}
I20260709 13:16:42.023110  8250 rpcz_store.cc:276] 0709 13:16:40.166821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.167764 (+   943us) service_pool.cc:224] Handling call
0709 13:16:42.015476 (+1847712us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:41.183993  8103 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:42.064420  8177 rpcz_store.cc:276] 0709 13:16:39.945728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.946271 (+   543us) service_pool.cc:224] Handling call
0709 13:16:39.946619 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.947005 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.947042 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.951843 (+  4801us) log.cc:844] Serialized 26 byte log entry
0709 13:16:40.654420 (+702577us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:40.654468 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.654538 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:41.743219 (+1088681us) raft_consensus.cc:1685] finished
0709 13:16:41.743250 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.743460 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6247,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":6620,"thread_start_us":702181,"threads_started":1,"wal-append.queue_time_us":1447298}
I20260709 13:16:42.024684  9646 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:42.070955  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:42.012356  9689 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:41.765661  9838 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:16:42.062363  9628 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.249s	user 0.045s	sys 0.123s
I20260709 13:16:42.015122  9693 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:42.037467  9648 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:16:42.094067  8220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.485s	user 0.017s	sys 0.057s
I20260709 13:16:42.020645  9842 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:42.020044  9766 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:42.018724  9835 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:42.022840  9740 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:42.109129  8176 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
W20260709 13:16:42.108145  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 89520.2us
I20260709 13:16:42.113466  9802 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:16:42.111160  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:42.104176  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:42.008242  9756 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:42.106117  8787 rpcz_store.cc:276] 0709 13:16:39.535561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.535825 (+   264us) service_pool.cc:224] Handling call
0709 13:16:39.536151 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.540116 (+  3965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.540146 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.556991 (+ 16845us) log.cc:844] Serialized 26 byte log entry
0709 13:16:40.668686 (+1111695us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:40.707710 (+ 39024us) log.cc:844] Serialized 14 byte log entry
0709 13:16:40.707926 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.708000 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.086306 (+1378306us) raft_consensus.cc:1685] finished
0709 13:16:42.086326 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.086485 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3540,"prepare.queue_time_us":38323,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":45,"raft.queue_time_us":109957,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":87090,"thread_start_us":1078384,"threads_started":1,"wal-append.queue_time_us":1338829}
I20260709 13:16:42.158824  8182 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
W20260709 13:16:42.120283  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 107764us
W20260709 13:16:42.121279  8103 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 796) took 2247 ms (client timeout 1977 ms). Trace:
I20260709 13:16:42.121445  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:42.122268  8174 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:42.134032  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 119599us
I20260709 13:16:42.009451  9709 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:42.123693  8106 raft_consensus.cc:2368] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3.
I20260709 13:16:42.134402  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:42.086156  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:42.108126  9826 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.161993  8099 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:42.020509  9830 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.165598  9826 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:42.158332  9840 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.570s	user 0.002s	sys 0.000s
I20260709 13:16:42.166254  9830 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:42.113181  9768 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.304s	user 0.021s	sys 0.049s
I20260709 13:16:42.073100  8100 rpcz_store.cc:276] 0709 13:16:40.060244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.067514 (+  7270us) service_pool.cc:224] Handling call
0709 13:16:40.073934 (+  6420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.074194 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:40.776298 (+702104us) log.cc:844] Serialized 14 byte log entry
0709 13:16:40.904071 (+127773us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:41.122100 (+218029us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:41.194419 (+ 72319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.210714 (+ 16295us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.253977 (+ 43263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42810,"prepare.queue_time_us":1535386,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"raft.queue_time_us":122012,"raft.run_cpu_time_us":6142,"raft.run_wall_time_us":280290,"thread_start_us":701657,"threads_started":1}
I20260709 13:16:42.168437  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:42.168443  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:42.169085  8100 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:42.109707  9758 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:42.150003  8181 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:42.025373  9684 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.151317  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:42.217926  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:42.228323  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 124245us
I20260709 13:16:42.228726  8177 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:42.152537  9838 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.157316  9766 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.137063  9665 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:16:42.230087  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 68980.3us
I20260709 13:16:42.108448  8107 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:42.161902  9849 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:42.015115  9696 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.158314  8149 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:42.168619  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:42.242733  8788 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
W20260709 13:16:42.242949  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 84721.8us
I20260709 13:16:42.169242  8175 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:42.169764  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:42.017391  9743 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:42.169898  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:42.245374  8176 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 1.
I20260709 13:16:42.121202  9859 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.170578  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 232) took 2363 ms. Trace:
I20260709 13:16:42.149390  9693 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:42.171377  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:42.069281  9736 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:42.187767  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:42.188812  8254 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:42.293004  8252 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:42.294049  8787 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:42.190088  8255 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:42.163040  8103 rpcz_store.cc:269] 0709 13:16:39.874347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.879246 (+  4899us) service_pool.cc:224] Handling call
0709 13:16:40.770191 (+890945us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b5800002798. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:16:42.121182 (+1350991us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6886272}
W20260709 13:16:42.206346  8147 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.558s (SENT) [suppressed 19 similar messages]
I20260709 13:16:42.211030  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:42.211077  8253 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.213629  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:42.214080  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:42.150125  9708 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:42.170945  9825 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:16:42.221510  7993 catalog_manager.cc:5028] TS a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): tablet c362335b215641d38dd0c651acfb8fbb (table test-workload [id=fb9774bbc47c413b899a4135e9f64c03]) successfully deleted
I20260709 13:16:42.155261  9648 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.232810  9803 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:42.071714  9775 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:42.086567  9737 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:42.229512  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:42.156914  9842 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:42.186184  9756 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:42.163166  9740 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.241006  8174 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:16:42.302492  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 132772us
I20260709 13:16:42.211994  9835 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:42.307322  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:42.588905  8252 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:16:42.310417  8248 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:42.310433  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:42.247349  8105 rpcz_store.cc:276] 0709 13:16:39.806760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.807203 (+   443us) service_pool.cc:224] Handling call
0709 13:16:39.807581 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.833452 (+ 25871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.833482 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.836219 (+  2737us) log.cc:844] Serialized 26 byte log entry
0709 13:16:39.963617 (+127398us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b1800356e00. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:16:40.725354 (+761737us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:40.725440 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.725535 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.170288 (+1444753us) raft_consensus.cc:1685] finished
0709 13:16:42.170305 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.170496 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25472,"raft.queue_time_us":53173,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9204,"spinlock_wait_cycles":3354496,"thread_start_us":761519,"threads_started":1,"wal-append.queue_time_us":1344841}
I20260709 13:16:42.317937  8257 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 2: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:16:42.310127  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 70773.6us
W20260709 13:16:42.322784  7993 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 101290us
I20260709 13:16:42.186548  9709 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.590423  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:42.229689  9828 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:42.363492  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 229151us
I20260709 13:16:42.591138  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:42.370484  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.372278  8175 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:42.603070  8257 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:42.228824  8256 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:42.478667  8254 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:42.303058  9826 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:42.534009  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 304576us
W20260709 13:16:42.566318  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 360022us
I20260709 13:16:42.318791  9853 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.587819  9844 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:42.308082  9745 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:42.237476  9711 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:42.247416  9855 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.336s
I20260709 13:16:42.593753  8105 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:42.247169  9766 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:42.591784  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:42.640655  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 170) took 2965 ms. Trace:
I20260709 13:16:42.643486  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:42.644325  8252 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:42.593040  8221 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:42.486198  9801 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:42.487160  9708 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:42.601727  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:42.607309  8106 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:42.605249  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:42.664950  8254 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:42.523051  9867 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:42.617923  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:42.318126  9736 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.308511  9665 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.579604  9796 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.477698  9845 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:42.632316  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:42.702576  8256 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:16:42.581077  9830 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:42.040315  8249 rpcz_store.cc:276] 0709 13:16:39.748969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.781787 (+ 32818us) service_pool.cc:224] Handling call
0709 13:16:39.802975 (+ 21188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.818078 (+ 15103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.818132 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.818807 (+   675us) log.cc:844] Serialized 26 byte log entry
0709 13:16:40.335147 (+516340us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:40.338264 (+  3117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.372007 (+ 33743us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:41.636114 (+1264107us) raft_consensus.cc:1685] finished
0709 13:16:41.636148 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.636331 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2648,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":6781,"thread_start_us":467820,"threads_started":1,"wal-append.queue_time_us":1485736}
I20260709 13:16:42.642139  8178 rpcz_store.cc:276] 0709 13:16:39.675180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.675431 (+   251us) service_pool.cc:224] Handling call
0709 13:16:39.682725 (+  7294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.692004 (+  9279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.692046 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.692581 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:16:40.217008 (+524427us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:40.217052 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.217118 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.640386 (+2423268us) raft_consensus.cc:1685] finished
0709 13:16:42.640415 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.640591 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3075,"raft.queue_time_us":15653,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":4943,"spinlock_wait_cycles":1727232,"thread_start_us":492356,"threads_started":1,"wal-append.queue_time_us":2150502}
W20260709 13:16:42.648698  9857 log.cc:927] Time spent T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.497s	user 0.000s	sys 0.001s
I20260709 13:16:42.648880  9838 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:42.649194  9766 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:42.589622  9847 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:42.651213  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:42.646196  9628 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:16:42.721403  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 118191us
I20260709 13:16:42.676534  9709 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:42.306687  9859 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:42.617949  9844 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.707746  9862 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.610976  9812 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:42.580221  9842 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.687536  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:42.744480  8254 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:42.721815  9838 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:42.690212  8255 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:42.631383  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:42.604995  9835 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:42.642175  9852 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:42.593190  9740 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.704722  9867 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.635298  9836 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:42.646337  9711 raft_consensus.cc:697] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:42.645936  9815 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:42.718137  8252 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
W20260709 13:16:42.675470  8102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 800) took 1907 ms (client timeout 1580 ms). Trace:
W20260709 13:16:42.676020  9833 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.443s	user 0.000s	sys 0.000s
I20260709 13:16:42.682138  9689 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.722365  8223 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:42.725610  9868 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:42.624255  9826 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:42.707890  9801 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:42.639328  9745 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.733085  9866 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:42.623260  9828 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:42.715358  9762 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:42.688052  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:42.634369  9853 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:42.852506  9858 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:42.853207  9858 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.751715  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:42.731081  9844 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:42.756184  9838 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.758214  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:42.759269  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:42.925118  9756 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:42.926115  9838 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:42.927603  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 173) took 3093 ms. Trace:
W20260709 13:16:42.761668  9856 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:16:42.762353  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:16:42.765317  9846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.001s	sys 0.013s
I20260709 13:16:42.714834  9830 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:42.770982  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:42.780890  9815 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.774474  9737 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:42.775368  9693 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:42.742177  9709 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:42.777230  8102 rpcz_store.cc:269] 0709 13:16:40.744634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.746805 (+  2171us) service_pool.cc:224] Handling call
0709 13:16:42.651968 (+1905163us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000fb4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:42.652098 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2756807040}
I20260709 13:16:42.745770  9862 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:42.782224  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 59950.1us
I20260709 13:16:42.931360  8786 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:42.726712  9628 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:42.754832  9743 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:42.711297  9845 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.772589  9836 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.754912  9852 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:42.773226  9684 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:42.769730  8103 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:42.846035  8257 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:42.979743  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:42.777410  9696 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:42.849872  9762 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.756453  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:42.789108  9826 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:42.787364  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:42.926273  9736 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:42.759502  9783 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:42.776176  9708 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:42.798102  9648 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:42.708693  9796 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:42.928071  8179 rpcz_store.cc:276] 0709 13:16:39.833782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.851249 (+ 17467us) service_pool.cc:224] Handling call
0709 13:16:39.852119 (+   870us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.852531 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.852556 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.862212 (+  9656us) log.cc:844] Serialized 26 byte log entry
0709 13:16:41.106395 (+1244183us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:41.106436 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.106509 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.927395 (+1820886us) raft_consensus.cc:1685] finished
0709 13:16:42.927418 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.927551 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":17055,"thread_start_us":1015491,"threads_started":1,"wal-append.queue_time_us":2259846}
I20260709 13:16:42.788786  9689 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.927016  9827 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:42.949774  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:16:42.785815  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 174904us
I20260709 13:16:42.949872  8788 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:16:42.949447  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:43.018074  9796 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:43.021873  8782 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:42.813364  9801 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.980389  9852 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:42.965080  8251 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.009s	sys 0.004s
I20260709 13:16:42.953881  9775 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:42.958467  9846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.001s	sys 0.014s
I20260709 13:16:42.846635  9868 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:42.970027  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 388918us
I20260709 13:16:42.949169  9871 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:16:42.972146  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 379686us
I20260709 13:16:43.120039  8105 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:43.120654  8221 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:43.121335  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:43.122259  8221 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:43.026952  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:42.965245  9850 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:16:42.975524  8223 leader_election.cc:400] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3.
I20260709 13:16:42.958989  9882 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:42.965936  9737 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:42.997653  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:42.929198  9866 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:43.024091  8147 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:43.022454  9628 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:42.989910  9881 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:42.970953  9711 consensus_queue.cc:237] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:42.966490  9709 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:43.021240  9830 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:42.991904  9665 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:42.995216  9865 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:42.995428  9783 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:42.981465  9836 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:43.113232  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 97129.4us
W20260709 13:16:43.114984  8251 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.010s	sys 0.004s
W20260709 13:16:43.080274  9875 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 13:16:43.024947  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:43.119694  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:43.142938  9648 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:43.128423  8223 leader_election.cc:403] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:16:43.128170  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:43.167857  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:43.080737  9867 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:43.078743  9842 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:43.139771  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 115777us
I20260709 13:16:43.116323  9835 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:43.149772  9860 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:43.150985  9868 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:43.174212  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:43.174722  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 55111.5us
I20260709 13:16:43.174907  8105 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:43.175593  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:43.127528  9708 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:43.158056  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:43.163719  9866 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:43.126072  9877 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.142946  9881 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.139676  9736 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:43.169489  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:43.151942  9740 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:43.185699  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.153847  9745 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:43.192514  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:43.193185  8256 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.191045  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:43.170784  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 207548us
I20260709 13:16:43.128607  9871 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:43.172722  8149 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:43.176266  8105 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:43.195271  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:43.117574  9827 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:43.178967  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.194526  8223 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:43.166468  9648 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:43.182005  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.205753  8223 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:43.184352  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.181739  8072 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:43.206939  8252 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:43.186947  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.207768  8254 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:43.187337  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.208655  8255 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:43.151885  9737 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:43.194181  8179 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:43.202253  8257 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:43.179687  9878 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:43.200969  9783 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:43.174664  9665 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.210434  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:43.160135  9891 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:16:43.178136  9828 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:43.165627  9865 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:43.204093  9877 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:43.207274  8072 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:43.185571  9775 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:43.204393  9696 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:43.394163  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 197) took 1180 ms. Trace:
I20260709 13:16:43.384130  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 807) took 1313 ms. Trace:
W20260709 13:16:43.588443  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 393249us
I20260709 13:16:43.218765  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:16:43.619091  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 408706us
I20260709 13:16:43.619095  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.624233  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:43.201949  9835 raft_consensus.cc:2764] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:43.630151  8102 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:43.328354  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:43.622996  8106 rpcz_store.cc:276] 0709 13:16:42.070728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.233540 (+162812us) service_pool.cc:224] Handling call
0709 13:16:43.383908 (+1150368us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b5400211bd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:43.384054 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40005888}
I20260709 13:16:43.624557  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:43.202147  9864 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:16:43.622987  8251 rpcz_store.cc:276] 0709 13:16:42.213413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.213562 (+   149us) service_pool.cc:224] Handling call
0709 13:16:42.213849 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.214056 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:43.161144 (+947088us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.393687 (+232543us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.393762 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:43.393823 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.393922 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.394087 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":813343,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":2796,"raft.queue_time_us":9543,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":167469,"thread_start_us":1160342,"threads_started":2}
I20260709 13:16:43.636463  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:43.637337  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 430127us
I20260709 13:16:43.243294  9684 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:43.633652  8257 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:43.642117  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.634042  8174 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:43.631652  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1713) took 1312 ms. Trace:
I20260709 13:16:43.184885  9881 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.205106  9838 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:43.625674  8256 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:43.384152  9801 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:43.201004  9815 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:43.211098  9648 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.638600  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:43.626648  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:43.218397  9745 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:43.243472  9740 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:43.654264  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:43.635111  9866 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:43.642942  8102 rpcz_store.cc:276] 0709 13:16:42.319205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.193762 (+874557us) service_pool.cc:224] Handling call
0709 13:16:43.629684 (+435922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.631271 (+  1587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.631573 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.645826  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.646497  9585 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:43.272080  9762 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:43.353370  9736 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:43.638098  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.285880  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:43.320870  9858 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:43.353283  9756 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:43.649263  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.576805  9862 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:43.654928  9863 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:43.630421  9708 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:43.663193  9696 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:43.663754  9866 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.635358  9878 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:43.242149  9889 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:43.202961  9860 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:43.653149  8223 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:43.662078  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:43.711006  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 57955.7us
I20260709 13:16:43.711087  8174 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:43.635134  9775 raft_consensus.cc:697] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:43.656461  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:43.640821  9684 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.674714  9899 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:43.334611  9689 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:43.652441  9892 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:43.671598  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:43.650808  9709 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:43.677906  8256 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:43.648501  9838 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:43.678838  8251 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 2: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:43.660992  9783 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.739231  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.327739  9871 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:43.663400  9868 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:43.664667  9740 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.654191  9830 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.654340  9745 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:43.673314  9836 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.504s	user 0.003s	sys 0.003s
I20260709 13:16:43.374635  9743 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:43.708204  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:43.679922  9756 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:43.574502  9883 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:16:43.718575  8223 connection.cc:256] RPC call timeout handler was delayed by -2.2455053740000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 13:16:43.786514  8223 connection.cc:256] RPC call timeout handler was delayed by -2.1896718519999467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260709 13:16:43.674860  9865 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:43.720765  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:43.724552  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:43.706862  9708 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:43.725575  9897 log.cc:927] Time spent T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:16:43.726423  9877 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:43.710475  9889 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:16:43.727246  9882 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.585s	user 0.006s	sys 0.002s
I20260709 13:16:43.727294  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.727701  9737 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:43.727536  9775 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:43.728360  9891 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:43.729527  9665 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3.
I20260709 13:16:43.730068  9860 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:43.706789  9585 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:43.731290  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:43.732115  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:43.734301  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:43.674800  8249 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:43.737756  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.811245  8176 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:43.708319  9866 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:43.652168  9818 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:43.740168  8256 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:43.720070  9684 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:43.721334  9879 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:43.763156  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 175159us
I20260709 13:16:43.719769  9858 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:43.833459  9756 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:43.721619  9899 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.834318  9899 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.834590  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:43.835546  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:43.836820  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:43.778137  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:43.837682  8177 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.837925  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:43.838523  8099 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:43.778702  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:43.787213  8074 connection.cc:256] RPC call timeout handler was delayed by -2.0224935660000938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 13:16:43.839850  8074 connection.cc:256] RPC call timeout handler was delayed by -1.5634935660000338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
I20260709 13:16:43.840133  8181 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:43.701936  9736 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:43.739204  9838 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:43.767705  9903 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:16:43.708479  9863 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:43.761636  9868 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.802071  9709 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:43.787698  9836 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:43.796368  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:43.881022  8178 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
W20260709 13:16:43.799008  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 144813us
I20260709 13:16:43.886041  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:16:43.799162  8223 connection.cc:256] RPC call timeout handler was delayed by -1.5252797779999128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 13:16:43.887522  8223 connection.cc:256] RPC call timeout handler was delayed by -1.4108191199998146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 13:16:43.887967  8223 connection.cc:256] RPC call timeout handler was delayed by -1.3393762590001188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 13:16:43.888327  8223 connection.cc:256] RPC call timeout handler was delayed by -1.1190964089998943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2681s for a response
W20260709 13:16:43.888697  8223 connection.cc:256] RPC call timeout handler was delayed by -1.0630762590001268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
I20260709 13:16:43.768633  9745 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.765828  9827 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:43.803668  9898 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:16:43.807503  9878 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:43.809841  9891 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:43.821373  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.822275  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:43.796958  9708 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:43.828330  9585 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:43.825271  8253 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:43.829188  9879 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.831635  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:43.802330  9889 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:43.920480  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 64989.7us
I20260709 13:16:43.853060  9758 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:43.855337  9799 raft_consensus.cc:993] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
W20260709 13:16:43.855548  8786 consensus_meta.cc:287] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.886s	user 0.008s	sys 0.002s
I20260709 13:16:43.771381  9830 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:43.926654  9585 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:43.927050  9830 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:43.866799  8177 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:43.928078  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:43.843101  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:43.930790  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:43.931960  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:43.933007  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:43.871636  9832 log.cc:927] Time spent T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 2.276s	user 0.028s	sys 0.017s
I20260709 13:16:43.872471  9761 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:43.818380  9882 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:43.790128  9743 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:43.934587  9818 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:43.935065  9818 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.818732  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:43.764750  9740 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:43.879778  9863 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:43.735102  9892 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.899387  9665 consensus_queue.cc:1059] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:43.902108  9689 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:43.902336  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:43.904426  9709 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:43.906262  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:43.952659  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 46471.4us
I20260709 13:16:43.793532  9883 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:43.917749  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:43.918936  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:43.937529  9906 raft_consensus.cc:1081] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:43.918227  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:43.960065  8107 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 2: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:43.833545  9858 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:43.921140  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 89589us
I20260709 13:16:43.960950  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:43.961710  8251 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:43.917104  9826 consensus_meta.cc:287] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.922s	user 0.012s	sys 0.000s
I20260709 13:16:43.924846  8256 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
W20260709 13:16:43.920440  9844 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.991s	user 0.011s	sys 0.000s
I20260709 13:16:43.938913  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:44.016326  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 61922us
I20260709 13:16:43.941668  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:43.943125  8104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 803) took 3187 ms (client timeout 2109 ms). Trace:
I20260709 13:16:43.923282  9879 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.924369  9754 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:43.905879  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:43.940027  9859 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:43.955021  8182 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:44.034657  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:43.955570  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 80593.8us
I20260709 13:16:43.926992  9899 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:44.014688  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:44.022055  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 80476.2us
W20260709 13:16:44.021705  8104 rpcz_store.cc:269] 0709 13:16:40.756137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.779631 (+ 23494us) service_pool.cc:224] Handling call
0709 13:16:43.942956 (+3163325us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400226ad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:43.943063 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2842469248}
W20260709 13:16:44.016377  9909 log.cc:927] Time spent T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:16:44.017848  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:44.027697  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 121887us
I20260709 13:16:43.880119  9868 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:43.947081  9892 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.037500  8107 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:44.081058  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:44.081688  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.082290  8107 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:44.067941  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:44.068465  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 50710.3us
I20260709 13:16:43.949695  9672 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:43.956184  9743 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:44.084226  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:44.034171  9863 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:44.027472  8786 raft_consensus.cc:2410] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:44.027629  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 231) took 4304 ms. Trace:
I20260709 13:16:44.028107  9844 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:44.014943  9689 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:44.076319  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.079246  9859 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:44.034127  9754 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.091892  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:44.156610  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 71749.1us
I20260709 13:16:44.158016  8149 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:44.033766  9878 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:16:44.087040  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:44.018658  9758 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:44.095511  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.026665  9826 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:44.100152  8176 raft_consensus.cc:2368] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3.
W20260709 13:16:44.106088  9910 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:16:44.106575  9845 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:44.018877  9642 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:16:44.019254  9862 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:16:44.154168  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.187855  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.188236  9684 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:44.188958  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.189522  8250 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:44.189878  9882 raft_consensus.cc:3055] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:44.168391  9859 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:44.192015  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:44.192317  9859 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.192646  8174 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:44.193339  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.028314  9881 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:44.168041  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 82596.6us
I20260709 13:16:44.198714  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:44.199738  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:44.201805  9761 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:44.201920  9879 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:44.169473  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.095645  9877 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:44.203110  9877 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.203518  9877 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.203687  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:44.204294  8104 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:44.204604  8104 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:44.036211  9756 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:44.205397  8104 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:44.205888  9756 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:44.206259  9756 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.206496  8104 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:44.206590  9756 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.166992  9758 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.084954  9696 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.107779  9775 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:44.172854  9799 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:44.109229  9863 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:44.194247  8257 raft_consensus.cc:2368] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4.
I20260709 13:16:44.190236  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.194514  8251 raft_consensus.cc:2410] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:44.195348  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 207483us
I20260709 13:16:44.166675  9754 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.149873  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.202309  9761 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:16:44.209597  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.082973  9907 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:44.095780  9762 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:44.210531  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:44.096758  9745 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:44.176947  8786 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48110 (request call id 510) took 1412 ms (client timeout 1858 ms). Trace:
I20260709 13:16:44.193820  9736 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:44.248792  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 1771) took 1058 ms. Trace:
I20260709 13:16:44.247968  8250 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:16:44.260281  8251 rpcz_store.cc:276] 0709 13:16:43.188999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.960635 (+771636us) service_pool.cc:224] Handling call
0709 13:16:44.247547 (+286912us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:44.217307  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 118829us
I20260709 13:16:44.190276  9882 raft_consensus.cc:740] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:44.254814  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1705) took 4488 ms. Trace:
I20260709 13:16:44.216746  9775 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.192731  9891 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:44.192047  9708 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:44.244673  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 86808.8us
I20260709 13:16:44.192049  9689 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:44.216257  9696 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:44.264390  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.362589  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:44.363401  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.364264  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:44.364609  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.364907  8182 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:44.366160  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:44.366523  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.367238  8254 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:44.347668  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.368053  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.368227  9859 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:44.368800  8254 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:44.369377  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.369890  9899 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:44.370219  8784 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:44.370834  9853 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:44.371167  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.371817  8784 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:44.372741  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.357959  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.266599  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.314689  8106 raft_consensus.cc:2368] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3.
I20260709 13:16:44.374125  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:44.333452  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.331022  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.376950  8251 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:44.256409  9863 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.256666  8249 raft_consensus.cc:2368] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5.
I20260709 13:16:44.251330  9761 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:44.350411  8104 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:44.374176  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.212148  9836 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:44.215301  9758 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:44.251859  9799 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:44.261701  8108 rpcz_store.cc:276] 0709 13:16:39.766283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.768045 (+  1762us) service_pool.cc:224] Handling call
0709 13:16:39.792861 (+ 24816us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.107573 (+2314712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.254571 (+2146998us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b54003a4b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:44.254757 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5133704448}
W20260709 13:16:44.335476  9803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.624s	user 0.030s	sys 0.038s
I20260709 13:16:44.293574  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.214341  9906 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:44.321592  9684 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:44.374349  8788 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:44.365276  8103 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
W20260709 13:16:44.384215  9866 consensus_meta.cc:287] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.549s	user 0.007s	sys 0.002s
I20260709 13:16:44.348278  9916 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.390385  9709 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:44.390460  9859 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:44.391306  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.331108  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:44.320047  8099 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 5: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:44.322858  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.276221  9775 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:44.252535  9865 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:44.394096  9708 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:44.257532  9907 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:44.382129  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:44.395439  9844 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:44.366523  9745 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:44.395902  9783 consensus_meta.cc:287] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.632s	user 0.002s	sys 0.007s
I20260709 13:16:44.398401  9879 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:44.400568  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:16:44.256963  8786 rpcz_store.cc:269] 0709 13:16:42.756384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.757963 (+  1579us) service_pool.cc:224] Handling call
0709 13:16:44.168506 (+1410543us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.400779  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.401604  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.406013  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 172) took 4607 ms. Trace:
I20260709 13:16:44.406144  9826 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:44.389123  9883 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:44.374903  9852 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.265s	user 0.013s	sys 0.000s
W20260709 13:16:44.407889  9838 consensus_meta.cc:287] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
W20260709 13:16:44.408782  9648 consensus_meta.cc:287] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.000s
I20260709 13:16:44.409241  9646 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:44.409896  9868 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:44.410852  9756 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:44.411743  9912 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.238s	user 0.002s	sys 0.000s
I20260709 13:16:44.408361  8004 catalog_manager.cc:5697] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:44.411629  9889 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:44.417201  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.257185  9762 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:44.385990  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:44.373378  8784 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
W20260709 13:16:44.415877  9803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.708s	user 0.036s	sys 0.040s
I20260709 13:16:44.637260  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:44.650285  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 390495us
I20260709 13:16:44.518846  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:44.458439  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.471170  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.651971  8791 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:44.652156  8250 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:16:44.619658  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.653038  8254 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:16:44.657091  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.653069  8788 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:44.659986  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.653329  8183 rpcz_store.cc:276] 0709 13:16:39.799019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.801299 (+  2280us) service_pool.cc:224] Handling call
0709 13:16:39.801673 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.009719 (+2208046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.405656 (+2395937us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400248bd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:44.405903 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2538305792}
I20260709 13:16:44.444651  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.636202  9750 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:44.661525  9838 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:44.686462  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:44.687048  8175 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:44.687168  9838 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:44.687964  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:44.419528  9906 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.663674  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.698108  8248 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 4: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:16:44.512347  9740 consensus_meta.cc:287] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.001s
I20260709 13:16:44.415766  9799 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:44.609879  9818 consensus_meta.cc:287] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.674s	user 0.000s	sys 0.012s
W20260709 13:16:44.632975  9892 consensus_meta.cc:287] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.000s
I20260709 13:16:44.696583  8175 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:44.716693  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.728932  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.703649  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:44.729410  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.578054  9804 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:44.719044  8174 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:44.730181  8108 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:44.721201  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.619536  9871 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:44.659127  9762 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:44.727535  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.698406  8252 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:44.740918  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.741693  8252 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:44.729796  8183 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:44.691082  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.743702  8102 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:44.659263  9646 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:44.746997  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:44.720531  9906 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:44.737596  8175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 1766) took 1469 ms (client timeout 1900 ms). Trace:
I20260709 13:16:44.509127  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.755537  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:44.750247  8175 rpcz_store.cc:269] 0709 13:16:43.259535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.259664 (+   129us) service_pool.cc:224] Handling call
0709 13:16:44.686309 (+1426645us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b58000d7d98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:16:44.728977 (+ 42668us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12930944}
I20260709 13:16:44.516878  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.680569  8785 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:44.746932  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:44.760371  8791 raft_consensus.cc:2410] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:44.727087  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:44.748201  8107 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:44.662370  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:44.428479  9866 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:44.697702  9844 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:44.720750  9828 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:44.662736  9865 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:44.728360  9740 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:44.738183  9892 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:44.783344  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 508) took 2014 ms. Trace:
I20260709 13:16:44.626859  9754 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:44.725543  9879 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:44.751487  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.753170  9921 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:44.746628  8180 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 3: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:44.763875  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.763998  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:44.799943  8251 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:44.764241  8108 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:44.761852  8147 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:44.764477  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 246) took 1044 ms. Trace:
I20260709 13:16:44.764354  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:44.765242  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:44.661746  9852 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:44.443687  9916 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:44.768402  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:44.748621  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.754406  9886 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.636132  9882 consensus_queue.cc:260] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:44.784639  8253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 1772) took 1581 ms (client timeout 1900 ms). Trace:
I20260709 13:16:44.785616  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 240) took 1132 ms. Trace:
I20260709 13:16:44.786181  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:44.786471  8248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 1775) took 1579 ms (client timeout 2066 ms). Trace:
I20260709 13:16:44.783768  8789 rpcz_store.cc:276] 0709 13:16:42.755855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.755993 (+   138us) service_pool.cc:224] Handling call
0709 13:16:42.756253 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.986398 (+230145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.986441 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.986499 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:42.986541 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.769718 (+1783177us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b540039d0d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:44.769778 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.769918 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528686848}
I20260709 13:16:44.787690  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:44.749681  9696 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:44.148412  8101 rpcz_store.cc:276] 0709 13:16:39.711817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.712679 (+   862us) service_pool.cc:224] Handling call
0709 13:16:39.770004 (+ 57325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:40.757591 (+987587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:40.790734 (+ 33143us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:43.357827 (+2567093us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b2c000014c8. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:16:43.358469 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 13:16:43.635716 (+277247us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:43.637936 (+  2220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.648279 (+ 10343us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.940872 (+292593us) raft_consensus.cc:1685] finished
0709 13:16:43.940890 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.957566 (+ 16676us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14479,"raft.queue_time_us":53017,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":12319,"spinlock_wait_cycles":5549440,"thread_start_us":1181142,"threads_started":2,"wal-append.queue_time_us":294936}
I20260709 13:16:44.782488  9804 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:44.662392  9648 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:44.861279  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.861779  8179 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:44.793721  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 1782) took 1155 ms. Trace:
I20260709 13:16:44.802345  8102 rpcz_store.cc:276] 0709 13:16:43.719783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.744558 (+1024775us) service_pool.cc:224] Handling call
0709 13:16:44.764015 (+ 19457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.764175 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.764198 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.764238 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:44.764266 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.764312 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.764424 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.806440  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:44.863644  8183 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:44.769495  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:44.807355  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:44.808002  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.866010  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.767997  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.808545  8105 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:44.810670  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:44.769778  9828 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:44.812091  8790 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:44.733058  9818 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:44.767483  8100 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:44.824429  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:44.879443  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 55133us
W20260709 13:16:44.814929  8253 rpcz_store.cc:269] 0709 13:16:43.190461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.218429 (+ 27968us) service_pool.cc:224] Handling call
0709 13:16:44.771224 (+1552795us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54001e5854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:44.771345 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430097664}
I20260709 13:16:44.848493  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.849259  8252 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.854797  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 1779) took 1594 ms. Trace:
I20260709 13:16:44.880962  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:16:44.852942  8248 rpcz_store.cc:269] 0709 13:16:43.206991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.727053 (+520062us) service_pool.cc:224] Handling call
0709 13:16:44.786286 (+1059233us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b54002af3d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:44.786420 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2061442816}
I20260709 13:16:44.881526  8253 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.882171  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.882725  8248 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:44.883463  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:44.853590  8106 rpcz_store.cc:276] 0709 13:16:43.653085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.654373 (+  1288us) service_pool.cc:224] Handling call
0709 13:16:44.785345 (+1130972us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b540030e3d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:44.785540 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1359597824}
I20260709 13:16:44.867650  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.781061  9844 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:44.805908  9750 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:44.815550  9585 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:16:44.862571  8257 rpcz_store.cc:276] 0709 13:16:43.638288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.641414 (+  3126us) service_pool.cc:224] Handling call
0709 13:16:44.787456 (+1146042us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b5400092ed4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:44.793639 (+  6183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268240128}
I20260709 13:16:44.911378  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.912360  8257 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:44.815608  9830 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:44.871758  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 61173.3us
I20260709 13:16:44.916906  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:44.872717  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 65458.4us
I20260709 13:16:44.799580  9879 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:44.869642  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:44.860487  9768 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.885339  9853 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:44.874485  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 248) took 1146 ms. Trace:
I20260709 13:16:44.875620  8784 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:44.927017  9853 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:44.926672  9768 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:44.927436  9853 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:44.876012  9828 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:44.927836  9853 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.876470  9740 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:44.884413  8788 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:44.884995  8248 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:44.809409  9826 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:44.892710  8253 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:44.893677  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 250) took 1164 ms. Trace:
I20260709 13:16:44.894063  9754 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:44.902597  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:44.903061  9648 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:44.860991  9804 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.843477  8786 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:44.905979  9756 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:44.906775  9923 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:16:44.881244  8255 rpcz_store.cc:276] 0709 13:16:43.260784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.785916 (+1525132us) service_pool.cc:224] Handling call
0709 13:16:44.854714 (+ 68798us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.913581  8252 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:44.927866  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:44.918718  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:44.965554  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 46903us
I20260709 13:16:44.966377  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:44.808478  9863 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:44.884899  9877 consensus_meta.cc:287] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.681s	user 0.012s	sys 0.001s
I20260709 13:16:44.926002  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:44.926324  9892 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:44.874719  9907 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:44.928637  8789 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:44.931902  8250 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.940059  8248 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:44.957270  9804 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.898527  9928 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:44.947232  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 1769) took 1759 ms. Trace:
I20260709 13:16:44.984026  8253 rpcz_store.cc:276] 0709 13:16:43.188207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.946440 (+1758233us) service_pool.cc:224] Handling call
0709 13:16:44.946743 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.946919 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.946946 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.946991 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:44.947018 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.947070 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.947179 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.911192  9708 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:44.806243  9921 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:44.843672  9886 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:44.962939  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 1770) took 1774 ms. Trace:
I20260709 13:16:44.963017  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 1773) took 1771 ms. Trace:
I20260709 13:16:44.915166  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:44.988720  8257 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:44.988916  8248 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:44.926783  8099 rpcz_store.cc:276] 0709 13:16:43.728317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.738095 (+1009778us) service_pool.cc:224] Handling call
0709 13:16:44.874417 (+136322us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.987917  8255 rpcz_store.cc:276] 0709 13:16:43.188623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.962221 (+1773598us) service_pool.cc:224] Handling call
0709 13:16:44.962498 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.962655 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.962675 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.962713 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:44.962740 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.962801 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.962890 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.969633  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:44.988183  8252 rpcz_store.cc:276] 0709 13:16:43.191193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.962432 (+1771239us) service_pool.cc:224] Handling call
0709 13:16:44.962639 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.962770 (+   131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.962791 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.962823 (+    32us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:44.962847 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.962890 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.962969 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.991638  8253 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:44.978260  8074 leader_election.cc:400] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4.
I20260709 13:16:44.950817  9889 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:44.992440  8074 leader_election.cc:403] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:44.943377  8100 rpcz_store.cc:276] 0709 13:16:43.728912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.508769 (+779857us) service_pool.cc:224] Handling call
0709 13:16:44.893579 (+384810us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:45.002154  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 620085us
I20260709 13:16:45.010828  8248 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:45.011785  8248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57556
I20260709 13:16:44.971206  9868 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:45.012326  8248 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:45.013378  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:44.974601  9883 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:44.974907  9745 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.972388  9916 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:45.014998  8253 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:45.031387  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:45.016593  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:45.017666  8248 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.023602  8104 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:44.985064  9928 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:44.985864  9768 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:45.039901  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:45.043125  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:16:45.041492  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 116295us
I20260709 13:16:45.044072  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:45.045085  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:44.979959  9877 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.030603  8785 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 2: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:45.047117  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:45.029044  9758 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.000s
I20260709 13:16:45.019431  9892 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.016460  9907 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:45.023587  9929 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:45.021227  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:45.059566  9646 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.049731  9826 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:45.042029  9928 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.049595  9689 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:45.068184  8787 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:45.048436  9648 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:45.081094  8250 raft_consensus.cc:2410] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:45.050367  9696 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:45.072945  9852 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:45.086513  9927 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:16:45.089861  9756 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:45.091207  8102 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:16:45.089210  9761 consensus_meta.cc:287] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.669s	user 0.004s	sys 0.004s
I20260709 13:16:45.044219  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:45.083719  8248 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.103049  8108 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:45.111815  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 812) took 1389 ms. Trace:
I20260709 13:16:45.068146  9907 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:45.091812  9826 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:16:45.178418  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 134303us
I20260709 13:16:45.102085  9689 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.179198  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 811) took 1461 ms. Trace:
I20260709 13:16:45.065047  9758 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:45.181130  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 160429us
W20260709 13:16:45.112382  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 65326.4us
I20260709 13:16:45.068717  9865 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:45.185281  8108 rpcz_store.cc:276] 0709 13:16:43.718148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.738879 (+1020731us) service_pool.cc:224] Handling call
0709 13:16:44.764141 (+ 25262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:45.178936 (+414795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.179125 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:45.189400  8149 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:45.189951  8248 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:45.190634  8755 leader_election.cc:400] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3.
I20260709 13:16:45.192662  8755 leader_election.cc:403] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:45.102589  9929 raft_consensus.cc:697] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:45.193221  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:45.240829  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 47682.1us
I20260709 13:16:45.108319  8782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 322) took 4858 ms. Trace:
I20260709 13:16:45.198173  9758 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:45.185078  8107 rpcz_store.cc:276] 0709 13:16:43.722471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.761902 (+1039431us) service_pool.cc:224] Handling call
0709 13:16:44.790304 (+ 28402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.790560 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:44.947298 (+156738us) log.cc:844] Serialized 14 byte log entry
0709 13:16:45.111359 (+164061us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:45.111435 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:45.111486 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.111573 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.111735 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":194592,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":44,"raft.queue_time_us":87244,"raft.run_wall_time_us":14241,"spinlock_wait_cycles":13186432,"thread_start_us":279645,"threads_started":3,"wal-append.queue_time_us":223008}
I20260709 13:16:45.198773  9937 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.102751  8786 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:45.180444  9761 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.180246  9756 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:45.209882  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:45.185595  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 823) took 1282 ms. Trace:
I20260709 13:16:45.210219  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:45.264569  8102 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:16:45.211041  9932 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:16:45.213215  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 829) took 1189 ms. Trace:
I20260709 13:16:45.265303  8104 rpcz_store.cc:276] 0709 13:16:44.024188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.731189 (+707001us) service_pool.cc:224] Handling call
0709 13:16:45.213025 (+481836us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54001b9754. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:45.213148 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609022848}
I20260709 13:16:45.216584  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 1780) took 1594 ms. Trace:
I20260709 13:16:45.266573  8250 rpcz_store.cc:276] 0709 13:16:43.621868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.720965 (+1099097us) service_pool.cc:224] Handling call
0709 13:16:45.216345 (+495380us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54001e6c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:45.216518 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423635712}
W20260709 13:16:45.218000  8176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 846) took 1439 ms (client timeout 1754 ms). Trace:
W20260709 13:16:45.267915  8176 rpcz_store.cc:269] 0709 13:16:43.778673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.917479 (+138806us) service_pool.cc:224] Handling call
0709 13:16:45.217789 (+1300310us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54000d7fd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:45.217936 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333515648}
I20260709 13:16:45.222280  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.192631  9879 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:45.224448  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:45.225620  9921 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:45.229003  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:45.230999  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:16:45.232128  8105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 244) took 1554 ms (client timeout 1613 ms). Trace:
I20260709 13:16:45.291607  8788 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
W20260709 13:16:45.292596  8105 rpcz_store.cc:269] 0709 13:16:43.677902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.720444 (+ 42542us) service_pool.cc:224] Handling call
0709 13:16:45.231914 (+1511470us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540036ddd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:45.232061 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2339688320}
I20260709 13:16:45.234233  9646 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:45.100354  9696 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:45.244175  8149 connection.cc:256] RPC call timeout handler was delayed by -1.0756835890001639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
W20260709 13:16:45.297084  8149 connection.cc:256] RPC call timeout handler was delayed by -1.0333835890000955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260709 13:16:45.100247  9648 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:45.245838  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:45.298755  8789 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.172290  9818 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:45.189114  9768 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:45.185760  9844 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:45.189877  9689 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.280367  9944 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:45.261263  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 51487.1us
I20260709 13:16:45.335181  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:45.210215  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:45.222504  9886 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:45.157356  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 820) took 1332 ms. Trace:
I20260709 13:16:45.187698  9826 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.278870  8253 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:16:45.279503  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:45.288084  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:45.244635  9883 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:45.295356  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:45.362864  8104 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:45.263924  8099 rpcz_store.cc:276] 0709 13:16:43.911524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.031041 (+1119517us) service_pool.cc:224] Handling call
0709 13:16:45.066679 (+ 35638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:45.092419 (+ 25740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.102013 (+  9594us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:45.113791 (+ 11778us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:45.117145 (+  3354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.158234 (+ 41089us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.181082 (+ 22848us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:45.192852  9799 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.264084  9756 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.297564  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:45.302585  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 113509us
I20260709 13:16:45.278847  9758 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:45.327819  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:45.377768  9758 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:16:45.378211  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 50459.4us
I20260709 13:16:45.379161  8072 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:45.379403  9800 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:45.379909  9800 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:45.380299  9800 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.380429  8072 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:45.327984  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:45.381577  9818 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.381752  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:45.382035  9886 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:45.382506  8104 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:45.382942  9941 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:45.183421  9907 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.290618  9863 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.339177  8785 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:45.339568  8221 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:45.340095  9865 raft_consensus.cc:2764] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:16:45.391815  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 52313.9us
I20260709 13:16:45.393118  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:45.340215  9844 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:45.340828  9761 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:45.341377  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:45.334800  9944 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:45.395097  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:45.395267  9944 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.302027  9696 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.292485  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:45.396425  8250 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:45.397236  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:45.398492  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:45.399989  8250 raft_consensus.cc:2368] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4.
I20260709 13:16:45.302217  9648 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.360687  8107 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.326138  9768 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.402011  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:45.403229  8250 raft_consensus.cc:2368] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3.
I20260709 13:16:45.402083  9768 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.360404  8253 pending_rounds.cc:85] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 3
I20260709 13:16:45.405635  8253 pending_rounds.cc:107] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.4
I20260709 13:16:45.406009  8253 raft_consensus.cc:2917] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Aborting config change with OpId 1.4: Aborted: Op aborted by new leader
I20260709 13:16:45.406507  8253 raft_consensus.cc:2889] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:45.407119  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:57550 (request call id 75) took 8091 ms. Trace:
I20260709 13:16:45.407507  8253 rpcz_store.cc:276] 0709 13:16:37.316063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.316186 (+   123us) service_pool.cc:224] Handling call
0709 13:16:37.320916 (+  4730us) log.cc:844] Serialized 501 byte log entry
0709 13:16:37.389239 (+ 68323us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b5400296920. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0dc5142 00007fa5a0da5eaa 00007fa5a0dacd53 00007fa5a0daccd9 00007fa5a0dacc69 00007fa5a0dacc31 00007fa5a0dabdfd 000000000038f354 000000000038f199 00007fa59dd5f475
0709 13:16:37.419878 (+ 30639us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5400296920. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0dccb26 00007fa5a0dc649a 00007fa5a0dc5714 00007fa5a0da5eaa 00007fa5a0dacd53 00007fa5a0daccd9 00007fa5a0dacc69 00007fa5a0dacc31 00007fa5a0dabdfd 000000000038f354
0709 13:16:45.407006 (+7987128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12507,"raft.queue_time_us":4929,"raft.run_cpu_time_us":3883,"raft.run_wall_time_us":106671,"spinlock_wait_cycles":28999808,"thread_start_us":29062,"threads_started":1,"wal-append.queue_time_us":50543,"wal-append.run_cpu_time_us":1973,"wal-append.run_wall_time_us":1088016}
I20260709 13:16:45.331214  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:45.337960  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:45.410043  8786 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.410833  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:45.364660  8789 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
W20260709 13:16:45.372545  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 75045.6us
I20260709 13:16:45.416412  9696 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.417367  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:45.247705  8782 rpcz_store.cc:276] 0709 13:16:40.218409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.228890 (+ 10481us) service_pool.cc:224] Handling call
0709 13:16:42.849675 (+2620785us) spinlock_profiling.cc:243] Waited 95.4 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27e9c 00007fa59dd27a5b 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:16:42.849893 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.022299 (+172406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.046131 (+2023832us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54003165d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:45.076466 (+ 30335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":614191616}
I20260709 13:16:45.409291  9944 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.390985  8104 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:45.340571  9646 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:45.420557  8786 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:45.421002  9646 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:45.421711  9646 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:45.421105  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:45.395421  8108 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:45.423362  8178 raft_consensus.cc:2368] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4.
I20260709 13:16:45.423924  8250 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 4: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:45.424218  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:45.423571  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:45.396050  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:45.423202  9944 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:45.425827  9696 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.426002  8252 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 4: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:16:45.391598  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 93876.9us
I20260709 13:16:45.426774  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:45.437460  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:45.435735  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:16:45.453225  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 193621us
I20260709 13:16:45.365887  9877 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.378266  9758 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.440121  9928 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:45.441462  9762 consensus_meta.cc:287] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.675s	user 0.009s	sys 0.000s
I20260709 13:16:45.441783  9868 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:45.442443  9865 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:45.442754  8223 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:45.443145  9708 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:16:45.471462  9828 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
I20260709 13:16:45.454203  8176 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:45.473116  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.360018  9929 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.479660  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.474436  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.480644  8176 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:45.445770  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:45.467067  8174 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:45.439206  9648 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.456162  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:45.486114  8181 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 2: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:45.457121  8179 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:45.381593  9879 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:45.456454  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.439888  9646 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.460865  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.434067  9768 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.450626  9804 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.473965  8182 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:45.455154  8253 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:45.499404  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:45.454351  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:45.484688  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 335) took 1217 ms. Trace:
I20260709 13:16:45.494827  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:45.393102  9775 consensus_meta.cc:287] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.001s
I20260709 13:16:45.465551  9868 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:45.479362  8180 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:45.498430  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.500104  8791 rpcz_store.cc:276] 0709 13:16:44.267073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.866960 (+599887us) service_pool.cc:224] Handling call
0709 13:16:44.867272 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:44.867581 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.867605 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:44.873830 (+  6225us) log.cc:844] Serialized 26 byte log entry
0709 13:16:45.236830 (+363000us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b180032b4e0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:16:45.367309 (+130479us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:45.367367 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.367469 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.481576 (+114107us) raft_consensus.cc:1685] finished
0709 13:16:45.481596 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.484619 (+  3023us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3374,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":27832,"spinlock_wait_cycles":24540928,"thread_start_us":130245,"threads_started":1,"wal-append.queue_time_us":597759}
I20260709 13:16:45.481732  9892 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4.
I20260709 13:16:45.470656  9799 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.477458  9865 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:45.482963  9828 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.482157  9818 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:45.527383  9928 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.524813  9828 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.500183  8253 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 4: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:45.483527  9708 raft_consensus.cc:2764] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:45.466192  9762 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.529692  9762 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.477260  9907 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.477208  9756 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.531286  9858 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:45.531857  9756 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.511943  9948 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:45.532436  9948 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:45.532859  9948 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.533967  9907 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.522677  9865 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:45.510229  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55961.8us
I20260709 13:16:45.538357  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:45.519269  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 1789) took 1268 ms. Trace:
I20260709 13:16:45.540526  8251 rpcz_store.cc:276] 0709 13:16:44.250593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.391044 (+140451us) service_pool.cc:224] Handling call
0709 13:16:45.519086 (+1128042us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400089dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:45.519212 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344087936}
I20260709 13:16:45.542837  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:45.543726  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:45.544610  9783 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:45.537671  9881 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:45.524189  9866 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:45.497798  9879 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:16:45.537269  9950 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260709 13:16:45.506098  9868 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.490018  9949 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:45.518389  9853 consensus_meta.cc:287] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 13:16:45.519090  9804 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.506002  9775 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.515895  9768 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.545961  9585 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:45.517005  9648 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.496479  9916 consensus_queue.cc:1059] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:16:45.560247  9916 raft_consensus.cc:3055] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:45.560577  9916 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:45.563709  9804 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:45.564236  9804 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:45.567731  9758 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.568496  9879 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.565042  9804 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.487612  9883 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:45.573120  9745 consensus_meta.cc:287] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.549s	user 0.006s	sys 0.002s
W20260709 13:16:45.574007  9906 consensus_meta.cc:287] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.809s	user 0.003s	sys 0.007s
I20260709 13:16:45.578188  9758 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:45.574369  9906 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.577154  9948 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.441260  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:16:45.623719  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 227417us
I20260709 13:16:45.624688  8099 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.456493  8104 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:16:45.626003  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 236722us
I20260709 13:16:45.626623  8100 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:45.627950  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:45.629648  8104 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:45.630842  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:45.632851  8104 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:45.346215  8103 rpcz_store.cc:276] 0709 13:16:43.819096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.763145 (+944049us) service_pool.cc:224] Handling call
0709 13:16:44.771441 (+  8296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:44.806101 (+ 34660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.807686 (+  1585us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:44.893617 (+ 85931us) log.cc:844] Serialized 26 byte log entry
0709 13:16:44.979246 (+ 85629us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:44.987240 (+  7994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.009692 (+ 22452us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.100846 (+ 91154us) raft_consensus.cc:1685] finished
0709 13:16:45.100874 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.151085 (+ 50211us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":68008,"threads_started":1,"wal-append.queue_time_us":121721}
I20260709 13:16:45.419134  8107 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:45.642009  8099 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:45.650550  8108 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:45.656085  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:45.658550  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.660387  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:45.661655  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.662294  8174 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:45.663120  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.663429  8106 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:45.663822  8174 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:45.664948  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.666128  8174 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 2: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:45.667181  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.668725  8175 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 2: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:45.668661  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.671626  8180 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:45.672650  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:16:45.672787  8249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 1781) took 2042 ms (client timeout 2179 ms). Trace:
W20260709 13:16:45.673394  8249 rpcz_store.cc:269] 0709 13:16:43.629879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.834330 (+204451us) service_pool.cc:224] Handling call
0709 13:16:45.672314 (+1837984us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b5400208d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:45.672531 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":961686912}
W20260709 13:16:45.674436  8256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 1784) took 2023 ms (client timeout 2113 ms). Trace:
W20260709 13:16:45.675001  8256 rpcz_store.cc:269] 0709 13:16:43.651139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.821087 (+169948us) service_pool.cc:224] Handling call
0709 13:16:45.674035 (+1852948us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b5400386b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:45.674242 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31047424}
I20260709 13:16:45.672827  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:45.676393  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 132598us
I20260709 13:16:45.677752  8183 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.686740  8783 raft_consensus.cc:2368] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5.
I20260709 13:16:45.561318  9916 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.689569  9948 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.690653  9916 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:45.695353  9965 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:16:45.696473  9775 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.698196  9826 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.558257  9853 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.703927  9646 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.705191  8790 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:45.580443  9745 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:45.706756  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:45.708050  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:45.708822  8179 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.697249  9906 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:45.702930  8178 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 852) took 1907 ms (client timeout 2082 ms). Trace:
I20260709 13:16:45.705139  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:45.720804  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 78033.8us
W20260709 13:16:45.711031  8178 rpcz_store.cc:269] 0709 13:16:43.795212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.221946 (+1426734us) service_pool.cc:224] Handling call
0709 13:16:45.702461 (+480515us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540031ecd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:45.702716 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353493888}
I20260709 13:16:45.705178  9853 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.728754  9937 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3.
I20260709 13:16:45.728996  9929 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:45.729449  9783 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:45.730587  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.731650  8177 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 2: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:45.731524  9783 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.732759  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:45.737653  9928 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:45.738718  9928 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.741838  9646 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:45.743206  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:45.743462  9646 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:45.743949  8254 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.745743  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.746743  8175 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 4: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:45.747967  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:45.748549  9966 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:16:45.748898  8175 raft_consensus.cc:2393] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:45.743901  9646 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:45.725251  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:45.726225  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 70424.9us
I20260709 13:16:45.761488  8254 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:45.764396  8147 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:45.765239  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:45.766105  8108 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.766433  9646 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.768553  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.769304  9957 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:45.770208  8181 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:45.762253  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:45.726851  9826 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.775444  8178 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 2: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:45.769757  9957 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.767980  9646 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.778626  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:45.782363  9868 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.778666  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:45.784956  8181 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:45.790267  8175 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:45.793574  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:45.794267  8100 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:45.872602  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:45.846128  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 347942us
I20260709 13:16:45.878710  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:45.879685  8252 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:45.790400  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:45.847961  8108 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:45.812127  8174 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:45.845129  8182 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:45.816370  8179 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:45.875197  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:45.875586  9689 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.846676  8183 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
W20260709 13:16:45.845852  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 69003us
I20260709 13:16:45.880528  8149 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:45.796969  8178 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:45.796556  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:45.888725  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:16:45.891634  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 95258.3us
I20260709 13:16:45.892527  9948 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:45.893119  9948 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:45.798707  8103 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:45.895335  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:45.895552  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:45.787148  9957 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.896245  9648 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:45.896745  9800 consensus_meta.cc:287] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.006s
I20260709 13:16:45.900678  9948 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.901798  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:45.887342  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:45.793119  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:45.906953  8177 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:45.799126  9854 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:45.914113  8104 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:45.915599  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:45.915861  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:45.915637  9648 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.918781  8176 raft_consensus.cc:2368] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3.
I20260709 13:16:45.918792  8175 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:45.919904  8791 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:45.908048  9916 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:16:45.920835  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:45.921841  8100 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.912374  9854 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:45.924712  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:45.923571  9854 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.926362  9854 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.930022  8107 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:16:45.931010  8783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 493) took 1660 ms (client timeout 2179 ms). Trace:
I20260709 13:16:45.931525  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:45.931473  8783 rpcz_store.cc:269] 0709 13:16:44.268939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.385721 (+116782us) service_pool.cc:224] Handling call
0709 13:16:45.927284 (+1541563us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54004ac254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:45.929506 (+  2222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2371114752}
I20260709 13:16:45.933055  9907 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:45.933502  9907 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:45.933854  9907 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:45.935997  9865 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:45.937507  8255 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:45.937728  9928 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:45.938318  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 163473us
I20260709 13:16:45.941103  8105 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:45.933085  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:45.944569  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:45.945924  9921 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:45.943956  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:45.941849  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:45.947031  8108 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:45.950299  8108 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:45.946383  9689 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:45.951727  9921 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.973169  8005 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36106 (request call id 196) took 6959 ms. Trace:
I20260709 13:16:45.955291  9928 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.980727  9879 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:45.981596  9879 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.982323  9879 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.985598  9879 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:45.973727  8180 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 2: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:45.913691  9800 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:45.971678  9921 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.990841  9868 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:45.991452  8108 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:45.986135  7993 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9abaa411847e4bf9907f7af5e2689c7b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 13:16:46.010627  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:46.011569  8183 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:46.012372  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:46.008134  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:46.013602  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:46.016117  8182 raft_consensus.cc:2368] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3.
W20260709 13:16:46.013000  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 132685us
I20260709 13:16:46.018415  8174 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:46.016963  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:46.005278  9865 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:46.033008  9648 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:46.033983  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:46.037585  9768 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:46.028954  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:46.038146  9768 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:46.037878  9838 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:46.038623  9768 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.038533  8180 raft_consensus.cc:2376] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3. Re-sending same reply.
I20260709 13:16:46.039309  9838 raft_consensus.cc:3055] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:46.039784  9838 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:46.040587  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:46.042428  8175 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:46.042994  9762 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:46.043608  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.043784  9762 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:46.044946  9918 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:46.045331  9918 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:46.046231  8074 leader_election.cc:400] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4.
I20260709 13:16:46.046618  8074 leader_election.cc:403] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:46.046526  9918 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:46.046921  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.047684  8074 leader_election.cc:400] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3.
I20260709 13:16:46.048022  8074 leader_election.cc:403] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:16:46.048645  9885 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.039884  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 1789) took 1968 ms. Trace:
I20260709 13:16:46.050369  8255 rpcz_store.cc:276] 0709 13:16:44.071132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.012956 (+941824us) service_pool.cc:224] Handling call
0709 13:16:45.675189 (+662233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:45.937915 (+262726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.038770 (+100855us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b5400386b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:46.039633 (+   863us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b5400386b50. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:46.039785 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2124385024}
I20260709 13:16:46.051787  8177 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:46.047926  9918 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:46.053452  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 109662us
I20260709 13:16:46.047854  8250 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.060983  9737 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3.
I20260709 13:16:46.064416  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:46.065256  8102 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:46.057085  7993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 71244.4us
I20260709 13:16:46.066323  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:46.071995  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:46.072618  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.076666  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:46.041100  9838 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.086589  9754 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:16:46.087500  9800 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:46.091733  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:46.052772  9928 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.096494  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:46.100142  9937 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:46.100612  9937 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:46.101751  9937 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.103191  9937 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.103488  9882 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:46.080585  9948 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.107416  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:46.100601  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:46.112179  9865 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:45.977183  8005 rpcz_store.cc:276] 0709 13:16:38.990306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.990608 (+   302us) service_pool.cc:224] Handling call
0709 13:16:39.686998 (+696390us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b540006a9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db6090 00007fa5a0e54f3a 00007fa5a6c0b1cc 00007fa5a6d0937e 00007fa5a51ca2a4 00007fa5a51ca232 00007fa5a51ca161 00007fa5a51ca0dc 00007fa5a51c9392 00007fa59f18748c 00007fa59f1868c6
0709 13:16:45.947050 (+6260052us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:42.157727 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:42.624051 (+466324us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:42.631667 (+  7616us) write_op.cc:435] Acquired schema lock
0709 13:16:42.631696 (+    29us) tablet.cc:662] Decoding operations
0709 13:16:42.772141 (+140445us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:42.778659 (+  6518us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:42.781662 (+  3003us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:16:42.962111 (+180449us) tablet.cc:701] Row locks acquired
0709 13:16:42.962129 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:16:42.977574 (+ 15445us) write_op.cc:270] Start()
0709 13:16:42.988510 (+ 10936us) write_op.cc:276] Timestamp: P: 1783603002971603 usec, L: 0
0709 13:16:42.988547 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:16:43.119419 (+130872us) log.cc:844] Serialized 1302 byte log entry
0709 13:16:44.166492 (+1047073us) op_driver.cc:464] REPLICATION: finished
0709 13:16:44.732456 (+565964us) write_op.cc:301] APPLY: starting
0709 13:16:44.744758 (+ 12302us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:44.763266 (+ 18508us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:44.789805 (+ 26539us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:44.864163 (+ 74358us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:44.864332 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:16:44.864383 (+    51us) write_op.cc:312] APPLY: finished
0709 13:16:44.864595 (+   212us) log.cc:844] Serialized 35 byte log entry
0709 13:16:44.864754 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:44.865023 (+   269us) write_op.cc:454] Released schema lock
0709 13:16:44.865063 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:44.930971 (+ 65908us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:44.942503 (+ 11532us) write_op.cc:454] Released schema lock
0709 13:16:45.924598 (+982095us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b540006af20. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0dc1dbe 00007fa5a0dcc930 00007fa5a0dcc8d8 00007fa5a0dcc858 00007fa5a0dcc813 00007fa5a0dcba9c 00007fa5a6cb7626 00007fa5a6cb1dd8 00007fa5a0e087cb 00007fa5a0e0b2c0
Metrics: {"mutex_wait_us":490995,"reported_tablets":5,"spinlock_wait_cycles":913941760,"child_traces":[["op",{"apply.queue_time_us":528274,"apply.run_cpu_time_us":3755,"apply.run_wall_time_us":187362,"num_ops":3,"prepare.queue_time_us":1386987,"prepare.run_cpu_time_us":62651,"prepare.run_wall_time_us":1547950,"raft.queue_time_us":230226,"raft.run_cpu_time_us":22796,"raft.run_wall_time_us":515550,"replication_time_us":1095053,"spinlock_wait_cycles":92072192,"thread_start_us":2434908,"threads_started":5,"wal-append.queue_time_us":673376}]]}
I20260709 13:16:46.109750  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:46.119271  9921 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.120257  9689 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:46.093376  9907 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.120821  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:46.122804  8149 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:46.123634  9907 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:46.123827  9689 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:46.125806  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 53965us
I20260709 13:16:46.126453  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:46.128952  8108 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:46.134447  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:46.143957  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:46.144586  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:46.145227  9879 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:46.145895  8221 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:46.146190  9879 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:46.147631  9758 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:46.148049  9879 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:46.148417  9758 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:46.148701  9879 raft_consensus.cc:697] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:46.149781  9803 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:46.150417  9803 raft_consensus.cc:697] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:46.151845  9803 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:46.155969  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.157523  9768 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.158826  9879 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.159703  9768 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:46.155861  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:46.161044  9921 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:46.161720  9865 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:46.162233  9865 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:46.162703  9865 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:46.165752  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:46.167418  9878 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:46.167814  9878 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:46.168207  9878 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.171275  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:46.134425  9868 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:46.173712  9868 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:46.174129  9868 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:46.174696  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:46.171949  9948 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:46.178283  8250 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
W20260709 13:16:46.181417  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 45653.6us
I20260709 13:16:46.184053  9743 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:46.184532  9743 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.184880  9743 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.175910  9689 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:46.182873  9838 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:46.206854  8149 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:16:46.224272  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 77209.6us
I20260709 13:16:46.235106  8108 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:46.203625  9646 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:16:46.238170  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 48363.1us
I20260709 13:16:46.239813  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.194919  9768 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:16:46.204931  9948 consensus_queue.cc:1059] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:16:46.229631  9803 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:46.244602  9852 raft_consensus.cc:2764] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
W20260709 13:16:46.244837  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.245162  9750 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:16:46.251402  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 44704us
I20260709 13:16:46.252488  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:46.252723  9928 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:46.253294  8183 raft_consensus.cc:2368] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3.
I20260709 13:16:46.254340  8252 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:46.247540  9803 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:46.255626  9803 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:46.258656  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.260636  9750 raft_consensus.cc:3055] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:46.261202  9750 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:46.264492  9754 raft_consensus.cc:3055] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:46.265064  9754 raft_consensus.cc:740] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:46.243791  9689 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:46.266796  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.272698  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:46.232220  9957 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.244143  8100 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:46.274489  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:16:46.283499  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.284322  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.249953  9646 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.293154  8791 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:46.268447  9879 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:46.281083  9689 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:46.298135  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:46.285867  9885 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4.
I20260709 13:16:46.303682  8256 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 2: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:46.270481  9865 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:46.298269  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:46.307978  8250 raft_consensus.cc:2368] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3.
I20260709 13:16:46.305949  8149 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:46.311203  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:46.311498  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.312294  8254 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:46.262534  9750 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.314586  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:46.325577  8102 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:46.326078  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 837) took 1048 ms. Trace:
I20260709 13:16:46.326337  8102 rpcz_store.cc:276] 0709 13:16:45.278272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.279596 (+  1324us) service_pool.cc:224] Handling call
0709 13:16:46.064133 (+784537us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b5800002798. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:16:46.326029 (+261896us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8187136}
I20260709 13:16:46.328842  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.279989  9754 consensus_queue.cc:260] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.335237  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:46.335724  8182 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.337926  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:46.337371  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:46.331331  9918 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:16:46.346859  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 49657.6us
I20260709 13:16:46.333369  9885 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:46.346947  8177 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:46.350032  8787 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:46.320327  9878 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.354401  8252 raft_consensus.cc:2368] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5.
I20260709 13:16:46.355316  9754 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:46.355404  8251 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:46.357851  9750 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.340088  9689 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.362087  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:46.363948  9907 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:46.364615  9907 raft_consensus.cc:697] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:46.365494  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:46.366273  8782 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:46.366995  9696 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:46.368095  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:46.369014  9737 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:46.369864  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:46.371057  8785 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:16:46.371011  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 196434us
I20260709 13:16:46.372864  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:16:46.376190  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.376950  8248 raft_consensus.cc:1240] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:46.378093  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:46.377949  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:46.379340  9646 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:46.379805  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:46.380132  9957 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:46.381393  9921 consensus_queue.cc:1059] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:46.382261  9878 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:46.382725  9921 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:46.383445  9921 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:46.381567  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:46.365861  9907 consensus_queue.cc:237] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.382393  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:46.385783  9921 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:46.386935  9865 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:46.387414  9921 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:46.350945  9885 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:46.388113  9885 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.394953  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.395488  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:46.361295  8182 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:16:46.404181  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:16:46.355634  9980 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:16:46.411517  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:46.411724  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:46.412285  8253 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:46.413687  8791 raft_consensus.cc:2368] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4.
I20260709 13:16:46.414024  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.414598  8252 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.418067  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:46.418246  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:46.418772  8787 raft_consensus.cc:2368] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5.
I20260709 13:16:46.419818  8250 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:46.416265  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:16:46.430197  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 57445.5us
I20260709 13:16:46.435009  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:46.420738  9868 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:46.442690  8183 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:46.408541  9852 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:16:46.446812  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.427881  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:46.463997  8791 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:46.486002  9737 consensus_queue.cc:1059] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:46.488086  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:46.488857  8787 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.489722  8257 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:46.492136  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.496834  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.499518  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.494035  8790 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:46.433931  9743 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.505455  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:46.468063  8249 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:46.508587  8250 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:46.510252  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:46.515275  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:46.517827  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.518718  8254 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 2: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:46.519098  9879 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:46.520164  8255 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:46.523592  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.525637  8223 leader_election.cc:400] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4.
I20260709 13:16:46.525959  8223 leader_election.cc:403] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:46.527153  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.529481  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:46.532847  8787 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:16:46.513340  9882 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.535962  8248 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:46.536376  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:46.541126  8787 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:16:46.536540  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 56297.5us
I20260709 13:16:46.540328  8253 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:46.543380  8251 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:46.543812  8784 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:46.546715  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:46.548509  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:46.549134  8783 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:46.549155  8789 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.546314  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.552002  9983 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:46.550704  9689 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:46.552584  9983 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.553249  9689 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:46.554091  9689 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:46.554708  9852 raft_consensus.cc:3055] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:46.555126  9852 raft_consensus.cc:740] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:46.556095  9852 consensus_queue.cc:260] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.532056  9921 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:46.532186  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:46.561327  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:46.562988  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:46.563829  8103 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 2: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:46.570513  8102 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:46.571393  8251 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:46.572952  8782 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:46.573675  8105 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:46.545027  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:46.577448  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:46.578349  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:46.559865  9852 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:46.578006  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:46.579396  8790 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:46.580214  8108 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:16:46.580214  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 67219.7us
I20260709 13:16:46.581064  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:46.581827  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:46.582691  8102 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:46.566144  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:46.585161  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:46.585919  9737 consensus_queue.cc:1059] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:46.586078  8101 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:46.597956  9737 raft_consensus.cc:3055] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:46.598378  9737 raft_consensus.cc:740] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:46.599285  9737 consensus_queue.cc:260] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:46.600526  9737 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.586205  9957 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:46.575699  9983 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:46.542546  9882 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.602787  8103 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:46.604759  9882 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:46.604624  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:46.606455  9868 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:46.587689  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:46.607419  8183 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:46.608439  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:46.609205  8782 raft_consensus.cc:2368] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4.
I20260709 13:16:46.609630  8004 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39810 (request call id 291) took 4499 ms. Trace:
I20260709 13:16:46.615921  8791 raft_consensus.cc:2376] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3. Re-sending same reply.
I20260709 13:16:46.618497  8252 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:46.620434  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:46.620124  9803 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:46.621201  8182 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 3: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:46.621348  8788 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:46.622351  8177 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:46.622874  8788 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:46.623530  9803 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:46.582852  9838 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:46.632781  9838 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.633996  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:46.627714  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:46.628892  8100 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:46.613991  8784 raft_consensus.cc:2376] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4. Re-sending same reply.
I20260709 13:16:46.631127  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:46.631901  9879 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4.
I20260709 13:16:46.634845  8183 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:46.626664  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:46.636188  8789 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:46.634950  9928 raft_consensus.cc:3055] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:46.646620  9928 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:46.649365  8783 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:46.650179  9868 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:46.650031  9928 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:46.650635  9838 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:46.650746  9868 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:46.651391  9928 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:46.652168  8105 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:46.610414  8004 rpcz_store.cc:276] 0709 13:16:42.109681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.110000 (+   319us) service_pool.cc:224] Handling call
0709 13:16:46.609456 (+4499456us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:44.950137 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:45.089918 (+139781us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:45.089955 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:16:45.089972 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:45.090345 (+   373us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:45.090398 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:45.090422 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:45.090607 (+   185us) tablet.cc:701] Row locks acquired
0709 13:16:45.090628 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:16:45.090798 (+   170us) write_op.cc:270] Start()
0709 13:16:45.090898 (+   100us) write_op.cc:276] Timestamp: P: 1783603005090753 usec, L: 0
0709 13:16:45.090917 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:16:45.186417 (+ 95500us) log.cc:844] Serialized 536 byte log entry
0709 13:16:46.252601 (+1066184us) op_driver.cc:464] REPLICATION: finished
0709 13:16:46.434115 (+181514us) write_op.cc:301] APPLY: starting
0709 13:16:46.479188 (+ 45073us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:46.490460 (+ 11272us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:46.490578 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:46.490934 (+   356us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:46.491184 (+   250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:16:46.491244 (+    60us) write_op.cc:312] APPLY: finished
0709 13:16:46.491574 (+   330us) log.cc:844] Serialized 23 byte log entry
0709 13:16:46.491787 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:46.494546 (+  2759us) write_op.cc:454] Released schema lock
0709 13:16:46.509953 (+ 15407us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:46.559484 (+ 49531us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:46.560850 (+  1366us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":158094,"apply.run_cpu_time_us":2776,"apply.run_wall_time_us":118486,"num_ops":1,"prepare.queue_time_us":257319,"prepare.run_cpu_time_us":3826,"prepare.run_wall_time_us":309565,"replication_time_us":1145607,"spinlock_wait_cycles":1408,"thread_start_us":202785,"threads_started":2}]]}
I20260709 13:16:46.653627  9957 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:46.654599  9957 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:46.654949  9957 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:46.655184  8108 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:46.655762  9957 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:46.656905  9957 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.657864  8786 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:46.651851  9868 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:46.658046  8074 leader_election.cc:400] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3.
I20260709 13:16:46.658507  8074 leader_election.cc:403] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:16:46.659757  9800 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3.
I20260709 13:16:46.660966  8074 leader_election.cc:400] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3.
W20260709 13:16:46.660984  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.663745  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:46.668920  8108 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:46.678589  8787 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:46.684588  8106 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:46.685784  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:46.686612  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:46.687276  8105 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:46.671877  9800 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:16:46.687858  8002 catalog_manager.cc:5697] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 3, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:46.689772  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.690595  8251 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:46.693960  8249 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:46.694867  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.698089  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:46.658004  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:46.699745  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:46.697383  9830 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:46.703841  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:16:46.708716  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.717885  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:46.720953  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:46.722548  8223 leader_election.cc:400] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3.
I20260709 13:16:46.722805  8223 leader_election.cc:403] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:46.723382  9982 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:46.723868  9982 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:46.724686  9982 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:46.725582  9878 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3.
I20260709 13:16:46.725787  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:46.726843  8223 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:46.708205  8002 catalog_manager.cc:5697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 3, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 3 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:16:46.737974  8252 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:46.740372  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:46.741921  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 56276.1us
I20260709 13:16:46.748775  8072 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:46.749997  8102 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:46.713547  9885 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:46.745042  9865 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:46.704252  9868 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:16:46.747721  8002 catalog_manager.cc:5697] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 2, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 2 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:16:46.756290  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 62242.4us
I20260709 13:16:46.707319  9921 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:16:46.760854  8257 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:46.762288  8178 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:46.764995  8002 catalog_manager.cc:5697] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 3, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.734496  9907 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:16:46.765038  8072 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:46.771727  8002 catalog_manager.cc:5697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 3, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 3 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:46.773489  8002 catalog_manager.cc:5697] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 3, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.776929  9838 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.792146  9838 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:46.798543  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.763043  9983 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:46.818887  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 44772.3us
I20260709 13:16:46.826248  9996 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:46.831588  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.816200  9878 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.828802  9996 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.848371  8149 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:46.849886  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:46.851127  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:46.852485  9907 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:46.853250  9907 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:46.853806  9907 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:46.854158  9885 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:46.854801  9907 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:46.856424  9916 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:46.857795  9743 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:46.863124  9918 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:46.863529  9918 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:46.864374  9918 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:46.842774  9996 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.843484  9830 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:46.882652  9838 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:46.891911  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.874745  9866 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:16:46.893877  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.838227  9878 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:46.870021  9995 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:46.915146  9878 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:46.916384  9983 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:46.860790  9689 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:46.945586  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.952311  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.957468  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 281233us
W20260709 13:16:46.958012  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.947901  9918 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:46.965451  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 114374us
I20260709 13:16:46.955425  9916 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.954952  9882 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:46.974184  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:46.975054  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 234811us
I20260709 13:16:46.966867  9866 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:47.007721  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.983042  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 222656us
I20260709 13:16:47.019955  8223 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:16:46.976306  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 211915us
I20260709 13:16:47.029852  9866 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:47.006390  9838 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:46.994212  7993 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9abaa411847e4bf9907f7af5e2689c7b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a0f96c12124b4e1a816d9fa970464091 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:47.043730  9996 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:46.972412  9865 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:47.050549  8177 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:47.053046  7993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 58923us
I20260709 13:16:47.052307  8072 leader_election.cc:400] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5.
I20260709 13:16:47.054275  8072 leader_election.cc:403] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:47.054224  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.053562  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:46.974568  9916 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.049152  9982 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:46.976155  9882 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.052747  8785 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:16:47.063058  8223 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:16:47.069038  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 68666us
I20260709 13:16:47.060088 10010 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:47.046758  9885 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:16:47.072486  8072 leader_election.cc:400] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4.
I20260709 13:16:47.073879  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.063238  9689 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:47.070061  9993 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:47.091562  9944 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:47.088310  9957 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:16:47.093254 10003 consensus_queue.cc:1059] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:47.093772  9928 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:47.094213  9928 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:47.095410  9928 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.096242  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.096463  9800 raft_consensus.cc:3055] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:47.096680  9928 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.096948 10005 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.098039 10005 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.073982 10009 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5.
I20260709 13:16:47.098423  8149 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.071156  9998 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:47.096956  9800 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:47.100888  9996 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:47.100955  9800 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.077877  9982 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.097347  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.102284  9865 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.108309 10004 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:47.109938  9882 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:47.109887  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.110900  9882 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.111259  9689 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:47.111709 10010 consensus_queue.cc:1059] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:47.103461  9800 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.088799  9999 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:47.112777  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.113271  9999 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:47.113463  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.113706  9957 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.114274  9999 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.115650  9999 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.115564  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:47.116532  9957 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:47.116997  9957 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.112612  9646 consensus_queue.cc:1059] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:47.117393  9957 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.118010  9646 raft_consensus.cc:3055] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:47.118427  9646 raft_consensus.cc:740] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:47.119262  9646 consensus_queue.cc:260] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.120056  8072 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:47.120637  9646 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.088992  9993 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:47.120942  9882 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.122504  9993 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.123751  9993 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.123682  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.124236  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:47.124718  9882 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:47.125279  9882 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:47.126365  9882 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.129604  9838 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:47.130225  9838 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:47.130071  9957 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.130769  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.153283  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.155146 10005 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:47.155653  9885 raft_consensus.cc:2764] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:47.155829 10005 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:47.156600  9921 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:47.132678  9916 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:47.171627  9916 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:47.172286  9916 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.176090  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:47.176955  8783 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:47.178524  9916 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:47.134057 10007 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.086s	user 0.003s	sys 0.000s
I20260709 13:16:47.143187  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:47.144080  9907 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:16:47.146152  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.147850  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:47.154345  9957 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:47.183004  9993 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:47.125175  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:47.168929  9921 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:47.184170  9907 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:16:47.185271  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 60199.2us
I20260709 13:16:47.186017  9907 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.154609  8223 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:47.157955  9868 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.187125  9907 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.187211  9868 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.184897  8785 raft_consensus.cc:2410] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:47.189661  9868 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:47.190304  9868 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:47.190475  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:47.191751  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:47.192307  8181 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:47.195333  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:47.196897  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:47.197589  8177 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:47.198309  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:47.199573  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:47.201186  8181 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:47.201702  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:47.204276  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:47.204579  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:47.204285  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:47.195268  9957 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:47.131181  9838 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:47.165798  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 83462.3us
I20260709 13:16:47.209399  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:47.210211  8074 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.213099  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:47.213551  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.213864  8183 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
W20260709 13:16:47.169198  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 91461.1us
W20260709 13:16:47.170930  8221 leader_election.cc:336] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.923s (SENT)
I20260709 13:16:47.186271  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:47.156908 10005 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.221498  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:47.222396  8183 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:47.158308  9885 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:47.208931  8182 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:47.191099  9868 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:47.238961  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:16:47.159891  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.216923 10009 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:47.217238  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 46365.7us
I20260709 13:16:47.218147 10006 consensus_queue.cc:1059] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:47.220263  9957 raft_consensus.cc:697] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:47.220887  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:16:47.207333  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.213446  9866 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.201555  9982 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:47.240861  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:47.261317  8253 raft_consensus.cc:2410] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:47.241883  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:47.245152  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:47.245770  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:47.184861  9993 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:47.247696  8108 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:47.266080  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 52602.8us
I20260709 13:16:47.249578  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:47.251031  8105 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:16:47.252065  8255 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:47.252193  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.254249  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:47.250887  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:47.237547  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.243633  9916 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:16:47.256978  8221 leader_election.cc:336] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.998s (SENT)
I20260709 13:16:47.269719  8248 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:47.273216  8256 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 2: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:16:47.275744  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.250574  9998 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.276871  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:47.278740  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:47.285907  8183 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:47.250360  9944 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:47.290938  8257 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:47.257566  9918 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:16:47.289168  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.288007  8106 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:47.295463  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:47.295980  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:47.186017  9921 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.298187  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:47.299764  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:47.268285 10016 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.299697  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:47.299885  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:47.291180  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.305621  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 61547.1us
I20260709 13:16:47.271116  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:16:47.306352  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 56510.9us
I20260709 13:16:47.307015  8177 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:16:47.308238  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 91812us
I20260709 13:16:47.308118  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:47.309084  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.306380  9918 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.310277  9957 consensus_queue.cc:237] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.312165  9918 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:47.312696  9918 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:47.272257  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:47.314769  8099 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.317690  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.317363  9993 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.317842  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:47.319271  9743 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.319700  9754 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:47.323601  9868 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.321156  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.290066  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:47.297668 10006 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:47.332244  8106 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:47.332852  8179 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:47.337615 10005 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.265669  9866 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.303727  9944 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.308472 10016 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.301095  8100 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:47.303565  9916 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:47.340124  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:47.345058  8108 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:47.342978  8253 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:47.345459  9916 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.349059  8248 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:47.349383  8103 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:47.351816  9800 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:47.352275  9800 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:47.352592  8257 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:47.353921  9689 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:47.354360  9689 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:47.355165  9689 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.356269  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:47.356920  8107 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.355871  8102 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:47.360090  9885 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.360381  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.361756  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:47.365500  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 56493.1us
I20260709 13:16:47.366904  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.374471  8175 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
W20260709 13:16:47.391733  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.393477  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.395490  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 74387.8us
I20260709 13:16:47.396600  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.331148  9743 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:47.400622  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:47.404320  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 44044.1us
I20260709 13:16:47.407100  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.398921  9944 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:47.399283 10010 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.401489  9830 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:47.353170  9800 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.403903  9982 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.404134  9918 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.422955  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.392951  9885 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.436594  9743 raft_consensus.cc:2764] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:47.443902  9866 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:47.444726  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.423557  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 171420us
I20260709 13:16:47.409976  9865 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:47.447384  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 46842.5us
I20260709 13:16:47.450174  8223 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:47.452189  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:47.437858  9918 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.456960  9918 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:47.454767  9866 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:47.462074  8223 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:47.464054  8074 leader_election.cc:400] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3.
I20260709 13:16:47.450670  9743 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.421813  9998 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:16:47.473214  8221 leader_election.cc:336] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.225s (SENT)
I20260709 13:16:47.479610  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.479069  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.422672 10010 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:47.478348 10019 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:16:47.482998  9878 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:47.483672  9878 raft_consensus.cc:697] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:47.478648 10016 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:47.463080  9982 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:47.461964  9866 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.485870  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:47.490237  8107 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:47.492879  9885 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:47.497184  9830 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:47.508279  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.507848  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:47.509868  8181 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:47.510682  8179 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:47.511616  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.511900  8183 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:47.513059  8176 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:47.514240  8074 leader_election.cc:400] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5.
I20260709 13:16:47.515308  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.489890  9982 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:47.516685  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 120222us
I20260709 13:16:47.499377  9866 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.494319  9993 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:47.522493  8175 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:47.513523  9879 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:47.511322  9865 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:47.523736  9999 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:47.530858 10010 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:47.531876  8099 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:47.484737  9878 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.532665  8105 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:47.509565  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:47.533593  9879 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:47.534651  9879 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.526249  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.517292 10020 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:47.519680  9982 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.523902  8101 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:47.521832  9998 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:16:47.539269  9885 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:47.539801 10020 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:47.554428 10005 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:47.555126 10020 consensus_queue.cc:1059] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:47.556366  8255 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:47.557188  9646 raft_consensus.cc:3055] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:47.557665  9646 raft_consensus.cc:740] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:47.557507  9996 consensus_queue.cc:1059] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:47.559211  9800 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.559407  9646 consensus_queue.cc:260] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.500067  9743 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.528127  9696 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:47.550585  9885 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.563197 10010 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:47.563647  9646 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.564368 10010 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:47.564765 10010 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:47.565366 10004 raft_consensus.cc:3055] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:47.548276  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:47.566051  9689 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.565801 10010 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.566874  9998 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:47.567276  9998 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.564761  9885 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:47.567651  9998 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.568241  9921 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:47.569537  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.558813  9996 raft_consensus.cc:3055] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:47.572754  9996 raft_consensus.cc:740] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:47.572774  9830 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:47.565758 10004 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:47.573882  9996 consensus_queue.cc:260] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.574400  9830 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:47.568058  9885 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:47.575047 10004 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.575743 10003 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:47.576097 10004 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.576218 10003 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:47.576100  9928 raft_consensus.cc:3055] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:47.577848  9928 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:47.577344 10003 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.578717  9928 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.579276 10003 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.579901  9928 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.575054  9996 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.587664  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:47.572297  9743 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:47.590193  9754 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:47.589564 10010 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.592679  8149 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:47.527653  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.592931  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:47.595633  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:47.596743  8183 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
W20260709 13:16:47.605849  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.591117  9754 raft_consensus.cc:697] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:16:47.617144  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 97998.6us
W20260709 13:16:47.628791  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.628243  9754 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.629760 10006 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:47.630862  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:47.623757  9865 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:47.631570  8249 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:47.632414  9982 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.596530 10020 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:16:47.634708  9982 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:16:47.635084  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 43828.7us
I20260709 13:16:47.638059  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.639150  9928 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.639791  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.639997  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.593796  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:47.646728  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 52988.7us
I20260709 13:16:47.651513  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:47.653633  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:47.651098 10016 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.656666 10016 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:47.658830  8002 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39814 (request call id 277) took 1582 ms. Trace:
I20260709 13:16:47.659250  9998 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.642683  9993 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:16:47.654644 10006 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:16:47.662784 10006 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:47.663165 10006 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:47.664040 10006 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.665620  8105 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:47.645682  9743 consensus_queue.cc:1059] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:16:47.652341  9689 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.667091  9743 raft_consensus.cc:3055] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:47.667487  9743 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:47.651175  9982 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:16:47.668422  9743 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.666177  8100 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:47.660692  8004 catalog_manager.cc:5697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.670432  9866 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.672680  9866 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:47.652477 10005 consensus_queue.cc:1059] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:16:47.655633 10020 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:16:47.674039 10005 raft_consensus.cc:3055] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:47.674424 10005 raft_consensus.cc:740] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:47.669790 10029 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:47.674881  9689 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:47.596856  9916 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:47.676213  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:47.679370  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:47.645328  9921 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:47.686914  8176 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:16:47.687347  8176 pending_rounds.cc:85] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 2
I20260709 13:16:47.672246  8004 catalog_manager.cc:5697] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 1 to 3, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 3 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.659279  8002 rpcz_store.cc:276] 0709 13:16:46.110520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.121778 (+ 11258us) service_pool.cc:224] Handling call
0709 13:16:47.658732 (+1536954us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:47.090563 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:47.091227 (+   664us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:47.091279 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:16:47.091297 (+    18us) tablet.cc:662] Decoding operations
0709 13:16:47.092165 (+   868us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:47.092270 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:47.092301 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:16:47.092893 (+   592us) tablet.cc:701] Row locks acquired
0709 13:16:47.092964 (+    71us) write_op.cc:260] PREPARE: finished
0709 13:16:47.093114 (+   150us) write_op.cc:270] Start()
0709 13:16:47.093254 (+   140us) write_op.cc:276] Timestamp: P: 1783603007093052 usec, L: 0
0709 13:16:47.093277 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:16:47.134826 (+ 41549us) log.cc:844] Serialized 2467 byte log entry
0709 13:16:47.296117 (+161291us) op_driver.cc:464] REPLICATION: finished
0709 13:16:47.451347 (+155230us) write_op.cc:301] APPLY: starting
0709 13:16:47.452526 (+  1179us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:47.481689 (+ 29163us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:47.491204 (+  9515us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:47.492041 (+   837us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:47.492217 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:16:47.492259 (+    42us) write_op.cc:312] APPLY: finished
0709 13:16:47.492504 (+   245us) log.cc:844] Serialized 53 byte log entry
0709 13:16:47.492651 (+   147us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:47.492753 (+   102us) write_op.cc:454] Released schema lock
0709 13:16:47.492791 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:47.493152 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:47.493179 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":16,"spinlock_wait_cycles":3968,"child_traces":[["op",{"apply.queue_time_us":123691,"apply.run_cpu_time_us":2814,"apply.run_wall_time_us":48384,"num_ops":6,"prepare.queue_time_us":193323,"prepare.run_cpu_time_us":4034,"prepare.run_wall_time_us":57325,"replication_time_us":172130,"thread_start_us":178436,"threads_started":2}]]}
I20260709 13:16:47.688230  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:47.655683  9800 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:47.665320 10006 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.691149  8223 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:47.692873  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:47.675374  9689 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:47.690152  8004 catalog_manager.cc:5697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 4, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 4 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.687587  8176 pending_rounds.cc:107] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:47.696949  8176 raft_consensus.cc:2889] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:47.699086  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:47.700282  8255 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:47.701578  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:47.702323  8248 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.703016  9921 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:47.703040  9999 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:47.703507  9921 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:47.703747  9999 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.704021  9921 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.704178  9999 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.696105  9743 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.711737  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:16:47.711869  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 70772.2us
I20260709 13:16:47.655879  9696 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:16:47.686038  9916 raft_consensus.cc:697] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:47.675345 10005 consensus_queue.cc:260] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.717298  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.692108  9800 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.695101  9998 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:47.710741  9646 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:47.730850  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.731698  8221 leader_election.cc:336] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.491s (SENT)
I20260709 13:16:47.733574  8179 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:47.734335  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:47.736971  8176 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.736569  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.742415  8253 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:47.727856 10029 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:47.707773  9878 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:16:47.732604 10004 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.727242  9866 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:16:47.727550  9800 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.746667  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:47.747558  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:47.747915  8149 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.746577  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:47.715137 10010 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:16:47.735304  9646 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.749714  8255 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:47.749346  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:47.754863  8102 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:47.759047  8108 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:47.727137  9996 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:16:47.760205  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:47.760910  8254 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:47.727191  9865 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:16:47.743867  9868 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:16:47.764084 10039 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.760200  9996 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:47.748960  9998 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.764909  9996 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:47.765146  9998 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.766463  9996 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.767508  9998 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:47.767791  9996 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.769019  9882 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:47.769616  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:47.762557  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:47.771720  8107 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:47.770238  8179 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:47.773873  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:47.758656  9646 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.756287 10029 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:47.783082  8149 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:47.786005  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 49510.6us
W20260709 13:16:47.794641  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.798597  8149 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:47.800276  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.758425  9879 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:16:47.776140  9993 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:47.801632  8248 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:47.802405  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.784621  9907 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.785092  8103 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:47.758612  9689 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.807055  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:47.813097  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.811066  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.805348  9993 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.802054 10030 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:47.804706  9838 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:47.809158 10016 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:47.816426  9957 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:47.832765 10032 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.773330  9916 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.809127  9944 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:16:47.825809  9993 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:47.862399  8072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.745s (SENT) [suppressed 34 similar messages]
I20260709 13:16:47.864082  9800 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.824976 10030 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:47.834175  9957 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:47.870510 10047 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:16:47.870944 10044 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:16:47.875612  9800 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:47.875870  9921 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.879335  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:47.905328  9944 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:47.907529  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 87826us
I20260709 13:16:47.819293 10028 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:16:47.899215  9957 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.840217  9866 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:16:47.877481 10030 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.908213  8100 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:47.921707  8103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:47.922174  9982 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:47.927997 10042 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.125s	user 0.003s	sys 0.000s
I20260709 13:16:47.912297  9999 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.931500  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:47.911505  9865 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:47.936064  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:47.937692  8181 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:16:47.914371  8099 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:47.934000  8102 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:47.944653  8175 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:47.953249  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:47.953980  8181 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:47.956218  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:47.956914  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:47.957131  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:47.836284 10029 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.957677  8787 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:47.958082  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:47.958534  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:47.959146  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:47.959717  8791 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:47.960011  8104 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:16:47.960641  9999 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:47.960670  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:47.961159  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:47.961908  8784 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:47.962544  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:47.964247  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:47.964425  8790 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:47.964849  8782 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.966025  8177 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:47.966766  8251 raft_consensus.cc:2393] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:47.968504  9993 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:47.969008  8789 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:47.972309  8782 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:47.973475  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.975736  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:47.978014 10039 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:47.978209  8221 leader_election.cc:336] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.637s (SENT)
I20260709 13:16:47.978736  8221 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.988176  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:47.988890  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:47.982352  8176 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:47.995416  8108 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:47.995878  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:47.947582  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 85208.7us
W20260709 13:16:48.013069  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.016456  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:48.018981  8252 raft_consensus.cc:2410] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:47.987592  9866 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:48.015130  9918 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:48.023260  8256 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:48.018976  9743 consensus_queue.cc:1059] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:16:48.024219  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.025034  9743 raft_consensus.cc:3055] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:48.022449 10008 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:47.987774  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:48.025557 10050 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:47.988673 10044 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:16:48.026791 10044 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:48.027189 10044 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:48.027985 10044 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.029119 10044 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:48.029367  9921 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:47.979712  9865 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.025763 10008 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:47.978752 10039 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:48.015151  9928 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.031136  9993 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:47.996405 10049 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:48.031637 10008 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:48.031402  9928 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.032017 10049 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:48.032454  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:48.014624  9996 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:16:48.033061 10049 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.034196  8072 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:48.034461 10049 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:48.036108  9996 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:48.014762  9689 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:48.038050 10048 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.033604  9646 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.038129  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:48.039767  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:48.040050  9800 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:48.040367  8176 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.951192  9982 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.045740  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:48.020789  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:48.042683 10005 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:48.014232  8103 raft_consensus.cc:606] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:48.061456  8251 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:16:48.031304  9865 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:48.055711  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:48.064572  8105 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:48.049975  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 236936us
I20260709 13:16:48.022661  8782 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:48.022711  8784 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:48.067014  8175 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.025413  9743 raft_consensus.cc:740] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:16:48.083366  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 46479.3us
I20260709 13:16:48.063181  8103 raft_consensus.cc:614] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:48.067353  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:48.060115 10039 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:48.088666  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:48.047521  9830 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:16:48.068974  8176 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:48.092578  8181 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.106485  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:48.061971  9928 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:48.089418  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:48.105512  8175 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:48.107187  8105 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:48.107307  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:48.116778  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:48.117640  8178 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:16:48.117846  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.118363  9800 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:48.118878  9800 raft_consensus.cc:697] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:48.119711  9800 consensus_queue.cc:237] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.097476  8100 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:48.121347  8248 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:48.121989  8255 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.081715  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.125097  8257 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.126062  8106 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:48.105683  9916 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:48.076733  9944 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:16:48.038576 10048 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.102972 10039 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.128103  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:48.140264 10040 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:48.140130 10058 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:16:48.141464 10045 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:48.142603  8223 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:48.059636 10050 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:16:48.081916 10016 consensus_queue.cc:1059] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:16:48.152365  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 63015.1us
I20260709 13:16:48.124889  9993 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.126458  8106 pending_rounds.cc:85] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 1
I20260709 13:16:48.128384  9646 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:48.157323 10061 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:48.163295  8106 pending_rounds.cc:107] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:48.151821 10039 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.165035  8106 raft_consensus.cc:2889] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:48.163993  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:48.167515  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:48.167750 10045 raft_consensus.cc:3055] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:48.155895  9999 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:48.171044  8108 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:48.144423  9957 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.155637  8101 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:48.183013  8221 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:48.123471 10029 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:16:48.184970  8223 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:48.126408  9868 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:16:48.187734  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:48.175868 10045 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:48.190672 10030 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.169793  9993 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.159403  8180 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:48.213495  8175 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:16:48.175928 10055 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:48.175953  9928 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.182123 10003 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.190744  9957 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:48.154546  9743 consensus_queue.cc:260] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:48.257663 10064 log.cc:927] Time spent T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:16:48.212193  9689 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:48.214226 10006 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:48.183811  9879 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:16:48.192176 10004 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:16:48.306305 10055 raft_consensus.cc:697] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:48.273541 10049 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:16:48.314101  9743 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:48.257529  9646 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 13:16:48.311690  9868 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:48.313781 10053 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:16:48.300761  9907 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:48.316107 10008 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:48.316440  9982 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:48.350039  8177 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:48.291417 10003 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:48.340997  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 153324us
I20260709 13:16:48.283003  9928 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:48.344426  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 255825us
I20260709 13:16:48.336961 10045 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.326053 10006 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:48.316581  8108 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:48.371145  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:48.371747  8788 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:48.371838  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:48.373361  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:48.368927 10016 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:16:48.399856  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:48.400689  8249 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:48.343444  9868 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:48.408861  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:48.409894  8251 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.365532 10008 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:48.368927  9882 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.369289 10058 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:48.418865  8221 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:48.411906  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.399866  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:48.405489  9982 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:48.406075  9878 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:48.411103 10032 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.413707  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:48.414261 10008 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:48.423936  8783 raft_consensus.cc:2393] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:48.420032 10029 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.449338 10029 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.452308 10029 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:48.453920  9993 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:48.406625 10055 consensus_queue.cc:237] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:48.433861 10071 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:16:48.433995 10082 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:16:48.440848 10039 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.434836  9928 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:48.437788  8786 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:48.432876  8251 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:48.439939  8249 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:48.455157  9878 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:48.432014 10032 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.445528 10003 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:48.417706 10058 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:48.463435 10032 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:48.464109 10058 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.465586 10058 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:48.420449  9882 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.469235  9882 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:48.469501  9868 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.470602  9868 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:48.447328  8782 raft_consensus.cc:2376] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4. Re-sending same reply.
W20260709 13:16:48.474210 10076 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:16:48.473081 10006 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.483219  8788 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
W20260709 13:16:48.486534  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 67776.8us
I20260709 13:16:48.490824  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:48.429244  9921 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.501660  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:48.502451  8183 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.459175 10039 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:48.505445  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 188889us
I20260709 13:16:48.496965 10053 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.494853 10058 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:48.514561  8102 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:48.428964  9865 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:16:48.552227  8108 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:48.545687  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:48.555452  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:48.555796  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:48.558199  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:48.560819  9928 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.496832  9882 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:16:48.562669 10008 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.506165  9921 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.586295  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:48.566994  9982 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:48.572938  8183 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:48.576493  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:16:48.583644  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.584787  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.569106 10030 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:48.587800  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:48.590538  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:48.593811  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:48.593998  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:48.607329  8251 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:48.610392  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.555717 10053 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.611311 10039 consensus_queue.cc:1059] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:48.613092 10053 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:48.609875  9865 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:16:48.615331 10008 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:48.595693  9907 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:48.617357  9907 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:48.618153  8255 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:48.618618  8255 pending_rounds.cc:85] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 1
I20260709 13:16:48.618245  9907 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.619203 10004 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:48.619652 10004 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:48.620070 10004 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.624007  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:48.624518  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:48.625254 10083 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:48.625738 10083 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:48.625846  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:48.626173 10083 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:48.626507  8249 raft_consensus.cc:2410] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:48.626471  8099 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.626786  9993 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.627144  9957 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:48.627452 10091 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.627506  9993 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.628063 10091 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.628916  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:48.609186  9944 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:48.629932  9944 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:48.630221  8100 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:48.630478 10080 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:48.631007 10090 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:48.630898  9944 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.626885 10003 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.609556  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:48.632365  8257 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:48.618885  8255 pending_rounds.cc:107] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:48.633018  8255 raft_consensus.cc:2889] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:48.634099  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.584338  9918 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:48.637504  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:48.639066  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.639822  8252 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:48.644068  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:48.626116  9830 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.634069 10016 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:48.618299  9998 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.652117  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.658401  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:48.659924  8252 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:48.587292  9928 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.660175  8108 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:48.595140  9743 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:16:48.630237 10091 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:48.681282  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:48.682133  8179 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:48.683166  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:48.683880  8179 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:48.686815  8179 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.659201  9830 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.692778  9928 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:48.693372  9830 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:48.694368  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:48.694994  8108 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:48.695889  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:48.696555  8108 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:48.698400  9921 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:48.699156  9993 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:48.699265  8100 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:48.700055 10050 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:48.637831 10082 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:16:48.700609 10050 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.643571  9646 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:16:48.703469  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.704947  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:48.644057  9918 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.705928  8179 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:48.708534  9918 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:48.637400 10003 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.680642  9998 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.649652 10075 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:48.711834 10003 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:48.704363  8252 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:48.718122  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:48.718597  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:48.720861  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.726539  8223 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:48.679855 10016 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:48.735044  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:48.735862  8782 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:48.737843  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:48.739140  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.739741  8252 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
W20260709 13:16:48.739781  7993 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9abaa411847e4bf9907f7af5e2689c7b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a0f96c12124b4e1a816d9fa970464091 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:48.741060  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.741390  9754 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:48.741740 10058 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.741873  9754 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:48.742394 10058 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.742981  9754 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.744330  9754 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:48.744709 10058 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:48.745401  9998 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:48.746213  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.717082 10029 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:16:48.731566 10052 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.826s	user 0.000s	sys 0.004s
I20260709 13:16:48.747480  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.748186  8248 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:48.749148  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.749840  8253 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:48.751998  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:48.753340  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.739610  8791 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:48.754114 10032 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:48.732267  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:48.690596  9982 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.755012 10032 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:48.755461 10032 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:48.755319  9982 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.756537 10032 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.733448  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:48.735455 10016 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.732719  9882 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:48.757804  9882 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.758263  9882 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.727864  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:48.760995  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:48.741307  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:48.737782  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.732146  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:48.744709 10050 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:48.777652  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 139712us
I20260709 13:16:48.781548  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:48.781665  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:48.782495  8183 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:48.782437  8251 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:16:48.785877  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 44680us
I20260709 13:16:48.786684  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:48.759615 10004 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:48.823153  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:48.745311 10058 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:48.828290  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:48.829195  8179 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
W20260709 13:16:48.782928  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.833803  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:48.837496  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:48.824887 10061 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:48.825603 10050 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:48.845371  8183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:48.782126  8249 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:16:48.850250  8257 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:48.827062  9982 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:48.842737 10032 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.846702 10053 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:48.875039  8253 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.834080 10058 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:48.860615  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.885291  8253 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
W20260709 13:16:48.900991  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 67261.8us
I20260709 13:16:48.859179  9646 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:48.901708  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 64273.8us
I20260709 13:16:48.902427  8147 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:48.905802  8183 raft_consensus.cc:606] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:48.906320  9944 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:48.910693 10058 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:48.899662  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:48.912154  9882 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:48.912652 10045 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:48.913178  8100 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:48.914104  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:48.914636  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:48.914714  8100 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:48.915920  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:48.916668  8100 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 2: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:48.916884 10048 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:48.912237  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:48.885996 10090 raft_consensus.cc:697] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:48.858081  9957 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 13:16:48.970569  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 68262.3us
I20260709 13:16:48.972287  8176 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:48.973177  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:48.974022  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 54512.4us
I20260709 13:16:48.975670  8179 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
W20260709 13:16:48.976711  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.912036 10004 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:48.903874  9646 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.987602  8248 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:48.983417  9999 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:48.991882  9999 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.968919  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:48.991897  9866 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.965687 10053 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 13:16:49.009097  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 184959us
I20260709 13:16:48.989447  9646 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.009501  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:48.990340  9944 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.010264  8105 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:48.993186 10048 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.989989  9907 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:48.997040  9999 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:49.047559  9907 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.038358  9944 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.050037  9882 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:49.052392  9944 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.055296  8105 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.053110  9944 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:49.070593 10118 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:49.071015  8784 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:49.071396 10118 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.072760  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:49.057567  8785 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:16:49.057248  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:49.067397  8100 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 2: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:16:49.089519 10107 log.cc:927] Time spent T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:16:49.089833 10101 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 13:16:49.090394 10111 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:49.014531  9866 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.091020 10111 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.093061  9866 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:49.095232 10097 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:16:49.096287 10096 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:16:49.077006  9944 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:49.089536 10098 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:16:49.058490 10048 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.110532  8176 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:49.085991 10100 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:49.093174 10111 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.115049  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:49.117658  8104 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 2: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:49.120179  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 873) took 1027 ms. Trace:
W20260709 13:16:49.140973 10103 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:16:49.143025 10004 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.143594 10004 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.143841 10083 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.120649  8104 rpcz_store.cc:276] 0709 13:16:48.093177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.093325 (+   148us) service_pool.cc:224] Handling call
0709 13:16:49.114876 (+1021551us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b5800002798. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:16:49.120112 (+  5236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3461504}
I20260709 13:16:49.150533  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:49.114657 10100 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.154059  8255 raft_consensus.cc:2393] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 2: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:49.110730 10118 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.068987 10090 consensus_queue.cc:237] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.140964 10053 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:49.130201  8099 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:49.166445  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:49.169072  8176 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:49.153766  9907 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:49.169780  8787 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:49.159884 10100 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.160808  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:49.165216 10004 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:49.178296 10058 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.178676 10102 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:16:49.178891 10058 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:49.180320 10106 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:16:49.182567  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:49.183250  8789 raft_consensus.cc:2393] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:49.171670  8100 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:49.197795  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 923) took 1092 ms. Trace:
I20260709 13:16:49.198539  8182 rpcz_store.cc:276] 0709 13:16:48.092729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.092870 (+   141us) service_pool.cc:224] Handling call
0709 13:16:48.093190 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.170199 (+ 77009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.170229 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.170612 (+   383us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.339786 (+169174us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:48.339842 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.175532 (+835690us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b540033fed4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:49.175600 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.175646 (+    46us) raft_consensus.cc:1685] finished
0709 13:16:49.175658 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.185531 (+  9873us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8602,"raft.queue_time_us":14169,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":29263,"spinlock_wait_cycles":158350720,"thread_start_us":65667,"threads_started":1,"wal-append.queue_time_us":218289}
I20260709 13:16:49.205854  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:49.206604  8256 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 2: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:49.193229 10112 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.181344 10058 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:49.185587  9944 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.170907 10053 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.237771 10048 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:49.223721 10112 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.241858 10112 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:49.246596  9999 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.248318  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:49.253576  8789 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:49.254127 10016 consensus_queue.cc:1059] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:49.254386  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:49.254983 10016 raft_consensus.cc:3055] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:49.255375 10016 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:49.256124 10016 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.251650 10118 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.258919 10118 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.259999  8789 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:49.261757 10053 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:49.265255  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:49.266237  8784 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 3: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:49.267268  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:49.267903  8784 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:49.267822 10100 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.269001  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:16:49.270442  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 522808us
I20260709 13:16:49.272156  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:49.274130  9996 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.274760  9996 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.276930  9996 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.276733  9646 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.273346  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:49.261134 10118 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.257316 10016 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.279532 10099 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.323428 10099 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.326237  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:49.326562 10099 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.327270 10099 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:49.327720 10099 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:49.333045 10119 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.172s	user 0.002s	sys 0.000s
I20260709 13:16:49.329777 10099 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:49.284880  8180 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:16:49.278761  9646 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.338814  8785 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:49.285372 10093 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.342202 10093 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.287945  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:49.351141  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 63268.4us
I20260709 13:16:49.288295  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:49.354866  8108 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:49.288750  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:49.283632  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:49.356202  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:49.357165  8107 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:49.357674  8108 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.286559  9921 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.294847  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:49.295571  8251 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:49.296581  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:49.289286  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:49.298066  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:49.300598  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:49.302525  8791 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:49.292699  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:49.317133  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 919) took 1225 ms. Trace:
I20260709 13:16:49.306767  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:49.358007  8107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:16:49.359349  8248 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
W20260709 13:16:49.360316  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 71113.8us
I20260709 13:16:49.360100  8255 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.360484  8175 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:49.362354  8107 raft_consensus.cc:606] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:49.362103  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55422.1us
I20260709 13:16:49.366825  8107 raft_consensus.cc:614] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:49.368049  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 75455.1us
I20260709 13:16:49.369858  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:49.280407  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:49.360632  8256 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:49.367375  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:49.361585  8177 rpcz_store.cc:276] 0709 13:16:48.091429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.091593 (+   164us) service_pool.cc:224] Handling call
0709 13:16:48.098466 (+  6873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.350458 (+251992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.316881 (+966423us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54002f9254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:49.317078 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578161536}
I20260709 13:16:49.373925  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:49.374926  8147 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:49.375464  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:49.376750  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:49.378544  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:49.383503  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:49.357882  9878 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:49.387460  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:49.315181  9830 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.307090 10100 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:49.372473  8790 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
W20260709 13:16:49.463656  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.362874 10039 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.300654 10055 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:49.287470 10003 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.387967 10099 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:49.363736 10090 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:49.396893  9800 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:49.367935  9646 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.286387  9998 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.358592  9921 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.286850 10091 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.394892 10101 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:49.435547  8108 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:49.277422  9996 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.545756  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:49.363047 10085 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.289470 10080 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.322463  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:49.380885  9689 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:49.283885 10108 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:49.399145  9907 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:49.499297  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 120829us
I20260709 13:16:49.552080  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:49.398551  9878 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.380160 10030 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:49.482837 10032 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.398986 10029 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.153s
I20260709 13:16:49.544390 10090 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:49.487052 10039 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.522454  8005 catalog_manager.cc:5697] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.497591  8784 raft_consensus.cc:2410] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:49.496428 10099 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.544243  8177 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:49.484800 10048 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:49.545670  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:49.318388  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:49.372130 10058 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.126s
I20260709 13:16:49.549222  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:49.499816  9800 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:49.542285 10082 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:16:49.514111  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:49.485564  9830 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.540799  9998 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.547164  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:49.543880  9928 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:49.494637 10055 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.554898  9907 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.497519 10003 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.509167  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:49.641619 10100 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:49.644925 10030 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.560985  9878 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.692809 10030 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.650054 10032 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.667114 10099 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.560710  8783 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:49.675213 10016 consensus_queue.cc:1059] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:49.675689  8177 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:49.675849  9800 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:49.676350 10048 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.647912  9957 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.792807  9957 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:49.793640 10129 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.106s	user 0.001s	sys 0.003s
I20260709 13:16:49.680199  8108 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.398675 10112 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:49.683665  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 169695us
I20260709 13:16:49.640874  9996 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.639689 10080 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.719133 10032 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.681030 10049 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:49.724617 10132 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:49.723475 10140 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:49.686597  8785 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.739962  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 884) took 1014 ms. Trace:
I20260709 13:16:49.739610  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1783) took 1094 ms. Trace:
I20260709 13:16:49.740206  8102 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:49.759878  8791 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:16:49.763638  8255 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:49.768107  9865 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:49.683068 10090 raft_consensus.cc:2764] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:49.828251 10140 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:49.839116 10130 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.111s	user 0.002s	sys 0.002s
I20260709 13:16:49.839413 10140 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:49.689736  9907 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.840348  9944 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.725029 10135 consensus_queue.cc:1059] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:16:49.840948  9944 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.843538  9944 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:49.837553 10032 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.844602  9689 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:49.844760 10032 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.845662 10090 raft_consensus.cc:3055] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:49.846094 10090 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:49.847101 10032 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:49.846966 10090 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.746420  9743 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:49.561417  9993 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:49.739187 10003 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:49.732875  9830 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:49.788647  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 1845) took 1194 ms. Trace:
I20260709 13:16:49.856647  8254 rpcz_store.cc:276] 0709 13:16:48.594131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.594574 (+   443us) service_pool.cc:224] Handling call
0709 13:16:48.594891 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.604612 (+  9721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.604643 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.524412 (+919769us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b2c000e7a78. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:16:49.524922 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.767807 (+242885us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:49.767853 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.767940 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.788317 (+ 20377us) raft_consensus.cc:1685] finished
0709 13:16:49.788340 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.788573 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19730,"raft.queue_time_us":9538,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":3451,"spinlock_wait_cycles":12724608,"thread_start_us":111406,"threads_started":1,"wal-append.queue_time_us":224984}
W20260709 13:16:49.789016 10142 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.095s	user 0.001s	sys 0.003s
I20260709 13:16:49.716179  8099 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:49.747350 10055 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:49.791538 10099 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.864378  9996 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:49.864537  9865 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:49.864737 10099 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:49.865075  9865 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.557703 10085 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.693060  9998 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:49.904794 10141 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 13:16:49.905972 10138 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:16:49.908447 10030 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.902743 10032 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.910228 10140 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.910346 10032 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.912613 10140 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.912714 10032 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.561468  8178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:16:49.914829 10085 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:49.915071  8178 raft_consensus.cc:606] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:49.915418 10085 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.734462  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 218) took 1358 ms. Trace:
I20260709 13:16:49.860566  9993 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.916049  8180 rpcz_store.cc:276] 0709 13:16:48.376532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.416069 (+ 39537us) service_pool.cc:224] Handling call
0709 13:16:48.445646 (+ 29577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.335365 (+889719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.734166 (+398801us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b5400003054. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:49.734397 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1929369344}
I20260709 13:16:49.916623  9800 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.737571 10100 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:49.916061 10085 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.918264 10100 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.919276 10085 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:49.677197  9866 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:16:49.737828 10093 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.724138 10139 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.817910  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.748595 10039 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.749240 10083 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:49.921214 10139 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.921762 10039 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.814889 10082 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.922401 10080 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.922251 10039 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.923516 10139 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.923646  9957 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.550634 10101 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:49.828418  8105 rpcz_store.cc:276] 0709 13:16:48.645023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.064938 (+419915us) service_pool.cc:224] Handling call
0709 13:16:49.090055 (+ 25117us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.283978 (+193923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.284012 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.284483 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.542105 (+257622us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:49.542146 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.542219 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.739342 (+197123us) raft_consensus.cc:1685] finished
0709 13:16:49.739368 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.739541 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195111,"raft.queue_time_us":196787,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":256626,"threads_started":1,"wal-append.queue_time_us":431813}
I20260709 13:16:49.924250 10039 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.925014 10048 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.925400  8105 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:49.861855 10090 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:49.828243  8104 rpcz_store.cc:276] 0709 13:16:48.725786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.148185 (+422399us) service_pool.cc:224] Handling call
0709 13:16:49.148557 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.284032 (+135475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.284059 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.284483 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.557684 (+273201us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:49.557859 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.557930 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.739744 (+181814us) raft_consensus.cc:1685] finished
0709 13:16:49.739770 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.739905 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135113,"raft.queue_time_us":138547,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"spinlock_wait_cycles":52096,"thread_start_us":272842,"threads_started":1,"wal-append.queue_time_us":435045}
I20260709 13:16:49.828492 10132 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.688644  9882 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:49.922482 10082 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.927268 10132 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:49.740600  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 877) took 1104 ms. Trace:
I20260709 13:16:49.933037  8103 rpcz_store.cc:276] 0709 13:16:48.635927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.734175 (+ 98248us) service_pool.cc:224] Handling call
0709 13:16:48.734592 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.268554 (+533962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.268587 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.269021 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.644915 (+375894us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:49.650002 (+  5087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.666705 (+ 16703us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.740320 (+ 73615us) raft_consensus.cc:1685] finished
0709 13:16:49.740357 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.740535 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":533525,"raft.queue_time_us":535015,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":289468,"threads_started":1,"wal-append.queue_time_us":392980}
I20260709 13:16:49.802964 10112 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.937773  8174 raft_consensus.cc:2368] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5.
I20260709 13:16:49.731173  9921 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:49.525738  9646 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:49.853464  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 300372us
I20260709 13:16:49.959040  8074 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:49.551878 10091 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.962224 10148 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:49.962797 10148 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.963228 10148 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:49.856205  9743 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:49.965408  9743 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:49.909258  9907 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.957813 10108 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:49.564284  8106 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:49.927500  8104 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:16:49.925462  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:49.931438 10101 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:49.919489  9865 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.932535 10082 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:49.937656 10112 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:49.689355 10010 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.938243  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 378401us
I20260709 13:16:49.836526 10049 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:49.985039  8105 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:49.915452  8178 raft_consensus.cc:614] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:49.963438 10091 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:50.009940  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:50.033356  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:50.025876  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 347414us
I20260709 13:16:50.034024  8104 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:50.038599  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:50.038908  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:50.040697  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:50.042398  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:50.042689  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.043540  8179 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:50.043474  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:50.047618  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:49.974731  9878 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.051537  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.051894  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:50.052587  8179 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:50.054005  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.054772  8178 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:50.057346  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:50.048745  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.030745  8786 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:50.066831  8180 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:50.061106  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.067829  8254 raft_consensus.cc:2410] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:50.061106  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.075839  8178 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:50.041369  9882 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:50.053934 10083 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:16:50.101743  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.106081  8178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
W20260709 13:16:50.111573  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 53524.7us
I20260709 13:16:50.115573  8178 raft_consensus.cc:606] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:50.112670  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.118731  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.119540  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.119606  8183 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:50.099097  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.114722  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.035204 10010 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.111181  8147 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:50.125087  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:50.121114  8177 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:50.125798  8175 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:50.120308  8254 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
W20260709 13:16:50.129618  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 325303us
W20260709 13:16:50.131754  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 93235.2us
I20260709 13:16:50.120939  8181 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:50.137108  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.113306 10055 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:50.144584 10055 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.145058 10055 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.144618  8178 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:50.139883  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.058213 10060 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:16:50.149644  8256 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:50.149952  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.160456  8182 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:50.158900  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.162092  8183 raft_consensus.cc:2368] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5.
I20260709 13:16:50.152547  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:50.163450  8175 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:50.151814  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:50.114598 10083 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:50.159328  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:16:50.173727  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.123699  9882 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:50.190392  9882 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.134605 10048 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:50.184365  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:50.192152 10048 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.192704 10140 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:50.192746 10048 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.193252 10140 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.193739 10140 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.202970  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:50.135397  9921 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:50.204015  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:50.210184  8788 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:50.203354  8789 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:50.204348  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:50.222440  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:50.169080 10030 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.168509 10143 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:50.183799 10083 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:50.224223  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:50.231724  8787 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:50.225597  8072 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:50.128304 10132 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.114156 10108 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.201227 10093 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:50.213994 10099 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:50.222220 10029 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.238435  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:50.229763  9800 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:50.228603  9996 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:50.221984  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:50.272711  8782 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.236306 10032 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:50.275537 10032 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.217254  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.238629  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:50.277680 10032 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:50.243960  8108 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:50.217849 10075 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:50.279918 10075 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.281574  9865 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:50.281997 10075 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:50.246711 10132 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:50.283368  9865 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:50.283910  9865 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.277067  8785 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
W20260709 13:16:50.229259  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 108383us
I20260709 13:16:50.259792  8072 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:50.230923  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:50.239308  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:50.265508  9996 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.231840  9646 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:50.266518 10049 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:50.266815 10149 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:16:50.257287  9921 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:50.271907 10148 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.279285  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:50.306049  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 66832.3us
I20260709 13:16:50.306331  8108 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:50.245536  8104 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:50.286296 10010 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.240751 10093 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.240495 10016 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:50.315779 10016 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.316563 10159 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:50.316884 10148 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.242251 10099 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.284876 10055 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.291149 10080 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:50.307096  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:50.327419  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:50.297891 10048 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.312583 10157 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:50.314674 10143 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:50.302529  9921 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.317816  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:50.318542  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1790) took 1036 ms. Trace:
I20260709 13:16:50.331596  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:50.258422 10029 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.317608 10093 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.331102  8107 rpcz_store.cc:276] 0709 13:16:49.282594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.394824 (+112230us) service_pool.cc:224] Handling call
0709 13:16:49.395168 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.644302 (+249134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.644350 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.655856 (+ 11506us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.851796 (+195940us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:49.851859 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.851962 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.318334 (+466372us) raft_consensus.cc:1685] finished
0709 13:16:50.318354 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.318480 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":328416,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"thread_start_us":334608,"threads_started":2,"wal-append.queue_time_us":333520}
I20260709 13:16:50.335778  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:50.303028  9800 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:50.336376  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:50.337106  8787 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:50.337558  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:50.332908  9921 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.326188 10080 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.298650 10154 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:16:50.330731 10143 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.314688  9999 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:50.340348  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.350953  8175 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:50.342782  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:50.351976  8182 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.352470  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:50.344179  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:50.229192  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 97384.9us
I20260709 13:16:50.301860 10112 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.325055 10099 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.317198 10159 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.338759  8107 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:16:50.356200  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 64299.5us
I20260709 13:16:50.301486 10140 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.333174  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:50.357816  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:50.346858 10135 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:50.363234  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:50.354987  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 874) took 1721 ms. Trace:
I20260709 13:16:50.338325  9830 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:50.338124  9800 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.354348  8221 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:50.372515  8147 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:50.380493  8107 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:50.349416  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:50.380671  8108 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:50.338441  9998 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:50.347956 10080 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.344728 10148 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:50.385795  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:50.394698  8180 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:50.389909 10048 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.356220 10132 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:50.390235 10016 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:50.384050 10010 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:50.392827 10135 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:50.394635  8783 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:50.393406 10165 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:16:50.401844  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:50.403898  8182 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:50.355880 10143 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.403537  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:50.411530  9921 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.412811 10112 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.394778 10090 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.394416 10055 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:50.421962  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:50.398550  9830 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.403326  9800 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:50.445779  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 50956.6us
I20260709 13:16:50.408082 10049 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:50.404234  9865 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:50.408042 10148 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.437704  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:50.395033  8101 rpcz_store.cc:276] 0709 13:16:48.633104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.641314 (+  8210us) service_pool.cc:224] Handling call
0709 13:16:48.698772 (+ 57458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.266938 (+568166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.266975 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.267445 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.490153 (+222708us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:49.497938 (+  7785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.333328 (+835390us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b5400226ad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:50.335010 (+  1682us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.343413 (+  8403us) raft_consensus.cc:1685] finished
0709 13:16:50.343438 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.354872 (+ 11434us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":546532,"raft.queue_time_us":549493,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":31981312,"thread_start_us":137446,"threads_started":1,"wal-append.queue_time_us":382620}
I20260709 13:16:50.437460 10010 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:50.440186  8785 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.454054  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1787) took 1172 ms. Trace:
I20260709 13:16:50.455411  8782 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:50.438700 10044 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:50.482017  8183 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.456974 10099 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.457821  9830 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.459769  8786 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:50.480881  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:50.457705 10049 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.445055 10159 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.476809 10148 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.443730 10090 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.495011 10055 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:50.495323 10029 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.519080  8183 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:50.520532  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:50.505643  9865 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.501197 10132 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:50.495733 10044 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:50.529543 10016 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.530119 10044 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.530274 10016 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.531405 10044 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.509014 10049 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.540239  9998 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:50.540885  9998 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.543306  9998 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:50.545845 10049 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.494999  8099 rpcz_store.cc:276] 0709 13:16:49.281681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.318082 (+ 36401us) service_pool.cc:224] Handling call
0709 13:16:50.453744 (+1135662us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b540036e2d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:50.453935 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51835264}
I20260709 13:16:50.519891 10055 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.512480 10159 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.528237 10132 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.549168  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48096 (request call id 378) took 1275 ms. Trace:
I20260709 13:16:50.567516  8107 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
W20260709 13:16:50.567951  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 213687us
I20260709 13:16:50.551725 10174 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.575359  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:50.568993  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 283) took 1050 ms. Trace:
W20260709 13:16:50.581740 10101 consensus_meta.cc:287] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.000s
I20260709 13:16:50.505643 10135 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.571990 10055 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.547868  9865 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.562160  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:50.582146 10132 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.595379  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.595763  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.596308  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.596518  8256 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:50.596903  8255 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:50.597822  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.605229  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:50.605942  8101 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.589211  8103 rpcz_store.cc:276] 0709 13:16:49.511999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.936470 (+424471us) service_pool.cc:224] Handling call
0709 13:16:49.936799 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.937059 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:50.232183 (+295124us) log.cc:844] Serialized 14 byte log entry
0709 13:16:50.523700 (+291517us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:50.525047 (+  1347us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:50.528714 (+  3667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.550159 (+ 21445us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.558258 (+  8099us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11322,"prepare.queue_time_us":370959,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":22397,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":25585,"thread_start_us":524332,"threads_started":2,"wal-append.queue_time_us":370769}
I20260709 13:16:50.607508  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:50.608551  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:50.612826  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.615185  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:50.618248  8257 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:50.588934 10140 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:50.621491  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:50.623507  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.624444  8249 raft_consensus.cc:2410] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:50.624660  9865 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.630076  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:50.634812  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:50.636404  8788 pending_rounds.cc:85] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 6
I20260709 13:16:50.636829  8788 pending_rounds.cc:107] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:16:50.637135  8788 raft_consensus.cc:2889] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:50.562145 10010 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.641964  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:50.626684  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:50.600931  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:50.649698  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.602675 10039 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:50.586144 10159 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.664157  8257 raft_consensus.cc:2410] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:50.625252 10032 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:50.653270 10190 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:50.582374  8784 rpcz_store.cc:276] 0709 13:16:49.253266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.268743 (+ 15477us) service_pool.cc:224] Handling call
0709 13:16:50.526073 (+1257330us) spinlock_profiling.cc:243] Waited 75.6 ms on lock 0x7b54005226d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:50.529011 (+  2938us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173806848}
I20260709 13:16:50.632911 10189 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.600476 10179 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:50.618428  8103 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:50.648524  9865 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:50.673828  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:50.679953 10190 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.679369 10032 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.673610  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.617372 10080 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.692127  8249 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:50.693235 10080 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.694043 10032 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:50.694995 10032 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:50.696835 10186 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:50.687364 10189 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.601817 10172 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:16:50.671193  9921 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:50.585747 10174 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.593245 10101 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.685578 10093 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.688532 10190 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.648985 10083 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.697253 10186 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.722225  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.723152  8183 raft_consensus.cc:2410] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:50.682315 10179 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.700484 10080 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.717406  9878 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:50.700335  8783 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:16:50.721460  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.675750 10039 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.684404  9865 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:50.724436  8102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1792) took 1411 ms (client timeout 1799 ms). Trace:
W20260709 13:16:50.783890  8102 rpcz_store.cc:269] 0709 13:16:49.312527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.325964 (+ 13437us) service_pool.cc:224] Handling call
0709 13:16:50.724236 (+1398272us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54000f4454. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:50.724363 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950294400}
W20260709 13:16:50.715677 10184 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:16:50.726665  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.727049  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:50.718938  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.785851  8177 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
I20260709 13:16:50.786624  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.787590  8183 raft_consensus.cc:2368] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5.
I20260709 13:16:50.775710 10179 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.725373 10186 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.793915  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:50.792893  8789 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:50.796450  8177 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:50.723838 10029 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:50.726348 10048 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:50.776695  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:50.776146 10112 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:50.789556  9865 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.807806  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:50.790733 10049 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.816448  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.799052  9878 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.815749  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.795954  8101 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:50.817308  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.817569  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:50.817301  8255 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:50.821169  8256 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:50.815447  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.819841  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:50.821512  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.822315  8250 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:50.822499  9878 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.824648  9878 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:50.815392  8103 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.785820 10080 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.830950  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.849639  8256 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:50.806708 10029 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.808151 10048 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.827996 10173 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.814126 10112 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.854801  8250 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:50.854676  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.825883  9830 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.831629  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.859398  8255 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:50.838374 10147 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.831913 10044 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:50.863020  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.865175  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:50.867982  8178 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:16:50.869513 10194 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:50.871233  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:50.872666  8256 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:50.864547  8249 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:50.860320 10173 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:50.887079  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 260457us
I20260709 13:16:50.887938  8223 leader_election.cc:400] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5.
I20260709 13:16:50.888242  8223 leader_election.cc:403] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:50.885125  9830 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:50.891646  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:50.893836  8256 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.870095 10194 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.895186  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.876688  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:50.899648  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:50.900296  8101 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:50.900735 10101 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.874202 10093 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.871619 10044 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.900785 10174 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.912276  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:50.924898  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:50.899245 10083 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:50.904127 10159 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.867849 10147 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:50.934427  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:50.913723 10039 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:50.917795 10195 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.949052 10173 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.935206 10174 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:50.952538  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:50.961575  9830 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:50.963217 10080 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.965735  8785 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:50.966527 10194 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:50.986398 10132 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:50.987649 10029 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:50.939426 10189 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:50.942214 10083 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.996622  8256 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
W20260709 13:16:51.000403 10143 consensus_meta.cc:287] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.000s
I20260709 13:16:51.001883 10112 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:51.002957  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 79457.2us
I20260709 13:16:50.998168 10186 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.007018  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:51.008980  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 367107us
I20260709 13:16:51.010165  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:51.010983  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:51.013276  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:50.952948 10093 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:50.952998  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1793) took 1640 ms. Trace:
I20260709 13:16:51.000984 10143 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.025216  8252 raft_consensus.cc:2393] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:51.017880 10058 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:51.028359  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:51.019258 10173 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.021054  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:51.027834 10058 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:51.020239  9743 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:16:51.030055 10193 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:16:51.020371 10093 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.020097 10039 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 13:16:51.026593 10080 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:51.204429 10032 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:51.019604 10189 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:51.019004 10048 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:50.990412  9865 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.024291 10154 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.022950  8100 rpcz_store.cc:276] 0709 13:16:49.312769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.683003 (+370234us) service_pool.cc:224] Handling call
0709 13:16:49.692094 (+  9091us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.721921 (+ 29827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.721969 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.722658 (+   689us) log.cc:844] Serialized 26 byte log entry
0709 13:16:50.034197 (+311539us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:50.044676 (+ 10479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.949976 (+905300us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b54001b9254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:50.950033 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.950087 (+    54us) raft_consensus.cc:1685] finished
0709 13:16:50.950101 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.952914 (+  2813us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118337,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"spinlock_wait_cycles":3385728,"thread_start_us":302609,"threads_started":1,"wal-append.queue_time_us":571069}
I20260709 13:16:51.009730 10083 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.021382 10199 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:51.174800  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:51.199414  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 171132us
I20260709 13:16:51.264062  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:51.021661 10191 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:51.207129 10192 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:16:51.204285  9743 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:51.208220  9800 consensus_meta.cc:287] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.721s	user 0.007s	sys 0.003s
I20260709 13:16:51.208834 10080 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.171216 10058 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:51.021785 10148 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.029364  8074 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:51.204473 10159 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.204901 10093 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:51.211782 10188 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:51.259928  8101 raft_consensus.cc:2368] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3.
I20260709 13:16:51.283608  8251 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:51.284876 10199 raft_consensus.cc:697] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:51.260155 10154 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.291409 10174 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:51.308269 10174 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:51.308475 10083 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:51.309520 10174 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.310559  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:51.312090  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:51.262820  8786 consensus_meta.cc:287] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.750s	user 0.009s	sys 0.002s
I20260709 13:16:51.164858 10173 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:51.289700  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 260467us
I20260709 13:16:51.284662 10032 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:51.316356 10032 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.316427  9830 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:51.316569  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:51.316838 10032 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:51.317085  9830 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.318607  9921 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:51.319164  9830 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:51.292945 10159 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.290117 10147 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:51.307513 10080 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:51.319111  9921 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.313100  8100 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:51.294175 10044 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:51.340055  9921 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:51.320393  8101 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:51.341207  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:51.342360  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 896) took 1322 ms. Trace:
I20260709 13:16:51.342549  8100 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:51.342789  8101 rpcz_store.cc:276] 0709 13:16:50.020165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.341517 (+1321352us) service_pool.cc:224] Handling call
0709 13:16:51.341850 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.342038 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.342063 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:51.342104 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:51.342144 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.342201 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.342302 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:51.346536  9865 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:51.347738 10186 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:51.287796  9800 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.349005  8102 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:51.349958  9800 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:51.351146 10032 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.351938 10148 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:51.353170 10162 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.965s	user 0.003s	sys 0.014s
I20260709 13:16:51.320241  8786 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:51.357523  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 898) took 1172 ms. Trace:
I20260709 13:16:51.358024  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 288) took 1075 ms. Trace:
I20260709 13:16:51.283200  8755 leader_election.cc:400] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5.
I20260709 13:16:51.307214 10143 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:51.358595  8108 rpcz_store.cc:276] 0709 13:16:50.282802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.317558 (+ 34756us) service_pool.cc:224] Handling call
0709 13:16:51.357859 (+1040301us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b540030e3d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:51.357959 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114215808}
I20260709 13:16:51.359419  8755 leader_election.cc:403] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:51.359555 10199 consensus_queue.cc:237] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.360332 10044 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:16:51.363272  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 83526.7us
I20260709 13:16:51.364272  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:51.380640  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:51.381402  8787 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:51.374958 10055 consensus_meta.cc:287] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.774s	user 0.011s	sys 0.000s
I20260709 13:16:51.373302 10191 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:51.409842  9743 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:51.412243 10195 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5.
I20260709 13:16:51.415717  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:51.427070  8783 raft_consensus.cc:2393] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:51.427484  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 286) took 1257 ms. Trace:
I20260709 13:16:51.427847  8102 rpcz_store.cc:276] 0709 13:16:50.170498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.796246 (+625748us) service_pool.cc:224] Handling call
0709 13:16:51.427295 (+631049us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54000f4454. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:51.427430 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236869504}
I20260709 13:16:51.428112  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:51.428814  8783 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:51.416564 10053 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.419981 10173 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:51.420742  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:51.422941 10016 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:51.424396  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 895) took 1404 ms. Trace:
I20260709 13:16:51.438239  8107 rpcz_store.cc:276] 0709 13:16:50.019872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.403254 (+383382us) service_pool.cc:224] Handling call
0709 13:16:51.424178 (+1020924us) spinlock_profiling.cc:243] Waited 91.8 ms on lock 0x7b54003f3254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:51.424320 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211239296}
W20260709 13:16:51.424882  8103 consensus_meta.cc:287] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.572s	user 0.007s	sys 0.000s
I20260709 13:16:51.425400  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:16:51.425846  8106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1789) took 2143 ms (client timeout 1981 ms). Trace:
I20260709 13:16:51.440563  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:51.441883  8788 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:51.425726  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:51.358170  8100 rpcz_store.cc:276] 0709 13:16:50.184782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.356321 (+1171539us) service_pool.cc:224] Handling call
0709 13:16:51.356755 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.357005 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.357047 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:51.357111 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:51.357176 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.357269 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.357419 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:51.425441  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1796) took 2024 ms. Trace:
I20260709 13:16:51.443323  8105 rpcz_store.cc:276] 0709 13:16:49.401215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.926135 (+524920us) service_pool.cc:224] Handling call
0709 13:16:49.926422 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.031568 (+105146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.425178 (+1393610us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b54003c3554. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:51.425348 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134294272}
W20260709 13:16:51.430354 10179 consensus_meta.cc:287] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.002s
W20260709 13:16:51.440440  8106 rpcz_store.cc:269] 0709 13:16:49.282343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.288502 (+  6159us) service_pool.cc:224] Handling call
0709 13:16:51.425647 (+2137145us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540040b0d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:51.425745 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477133056}
I20260709 13:16:51.413282  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:51.453001  8787 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:51.456591  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:51.408991 10132 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:51.459841  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 46691.1us
I20260709 13:16:51.430352  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:51.468004  8105 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:51.469542  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:51.471181  8788 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:51.482585  8147 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:51.483004  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:51.483927  8789 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:51.440470 10143 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:51.488197  8147 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:16:51.439275 10135 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.014s	sys 0.017s
I20260709 13:16:51.489920  8099 raft_consensus.cc:2393] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:51.490437  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 900) took 1304 ms. Trace:
W20260709 13:16:51.490041 10135 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.014s	sys 0.017s
I20260709 13:16:51.491420 10154 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:51.491226 10143 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.441461  8103 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
W20260709 13:16:51.493721 10190 consensus_meta.cc:287] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.766s	user 0.005s	sys 0.006s
I20260709 13:16:51.494379  8100 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:51.494150 10190 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.496243 10190 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:51.493741  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 902) took 1134 ms. Trace:
I20260709 13:16:51.461910  8787 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:51.430449 10032 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:51.497860  9996 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:51.498667 10048 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:51.499536 10090 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:51.499459 10048 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.407615 10055 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.466172  9689 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:51.487922  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:51.505620  8789 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:51.467443  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:51.486373  8786 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:51.507730  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:51.441488 10053 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:51.511197  8174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 224) took 1955 ms (client timeout 1867 ms). Trace:
I20260709 13:16:51.497134  8103 rpcz_store.cc:276] 0709 13:16:50.358990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.703644 (+344654us) service_pool.cc:224] Handling call
0709 13:16:51.493677 (+790033us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:51.501610 10032 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.490926 10147 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:51.515177  8253 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:16:51.512408  8174 rpcz_store.cc:269] 0709 13:16:49.548674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.548937 (+   263us) service_pool.cc:224] Handling call
0709 13:16:51.504326 (+1955389us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b5400101154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:51.504447 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617996032}
I20260709 13:16:51.462250 10179 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.502200  8099 rpcz_store.cc:276] 0709 13:16:50.185609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.420497 (+1234888us) service_pool.cc:224] Handling call
0709 13:16:51.490372 (+ 69875us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:51.509045 10154 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:51.521384  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 223367us
I20260709 13:16:51.510157 10090 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:51.512517 10135 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:51.527427  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:51.529117  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:51.530367  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:51.535334  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:51.546795  8178 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:51.537019  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:51.538704  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:51.543212  8174 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:51.551222  8251 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:51.551617  8072 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:16:51.585356  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 44221.3us
I20260709 13:16:51.595209  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:51.541671 10190 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:51.545179 10090 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.559902  8072 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:16:51.657785  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 97985.5us
I20260709 13:16:51.658802  8072 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:51.601454 10170 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:51.556638 10159 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:51.521890 10032 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.554682 10173 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:51.596873  9996 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:51.561069 10143 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:51.607352  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:16:51.757030 10205 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:16:51.757270  8783 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:51.542255 10154 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.601827  9743 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:51.758589  9743 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.760339 10154 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:51.760658  9743 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:51.550880 10135 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.602394 10048 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:51.763535 10048 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:51.764067 10048 raft_consensus.cc:697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:51.604530 10055 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:51.611315 10082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.380s	user 0.018s	sys 0.031s
I20260709 13:16:51.599123 10058 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:51.765887 10082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.543s	user 0.018s	sys 0.031s
I20260709 13:16:51.767251 10058 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:51.653638  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:51.768388  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 114832us
I20260709 13:16:51.769421  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:51.771132  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:51.772203  8755 leader_election.cc:400] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5.
I20260709 13:16:51.772480  8755 leader_election.cc:403] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:51.801739  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:51.720130 10174 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:51.805699  8789 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:51.803278  9743 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:51.803452 10189 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:51.803282 10198 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5.
I20260709 13:16:51.740298 10206 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:51.749248 10148 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.676146 10093 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.800966 10191 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:51.798735  9996 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:16:51.826082  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 320004us
I20260709 13:16:51.806700 10016 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:51.738595 10190 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.809048 10174 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:16:51.813768 10181 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.260s	user 0.001s	sys 0.001s
I20260709 13:16:51.738752 10170 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.808139 10189 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:51.806699  9743 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:51.773885 10173 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.812660  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:51.847267  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 359113us
I20260709 13:16:51.765165 10048 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.814459 10206 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:51.921814  8147 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:51.848229 10053 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:51.847833 10016 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:51.846359 10145 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:51.906240 10174 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:51.899646 10135 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:51.898541 10179 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:51.834647 10148 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.917493  9743 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.918388 10189 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:51.960417  9689 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:51.966164  9907 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:51.996630  9907 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:51.997107  9907 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.997495  9907 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:51.999614 10212 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:16:52.000164  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 1853) took 1184 ms. Trace:
W20260709 13:16:52.000872 10214 log.cc:927] Time spent T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:16:52.001385  8180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 943) took 1870 ms (client timeout 1782 ms). Trace:
I20260709 13:16:52.001843 10217 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.002362  9689 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.002561 10217 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.972631 10145 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:51.971237  9996 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:51.984707 10093 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:51.986266 10201 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.772s	user 0.000s	sys 0.016s
I20260709 13:16:51.988113  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 1863) took 1947 ms. Trace:
I20260709 13:16:51.971808  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1797) took 1934 ms. Trace:
I20260709 13:16:51.995419  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 947) took 1634 ms. Trace:
I20260709 13:16:51.961063 10206 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:52.007480  8178 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:52.000627  8253 rpcz_store.cc:276] 0709 13:16:50.816265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.817084 (+   819us) service_pool.cc:224] Handling call
0709 13:16:51.999938 (+1182854us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b54002ae9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:52.000090 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596470144}
I20260709 13:16:51.970197 10016 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:52.018448  8248 rpcz_store.cc:276] 0709 13:16:50.040385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.040548 (+   163us) service_pool.cc:224] Handling call
0709 13:16:50.040858 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:50.041237 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:51.375022 (+1333785us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b18002ee820. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dcd9c0a 00007fa5a7419219 00007fa59dd61a40 00007fa59dd5c4e4 00007fa59dd5c455 00007fa5a48443c7 00007fa5a0e569a7 00007fa5a0e660bf 00007fa5a0e66038
0709 13:16:51.525648 (+150626us) log.cc:844] Serialized 14 byte log entry
0709 13:16:51.816354 (+290706us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:51.834871 (+ 18517us) log.cc:844] Serialized 26 byte log entry
0709 13:16:51.835011 (+   140us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:51.835045 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.835118 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:51.987713 (+152595us) raft_consensus.cc:1685] finished
0709 13:16:51.987833 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.988034 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18046,"prepare.queue_time_us":1356694,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":627,"raft.run_cpu_time_us":2101,"raft.run_wall_time_us":30540,"spinlock_wait_cycles":66966400,"thread_start_us":331621,"threads_started":2,"wal-append.queue_time_us":360837}
W20260709 13:16:52.016587 10203 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.416s	user 0.001s	sys 0.000s
I20260709 13:16:52.020473  8175 rpcz_store.cc:276] 0709 13:16:50.361183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.361338 (+   155us) service_pool.cc:224] Handling call
0709 13:16:50.361677 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:50.371083 (+  9406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:50.371112 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:50.381936 (+ 10824us) log.cc:844] Serialized 52 byte log entry
0709 13:16:50.522074 (+140138us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:50.592176 (+ 70102us) log.cc:844] Serialized 14 byte log entry
0709 13:16:50.598363 (+  6187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.598474 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:51.516620 (+918146us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b1800046960. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:16:51.994995 (+478375us) raft_consensus.cc:1685] finished
0709 13:16:51.995120 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.995334 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10274,"prepare.queue_time_us":88979,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":7493,"raft.queue_time_us":10397,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":17680,"spinlock_wait_cycles":4821888,"thread_start_us":140848,"threads_started":2,"wal-append.queue_time_us":198942}
I20260709 13:16:52.005314 10217 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:52.001909  8180 rpcz_store.cc:269] 0709 13:16:50.130981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.133983 (+  3002us) service_pool.cc:224] Handling call
0709 13:16:52.001151 (+1867168us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x7b5400011154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:52.001305 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153881472}
I20260709 13:16:52.038975 10217 raft_consensus.cc:993] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:16:52.057823  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.059038  8175 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:52.062155  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 245) took 1466 ms. Trace:
I20260709 13:16:52.062395  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.064072  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.065390  8182 raft_consensus.cc:2410] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:52.065254  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 262442us
I20260709 13:16:52.045849 10090 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:52.068653 10222 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:52.068549  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:52.067832  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:52.069698  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:52.069484  8104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 897) took 2049 ms (client timeout 1995 ms). Trace:
I20260709 13:16:52.071635  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.025213  8101 rpcz_store.cc:276] 0709 13:16:50.035202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.344778 (+1309576us) service_pool.cc:224] Handling call
0709 13:16:51.345083 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.345279 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:51.489705 (+144426us) log.cc:844] Serialized 14 byte log entry
0709 13:16:51.866750 (+377045us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:51.903222 (+ 36472us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:51.919913 (+ 16691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.961602 (+ 41689us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.969167 (+  7565us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":200597,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":103,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":36389,"thread_start_us":456199,"threads_started":2,"wal-append.queue_time_us":529251}
I20260709 13:16:52.072590  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:52.070861  9743 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.073588  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.074577  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.075006 10112 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:52.076617  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:52.078729  9993 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:52.056181 10221 raft_consensus.cc:1081] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
W20260709 13:16:52.088780  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 167137us
I20260709 13:16:52.089999  8182 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:52.090852  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:52.073096 10099 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:52.088304  8104 rpcz_store.cc:269] 0709 13:16:50.020471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.057090 (+ 36619us) service_pool.cc:224] Handling call
0709 13:16:52.069243 (+2012153us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b540001b8d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:52.069386 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430692096}
I20260709 13:16:52.093387  8183 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:52.100205  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.095446  8180 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.101118  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:52.131683  8179 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.094130 10191 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:52.132725  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.109129  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:52.101797  8175 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:52.133322  8177 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:52.133455  8182 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.134099  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.134212  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:16:52.088320  8786 consensus_meta.cc:287] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.000s
I20260709 13:16:52.135186  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.135455  8786 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
W20260709 13:16:52.103621  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 256544us
I20260709 13:16:52.136410  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:52.137494  9743 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:52.140022  9743 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:52.140661  9743 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.143069 10190 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:52.134763  8177 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:52.144460  8182 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:52.148742  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.151968  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:52.145766  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:52.153231  9743 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:52.155115  8182 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:52.158638  8177 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:52.161464  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.162844  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:52.163972  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:52.169265  8253 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.164801  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.171897  8248 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:52.165606  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.161798  8174 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:52.174126  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:52.176128  8174 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.165944  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:52.143985  9907 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.166862  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.184157  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.184929  8250 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:52.178830  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:52.185875  8256 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:52.179759  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:52.187605  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.188290  8248 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:52.190043  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.191219  8250 raft_consensus.cc:2410] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:52.189194  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.192341  8248 raft_consensus.cc:2410] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:52.173686  8183 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:52.159830 10170 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:52.149219 10145 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:52.103753 10226 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.206372  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:52.207392  8183 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.216341 10217 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:52.216815 10217 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:52.217172 10217 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:52.159708 10032 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:52.224721  8176 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:52.172273 10221 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:52.231442  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:52.233269  8182 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:52.234486  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.239593  8250 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:52.246282  8253 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:52.211045 10099 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.259800  8248 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:52.253327  8183 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:52.247934  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.274724  8182 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:52.254819  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 906) took 1358 ms. Trace:
I20260709 13:16:52.275760  8256 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:52.211786 10148 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:52.292706  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 190107us
I20260709 13:16:52.290941  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.218886  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:52.275578  8108 rpcz_store.cc:276] 0709 13:16:50.896076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.359700 (+463624us) service_pool.cc:224] Handling call
0709 13:16:51.359982 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.360173 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:51.513418 (+153245us) log.cc:844] Serialized 14 byte log entry
0709 13:16:52.254359 (+740941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:52.254434 (+    75us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:52.254500 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.254584 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:52.254747 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1261,"prepare.queue_time_us":241994,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":67399,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":9052,"thread_start_us":891982,"threads_started":3,"wal-append.queue_time_us":480177}
I20260709 13:16:52.296424  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.297904  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.298915  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.299507  8250 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:52.299971 10140 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.300573  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:52.300434 10140 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:52.300434  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.302779 10140 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:52.303638  8248 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:52.306845  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:52.305902  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:52.310072  8183 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:52.101884 10112 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:52.314941  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.237843 10221 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.337630  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:52.338792  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 535) took 2137 ms. Trace:
I20260709 13:16:52.312674  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.339206  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:52.339661  8183 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:52.340137  8786 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:52.337206  8249 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:52.333704  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:52.339247  8791 rpcz_store.cc:276] 0709 13:16:50.201409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.201589 (+   180us) service_pool.cc:224] Handling call
0709 13:16:52.338143 (+2136554us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:16:52.338312 (+   169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.338479 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.338500 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:52.338537 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:52.338577 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.338623 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:52.338719 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13587200}
I20260709 13:16:52.345250  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:52.346694  8182 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.349624  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:52.350291  8784 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:52.295032 10099 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.314730  8221 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:52.338737  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:52.370532  8788 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:16:52.371909  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 57236.5us
I20260709 13:16:52.310266  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:52.373478  8221 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:52.231302 10226 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.377000  8175 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:52.374145 10090 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:52.381032  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:52.381470 10140 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:52.419217  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:52.419090 10140 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.356324 10221 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:52.419960  8255 raft_consensus.cc:2393] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:16:52.420389  8255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 1866) took 1497 ms (client timeout 1631 ms). Trace:
I20260709 13:16:52.423054  8783 raft_consensus.cc:2410] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:52.389611 10191 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:52.425052 10191 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.376950 10179 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:52.262585  8253 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:52.445348  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:52.445717  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.448035  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:16:52.449648  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 139468us
I20260709 13:16:52.450584  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:52.420745  8255 rpcz_store.cc:269] 0709 13:16:50.923509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.923676 (+   167us) service_pool.cc:224] Handling call
0709 13:16:52.419057 (+1495381us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b5800052298. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:16:52.420336 (+  1279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11414400}
I20260709 13:16:52.299443  8179 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:52.476390  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.479137  8177 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:52.483631  8182 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:52.417112 10157 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:52.485296 10197 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.488428 10157 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.490300  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:52.452687 10179 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:52.452883 10075 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.485734 10145 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.488618 10090 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:52.488888 10135 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:52.499492  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:52.497052  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:16:52.541735  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 44781.6us
I20260709 13:16:52.497720 10157 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:52.501098 10179 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:52.498042 10234 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:52.540783  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 345737us
W20260709 13:16:52.543047  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 43623.4us
I20260709 13:16:52.509269 10145 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.556557  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:52.557472 10239 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:52.557878 10239 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:52.558247 10239 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.495894  9907 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:52.543180  8074 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:52.494330 10099 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:52.562487  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:16:52.524441 10147 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.001s	user 0.013s	sys 0.038s
I20260709 13:16:52.563035 10099 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:52.563707 10139 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:52.564469 10139 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:52.558164 10145 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:52.565631 10139 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:52.513128 10090 raft_consensus.cc:697] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:16:52.554692 10044 consensus_meta.cc:287] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 1.194s	user 0.013s	sys 0.011s
I20260709 13:16:52.526834 10135 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:52.542039 10226 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:52.568009  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:16:52.563376 10147 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.013s	sys 0.039s
I20260709 13:16:52.553011 10093 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:52.508347 10075 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.568758 10234 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.555361 10237 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:52.500108 10197 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:52.586820 10112 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:52.587051 10044 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5.
I20260709 13:16:52.587709 10148 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:52.588806  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:52.580374  8174 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:52.598670  8790 raft_consensus.cc:2410] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:52.599388  8183 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:52.593130 10226 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:16:52.589313  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:52.602813  8104 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:52.592270 10237 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.584767 10147 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:52.603961 10237 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.604259  8180 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:52.604744 10147 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.607750 10148 raft_consensus.cc:697] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:52.608891 10148 consensus_queue.cc:237] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:52.609835 10231 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:16:52.610414 10173 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:52.592686 10234 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:52.603644 10206 consensus_meta.cc:287] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.572s	user 0.022s	sys 0.005s
I20260709 13:16:52.614696  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.615686  8256 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:52.614777  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:52.623431  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:52.630281  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.591526  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:52.633451  8004 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36106 (request call id 197) took 5716 ms. Trace:
I20260709 13:16:52.634678  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:52.635861  8174 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:52.634735  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:52.637024 10090 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.643311  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:16:52.644229  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 52821.8us
I20260709 13:16:52.633987  8004 rpcz_store.cc:276] 0709 13:16:46.917535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.917725 (+   190us) service_pool.cc:224] Handling call
0709 13:16:52.633354 (+5715629us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:47.726878 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:47.806285 (+ 79407us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:47.807105 (+   820us) write_op.cc:435] Acquired schema lock
0709 13:16:47.809346 (+  2241us) tablet.cc:662] Decoding operations
0709 13:16:47.906913 (+ 97567us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:47.911990 (+  5077us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:47.914158 (+  2168us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:16:47.925791 (+ 11633us) tablet.cc:701] Row locks acquired
0709 13:16:47.925821 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:16:47.926023 (+   202us) write_op.cc:270] Start()
0709 13:16:47.926184 (+   161us) write_op.cc:276] Timestamp: P: 1783603007925968 usec, L: 0
0709 13:16:47.926236 (+    52us) op_driver.cc:348] REPLICATION: starting
0709 13:16:47.927105 (+   869us) log.cc:844] Serialized 1365 byte log entry
0709 13:16:48.121967 (+194862us) op_driver.cc:464] REPLICATION: finished
0709 13:16:48.399478 (+277511us) write_op.cc:301] APPLY: starting
0709 13:16:48.405544 (+  6066us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:48.419133 (+ 13589us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:48.427922 (+  8789us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:48.434513 (+  6591us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:48.434697 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:16:48.434745 (+    48us) write_op.cc:312] APPLY: finished
0709 13:16:48.434979 (+   234us) log.cc:844] Serialized 35 byte log entry
0709 13:16:48.435162 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:48.435258 (+    96us) write_op.cc:454] Released schema lock
0709 13:16:48.435302 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:48.435651 (+   349us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:48.435681 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":79974,"reported_tablets":17,"spinlock_wait_cycles":14208,"child_traces":[["op",{"apply.queue_time_us":250540,"apply.run_cpu_time_us":2326,"apply.run_wall_time_us":36195,"num_ops":3,"prepare.queue_time_us":26376,"prepare.run_cpu_time_us":4817,"prepare.run_wall_time_us":200563,"replication_time_us":195563,"thread_start_us":235753,"threads_started":2}]]}
I20260709 13:16:52.634239  8005 catalog_manager.cc:5697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 1 to 3, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 3 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.647066  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:52.599574 10093 raft_consensus.cc:697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:52.653314  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:52.658964  8005 catalog_manager.cc:5697] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 2 to 3, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 3 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:52.664556  8177 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:52.635488 10112 raft_consensus.cc:2764] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:16:52.654174  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:52.715804  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 61705.9us
W20260709 13:16:52.714639  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 91289.9us
I20260709 13:16:52.716701  8221 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:52.722425  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.724059  8174 raft_consensus.cc:2393] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:52.585887  9907 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 13:16:52.723825  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.732324  8251 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:52.652096 10140 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:52.669852 10174 consensus_meta.cc:287] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.004s
I20260709 13:16:52.734265  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:52.666848  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:52.649394 10229 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:52.734500  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.729907 10166 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:52.722901  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:52.767958  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:52.770421  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:52.779385  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.780872  8105 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:52.630352 10206 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.721555  9999 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:52.745658 10053 raft_consensus.cc:2764] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:16:52.786840  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 69994.8us
W20260709 13:16:52.768044 10245 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:16:52.741886  9878 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.769261 10191 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:52.780198 10166 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.789465 10226 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.785770 10044 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:52.822626  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:52.823457  8105 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:16:52.770242 10174 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.808535 10191 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.807682  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:52.817155 10166 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:52.728590 10135 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:52.825598 10016 consensus_meta.cc:287] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.791s	user 0.008s	sys 0.026s
W20260709 13:16:52.864370  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 216244us
I20260709 13:16:52.824695 10227 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:52.865592  8223 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.129:45123 timed out after 2.168s (SENT) [suppressed 3 similar messages]
W20260709 13:16:52.866382  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 206728us
I20260709 13:16:52.807664  9878 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.868913  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:52.859480 10244 log.cc:927] Time spent T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 13:16:52.872498  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 82813.1us
I20260709 13:16:52.875262  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:52.876150  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:52.853263 10191 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:52.806743 10093 consensus_queue.cc:237] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:52.882624  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:52.828610 10044 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.825100 10226 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:52.902365  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.903191  8256 raft_consensus.cc:2410] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:52.905818  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.906634  8256 raft_consensus.cc:2368] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5.
I20260709 13:16:52.897907  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:52.897341  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:52.898861  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:52.908313  8104 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:52.908420  8250 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:52.899822  8251 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:52.881876 10139 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:52.876706  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:16:52.913038 10246 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 13:16:52.913786 10256 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:16:52.917167  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.968340  8223 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:53.018432  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:52.927510  9996 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:16:52.928212 10261 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:52.929978  8786 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:52.902047 10146 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:52.885027  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:52.869907 10016 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.873922 10227 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.897926 10242 consensus_queue.cc:1059] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:16:52.062690  8254 rpcz_store.cc:276] 0709 13:16:50.595617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.595760 (+   143us) service_pool.cc:224] Handling call
0709 13:16:50.596114 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.596321 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:51.641527 (+1045206us) log.cc:844] Serialized 14 byte log entry
0709 13:16:52.061718 (+420191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:52.061788 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:52.061866 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.061950 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:52.062085 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":803816,"prepare.queue_time_us":814815,"prepare.run_cpu_time_us":21,"prepare.run_wall_time_us":21,"raft.queue_time_us":16172,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":17175,"thread_start_us":631328,"threads_started":2}
I20260709 13:16:53.055022  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:53.055358  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:53.056315  8254 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:52.900633 10148 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:52.956758  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:53.057989  8789 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:52.964080  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:53.012454  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.900825 10010 raft_consensus.cc:2764] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:16:52.970077  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:53.015451  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:53.063162  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 47799.8us
I20260709 13:16:53.059943  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:53.064357  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:52.960071  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:52.885176 10090 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:53.023593  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.024783  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:53.028239  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 61866.3us
I20260709 13:16:53.029083  8250 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:53.070793  8252 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:16:52.936079 10189 consensus_meta.cc:287] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.918s	user 0.010s	sys 0.010s
W20260709 13:16:52.927570 10253 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:16:52.955286 10221 consensus_meta.cc:287] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.009s
I20260709 13:16:53.033785  8790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 548) took 1630 ms. Trace:
W20260709 13:16:52.972777 10264 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:16:53.035491  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:16:52.968823 10228 log.cc:927] Time spent T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.585s	user 0.000s	sys 0.009s
I20260709 13:16:53.037392  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:52.975535 10239 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.085826  8104 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:53.047583 10139 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:52.914857 10053 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:52.938791 10198 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.964116  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:52.960474 10197 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:52.970813 10044 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:52.946794 10226 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:52.946179 10075 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.050814  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:53.032235  9993 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.030063  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:53.031193  9918 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.065589  8107 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:53.102582  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:53.087450 10268 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.044672 10146 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.960172 10179 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.074497  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:53.074649  8791 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:52.951150 10234 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.078008  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:53.079700  8147 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:53.084048  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.081079  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:52.940708 10237 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:52.971410  8180 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:53.082285 10090 raft_consensus.cc:697] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:53.082007  8790 rpcz_store.cc:276] 0709 13:16:51.403327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.403648 (+   321us) service_pool.cc:224] Handling call
0709 13:16:53.022952 (+1619304us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540051a4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:53.033689 (+ 10737us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2653494656}
I20260709 13:16:53.095623  8254 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:53.036288  9996 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.096989  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:52.966552 10191 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.069604  9907 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:53.144567  9907 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:53.053737  8101 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
W20260709 13:16:53.098224  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 79856.3us
I20260709 13:16:53.145488  9907 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.146442  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.146519  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:53.147075  8101 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:53.148444  8101 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:53.065500 10263 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:53.103564  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.150485  8107 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:53.151924  8107 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:53.036870 10183 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.078023 10099 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.077461  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.087688  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:53.119812  8102 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.110713  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:16:53.123844  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 44258.9us
I20260709 13:16:53.088101 10206 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:53.129689  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.208679  8253 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
W20260709 13:16:53.132304  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 57901.3us
I20260709 13:16:53.133947  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.076781 10166 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.134614  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:53.212729  8790 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:53.135468  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.105626  9993 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.136674  9918 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.114632 10075 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:53.137936  8103 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 5: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:53.138460 10044 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.087746 10221 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.128055  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.140131  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.210541  9878 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:53.155596  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.129909 10048 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:53.165463  8107 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:53.082821 10189 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.153594 10139 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.152994  8149 leader_election.cc:400] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5.
I20260709 13:16:53.283563  8149 leader_election.cc:403] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:53.130786 10229 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:53.126255 10197 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.127545  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:53.192906 10140 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:53.104187 10053 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.146647  9907 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.166788  9999 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.216256  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:53.193959 10228 log.cc:927] Time spent T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:16:53.222306  8790 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:53.283927  8102 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:53.106317 10198 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.227171  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.357983  8254 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
W20260709 13:16:53.206365 10217 consensus_meta.cc:287] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.989s	user 0.021s	sys 0.000s
I20260709 13:16:53.244508  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:53.204696 10157 consensus_meta.cc:287] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
I20260709 13:16:53.194216 10148 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:53.120255 10268 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.363643 10148 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.364378 10268 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.206516  9996 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.148661 10234 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.275139  8256 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:53.275250  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.278368  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:53.280416  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.365589  8255 raft_consensus.cc:2410] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:53.204443 10099 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.365736  8107 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:53.203114 10090 consensus_queue.cc:237] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.365772  8253 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 5: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:53.347815  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.367439  8104 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
W20260709 13:16:53.353134  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 137001us
W20260709 13:16:53.286240  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 221914us
I20260709 13:16:53.368505  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:53.324497  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 175945us
I20260709 13:16:53.369401  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:53.369339  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:53.384011  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:16:53.296286  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 143439us
I20260709 13:16:53.282538 10206 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:53.245968 10273 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:53.244728 10242 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.256080  8789 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:16:53.366675  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:53.402112  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.402406  8785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 390) took 1899 ms. Trace:
I20260709 13:16:53.402577 10227 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.402871  8785 rpcz_store.cc:276] 0709 13:16:51.502781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.503858 (+  1077us) service_pool.cc:224] Handling call
0709 13:16:51.519936 (+ 16078us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:51.604858 (+ 84922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.606641 (+  1783us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:51.741956 (+135315us) log.cc:844] Serialized 26 byte log entry
0709 13:16:52.085562 (+343606us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:52.170344 (+ 84782us) log.cc:844] Serialized 14 byte log entry
0709 13:16:52.206214 (+ 35870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.219449 (+ 13235us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:52.968252 (+748803us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:16:53.398496 (+430244us) raft_consensus.cc:1685] finished
0709 13:16:53.402149 (+  3653us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.402323 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52125,"prepare.queue_time_us":60363,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":14931,"raft.queue_time_us":75879,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":201,"spinlock_wait_cycles":27482880,"thread_start_us":206089,"threads_started":1,"wal-append.queue_time_us":473871}
W20260709 13:16:53.405886 10255 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.495s	user 0.000s	sys 0.004s
I20260709 13:16:53.394904 10237 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.407603  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:53.407858  8789 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:53.407972 10099 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.408502 10091 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:53.408895  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.347067  8782 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:53.409121 10091 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.410131 10216 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:16:53.385928 10272 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:16:53.357721 10252 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:53.412846 10091 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.362144 10140 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.346276 10189 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.352066  9993 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:53.359154 10229 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:53.343237 10166 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:53.503913  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:53.504581  8177 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.350708  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.350872 10275 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:53.507592  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:53.394045 10271 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:16:53.394898 10053 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.395089 10221 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.395813 10250 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:53.397104  8149 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:53.397953 10239 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.281136 10048 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.368830  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:53.370730  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:53.568861  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 200143us
W20260709 13:16:53.569110  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 198500us
I20260709 13:16:53.569566  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:53.404484 10198 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.570374  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:53.410408  8253 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:53.385135 10179 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:53.411155  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.571980  8104 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:53.572840  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.326886 10226 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5.
I20260709 13:16:53.505013  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:53.387802 10191 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.276741 10044 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.283174  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.362376  8784 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.586292  8177 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:16:53.367925  8783 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:53.591137 10044 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:53.591596  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.591782  8782 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:53.344687  9918 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.592104 10060 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:53.592348  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.592990 10060 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:53.593139  9918 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:53.593403 10060 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:53.593703  9918 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.594230 10060 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.595347 10060 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.595844  9918 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:53.361109 10197 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.597589  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.598402  8100 raft_consensus.cc:2393] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:53.599100 10197 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:53.599332  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:53.371801 10217 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.600164  8100 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:53.371537 10157 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.590955 10170 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:53.547654  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:16:53.566505  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 197227us
I20260709 13:16:53.610311  8791 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:53.610605  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:53.503638 10229 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.414640  8175 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:53.575994  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:16:53.580085  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 183012us
I20260709 13:16:53.393250 10183 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:53.535048  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:53.412352 10206 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.575251 10091 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:53.589741 10166 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:53.577128 10196 raft_consensus.cc:2764] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:16:53.590591 10216 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:53.601622  8174 raft_consensus.cc:2410] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:16:53.545527  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.592181  8253 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:53.652776  8251 raft_consensus.cc:2410] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:53.603513  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.654801  8100 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:53.604019 10217 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.605576  9999 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:53.606451 10265 log.cc:927] Time spent T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.655s	user 0.008s	sys 0.010s
I20260709 13:16:53.607204 10157 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:53.591629  8223 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:53.607641  8101 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:53.607993  8252 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:53.587286 10252 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:53.536607 10275 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.575798 10048 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:53.675736  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:53.639643  8791 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:53.674399  8253 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:53.677870  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:53.678606  8791 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.624571 10140 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.649845  8103 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.505509 10242 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.624523 10170 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:53.656916  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:53.645813 10276 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:53.661077  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 50554.3us
I20260709 13:16:53.661010  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:53.687814  8175 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.661527  8107 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:16:53.660408  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:53.662225  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 91951.2us
I20260709 13:16:53.689611  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:16:53.657531 10266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.016s	sys 0.024s
I20260709 13:16:53.681043  8249 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
W20260709 13:16:53.693310 10266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.016s	sys 0.024s
I20260709 13:16:53.694278 10139 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:53.694660 10139 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:53.695022 10139 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.696416 10148 consensus_queue.cc:1059] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:53.697232 10099 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:53.697554 10217 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:53.698637 10099 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:53.699110 10099 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:53.698539 10148 consensus_queue.cc:1059] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:16:53.700681 10091 raft_consensus.cc:3055] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:53.701030 10091 raft_consensus.cc:740] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:53.701797 10091 consensus_queue.cc:260] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.702872 10091 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.705302  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:53.706408  8782 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:53.707345  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.699856 10099 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.708410 10099 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.708446  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.708841  8782 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:53.709154  8250 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:16:53.710537  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:53.711383  8250 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.663609  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:53.664755  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 73199.7us
I20260709 13:16:53.688633  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:53.713976  8223 leader_election.cc:400] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3.
I20260709 13:16:53.576627  8785 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:53.718957 10275 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:53.725443  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:53.726233  8101 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:53.727166  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:53.727687  8101 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.728024  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.728673  8099 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:16:53.730886 10242 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:53.673939 10252 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:53.731614 10252 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:53.732936  8787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:48648 (request call id 0) took 1416 ms. Trace:
I20260709 13:16:53.734442  8784 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:53.736546  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:53.737743 10206 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:53.738078  8257 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:53.738886  8257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57566
I20260709 13:16:53.739405  8257 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:53.739714  8257 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.745751  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:53.674732 10179 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:53.746894 10206 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:53.734480  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:53.750543  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:53.743316  8175 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:53.751675  8106 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:53.721149 10146 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:53.686185  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:53.715924  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:53.716049  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 243) took 1268 ms. Trace:
I20260709 13:16:53.753149  8253 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.754004  8104 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:53.715312  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:53.736205 10170 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:53.763437  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 77353.8us
I20260709 13:16:53.733294  8787 rpcz_store.cc:276] 0709 13:16:52.316636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.316791 (+   155us) service_pool.cc:224] Handling call
0709 13:16:52.958443 (+641652us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e261c0 00007fa5a5e129d9 00007fa5a5e12442 00007fa59f38ec54
0709 13:16:53.732672 (+774229us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400608bd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e52735 00007fa5a0e4a9fa 00007fa5a5e124c9 00007fa59f38ec54 00007fa59f38ebe2 00007fa59f38eb11 00007fa59f38ea8c 00007fa59f38dd42 00007fa59f18748c 00007fa59f1868c6
0709 13:16:53.732855 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495745024}
I20260709 13:16:53.692497  8791 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:53.774029 10048 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.775395  8182 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:53.776710 10048 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:53.777535  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 62335.6us
I20260709 13:16:53.787499  8149 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:53.789958  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:53.792160  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:53.796500  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:53.753075  8181 rpcz_store.cc:276] 0709 13:16:52.447714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.458096 (+ 10382us) service_pool.cc:224] Handling call
0709 13:16:52.458414 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:52.711972 (+253558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.712002 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:52.949322 (+237320us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b2c000e6688. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:16:52.949877 (+   555us) log.cc:844] Serialized 52 byte log entry
0709 13:16:53.053315 (+103438us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:53.088256 (+ 34941us) log.cc:844] Serialized 14 byte log entry
0709 13:16:53.088565 (+   309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.088665 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.709873 (+621208us) raft_consensus.cc:1685] finished
0709 13:16:53.715767 (+  5894us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.715965 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53722,"raft.queue_time_us":103111,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":6988,"spinlock_wait_cycles":150827392,"thread_start_us":356149,"threads_started":2,"wal-append.queue_time_us":168706}
I20260709 13:16:53.798033  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:53.800020  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:53.800633  8250 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:16:53.795090  8257 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.811957  8253 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:53.812865  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:53.812963  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:53.801646  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.815078  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:53.816629  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:53.787699 10166 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:53.822466  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:53.823240  8175 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 4: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:53.824090  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:53.824669  8250 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:53.825009  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:53.824694  8177 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:53.826356  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:53.824115  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:53.828683  8181 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:53.787803  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:53.819257  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:53.787616 10179 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:53.818212  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:53.801087 10251 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:53.852169  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:53.852672  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 187222us
I20260709 13:16:53.796284 10206 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:53.844643  8257 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:53.800909 10099 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:53.854369  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:53.832432  8174 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:53.854684  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:53.859373  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:53.850454  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.795959 10250 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:53.855801  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:53.859966  8178 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:53.860199  8253 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:53.829717 10221 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:53.823167  9999 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:53.827736 10146 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:53.831786  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:53.823772 10242 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:53.862236  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:53.811898 10091 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:16:53.862557  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.812412 10197 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:16:53.864329  8223 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:53.813956 10276 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:53.853232 10179 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.855430 10010 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:53.851446  9918 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:16:53.870613  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.863961 10060 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:53.876807 10139 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.872707 10279 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:16:53.867632 10196 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:53.867542 10099 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:53.859160 10093 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:53.857914 10166 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:53.863317  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:53.890151  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:53.871765  8250 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:53.829478  9907 consensus_queue.cc:1059] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:16:53.864264 10270 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:53.863873 10234 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:16:53.993528 10229 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:53.994719  8106 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:53.995859 10229 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:53.996349  8101 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:16:53.999264 10237 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:53.999600  8103 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:53.872810 10179 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.871986 10276 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.873543  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:53.869724 10157 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:53.874136  9999 raft_consensus.cc:697] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:53.860422 10206 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:53.883167  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:53.863049 10221 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:53.862587 10172 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:53.864553 10242 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:16:53.986941  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 122665us
W20260709 13:16:53.988253  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 98193us
I20260709 13:16:54.012867 10252 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:53.864811 10146 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:54.009522 10157 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:54.010869  9999 consensus_queue.cc:237] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.009083  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:54.020685  8253 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:54.018663 10242 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:54.022749 10135 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:54.023166 10157 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:54.026077 10206 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:54.027482 10254 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 1.123s	user 0.003s	sys 0.006s
I20260709 13:16:54.028985 10183 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:54.002008 10075 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:53.987666 10166 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.029590 10183 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:54.030083 10166 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:54.013549  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 916) took 1425 ms. Trace:
I20260709 13:16:54.031184  8257 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 4: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:54.030819 10183 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.032859  8257 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:54.033519 10146 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:54.001340  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:54.036412  8250 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:54.016942  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:54.001596 10044 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.037739 10044 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.022187  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:54.038333  8223 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:54.038851  8253 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:54.016681  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:54.039662 10044 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:54.040203 10044 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:54.040779  8147 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:54.040964  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:54.013633 10276 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:54.042128  9907 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:54.015630 10221 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:54.037999 10148 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:54.045513 10197 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:54.043052 10237 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:54.043776  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:54.030599  8108 rpcz_store.cc:276] 0709 13:16:52.588380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.588549 (+   169us) service_pool.cc:224] Handling call
0709 13:16:54.013330 (+1424781us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540036e2d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:54.013478 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2879095040}
I20260709 13:16:54.048023  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:54.048542  8107 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:16:54.017827  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 134768us
I20260709 13:16:54.012198 10053 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:54.050737 10053 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:54.051391 10189 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:54.051615 10053 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.051982 10189 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.052647 10053 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:54.053948  8250 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:16:54.044878 10260 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.111s	user 0.005s	sys 0.016s
I20260709 13:16:54.045060 10060 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:54.045722 10148 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:54.069167 10148 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:54.042484  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:54.050271  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:54.075573  8176 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
W20260709 13:16:54.076941  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.055428  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:54.048574  8791 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:54.042130  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:54.032799 10183 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:54.044617 10172 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:54.055097  8179 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:54.057786  8181 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:54.043650  9907 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:54.059021  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:16:54.060148  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 208064us
I20260709 13:16:54.098819  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:54.063971  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:54.099164  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:54.084285  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:54.059957  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:54.068665 10189 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:54.076753  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:54.055946  8183 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:54.083110  8181 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:54.083745  8787 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:54.101964  8257 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:54.102509  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:54.109685  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:16:54.110119  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 46223.7us
I20260709 13:16:54.110299  8108 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:54.111172  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:54.113360  8791 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:54.115950  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:54.116875  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:54.065549  9918 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:54.065757  9996 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.117072  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:54.108542  8107 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:54.131644  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:54.132256  8791 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:54.066896 10139 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:54.121064  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:54.138185  8179 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:54.123835 10216 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:54.124740  8147 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:54.125562 10217 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:54.128269 10250 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:54.097890 10172 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:54.132311  8107 raft_consensus.cc:2368] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4.
I20260709 13:16:54.134245  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:54.074977  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1817) took 1030 ms. Trace:
I20260709 13:16:54.135447  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:54.149921  8791 raft_consensus.cc:2410] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:54.138777  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:54.105356 10239 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:54.118090 10237 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:54.158556  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:54.158603  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:54.159469  8107 raft_consensus.cc:2410] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:54.162791  8223 leader_election.cc:400] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4.
I20260709 13:16:54.163177  8223 leader_election.cc:403] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:16:54.151604  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:54.151548  8257 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:54.153244  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:54.118255  9878 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:54.172231  9878 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4.
I20260709 13:16:54.170152  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:54.174824  8790 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5. Ops: [3.6-4.7]
I20260709 13:16:54.176807  8257 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:54.182503  8257 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:54.140885 10230 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:54.122175 10075 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:16:54.139165 10298 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:54.188989  8108 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:54.156491 10172 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:54.208971  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:54.163910 10060 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:54.212600  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:54.215167  8072 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:54.216066  8072 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:54.216153  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:54.219072  8257 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:16:54.214210  7991 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9abaa411847e4bf9907f7af5e2689c7b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5033fc7e66374940a203908ea8b0078f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:54.141037  9996 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.222203  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:54.224395  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:54.178243 10239 raft_consensus.cc:697] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:54.226913  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:54.227550  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:54.186095 10237 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:54.186774 10230 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.210914  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:54.238754  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:54.239338  8176 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:54.239161 10239 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.239675  8176 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:54.241130 10279 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:54.218852 10060 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.241737 10060 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:54.241684 10279 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.182003 10216 consensus_queue.cc:1059] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:16:54.236351 10229 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:54.243420 10229 raft_consensus.cc:697] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:54.243773 10279 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:54.244230 10229 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.215088 10196 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.227905  9907 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:54.245673 10196 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.246527  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:54.247620 10196 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:54.247565 10280 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:54.249090 10280 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:54.249946 10237 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.223106  9878 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:54.250777 10166 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.251214 10280 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:54.251309  9878 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:54.252209  9878 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.252970 10166 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:54.253192  9996 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:54.258731  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:54.258956 10091 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:54.236967 10090 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.259992 10090 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.260517 10230 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:54.261823  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 1872) took 1343 ms. Trace:
I20260709 13:16:54.262099 10090 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:54.262238  8251 rpcz_store.cc:276] 0709 13:16:52.918576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.035225 (+116649us) service_pool.cc:224] Handling call
0709 13:16:54.261589 (+1226364us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400208854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:54.261731 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1308074368}
I20260709 13:16:54.263461  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:54.263959 10099 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:54.264504  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:54.265079  8251 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:54.267520  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:54.268245 10234 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:54.270068 10234 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:54.271670 10234 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:54.272751  8072 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:54.273908 10091 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:54.275796 10091 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:54.276705  9996 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:54.277060  9996 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:54.277863  9996 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.279692  8106 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:54.280411  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:54.282287  8253 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:16:54.282693  8253 pending_rounds.cc:85] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 5
I20260709 13:16:54.282909  8253 pending_rounds.cc:107] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:16:54.283144  8253 raft_consensus.cc:2889] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:54.284529 10044 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:54.285591  8783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 399) took 1967 ms. Trace:
W20260709 13:16:54.238386  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.238189  8108 raft_consensus.cc:2376] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6. Re-sending same reply.
I20260709 13:16:54.272574 10221 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.294884 10216 raft_consensus.cc:3055] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:54.295416 10216 raft_consensus.cc:740] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:54.296167 10216 consensus_queue.cc:260] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.299141 10299 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:54.299714 10299 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:54.300153 10299 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:54.301216 10216 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:54.231904  8257 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:54.301456 10174 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:54.228120 10016 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:54.259616  8102 raft_consensus.cc:2410] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:54.280913 10146 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.320611  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:54.285984 10252 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:16:54.326983  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.327916  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:54.356518  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:54.380251  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 255561us
W20260709 13:16:54.402007  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 266605us
I20260709 13:16:54.314409 10091 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:54.235219 10242 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:54.406948  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.400458  8181 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:54.402943  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:54.326702  8782 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:54.413528  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:54.415907  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:54.425987  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:54.422695 10053 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:54.426681 10174 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:54.415776 10060 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.443233  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:54.449023  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 51571.1us
W20260709 13:16:54.449635  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 286996us
I20260709 13:16:54.411550 10157 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.285998  8783 rpcz_store.cc:276] 0709 13:16:52.443934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.456956 (+ 13022us) service_pool.cc:224] Handling call
0709 13:16:52.500929 (+ 43973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.591324 (+1090395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.285333 (+694009us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b5400362c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:54.285532 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1941979392}
I20260709 13:16:54.412381 10172 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.436347  9907 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:54.451361 10174 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.444128 10250 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:54.430649 10148 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.466835  9907 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.464170  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:54.471908 10172 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:16:54.466552  8786 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 554) took 1692 ms (client timeout 1563 ms). Trace:
I20260709 13:16:54.466562  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:54.477712  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:54.473815 10276 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.157034  8100 rpcz_store.cc:276] 0709 13:16:53.041989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.655573 (+613584us) service_pool.cc:224] Handling call
0709 13:16:53.655986 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.656230 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:53.799438 (+143208us) log.cc:844] Serialized 14 byte log entry
0709 13:16:53.985688 (+186250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:54.002027 (+ 16339us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:54.015154 (+ 13127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.019834 (+  4680us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:54.066794 (+ 46960us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28258,"prepare.queue_time_us":209613,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":29620,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":17825,"thread_start_us":178105,"threads_started":2,"wal-append.queue_time_us":175845}
I20260709 13:16:54.487866  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:54.483530 10146 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:54.482872 10221 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:54.483575  8786 rpcz_store.cc:269] 0709 13:16:52.773922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.776325 (+  2403us) service_pool.cc:224] Handling call
0709 13:16:54.466347 (+1690022us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b54004ac254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:54.466471 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171881344}
I20260709 13:16:54.496870  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:54.482103 10060 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:54.492390  8099 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:54.498535 10157 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:54.482064 10174 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:54.470252 10309 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:54.541174  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 265) took 1125 ms. Trace:
I20260709 13:16:54.448387  9918 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:54.503280  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 1890) took 1480 ms. Trace:
I20260709 13:16:54.445276 10179 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:54.481853 10304 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:16:54.504200  8107 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:54.501252  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:54.547961  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:54.541558  8250 rpcz_store.cc:276] 0709 13:16:53.415999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.061867 (+645868us) service_pool.cc:224] Handling call
0709 13:16:54.062163 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.062408 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:54.448789 (+386381us) log.cc:844] Serialized 14 byte log entry
0709 13:16:54.540830 (+ 92041us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:54.540886 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:54.540933 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.540997 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:54.541118 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4594,"thread_start_us":473124,"threads_started":2}
I20260709 13:16:54.501274 10242 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:54.530066 10148 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:54.525714  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 63450.2us
I20260709 13:16:54.532852  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1815) took 1571 ms. Trace:
I20260709 13:16:54.603036  8105 rpcz_store.cc:276] 0709 13:16:53.010118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.167885 (+157767us) service_pool.cc:224] Handling call
0709 13:16:53.199801 (+ 31916us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.200228 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.200268 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:53.200838 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.034766 (+833928us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b18003a9de0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:16:54.161003 (+126237us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:54.532062 (+371059us) log.cc:844] Serialized 14 byte log entry
0709 13:16:54.532374 (+   312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.532478 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:54.532532 (+    54us) raft_consensus.cc:1685] finished
0709 13:16:54.532622 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:54.532776 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48072,"prepare.queue_time_us":96479,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":21309,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":25934,"spinlock_wait_cycles":54974336,"thread_start_us":421040,"threads_started":2,"wal-append.queue_time_us":1190823}
I20260709 13:16:54.541966  8256 rpcz_store.cc:276] 0709 13:16:53.022889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.023006 (+   117us) service_pool.cc:224] Handling call
0709 13:16:53.023322 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.365203 (+341881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.502422 (+1137219us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54002e9d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:54.503201 (+   779us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578595584}
I20260709 13:16:54.462432 10310 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:54.490988 10217 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:16:54.523047 10301 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:16:54.599524  8181 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:54.531394  8223 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:54.606468  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 75201.2us
I20260709 13:16:54.475304 10230 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.529174 10252 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:54.622068  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:54.618818  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:54.543596  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:54.548750 10276 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:54.492866 10250 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.533878 10247 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 13:16:54.637130  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:54.533576  9993 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:54.638535  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:54.640897  8072 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:54.645407  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:54.549170  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:54.602269 10234 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.618041  8251 raft_consensus.cc:2368] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5.
I20260709 13:16:54.542459 10060 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:16:54.619084 10166 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:54.646692  8250 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:54.651723  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:54.533558 10311 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 13:16:54.647734  8256 raft_consensus.cc:2368] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5.
I20260709 13:16:54.633320 10252 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:54.659372  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:54.661136  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:54.663131  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:54.660698  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:54.662346 10217 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.667479  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:54.668514  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:54.650054 10276 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:54.673209  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:54.672646 10221 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:54.643867 10242 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:16:54.676651  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:54.683805  8256 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:54.674456  8250 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:54.662070 10252 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:54.653673 10234 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.662005 10060 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:54.688746  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:54.633845 10310 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:54.690860 10308 log.cc:927] Time spent T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:16:54.702216  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:54.662498 10216 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:16:54.669824 10146 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:16:54.719842  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 99610.5us
W20260709 13:16:54.704550  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 45258.9us
I20260709 13:16:54.662465  9918 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.674360 10312 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:16:54.698982 10060 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:54.703516  8250 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:54.724833  8149 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:54.720952 10320 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:16:54.729030  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:54.729144  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:54.731557  8256 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:54.735080  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:54.706053 10179 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:54.706579 10310 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:54.767099 10166 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:54.770320  8177 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:54.768635  8149 leader_election.cc:400] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5.
I20260709 13:16:54.776765  8149 leader_election.cc:403] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:54.732620 10221 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:54.780577  8256 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:54.743542 10196 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:54.744154 10321 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:54.791246  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:54.793465  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:54.776655 10242 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.798864  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:54.800040  8256 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:54.815237  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.783422 10166 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:16:54.849989 10324 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:16:54.853000 10135 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.853791 10135 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:54.795015 10310 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:54.790650 10230 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:54.804288  9907 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:54.860383  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:54.793591 10250 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:54.866539  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:54.808854 10242 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.890748 10242 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:54.892264  8177 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:54.858202 10317 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:54.910742  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.913991 10166 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.792660 10060 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.875113  9907 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:54.917748  9907 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:54.917883 10060 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:54.922029 10329 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:16:54.925716 10234 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:54.940114  8785 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:54.942818  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:54.945039  8248 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:54.949606 10334 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:16:54.955992  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.960155  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:16:54.961879 10299 consensus_meta.cc:287] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.661s	user 0.010s	sys 0.004s
I20260709 13:16:54.967250 10299 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.970168 10174 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:54.941256  8785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 404) took 1379 ms. Trace:
I20260709 13:16:54.971169  8256 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:54.974037  8256 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:54.974417  8248 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:54.975715  8256 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:16:54.960268  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 224041us
I20260709 13:16:54.976994  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:54.971629  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 172486us
I20260709 13:16:54.970916  8099 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:16:54.980124  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:54.977246  8256 raft_consensus.cc:3055] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:54.982992  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 1893) took 1790 ms. Trace:
I20260709 13:16:54.983175  8256 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:54.983464  8253 rpcz_store.cc:276] 0709 13:16:53.192375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.039538 (+847163us) service_pool.cc:224] Handling call
0709 13:16:54.260254 (+220716us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b5800052298. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:16:54.281935 (+ 21681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.283607 (+  1672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.981323 (+697716us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b5400208850. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:54.982921 (+  1598us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88071168}
I20260709 13:16:54.986011  8256 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:54.994418  8256 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:55.027498  8256 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:55.028419 10337 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:55.028913 10332 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:16:55.005574  9999 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:54.921532 10317 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:55.033550 10170 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.000s	sys 0.018s
W20260709 13:16:55.065551  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 85507.9us
I20260709 13:16:54.798619 10321 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:55.075989 10321 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:55.072572 10174 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:54.972504  8785 rpcz_store.cc:276] 0709 13:16:53.562416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.716891 (+154475us) service_pool.cc:224] Handling call
0709 13:16:54.939488 (+1222597us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:16:54.939817 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.940863 (+  1046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.941166 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76932992}
W20260709 13:16:55.065827 10170 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.000s	sys 0.018s
I20260709 13:16:55.084471  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:55.091538  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:55.093456  8182 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:55.097630  8788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 400) took 2611 ms. Trace:
I20260709 13:16:55.098047  8788 rpcz_store.cc:276] 0709 13:16:52.486473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.491966 (+  5493us) service_pool.cc:224] Handling call
0709 13:16:52.948160 (+456194us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:16:54.466954 (+1518794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.467163 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:54.535552 (+ 68389us) log.cc:844] Serialized 14 byte log entry
0709 13:16:54.602334 (+ 66782us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:54.602389 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:54.602439 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.602502 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:54.915512 (+313010us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b18003e9740. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:16:55.097451 (+181939us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54004ac250. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:55.097572 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":174273,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":76360,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":18483,"spinlock_wait_cycles":3512564736,"thread_start_us":69522,"threads_started":2,"wal-append.queue_time_us":127699}
I20260709 13:16:55.110411  8182 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:55.111750  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:55.111913  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:55.093659  9999 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.120097 10299 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:55.120220 10310 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5.
I20260709 13:16:55.112615 10350 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:16:55.122591 10350 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:55.122959 10350 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:55.123983 10350 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:55.125388 10350 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:55.126852 10135 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:55.128567  8182 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:55.129098  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:55.130049  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:55.115681 10139 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:55.102550 10252 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:55.135962 10317 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:16:55.136837  8252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 1876) took 2056 ms (client timeout 1556 ms). Trace:
W20260709 13:16:55.137292  8252 rpcz_store.cc:269] 0709 13:16:53.080579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.080741 (+   162us) service_pool.cc:224] Handling call
0709 13:16:55.136635 (+2055894us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b5400071054. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:55.136769 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121046784}
I20260709 13:16:55.141299  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 302) took 1799 ms. Trace:
I20260709 13:16:55.141773  8104 rpcz_store.cc:276] 0709 13:16:53.341742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.754743 (+413001us) service_pool.cc:224] Handling call
0709 13:16:55.140729 (+1385986us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b5800002798. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:16:55.140926 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.141078 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.141094 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:55.141124 (+    30us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:55.141146 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.141182 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.141256 (+    74us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18944384}
I20260709 13:16:55.143235  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:55.147840  8178 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:55.161284  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:55.162325  8104 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:55.162358  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:55.162570  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:55.165904  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:55.166244 10252 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:55.164319 10166 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:16:55.169075 10135 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:55.169521  9918 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.167141  8100 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:55.169986  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:55.170055  9918 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:55.170863  8105 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:55.172385  9918 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:55.148540  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 977) took 2495 ms. Trace:
I20260709 13:16:55.173519 10166 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:55.174057 10166 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:55.173377  8180 rpcz_store.cc:276] 0709 13:16:52.652627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.816433 (+163806us) service_pool.cc:224] Handling call
0709 13:16:52.859644 (+ 43211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.125294 (+265650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.148201 (+2022907us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54002f9c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:55.148431 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247037824}
I20260709 13:16:55.174979 10166 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:55.175377  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:55.176188 10166 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:55.176573  8180 raft_consensus.cc:2368] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4.
W20260709 13:16:55.139851 10340 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.160s	user 0.003s	sys 0.000s
I20260709 13:16:55.145745 10139 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:55.179266  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:55.180608  8223 leader_election.cc:400] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4.
I20260709 13:16:55.180943  8223 leader_election.cc:403] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:16:55.180841  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:55.117275  9999 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:55.182368  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:55.179302  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:55.148903 10337 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:55.186060  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:55.184595 10139 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:55.188849  8102 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:55.188956  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:55.180073 10341 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:55.190066  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:16:55.190189  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.179962 10150 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:55.191628 10275 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:55.191932 10174 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:55.189834 10337 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:55.190122 10263 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:55.183439 10298 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:16:55.197875  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 1904) took 1144 ms. Trace:
I20260709 13:16:55.202457  8105 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:55.185302 10252 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:55.239971  8250 rpcz_store.cc:276] 0709 13:16:54.053848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.730799 (+676951us) service_pool.cc:224] Handling call
0709 13:16:54.769565 (+ 38766us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.775414 (+  5849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.775463 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:54.776417 (+   954us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.867407 (+ 90990us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:54.867468 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.867568 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.120990 (+253422us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:16:55.197515 (+ 76525us) raft_consensus.cc:1685] finished
0709 13:16:55.197541 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.197790 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13074,"raft.queue_time_us":34850,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":44058,"spinlock_wait_cycles":2385792,"thread_start_us":60574,"threads_started":1,"wal-append.queue_time_us":184375}
I20260709 13:16:55.212268 10174 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.184651  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:55.186192 10135 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:55.238206  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.245620  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.190193  8101 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:55.251405 10317 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:16:55.255954 10353 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:16:55.256417 10317 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:55.256100 10347 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:16:55.257697  9999 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:55.252744 10174 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:55.258737 10317 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:55.212649 10091 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:55.239988 10229 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:16:55.265388 10337 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:55.239466 10166 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:16:55.261762 10091 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:55.250206  9907 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:55.271967  9907 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:55.251904 10275 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:16:55.229943 10341 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:55.277877 10311 raft_consensus.cc:3055] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:55.278446 10311 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:55.278358 10341 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:55.279770 10311 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:55.282223 10091 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:55.284453  8181 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:55.285120  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.250308 10234 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:16:55.287638  9996 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:55.299113  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:55.299280  8249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60806 (request call id 262) took 2275 ms (client timeout 1577 ms). Trace:
W20260709 13:16:55.299935  8249 rpcz_store.cc:269] 0709 13:16:53.023936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.031350 (+  7414us) service_pool.cc:224] Handling call
0709 13:16:55.299017 (+2267667us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b5400070b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:55.299170 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1082828160}
I20260709 13:16:55.300740  8180 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:55.304924  8257 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:55.319375  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:55.320410  8181 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:55.305124 10311 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:55.323081  8181 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:55.307928 10361 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.009s
I20260709 13:16:55.322077  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:55.324230  8784 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:55.327121  8101 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:55.327251  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:55.330319  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 988) took 1103 ms. Trace:
I20260709 13:16:55.332943 10263 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:55.339208  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 118411us
I20260709 13:16:55.361518  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:55.362462  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:55.347883  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:55.357685  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:55.363724  8256 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:16:55.358625  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.359006  8253 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:55.363874  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:55.364382  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:55.365027  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:55.365087  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:55.365741  8253 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:55.365280  8255 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:16:55.368037  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:55.360450  8183 rpcz_store.cc:276] 0709 13:16:54.226911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.227316 (+   405us) service_pool.cc:224] Handling call
0709 13:16:55.330032 (+1102716us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54002f9254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:55.330240 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1906160000}
I20260709 13:16:55.373744  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:55.374239  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:55.374409  8102 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:55.377264  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:55.379056  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:55.385419  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:55.387699  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:55.391606  8253 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:55.392441  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:55.394152  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:55.396849 10252 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4.
W20260709 13:16:55.374835 10336 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:16:55.408480 10355 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.409116 10355 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:55.412977 10355 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:55.370162 10226 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:55.372574 10321 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:55.360203 10269 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:55.373759 10350 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:55.414692  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:55.382251 10317 raft_consensus.cc:2764] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:55.417659  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:55.387154 10237 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:55.402504 10148 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.378437 10075 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:55.432098  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:55.428015  8183 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:16:55.375594 10232 consensus_queue.cc:1059] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:16:55.431254  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:55.398488  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:55.401588  9907 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:16:55.401450  9918 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:16:55.402230  8103 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:55.416177 10229 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:55.424180 10135 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:55.397898 10276 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:55.414788  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:55.439822  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:55.438889  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:55.387320 10250 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:16:55.427750 10350 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.436905 10237 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:55.407227 10299 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:55.446256 10321 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:55.398144  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 408) took 1773 ms. Trace:
I20260709 13:16:55.439213 10173 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.469288  8106 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:16:55.480367  9999 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:55.432535 10269 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:55.482941  8249 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:55.438472 10216 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:16:55.489388  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:55.485392 10350 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:55.465251 10075 raft_consensus.cc:697] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:55.491329 10299 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.468923 10150 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:55.457516 10263 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:16:55.461781  8101 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:55.501772  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:55.499181  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 75109.1us
I20260709 13:16:55.446475 10148 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:55.494024 10250 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:55.495391  9999 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.509733  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:55.489156 10237 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:55.499006 10321 raft_consensus.cc:697] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:55.503721  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:55.497215 10173 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:55.610908 10252 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:16:55.521633 10357 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:16:55.936837 10252 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:55.706295 10317 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:55.938548 10317 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:55.574136 10363 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:16:55.828989  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 380014us
I20260709 13:16:55.941063  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:55.504722 10299 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:55.882283  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.942178  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:16:55.857285  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 183500us
I20260709 13:16:55.946938  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:55.947492  8105 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:55.848277 10269 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:55.513073  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:55.492664  8784 rpcz_store.cc:276] 0709 13:16:53.625257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.735249 (+109992us) service_pool.cc:224] Handling call
0709 13:16:55.323811 (+1588562us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:16:55.324016 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.365615 (+ 41599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.393582 (+ 27967us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32051584}
I20260709 13:16:55.721912 10075 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:55.720211 10355 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:55.812076 10174 consensus_meta.cc:287] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.002s
W20260709 13:16:55.949765 10371 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:16:55.950121 10174 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:55.935973  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:55.607317  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:55.801607  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 416292us
I20260709 13:16:55.673171  8181 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:55.957597  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:55.958956  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:16:55.610075 10367 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:16:55.523298 10358 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:16:55.757933 10369 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:16:55.720046 10370 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:55.935886  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:55.600765 10364 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:16:55.967818  8105 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:55.982170  8105 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:16:55.966037 10093 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:16:55.971846 10368 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:55.949733 10355 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:55.989673 10174 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:55.990891 10355 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:55.969630 10206 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:16:55.973325  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:55.605113 10350 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:55.993594 10368 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:55.994073 10368 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.994467 10368 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:55.995281 10183 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.995565 10350 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:55.995868 10183 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:55.966789 10362 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:16:55.974398 10060 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:56.014865 10368 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:55.959599  9907 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:56.017149 10368 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:56.017705  9907 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.033327 10362 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:56.034031 10362 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:56.034579 10183 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:56.034781 10362 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.035949 10148 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:55.945549  9999 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:56.036648 10173 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:55.941416 10250 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:55.962529 10157 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.612973  9918 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.961156 10139 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:16:55.958362 10269 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:55.955386 10252 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:56.035977 10362 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:56.042827  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 66927.5us
I20260709 13:16:56.049513  9918 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:55.979636 10321 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.051801  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:56.008371 10370 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.063715 10370 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:56.065855  9907 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:56.037609 10375 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:56.067233 10375 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:56.067739 10375 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:56.070521 10010 raft_consensus.cc:3055] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:56.071180 10010 raft_consensus.cc:740] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:56.072336 10010 consensus_queue.cc:260] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.074276 10269 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.074870 10269 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:56.080751 10311 consensus_meta.cc:287] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.721s	user 0.010s	sys 0.000s
I20260709 13:16:56.081938 10232 raft_consensus.cc:3055] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:56.082556 10232 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:56.083784 10232 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.085083 10250 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.074028 10010 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:56.047683 10317 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:56.089562 10385 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:16:56.108001 10317 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:56.108382 10317 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:56.047150 10157 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.109238 10317 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.110333 10317 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:56.110693 10157 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:16:56.069314 10319 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 1.432s	user 0.003s	sys 0.015s
I20260709 13:16:56.085309 10232 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:56.115811 10250 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.113574 10269 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:56.117307 10239 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.687s	user 0.011s	sys 0.018s
I20260709 13:16:56.088702 10299 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.170102 10375 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.173903 10375 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:55.969003  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:56.209488  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 240377us
I20260709 13:16:55.977253  8099 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:56.221220  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:56.223088  8099 raft_consensus.cc:2410] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:56.224037  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:56.224745  8099 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:56.225844  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:56.229321  8100 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:56.230803  8101 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:55.982671  8105 pending_rounds.cc:85] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 6
I20260709 13:16:55.963342  8108 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:56.233997  8105 pending_rounds.cc:107] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:16:56.234500  8105 raft_consensus.cc:2889] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:56.247078  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:56.252038  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.000399  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:56.256547  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 1917) took 1968 ms. Trace:
I20260709 13:16:56.257182  8179 rpcz_store.cc:276] 0709 13:16:54.288012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.291510 (+  3498us) service_pool.cc:224] Handling call
0709 13:16:54.297771 (+  6261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.298114 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:16:54.298144 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:54.298597 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.438642 (+140045us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:54.438689 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.438800 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:56.068548 (+1629748us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:16:56.255407 (+186859us) raft_consensus.cc:1685] finished
0709 13:16:56.255453 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.256249 (+   796us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11344,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":61,"spinlock_wait_cycles":4265344,"thread_start_us":139749,"threads_started":1,"wal-append.queue_time_us":248463}
W20260709 13:16:56.260402  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 208587us
I20260709 13:16:56.262148  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:56.263059  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:56.263197  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 262763us
I20260709 13:16:56.261210  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:56.264870  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:56.265797  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:56.266713  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:56.267366  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:56.269846 10075 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:56.271557 10075 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:56.272156 10075 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:56.272799 10075 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.274904  9918 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:56.275801  9918 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.275637  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:56.277817 10048 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:56.278978 10048 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:56.282079 10048 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:56.283310  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:56.285306  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:56.286101 10140 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:56.286643 10140 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:56.287072 10140 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.276667  9918 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.289601  8253 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:56.290047  8253 pending_rounds.cc:85] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 1
I20260709 13:16:56.290071  9918 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:56.290443  8253 pending_rounds.cc:107] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:56.290819  8253 raft_consensus.cc:2889] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:56.292212  9999 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.294957  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:56.284708  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:56.315919  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.318748  8254 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:56.324476 10157 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.329617  9878 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.330615  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 46138.4us
W20260709 13:16:56.122897 10239 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.702s	user 0.011s	sys 0.018s
I20260709 13:16:56.336613 10277 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:56.342939 10370 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.343164 10166 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.347204 10172 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.367089 10172 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.348716 10299 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:56.349782 10375 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.353812 10275 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:56.381937  8256 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:56.381817 10275 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.384490 10275 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:56.355535 10139 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.356040  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 90521us
I20260709 13:16:56.380918 10311 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:56.354681 10277 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.385118 10375 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.413682  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:56.414162  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:56.416862 10311 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.425810  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:56.330955  9878 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.421897  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:56.432919 10157 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.439332 10139 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.439404  8788 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:56.441803  8253 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:56.443123  8256 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:56.435953  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:56.418905 10166 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.452102  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 1930) took 1296 ms. Trace:
I20260709 13:16:56.421530 10370 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.453256  9878 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:56.452553  8181 rpcz_store.cc:276] 0709 13:16:55.147644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.967354 (+819710us) service_pool.cc:224] Handling call
0709 13:16:55.967851 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.968191 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:56.264158 (+295967us) log.cc:844] Serialized 14 byte log entry
0709 13:16:56.344878 (+ 80720us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.396680 (+ 51802us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:56.434623 (+ 37943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.444154 (+  9531us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.444269 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":101280,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":6825,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":4028,"thread_start_us":332963,"threads_started":2,"wal-append.queue_time_us":114767}
I20260709 13:16:56.454494  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:56.454814  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:56.455029 10370 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:56.455520  8788 raft_consensus.cc:2410] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:56.456897 10375 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:56.443310 10277 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.458961  8176 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.459816 10277 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:56.460093  8176 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:56.461131  9999 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:56.462180  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:16:56.464112  8177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 1924) took 1598 ms (client timeout 2011 ms). Trace:
W20260709 13:16:56.464594  8177 rpcz_store.cc:269] 0709 13:16:54.866037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.866219 (+   182us) service_pool.cc:224] Handling call
0709 13:16:56.463655 (+1597436us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b54002490d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:56.463879 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41593088}
I20260709 13:16:56.465080 10148 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:56.465904 10148 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.468523 10148 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:56.469012 10148 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.469895  8784 raft_consensus.cc:2368] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4.
I20260709 13:16:56.469610 10148 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.471551 10299 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:56.471822  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 125119us
I20260709 13:16:56.472782  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:56.437618 10140 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.453779 10166 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:56.475303  8183 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:16:56.561496 10172 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:16:56.559850  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.567839  8176 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:56.486771  8181 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:56.555073  8179 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:56.497696  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:56.569841  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.569811 10093 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:16:56.573967  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 101358us
W20260709 13:16:56.575253 10237 consensus_meta.cc:287] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.005s
I20260709 13:16:56.556160 10139 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:56.577543 10075 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:56.572299  8176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 989) took 2342 ms (client timeout 1623 ms). Trace:
I20260709 13:16:56.570348  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:56.505105  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 1903) took 2078 ms. Trace:
I20260709 13:16:56.505748  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:56.593691  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:56.506058 10299 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:56.599995  8179 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:16:56.596873  8257 rpcz_store.cc:276] 0709 13:16:54.426096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.800033 (+373937us) service_pool.cc:224] Handling call
0709 13:16:55.302568 (+502535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.305408 (+  2840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.504658 (+1199250us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400070b50. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:56.504912 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152814976}
W20260709 13:16:56.596557  8176 rpcz_store.cc:269] 0709 13:16:54.229647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.233306 (+  3659us) service_pool.cc:224] Handling call
0709 13:16:56.458156 (+2224850us) spinlock_profiling.cc:243] Waited 51 ms on lock 0x7b4c002b0f40. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f118a20 00007fa59f129a29 00007fa59f0ef644 00007fa59f116f2d 00007fa59f116b93 00007fa5a0e4718b 00007fa5a0e47cb5 00007fa5a0e42f30 00007fa5a0e447de 00007fa5a0e5027c 00007fa5a5e11b17
0709 13:16:56.572171 (+114015us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117380864}
I20260709 13:16:56.603866  8177 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:56.604233  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:56.604921  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:56.605722  8177 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:16:56.605931  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:56.606498 10053 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:16:56.606712  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:56.606729  8257 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:56.609023 10206 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.609053  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:56.610368 10093 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.612103  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:56.612957 10093 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:56.588409 10140 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:56.602324 10237 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.614907 10311 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:56.618366  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:56.619837  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:56.620594  8176 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.623294 10075 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:56.623507  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:56.625226  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:56.626003  8179 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.627996  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 937) took 2563 ms. Trace:
I20260709 13:16:56.628398  8107 rpcz_store.cc:276] 0709 13:16:54.064874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.161137 (+ 96263us) service_pool.cc:224] Handling call
0709 13:16:54.211922 (+ 50785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.601756 (+389834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.627475 (+2025719us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54002a3854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:56.627786 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":668524416}
I20260709 13:16:56.617393  8177 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:56.616031 10237 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:56.639271  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:56.647465  8179 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:16:56.645816  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:16:56.633255 10317 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.006s
I20260709 13:16:56.650815  8256 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:56.609380  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:56.653303  8176 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:16:56.656716 10179 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:56.657624  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:16:56.662833  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.674111 10242 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:56.677948 10145 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:56.678831  8103 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:56.679358  8788 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:56.679606  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1840) took 1262 ms. Trace:
I20260709 13:16:56.680445  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:56.683562  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:56.685067  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:56.685346  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 998) took 1614 ms. Trace:
I20260709 13:16:56.609602 10206 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.657366 10179 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.686327  8787 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:56.687295  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 258) took 1562 ms. Trace:
I20260709 13:16:56.662601 10093 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:56.691917 10250 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:16:56.692960  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 69622.9us
I20260709 13:16:56.693804 10232 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:56.679981  8103 rpcz_store.cc:276] 0709 13:16:55.418142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.972557 (+554415us) service_pool.cc:224] Handling call
0709 13:16:56.618784 (+646227us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b5800002798. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:16:56.619204 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.679302 (+ 60098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.679535 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6655744}
I20260709 13:16:56.681253  8788 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
W20260709 13:16:56.693243 10307 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 2.227s	user 0.004s	sys 0.000s
I20260709 13:16:56.697036 10139 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:16:56.697306  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:56.702067  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.698431  8178 rpcz_store.cc:276] 0709 13:16:55.070996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.167439 (+ 96443us) service_pool.cc:224] Handling call
0709 13:16:55.167896 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.267850 (+1099954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.267895 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.267961 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:56.267993 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.684915 (+416922us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002481d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:56.684957 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.685174 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2528484224}
I20260709 13:16:56.698447  8790 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:16:56.712845  8177 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:56.715045  8791 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:56.713946  8183 rpcz_store.cc:276] 0709 13:16:55.125344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.479884 (+354540us) service_pool.cc:224] Handling call
0709 13:16:56.473611 (+993727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.561788 (+ 88177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.687046 (+125258us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b54002490d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:56.687226 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2284057984}
I20260709 13:16:56.696463  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:56.731328  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:56.731554  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1000) took 1648 ms. Trace:
I20260709 13:16:56.733275  8788 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:56.735124  8788 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:56.737572 10232 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:56.737706  8783 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:56.739146 10232 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.739734  8783 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:56.741724  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 272475us
I20260709 13:16:56.744306  8179 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:56.743974  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:56.732131  8180 rpcz_store.cc:276] 0709 13:16:55.083183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.177564 (+ 94381us) service_pool.cc:224] Handling call
0709 13:16:55.296258 (+118694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.301135 (+  4877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.731162 (+1430027us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540031ecd0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:56.731374 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235370368}
I20260709 13:16:56.747725 10250 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.749114  8180 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:16:56.749655  8180 pending_rounds.cc:85] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 3
I20260709 13:16:56.749933 10157 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:56.749967  8180 pending_rounds.cc:107] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:16:56.750737  8180 raft_consensus.cc:2889] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:56.750624 10093 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:56.755692 10317 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:56.756748  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:56.758512  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 1913) took 2702 ms. Trace:
I20260709 13:16:56.758914  8175 rpcz_store.cc:276] 0709 13:16:54.055509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.056279 (+   770us) service_pool.cc:224] Handling call
0709 13:16:54.056577 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.056999 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.057034 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:54.057563 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.456969 (+2399406us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b180031abc0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:16:56.602626 (+145657us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:56.641028 (+ 38402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.646699 (+  5671us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:56.757955 (+111256us) raft_consensus.cc:1685] finished
0709 13:16:56.757972 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.758259 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26023,"raft.queue_time_us":8586,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"spinlock_wait_cycles":14074752,"thread_start_us":48575,"threads_started":1,"wal-append.queue_time_us":2657848}
I20260709 13:16:56.760739  8180 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:56.761642  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1004) took 1443 ms. Trace:
I20260709 13:16:56.762005  8179 rpcz_store.cc:276] 0709 13:16:55.301857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.695920 (+1394063us) service_pool.cc:224] Handling call
0709 13:16:56.711941 (+ 16021us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.744805 (+ 32864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.745052 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.756891  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1007) took 1275 ms. Trace:
I20260709 13:16:56.763006  8177 rpcz_store.cc:276] 0709 13:16:55.481048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.755684 (+1274636us) service_pool.cc:224] Handling call
0709 13:16:56.756082 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.756463 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.756490 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.756566 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:56.756656 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.756716 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.756818 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.772964  8176 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:56.773837  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1005) took 1464 ms. Trace:
I20260709 13:16:56.774298  8176 rpcz_store.cc:276] 0709 13:16:55.309078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.654960 (+1345882us) service_pool.cc:224] Handling call
0709 13:16:56.720952 (+ 65992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.773525 (+ 52573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.773765 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.758520 10150 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:56.776682  8175 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:56.749985 10250 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:56.772680 10317 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:56.776813 10093 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:56.750696 10139 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.789110  8183 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:56.796895  8179 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:56.802677  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 46098us
I20260709 13:16:56.810151 10250 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:56.814096 10010 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:56.814949 10010 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.815240  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:56.816535  8788 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:56.818490  8255 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:56.818733 10010 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:56.823592  8250 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:56.823662 10206 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:56.821892  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1008) took 1337 ms. Trace:
I20260709 13:16:56.825139  8178 rpcz_store.cc:276] 0709 13:16:55.484767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.764402 (+1279635us) service_pool.cc:224] Handling call
0709 13:16:56.788418 (+ 24016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.820519 (+ 32101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.820560 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.821633 (+  1073us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:56.821680 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.821736 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.821841 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.827627  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:56.836447  8183 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:56.859265  8788 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:56.821066 10150 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:56.869854 10150 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:56.853575 10010 consensus_queue.cc:1059] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:16:56.879019  8782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 591) took 2838 ms. Trace:
I20260709 13:16:56.879719  8782 rpcz_store.cc:276] 0709 13:16:54.040769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.041516 (+   747us) service_pool.cc:224] Handling call
0709 13:16:54.041844 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.419847 (+378003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.878276 (+2458429us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54005802d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:56.878762 (+   486us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627290368}
W20260709 13:16:56.914263  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 89190.3us
W20260709 13:16:56.978142 10408 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:16:56.978292  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 1908) took 2812 ms. Trace:
I20260709 13:16:56.978549  8248 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:56.979355  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 1914) took 1623 ms. Trace:
I20260709 13:16:56.979913  8248 rpcz_store.cc:276] 0709 13:16:55.355982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.356096 (+   114us) service_pool.cc:224] Handling call
0709 13:16:55.356347 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.965067 (+1608720us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b54001ce6a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0dc3dc0 00007fa5a0e4e1c0 00007fa5a0e4f231 00007fa5a0e4bd8f 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c
0709 13:16:56.979034 (+ 13967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.979282 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6609664}
W20260709 13:16:56.983355 10405 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:16:56.984040  8257 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:56.985743  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:56.986189 10269 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:56.986931  8251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60806 (request call id 276) took 2542 ms (client timeout 1993 ms). Trace:
W20260709 13:16:56.987332  8251 rpcz_store.cc:269] 0709 13:16:54.313957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.408446 (+ 94489us) service_pool.cc:224] Handling call
0709 13:16:56.821256 (+2412810us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400387f54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:56.856162 (+ 34906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430902528}
I20260709 13:16:56.987905 10139 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:56.912714 10250 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:16:56.988926  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:56.978829  8174 rpcz_store.cc:276] 0709 13:16:54.054150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.056244 (+  2094us) service_pool.cc:224] Handling call
0709 13:16:54.056492 (+   248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.056794 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.056817 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:54.057175 (+   358us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.320749 (+263574us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:54.320788 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.320867 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:56.692233 (+2371366us) spinlock_profiling.cc:243] Waited 8.98 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:16:56.824899 (+132666us) raft_consensus.cc:1685] finished
0709 13:16:56.824921 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.866860 (+ 41939us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6991,"raft.queue_time_us":2704,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":8230,"spinlock_wait_cycles":20653440,"thread_start_us":202910,"threads_started":1,"wal-append.queue_time_us":380213}
I20260709 13:16:56.990581  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:56.987285  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:56.993156  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:56.994940  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:56.995913  8257 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:56.993366  8251 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:56.993506 10232 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:56.998241 10232 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.000949 10232 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:57.001468 10232 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:57.002413  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:57.003536 10269 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:57.004072 10269 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.004469 10269 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.005348 10317 consensus_queue.cc:1059] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:57.006418 10317 raft_consensus.cc:3055] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:57.006752 10317 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:57.007230 10242 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.007723 10317 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.007851 10242 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.009153 10317 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.039443 10311 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.039903  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.040150 10311 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.040871 10145 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:57.041796 10145 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.042505 10311 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:57.043013 10311 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.043525 10311 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.044932 10299 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:57.045905  9878 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.046532 10355 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:57.048878 10379 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.002207 10232 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.051875 10355 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.052105 10379 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.051265  8074 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:57.059602 10382 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:57.049255  9878 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.060483  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:57.056702  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:57.061846  8253 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:57.047588 10299 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:57.069240  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:16:57.073962  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 56685.2us
I20260709 13:16:57.079515  8107 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:57.074610  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:57.062587 10311 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:57.061568 10172 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:16:57.096942  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 65729.7us
I20260709 13:16:57.096932  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:57.097208  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:57.099342 10140 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:57.101620  8182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 996) took 1992 ms (client timeout 1711 ms). Trace:
I20260709 13:16:57.102170 10355 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:57.102864 10382 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:57.104153 10250 raft_consensus.cc:3055] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:57.072605 10232 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:57.107903  8785 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:57.107939 10242 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:57.023896 10269 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:57.113371  8182 rpcz_store.cc:269] 0709 13:16:55.070459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.111483 (+ 41024us) service_pool.cc:224] Handling call
0709 13:16:57.054676 (+1943193us) spinlock_profiling.cc:243] Waited 8.67 ms on lock 0x7b5400329454. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:57.062788 (+  8112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19938560}
I20260709 13:16:57.119820  8104 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.122141  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:57.113166 10140 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.116464  8103 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 6. Ops: []
I20260709 13:16:57.118607 10382 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.127784  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:57.126459  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:57.128257 10269 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:57.117905 10250 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:57.130831  8107 raft_consensus.cc:2410] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:57.124091  9878 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:57.113346 10172 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.129405 10140 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.136363  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:57.129756 10139 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:57.143710 10299 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.145097 10299 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.146652  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:57.152021  8104 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:57.144105  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:57.142704  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:57.135154 10232 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:57.134202 10206 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:57.161619 10234 raft_consensus.cc:2764] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:57.162504  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 588) took 3607 ms. Trace:
I20260709 13:16:57.162971  8789 rpcz_store.cc:276] 0709 13:16:53.534358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.284021 (+749663us) service_pool.cc:224] Handling call
0709 13:16:54.284388 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.284707 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.284740 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.876585 (+2591845us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b2c00047c48. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:16:56.877325 (+   740us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.051516 (+174191us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:57.051564 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.055141 (+  3577us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.128630 (+ 73489us) raft_consensus.cc:1685] finished
0709 13:16:57.128645 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.141570 (+ 12925us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10765,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":71,"spinlock_wait_cycles":79106944,"thread_start_us":138783,"threads_started":1,"wal-append.queue_time_us":193685}
I20260709 13:16:57.167181 10418 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.167857 10418 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:57.169952  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.151950 10237 consensus_queue.cc:1059] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:16:57.178512 10237 raft_consensus.cc:3055] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:57.178896 10237 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:16:57.179646  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:57.180115  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.179811 10140 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.179972 10237 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.183691  8251 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:57.140084 10379 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:57.186923  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:57.181870 10269 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:57.188660 10232 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:57.189834 10148 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:57.189735 10232 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:57.193004  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.181586 10139 raft_consensus.cc:697] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:57.182051 10206 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:57.198925 10206 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.210356  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:57.196012 10269 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:57.213934  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:57.213967  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:57.211148 10415 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.141s	user 0.006s	sys 0.000s
I20260709 13:16:57.201510 10237 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:57.218925  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:57.221143  8176 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:57.221886  8177 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:57.222138 10150 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:16:57.222575  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 267394us
I20260709 13:16:57.224363 10382 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.225232 10157 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.225823 10157 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.226711 10382 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:57.220698 10140 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:57.228355 10157 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:57.203508 10148 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:16:57.257694  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 45506.3us
W20260709 13:16:57.259810  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 45045.5us
I20260709 13:16:57.228354 10172 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:57.268082 10418 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:57.271353  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 503943us
I20260709 13:16:57.214924 10250 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.278653 10382 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:57.280220 10075 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:57.280645 10075 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:57.281627 10418 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:57.281738 10075 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.283463 10075 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.284788  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:57.285800 10010 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:57.286345  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:57.287225 10232 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:57.287583 10010 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:57.287662 10232 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:57.288097 10010 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.287976 10139 consensus_queue.cc:237] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.288748 10010 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.288215 10232 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:57.290017 10431 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:57.297845  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:57.298039  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:57.298664 10432 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:57.291075 10431 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:16:57.299299 10432 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:57.298727  8104 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:57.299717  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:57.300432 10432 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.302338  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 278) took 1955 ms. Trace:
I20260709 13:16:57.302728  8250 rpcz_store.cc:276] 0709 13:16:55.347031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.347988 (+   957us) service_pool.cc:224] Handling call
0709 13:16:56.823205 (+1475217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.824193 (+   988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.302152 (+477959us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400387f50. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:57.302282 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3390980992}
I20260709 13:16:57.307022 10234 raft_consensus.cc:3055] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:57.307442 10234 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:57.308308 10234 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.309978 10427 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.310575 10427 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.312906 10427 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:57.314365  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:57.314663  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:57.315788  8181 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:57.317132  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:57.318331  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:57.321602  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:57.321767  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:57.322283  8253 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:57.323590  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:57.324198  8106 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:57.315706  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:57.326092 10422 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:57.325814 10232 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.327461  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:57.328068  8005 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39810 (request call id 292) took 9932 ms. Trace:
I20260709 13:16:57.329137  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:57.329785  8253 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:57.329845  8787 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:57.350684  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:57.351434  8177 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:57.354928  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:57.333467  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:57.331538 10179 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:16:57.359054  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 99223.3us
I20260709 13:16:57.361032  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:57.360376  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:57.278496 10150 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:57.360069  8104 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:57.363020  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:57.363919  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:57.361624  8105 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:57.366295  8176 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:16:57.373556  8106 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:57.377803  8253 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:57.383013  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:57.387888  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:57.273069 10148 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.377640 10432 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:57.365181 10150 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:57.397064  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:57.403888  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:57.407958  8106 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:57.412104 10010 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.412585 10234 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:57.413877  8103 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:16:57.414911 10170 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:57.416143  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:57.377231 10093 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:16:57.418267  8783 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:57.419204  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:57.419760  8105 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.409790  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:57.427114  8181 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:16:57.387909  8755 connection.cc:256] RPC call timeout handler was delayed by -1.2817971919998854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
I20260709 13:16:57.431133  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:57.429473  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:57.430847  8176 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:16:57.382916  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:57.438714  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:57.439113  8249 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:57.439610  8257 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:57.440267  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:57.440850  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:16:57.441838 10425 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:16:57.432732 10075 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.467284  8254 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.437237  8107 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:57.461865  8252 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.378907 10242 consensus_queue.cc:1059] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:16:57.328414  8005 rpcz_store.cc:276] 0709 13:16:47.395172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.395313 (+   141us) service_pool.cc:224] Handling call
0709 13:16:57.327760 (+9932447us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:52.934666 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:52.935423 (+   757us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:52.935473 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:16:52.935498 (+    25us) tablet.cc:662] Decoding operations
0709 13:16:52.936196 (+   698us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:52.936275 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:52.936315 (+    40us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:16:52.936723 (+   408us) tablet.cc:701] Row locks acquired
0709 13:16:52.936746 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:16:52.936925 (+   179us) write_op.cc:270] Start()
0709 13:16:52.937057 (+   132us) write_op.cc:276] Timestamp: P: 1783603012936867 usec, L: 0
0709 13:16:52.937081 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:16:52.948411 (+ 11330us) log.cc:844] Serialized 1303 byte log entry
0709 13:16:53.598057 (+649646us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa59dd420ac 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b
0709 13:16:53.718230 (+120173us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b1800242740. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa5a09f44bc 00007fa59dd4248b 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1
0709 13:16:53.828851 (+110621us) op_driver.cc:464] REPLICATION: finished
0709 13:16:54.043283 (+214432us) spinlock_profiling.cc:243] Waited 871 us on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa59dd420ac 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a4882ef0
0709 13:16:54.411603 (+368320us) write_op.cc:301] APPLY: starting
0709 13:16:54.416493 (+  4890us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:54.432557 (+ 16064us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:54.435185 (+  2628us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:54.468011 (+ 32826us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:54.468211 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:16:54.468262 (+    51us) write_op.cc:312] APPLY: finished
0709 13:16:54.468482 (+   220us) log.cc:844] Serialized 35 byte log entry
0709 13:16:54.468665 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.468765 (+   100us) write_op.cc:454] Released schema lock
0709 13:16:54.468803 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:54.469160 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.469187 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3254038,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":582490,"apply.run_cpu_time_us":2380,"apply.run_wall_time_us":57563,"num_ops":3,"prepare.queue_time_us":190594,"prepare.run_cpu_time_us":45757,"prepare.run_wall_time_us":783895,"raft.queue_time_us":111412,"raft.run_cpu_time_us":49476,"raft.run_wall_time_us":409871,"replication_time_us":891600,"spinlock_wait_cycles":140539264,"thread_start_us":1346428,"threads_started":4,"wal-append.queue_time_us":739091,"wal-append.run_cpu_time_us":29557,"wal-append.run_wall_time_us":1770019}]]}
I20260709 13:16:57.469049  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:16:57.464881  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 186100us
W20260709 13:16:57.471429  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.473136 10075 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.481716 10150 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.483263 10150 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.486109 10010 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:57.491495 10232 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:57.513051  8254 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
W20260709 13:16:57.528905  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.529613 10093 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.530192 10093 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.532230 10093 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:57.537550  8755 leader_election.cc:400] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 4. Current term is 5.
I20260709 13:16:57.537674  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:57.540814  8787 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:57.550239  8105 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
W20260709 13:16:57.552870  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 156691us
W20260709 13:16:57.566105  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 58098.2us
I20260709 13:16:57.558043 10075 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:57.575891  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:57.581585  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 102325us
I20260709 13:16:57.587212  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:57.588092  8788 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:57.589135  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:57.589736  8788 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:57.590591  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:57.590613  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:57.591286  8787 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:57.592252  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:57.593739  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:16:57.594393  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.594521  8785 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:57.595384  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:57.595980  8252 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:57.575004 10093 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.596649  8788 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:57.596700  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:57.596995 10438 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:57.597240  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:57.597587  8782 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:57.598306  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:57.599956 10170 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.600111  8221 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:57.601280  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:57.602128  8790 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:57.602897  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:57.604878 10250 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.606598  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:57.607611  8790 raft_consensus.cc:2410] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:57.610442  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:57.610563  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:57.611050  8176 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:16:57.614051 10053 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:57.621740 10427 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.623324  8006 catalog_manager.cc:5697] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 4, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 4 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.625236  8006 catalog_manager.cc:5697] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:57.621048  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45264.9us
I20260709 13:16:57.627183  8006 catalog_manager.cc:5697] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.627838  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:57.630842  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:57.632809  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:57.646565  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:57.647303  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:16:57.656044  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 291593us
I20260709 13:16:57.568787 10139 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:16:57.658631  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 84488.4us
I20260709 13:16:57.592947 10206 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.625216 10299 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:57.659431  8791 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:57.660102  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 88139.7us
I20260709 13:16:57.629554  8006 catalog_manager.cc:5697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:57.666836  8072 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:57.668646  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:57.670501 10439 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:57.671444 10436 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:57.656541 10075 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:16:57.673398 10075 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:57.673811 10075 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.674189 10075 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.675509 10384 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:57.596035  8784 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:57.665374 10299 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:57.659060 10237 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:57.658931 10382 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:57.658532 10269 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.679883  8006 catalog_manager.cc:5697] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 3, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.702917  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:57.710340  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 79594.4us
I20260709 13:16:57.706746  8788 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:57.711210  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:57.666460 10170 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:57.718111  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 61097us
I20260709 13:16:57.658819 10317 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:16:57.596755 10093 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.676457 10148 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:57.724383  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 54579.1us
I20260709 13:16:57.729836  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:57.734016  8006 catalog_manager.cc:5697] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 3, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 3 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:16:57.710110 10428 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:57.709964 10237 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.716056 10269 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.722802  8100 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:57.747606 10232 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:57.748607  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.748467 10447 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:57.676914 10432 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:16:57.724812 10382 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:16:57.762641  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 51537.5us
I20260709 13:16:57.763616  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:57.738265  7991 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9abaa411847e4bf9907f7af5e2689c7b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:57.728766 10384 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:57.758179  8221 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:57.748507 10450 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:57.760507  8006 catalog_manager.cc:5697] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:57.764881  7991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 94812.4us
I20260709 13:16:57.737699 10428 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:16:57.776424  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 112511us
I20260709 13:16:57.754874 10269 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.727288 10139 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.738303 10420 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:16:57.736060 10242 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:16:57.762778 10140 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.738732 10237 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.743443 10148 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:57.804708  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:16:57.809769  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 80173.4us
W20260709 13:16:57.805169  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 137189us
I20260709 13:16:57.762447 10427 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:16:57.888679  8006 catalog_manager.cc:5697] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 4, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 4 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.802225 10416 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.814028 10443 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:16:57.899116  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:57.814836 10010 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:16:57.899462  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 146041us
I20260709 13:16:57.900234  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:57.892253  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:16:57.814097 10441 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:16:57.813537 10145 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:57.812711 10424 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:57.901453  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:57.766811 10384 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:57.893991  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 219097us
I20260709 13:16:57.758249 10234 consensus_queue.cc:1059] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.088s
W20260709 13:16:57.898527  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 93907.2us
I20260709 13:16:57.769873 10232 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:57.814294 10442 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:57.766647 10170 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:57.904282  8006 catalog_manager.cc:5697] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:57.812800 10382 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.946956 10456 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:57.947964  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:57.948956 10456 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:57.949836 10010 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.950508 10093 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:57.951599 10093 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.951839 10075 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.908120 10150 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.953171 10150 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.954015 10232 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.955183 10150 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:57.956611 10170 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.957468 10419 raft_consensus.cc:3055] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:57.957964 10419 raft_consensus.cc:740] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:57.958112 10139 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:57.959007 10419 consensus_queue.cc:260] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.960631 10419 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.812923 10436 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:57.962411 10436 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.907048 10355 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:57.965461 10355 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:57.965875 10355 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.965802 10428 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.967260 10428 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.969523 10451 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:57.969866 10298 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:57.970366 10298 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.970105 10451 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:57.970782 10298 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.972373 10451 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:57.838774 10299 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:57.910488  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:57.973941 10299 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.973946 10451 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:57.974617 10451 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:57.975046 10451 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.978374  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:57.980123 10179 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:57.980516 10179 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:57.980667  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 70282.3us
I20260709 13:16:57.980860  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:57.981369  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:57.982179 10424 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:57.982784 10206 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:57.983520 10424 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.984144 10234 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:57.984547 10234 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:57.984563 10317 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:57.985037 10449 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:57.889041 10148 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.941278 10145 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:57.987946  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.908370 10384 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.908764  8072 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:57.903707 10242 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:58.024353  8006 catalog_manager.cc:5697] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 2, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
W20260709 13:16:58.027781  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.947016 10455 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:57.980851 10179 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.985462 10449 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:16:58.019033 10441 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:16:58.031378  8006 catalog_manager.cc:5697] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 3 to 4, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 4 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:57.993359 10456 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.007818 10148 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:58.039650  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 130949us
W20260709 13:16:58.037827 10460 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.117s	user 0.003s	sys 0.000s
I20260709 13:16:58.022308 10053 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:58.054457 10053 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:58.054348 10457 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.147s
I20260709 13:16:58.055756 10053 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:58.030153 10448 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
W20260709 13:16:58.057900 10445 log.cc:927] Time spent T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:16:57.973202 10237 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.032413  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:57.943384 10450 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:16:58.037957 10455 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.056401 10457 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:16:57.995347  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 51131.3us
I20260709 13:16:58.046826 10456 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:58.057075 10053 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.000144 10140 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.059324  8182 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:57.903494 10416 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.063863  8006 catalog_manager.cc:5697] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 3, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:58.043838 10458 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:58.079641  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:57.985488 10234 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.083280  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:58.063223 10438 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.120718  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:58.121841  8248 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:58.054576 10075 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.067445 10455 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.129274  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:58.130813  8104 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:16:58.131105  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:58.123097  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:16:58.133491  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 50306.4us
I20260709 13:16:58.135178  8105 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:16:58.099713  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.082309  8252 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:58.138067  8006 catalog_manager.cc:5697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 3, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 3 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:16:58.143882  8107 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:58.147562  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 199643us
W20260709 13:16:58.150939  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 170006us
I20260709 13:16:58.154215  8006 catalog_manager.cc:5697] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 4 to 6, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 6 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:58.155184  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:58.159261  8106 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:58.155687  8006 catalog_manager.cc:5697] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 3 to 4, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 4 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:16:58.160602  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:58.159641  8106 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:16:58.163515  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:58.166148  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:58.148149  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:58.170593  8006 catalog_manager.cc:5697] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 3 to 4, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 4 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:58.171630  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:58.174129  8221 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:58.081970 10457 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.175123 10454 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:58.175599 10454 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:58.175993 10454 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:58.176782 10444 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.274s	user 0.002s	sys 0.000s
I20260709 13:16:58.176918 10457 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.177531 10457 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:58.178933 10435 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:58.179344 10435 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.179665 10435 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:58.180683 10179 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.133416 10438 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.147691 10451 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.160280  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:58.162829 10449 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.239007  8255 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:58.182468  8249 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:58.298911  8100 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:58.303459 10434 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.216207 10172 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:58.226750 10250 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:58.191476  8248 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:58.304021 10434 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.173480  8106 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.159713 10232 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.247793  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:58.219024  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:58.301267 10438 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:58.285841  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45815.7us
I20260709 13:16:58.167644 10234 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.302572  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:58.302884 10440 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:58.237501  8006 catalog_manager.cc:5697] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 3, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 3 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:16:58.356662  8106 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:58.298513  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:58.302142 10449 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.305330 10172 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.397838 10172 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.398488 10140 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.297943  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:58.400099 10298 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:58.396941  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 98512.3us
I20260709 13:16:58.163537 10420 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:58.163997 10467 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:58.359615  8791 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
W20260709 13:16:58.371059  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.308775  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 137196us
I20260709 13:16:58.170248 10010 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:58.403038  8254 raft_consensus.cc:2368] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5.
I20260709 13:16:58.169500 10442 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.403303  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:58.427446 10442 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:58.428270 10269 consensus_meta.cc:287] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.535s	user 0.006s	sys 0.002s
I20260709 13:16:58.428728 10269 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:58.239625 10452 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:16:58.182036  8785 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:58.417157  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 119312us
I20260709 13:16:58.287266 10299 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.422153  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.439510  8177 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:58.386426 10432 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:58.184002 10450 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.240s
I20260709 13:16:58.305676 10145 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:58.182567 10237 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:58.189608 10446 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.269s
I20260709 13:16:58.419474 10439 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.424203  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.424415  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.425248  8147 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:16:58.479183  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 54009.4us
I20260709 13:16:58.425784 10438 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:58.482676 10250 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:58.426705  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:58.483168 10250 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:58.483659 10250 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.484217  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:58.429265  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:58.485503 10093 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
W20260709 13:16:58.486455  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 57254.7us
I20260709 13:16:58.419771 10140 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:58.429561 10442 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.430198 10468 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.488267 10468 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:58.488705 10468 raft_consensus.cc:697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:58.489583 10468 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:58.491295 10465 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
I20260709 13:16:58.430876  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:16:58.492738  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 61939.8us
I20260709 13:16:58.170424  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:58.493497 10439 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.440904 10172 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.435652  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.495030  8181 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:58.495860 10172 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:58.496419 10442 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:58.497195 10442 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:58.497706 10442 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.357268 10447 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:58.498436 10447 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.500766 10447 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.249619 10436 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:58.304893 10382 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:16:58.445796  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.217890  8783 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:16:58.452459  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:58.453248  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:58.412477 10420 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:16:58.226016 10456 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.454574  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:58.439340 10299 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.454937 10384 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.456399  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.458053  8782 raft_consensus.cc:2410] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:58.458882  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:58.459519  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:58.460291 10467 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:58.461148  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:58.208674 10170 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.244s
I20260709 13:16:58.467413  8789 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:58.466917  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:58.465931  8223 connection.cc:256] RPC call timeout handler was delayed by -1.7521195719998559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
I20260709 13:16:58.415512 10242 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:16:58.475994  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.286164 10466 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.152s
I20260709 13:16:58.466861  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.493649 10269 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:58.495796 10439 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.442453  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:58.453701  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.393049 10232 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.412107 10355 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.586454 10434 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:58.587496 10355 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:58.589778 10179 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:58.580868 10172 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:58.594129 10451 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.594040 10172 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.596101 10456 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:58.596956 10172 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:58.557567  8102 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
W20260709 13:16:58.511883  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.598682  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.557607  8177 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
W20260709 13:16:58.554965  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.564509 10462 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:16:58.501248 10298 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:58.534950 10420 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.485574 10419 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:16:58.584399  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.501350 10447 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:16:58.583777  8107 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:16:58.496522  8182 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:58.422519 10440 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.570195  8099 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:58.570005  8101 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
W20260709 13:16:58.577415 10452 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:16:58.607663  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.578365  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:58.558815 10457 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:16:58.479411 10432 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.581825 10416 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.599872 10237 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.643771  8102 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:58.593091 10435 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.613111  8180 raft_consensus.cc:2410] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:58.645326  8183 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:58.644057  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:58.618239  8223 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:58.607995 10424 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:58.610750 10427 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.605731 10317 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.059s	sys 0.099s
I20260709 13:16:58.652294 10424 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.653527 10298 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.653708 10446 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:58.653970 10298 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.654125 10446 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:58.654367 10298 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.654542 10446 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:58.652681 10384 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:58.654569 10424 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:16:58.653548  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 75253.7us
I20260709 13:16:58.657722  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:58.658187  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:58.659740 10434 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:58.660554 10432 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.661321  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:58.662535  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.662722  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:58.662781  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:58.663259  8180 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:58.664312 10469 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:58.664855 10469 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:58.613468  8100 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:58.665697  8254 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:58.665930 10469 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.669322  8177 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:58.597647 10242 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.670548  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:58.648273  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 147847us
I20260709 13:16:58.675669  8178 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:58.676256  8147 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:16:58.667444 10317 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.059s	sys 0.099s
I20260709 13:16:58.677418  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:58.665000 10179 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:16:58.612309 10419 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.664849 10172 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:58.691253  8179 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.691383  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:58.691977  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 204363us
I20260709 13:16:58.693524  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:16:58.698479  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.682188  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:58.714928  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.715621  8174 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:16:58.716492  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.717222  8174 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:58.718014 10299 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.718498  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:58.719156  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:58.720706  8100 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:58.721724  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:16:58.722112 10474 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:58.722364  8181 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:58.711441 10466 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:16:58.723835  8257 raft_consensus.cc:3055] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:58.724174  8257 raft_consensus.cc:740] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:58.724859  8257 consensus_queue.cc:260] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.725641 10232 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.725732  8257 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.726172  8256 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:58.727763 10442 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.731439  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:58.732048  8107 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:58.732664  8221 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:58.733841  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:58.735185  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:58.735883 10419 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.736466  8251 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:58.737325 10424 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:58.737684 10242 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:58.738219  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 596) took 1132 ms. Trace:
I20260709 13:16:58.692103 10317 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:16:58.738603  8789 rpcz_store.cc:276] 0709 13:16:57.605841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.656623 (+ 50782us) service_pool.cc:224] Handling call
0709 13:16:58.738031 (+1081408us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b540065f4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:16:58.738148 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1833937152}
I20260709 13:16:58.739176 10470 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:58.739363 10317 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.740023  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:58.740836  8099 raft_consensus.cc:2393] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 5: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:58.736476 10172 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:58.741743  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:58.738016 10424 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:58.742527  8104 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:58.743425 10440 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.743517 10424 raft_consensus.cc:3055] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:58.682754 10416 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:58.676476 10427 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.744364 10416 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:58.744764 10416 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:58.745846 10427 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:58.742548 10172 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.747807  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:58.748046  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:58.748410  8255 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:16:58.748591  8249 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:16:58.723277  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:58.749941  8254 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:16:58.750205  8181 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:58.744006 10424 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:16:58.752398  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:58.735927  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:16:58.754197  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 47046us
I20260709 13:16:58.651621 10237 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.767577  8074 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:58.768061  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.758199  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:58.769121  8223 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:16:58.356794 10206 consensus_queue.cc:1175] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a0f96c12124b4e1a816d9fa970464091" responder_term: 4 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:58.767324  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:58.787154  8790 raft_consensus.cc:2393] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:16:58.716532 10148 consensus_meta.cc:287] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.654s	user 0.004s	sys 0.004s
I20260709 13:16:58.784608  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:58.768725  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:58.724869 10435 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.784018  8251 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:58.784608  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:58.766036  8179 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:16:58.782383  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:58.793322  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:58.792444  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:58.795662  8257 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:58.759027 10467 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:58.761473 10462 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.753931 10438 consensus_queue.cc:1243] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:58.800863  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:58.790691  8149 leader_election.cc:400] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5.
I20260709 13:16:58.784709 10140 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:58.789772 10148 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.800817  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:58.764503 10298 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.807783  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:58.809908 10424 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.811054 10237 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.812054 10442 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:58.795681 10434 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:58.790275 10470 raft_consensus.cc:2764] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:58.790696 10170 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:58.812127  8175 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:58.792990 10466 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:58.818333  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:16:58.821311 10455 consensus_meta.cc:287] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.666s	user 0.006s	sys 0.003s
I20260709 13:16:58.791625 10449 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:16:58.821206 10462 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.797796 10431 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:16:58.812896 10234 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:58.824374  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.896559  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.806769  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:58.801437  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:58.822270 10446 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.812525 10250 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.884558  8106 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:58.885159  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.870293  8177 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:58.888940  8149 leader_election.cc:403] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:58.845541  8107 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:58.804235  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:58.891378  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:16:58.893285  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:58.861797 10476 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.917025  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 112871us
I20260709 13:16:58.862157  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:58.904891  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:58.906466  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:16:58.883221 10454 consensus_meta.cc:287] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.002s
I20260709 13:16:58.896266 10234 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.823626 10075 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:16:58.871333 10474 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:58.914752  8183 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:16:58.939759  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:58.940651  8183 raft_consensus.cc:2393] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:58.941547  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:58.889065 10140 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.942852 10140 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.917600  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:58.946162  8174 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:58.947328  8174 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:58.888199 10170 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.949029 10170 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.896374 10093 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.953707 10093 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:58.955842 10093 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:58.948534  8174 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:58.958268  8174 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:58.919348  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:58.916270  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 128152us
I20260709 13:16:58.960983  8174 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:58.896850 10434 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:58.961561 10093 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.961823 10434 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:58.962157 10093 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.964349  8788 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:58.930625  8223 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:58.965339 10093 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:58.966491  8223 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:16:58.968025  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:58.918875  8249 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:16:58.970213 10179 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:58.970844 10179 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:58.971359 10179 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.927425  8175 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:58.818964 10467 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:58.994846 10488 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:58.996225 10467 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:58.997723  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:58.998349  8789 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.974027  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:58.975348  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:59.004938  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:58.999145  8108 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:16:58.934360 10234 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:58.916657 10484 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:58.973876  8783 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:58.928809  8101 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:58.974210  8099 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:16:59.014108  8180 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:59.020558  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:59.030305  8254 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:59.021723  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:59.018951  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:58.898211 10455 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:59.025236  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:58.997826 10424 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.033363  8104 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:59.034201  8178 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:59.027755  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:59.013958 10384 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:59.025861  8175 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:16:59.031440  8790 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:16:59.020259  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:58.973747 10075 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:59.032284 10481 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 13:16:59.037278  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 244897us
I20260709 13:16:59.019835 10145 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:58.973351 10170 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:59.034897  8183 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 1.
I20260709 13:16:59.038017  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:59.039690  8175 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:59.040033  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:59.040648  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:59.044611  8790 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.019418 10232 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:16:59.047242  8103 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:16:59.045120  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:59.022156 10438 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:59.048285 10458 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:59.048069 10317 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:59.024881 10473 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:58.934551 10454 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:58.928504 10476 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:59.035732 10435 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.019613 10467 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:16:59.054663 10458 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.036975 10384 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.044390 10484 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:59.068608  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:59.096052  8178 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 1.
I20260709 13:16:59.097276  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:59.069497  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:59.066735  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:16:59.063141 10473 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:59.059203  8175 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:16:59.089092  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 82088.1us
I20260709 13:16:59.100152  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:59.070838  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:59.068459 10382 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:16:59.104377  8179 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
W20260709 13:16:59.128561  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.093804 10458 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:59.135864  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:59.114154  8181 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:16:59.108093 10317 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:59.104444  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:16:59.105829 10473 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.088374 10435 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:59.119871 10382 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:59.170462  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 70391.7us
I20260709 13:16:59.137320 10462 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:59.136194 10250 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:59.135989 10484 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:59.144178 10420 consensus_meta.cc:287] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
I20260709 13:16:59.120033 10298 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:59.158687  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.094125 10384 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:59.144415 10145 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.147460 10446 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:59.249130  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:59.103821 10237 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 13:16:59.146160 10140 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:59.234843 10317 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.158471 10442 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5.
I20260709 13:16:59.300860 10462 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.223665 10502 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
W20260709 13:16:59.407194  8251 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.008s	sys 0.011s
W20260709 13:16:59.410555  8251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.008s	sys 0.011s
I20260709 13:16:59.327106 10170 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:16:59.414003  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.339392 10172 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.329368 10455 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:59.435787  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.331120 10317 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:59.455858 10496 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 13:16:59.295215 10503 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.168s
I20260709 13:16:59.340041 10446 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.460441  8789 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:16:59.305655 10420 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:59.463265 10420 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:59.464124  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 449506us
I20260709 13:16:59.464735 10140 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:59.464915  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:59.466756 10317 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:59.468093 10438 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:59.468953 10382 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:59.445771 10506 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:59.469551 10506 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:16:59.469931 10506 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:59.309122 10145 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:59.471349 10439 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:59.471908 10145 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:59.447579 10434 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:59.468792 10438 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:59.489557  8251 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:59.445642 10476 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:16:59.490507  8248 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.009s	sys 0.024s
W20260709 13:16:59.490934  8248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.009s	sys 0.024s
I20260709 13:16:59.460824 10179 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:59.444087 10490 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.409s	user 0.001s	sys 0.000s
I20260709 13:16:59.435448 10469 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:59.497648  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:59.441682 10269 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.497766  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:59.503206  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:59.435039 10484 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:59.513149  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 408697us
I20260709 13:16:59.489217 10454 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:59.414438 10462 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:59.534204  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:59.469317 10317 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:59.527294  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:59.528682  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 472217us
W20260709 13:16:59.528723  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 279671us
I20260709 13:16:59.529935  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:59.540042  8175 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.507172 10478 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.526227  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:59.533057  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:16:59.497484 10053 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.548972  8178 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:16:59.531827  8181 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:59.554013  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 418210us
I20260709 13:16:59.498701 10427 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:59.554052  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:59.489063 10172 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:59.564536  8182 raft_consensus.cc:3055] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:59.541728  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:59.531391  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:59.620901  8175 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:16:59.617653  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:59.540762 10466 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:59.621933  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 67955.9us
I20260709 13:16:59.622754  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:16:59.618821  8182 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:16:59.630626  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:59.631605  8106 raft_consensus.cc:2368] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6.
I20260709 13:16:59.579814  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:59.567255  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:16:59.543105 10416 consensus_meta.cc:287] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.798s	user 0.006s	sys 0.006s
I20260709 13:16:59.567756  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:59.547737 10250 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:16:59.568095  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:16:59.626785  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:59.630692  8221 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:59.526768 10484 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:59.519538 10269 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:59.562227  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:59.900398  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 1949) took 1193 ms. Trace:
W20260709 13:16:59.912822  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.911178  8183 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.909176  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 601) took 1151 ms. Trace:
W20260709 13:16:59.749097  8790 consensus_meta.cc:287] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.697s	user 0.012s	sys 0.000s
W20260709 13:16:59.911949  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 281349us
I20260709 13:16:59.698237  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:59.810245  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:59.570168  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:16:59.620098  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 78445.1us
I20260709 13:16:59.567473 10436 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:59.899268 10458 consensus_meta.cc:287] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.738s	user 0.010s	sys 0.000s
W20260709 13:16:59.921831  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.632588  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:59.948022  8106 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.765022  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 1951) took 1035 ms. Trace:
I20260709 13:16:59.944640  8103 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:59.682925  8256 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:59.872654  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:59.767649  8784 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:59.701045  8182 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:59.633852 10476 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:59.645393  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:16:59.908530 10442 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.762846 10499 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:59.878067 10511 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.196s	user 0.000s	sys 0.002s
I20260709 13:16:59.953585  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:59.931458  8791 rpcz_store.cc:276] 0709 13:16:58.759639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.759746 (+   107us) service_pool.cc:224] Handling call
0709 13:16:58.786118 (+ 26372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.998637 (+212519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.998673 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:58.998722 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:58.998755 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.908948 (+910193us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400544cd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:16:59.908994 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.909119 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488288128}
I20260709 13:16:59.875952 10383 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:59.945132  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:16:59.909886  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:59.916563 10145 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:59.810369 10234 consensus_meta.cc:287] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.787s	user 0.010s	sys 0.000s
I20260709 13:16:59.769495 10513 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.690958 10299 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.766011 10148 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:16:59.682431 10479 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.007s	sys 0.057s
W20260709 13:16:59.765813 10509 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:16:59.956943  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:59.977685 10470 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:59.734100 10438 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:16:59.957888  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 312590us
I20260709 13:16:59.620008 10454 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.323s
I20260709 13:16:59.960242  8182 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:59.843065 10172 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:59.960294  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:59.903642  8786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 599) took 1146 ms. Trace:
I20260709 13:16:59.920471  8253 rpcz_store.cc:276] 0709 13:16:58.706817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.706938 (+   121us) service_pool.cc:224] Handling call
0709 13:16:58.732512 (+ 25574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.732801 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:58.837801 (+105000us) log.cc:844] Serialized 14 byte log entry
0709 13:16:59.898923 (+1061122us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b18003d5040. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa5a09f44bc 00007fa59dd4248b 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec23a
0709 13:16:59.899477 (+   554us) log.cc:844] Serialized 14 byte log entry
0709 13:16:59.899636 (+   159us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:59.900112 (+   476us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:59.900176 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.900241 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.900339 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":186211,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":77,"raft.queue_time_us":216,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":147,"spinlock_wait_cycles":142368896,"thread_start_us":262947,"threads_started":2,"wal-append.queue_time_us":215490}
I20260709 13:16:59.931856  8790 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:16:59.909586 10447 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:16:59.976832  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 431) took 1044 ms. Trace:
I20260709 13:16:59.805402 10179 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:59.908494 10075 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:59.768317 10462 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:59.770437 10434 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:59.950238  8248 rpcz_store.cc:276] 0709 13:16:58.729994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.757875 (+ 27881us) service_pool.cc:224] Handling call
0709 13:16:58.784763 (+ 26888us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.789756 (+  4993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.789788 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:58.801989 (+ 12201us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.491481 (+689492us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:59.491529 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.491604 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.764809 (+273205us) raft_consensus.cc:1685] finished
0709 13:16:59.764830 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.764961 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4414,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":17493,"thread_start_us":629592,"threads_started":1,"wal-append.queue_time_us":873261}
I20260709 13:17:00.015770 10522 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.034161 10522 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.036381 10522 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:00.018708 10470 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:00.021530  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:00.038528  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:16:59.763020 10518 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.336s
I20260709 13:16:59.964320  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:00.027189  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:16:59.964339  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:59.965330 10269 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:16:59.632980 10317 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:00.018697  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:16:59.967597  8099 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:16:59.965590 10442 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:59.968926  8106 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:00.046603  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:59.877871 10469 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:00.026124 10531 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.022033 10299 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.047842 10469 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.048079 10531 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.050251 10531 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:00.050822 10503 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:59.632859 10455 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:59.763105 10477 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.051364 10503 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:00.051589 10455 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.051754 10477 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.052155  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:00.050858 10434 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.045922 10317 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.053246 10434 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.053980 10477 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:59.970403  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:00.054659  8176 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:17:00.055132 10317 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:00.055318 10434 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:00.055675  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.056945 10442 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:59.567081 10053 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.028281 10466 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:00.069370  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 1953) took 1403 ms. Trace:
I20260709 13:17:00.074434  8180 rpcz_store.cc:276] 0709 13:16:58.666155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.675684 (+  9529us) service_pool.cc:224] Handling call
0709 13:16:58.729651 (+ 53967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.036562 (+306911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.069114 (+1032552us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b5400329e54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:00.069304 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468449536}
I20260709 13:17:00.076128  8174 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:17:00.076557  8174 pending_rounds.cc:85] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 6
I20260709 13:17:00.076786  8174 pending_rounds.cc:107] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:17:00.077018  8174 raft_consensus.cc:2889] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:00.079056  8072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.725s (SENT) [suppressed 14 similar messages]
I20260709 13:16:59.962033  8249 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 6: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:00.098050 10462 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.098387 10454 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.098577 10145 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:00.098693 10462 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.098978 10454 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:59.973732  8223 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:16:59.769665 10519 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.336s
I20260709 13:17:00.100848 10454 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:16:59.772451 10384 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:00.101719  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 128061us
I20260709 13:17:00.072261 10466 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.103235 10384 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:00.103186  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:00.103880 10384 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:00.072433  8788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 620) took 2043 ms. Trace:
I20260709 13:17:00.104528 10179 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:00.104663 10384 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:16:59.971452 10446 consensus_meta.cc:287] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.003s
I20260709 13:17:00.105626 10446 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:59.962152 10206 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:00.100879 10462 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:00.071983 10435 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:00.106487 10206 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:00.073937  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:00.107522 10206 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:16:59.956200 10512 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:00.024623  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 114811us
I20260709 13:17:00.109797 10512 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.111047 10484 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:00.111974 10512 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:59.977212 10234 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:59.934367 10250 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.112224  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:00.113938 10234 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:00.114068 10250 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:59.954493 10436 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:16:59.963308  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:00.023517  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:00.026376  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:00.104769  8788 rpcz_store.cc:276] 0709 13:16:58.028940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.029154 (+   214us) service_pool.cc:224] Handling call
0709 13:16:58.029478 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.964766 (+935288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.072207 (+1107441us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b540051a4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:00.072377 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2149477120}
I20260709 13:17:00.115628  8251 raft_consensus.cc:2410] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:17:00.115860  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:00.116165 10436 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:00.116513  8108 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:00.027539  8790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48096 (request call id 437) took 1032 ms. Trace:
I20260709 13:17:00.030467  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:00.117136  8790 rpcz_store.cc:276] 0709 13:16:58.995214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.040419 (+ 45205us) service_pool.cc:224] Handling call
0709 13:17:00.027490 (+987071us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:00.117688  8248 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.119406  8790 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:17:00.119751  8790 pending_rounds.cc:85] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 5
I20260709 13:17:00.119966  8790 pending_rounds.cc:107] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:17:00.120178  8790 raft_consensus.cc:2889] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:59.567414 10478 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:16:59.677335  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45764.7us
I20260709 13:17:00.123466  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:00.117022  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:00.125919  8788 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:17:00.127194  8257 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:00.129874  8257 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:17:00.131965  8174 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:00.133158  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:00.134443  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:00.135960  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:00.138042  8179 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:00.138612 10435 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:00.140401  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:00.141005  8176 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:17:00.143435  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:00.145282  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:00.145912  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:16:59.934042 10525 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:00.146709  8099 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:17:00.146828 10525 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:00.147862  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:00.147809 10525 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.148595  8099 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:17:00.052070 10455 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:00.052251 10503 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.059074 10053 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:16:59.633867  8100 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:00.026489  8786 rpcz_store.cc:276] 0709 13:16:58.757058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.757874 (+   816us) service_pool.cc:224] Handling call
0709 13:16:58.816220 (+ 58346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.888801 (+ 72581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.896627 (+  7826us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:59.021121 (+124494us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.547802 (+526681us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:59.565170 (+ 17368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.618717 (+ 53547us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.903346 (+284629us) raft_consensus.cc:1685] finished
0709 13:16:59.903374 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.903546 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15725,"raft.queue_time_us":40721,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":4933,"thread_start_us":472360,"threads_started":1,"wal-append.queue_time_us":839123}
I20260709 13:17:00.147830 10436 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:17:00.028177  8784 rpcz_store.cc:276] 0709 13:16:58.932026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.933198 (+  1172us) service_pool.cc:224] Handling call
0709 13:16:59.767267 (+834069us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27e9c 00007fa59dd27a5b 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:16:59.767464 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.962211 (+194747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.975042 (+ 12831us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2795776}
I20260709 13:16:59.768836 10506 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.012341 10513 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.154742 10436 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:00.155184 10436 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:16:59.959390 10424 consensus_meta.cc:287] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.922s	user 0.012s	sys 0.000s
I20260709 13:17:00.065927  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:00.044971 10432 raft_consensus.cc:3055] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:00.066591  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 983) took 1425 ms. Trace:
W20260709 13:17:00.031656 10493 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.940s	user 0.000s	sys 0.004s
I20260709 13:17:00.079690  8105 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:17:00.018117 10473 consensus_meta.cc:287] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.723s	user 0.010s	sys 0.001s
I20260709 13:17:00.039570 10470 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:00.081163  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:00.166808  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 85734.2us
I20260709 13:17:00.168845  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:00.081763 10299 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:00.081931  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:00.170995  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:00.082175 10518 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:00.084017  8250 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:17:00.171208  8104 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:00.181169  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:00.046722  8183 raft_consensus.cc:2410] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:17:00.084988  8182 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:00.087419  8785 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:00.209646  8174 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:00.070070  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 1958) took 1399 ms. Trace:
I20260709 13:17:00.210009  8248 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:00.156173 10513 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:00.210260  8177 rpcz_store.cc:276] 0709 13:16:58.671001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.671260 (+   259us) service_pool.cc:224] Handling call
0709 13:16:58.870063 (+198803us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.917406 (+ 47343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.069896 (+1152490us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400329950. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:00.070017 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456546176}
I20260709 13:16:59.956969 10416 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:00.094517 10492 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.988s	user 0.003s	sys 0.003s
I20260709 13:17:00.098169  8249 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:59.974761  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:16:59.966257 10499 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:00.103914 10466 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:00.104943 10179 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.073053  8787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 430) took 1141 ms. Trace:
I20260709 13:17:00.221920  8787 rpcz_store.cc:276] 0709 13:16:58.931735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.931898 (+   163us) service_pool.cc:224] Handling call
0709 13:16:58.999493 (+ 67595us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:59.103339 (+103846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.103368 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:59.120471 (+ 17103us) log.cc:844] Serialized 52 byte log entry
0709 13:16:59.254089 (+133618us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:59.254146 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.072680 (+818534us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540049d4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:00.072737 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.072781 (+    44us) raft_consensus.cc:1685] finished
0709 13:17:00.072796 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.072997 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":431,"raft.queue_time_us":810,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":17348,"spinlock_wait_cycles":232647936,"thread_start_us":89219,"threads_started":1,"wal-append.queue_time_us":362811}
I20260709 13:16:59.956760 10458 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.182299 10473 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.225395 10458 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:00.225786 10473 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:00.226446  8789 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:00.226555  8785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 600) took 1469 ms. Trace:
I20260709 13:17:00.227070 10179 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.226990  8785 rpcz_store.cc:276] 0709 13:16:58.757371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.757956 (+   585us) service_pool.cc:224] Handling call
0709 13:17:00.086982 (+1329026us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:17:00.087174 (+   192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.216009 (+128835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.226500 (+ 10491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8237824}
I20260709 13:16:59.969820 10383 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:00.145936  8108 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
W20260709 13:17:00.017668 10479 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.019s	sys 0.074s
I20260709 13:17:00.028842 10447 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:00.062584 10469 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.159569  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:00.159634  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:00.160526  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:00.161571  8101 rpcz_store.cc:276] 0709 13:16:58.641256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.643402 (+  2146us) service_pool.cc:224] Handling call
0709 13:16:58.667005 (+ 23603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.034913 (+367908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.066278 (+1031365us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54000fb254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:00.066507 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535353088}
I20260709 13:17:00.171582  8791 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.127107 10478 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:00.185086  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:00.185961  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 81413.5us
W20260709 13:17:00.212555  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 43810.1us
I20260709 13:17:00.216347  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:00.209785  8147 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:00.161455 10432 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:00.163849 10512 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:00.156112 10506 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:00.217957  8255 raft_consensus.cc:2368] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6.
I20260709 13:17:00.218436  8103 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:00.212710 10299 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.218019  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:00.179669 10250 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:00.156213 10436 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.181681 10435 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
W20260709 13:17:00.259104  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 180066us
I20260709 13:17:00.376334  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 295) took 1608 ms. Trace:
I20260709 13:17:00.357133  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:00.359090  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 438) took 1363 ms. Trace:
I20260709 13:17:00.366938  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:00.252651  8102 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:00.448982  8790 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:00.182102 10454 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:00.313441  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:00.429548  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.375423  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:00.449968  8248 raft_consensus.cc:2410] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:17:00.463020  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:00.463990  8182 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:00.449252  8788 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:00.451777  8105 raft_consensus.cc:2410] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:17:00.453701  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:00.450773  8789 rpcz_store.cc:276] 0709 13:16:58.995574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.461204 (+465630us) service_pool.cc:224] Handling call
0709 13:16:59.466137 (+  4933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.226891 (+760754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.358841 (+131950us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54004ac254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:00.359030 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1748165504}
W20260709 13:17:00.449461  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 288977us
I20260709 13:17:00.459213  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:00.216310 10010 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:17:00.478462  8104 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 6: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:00.480259  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:00.485374  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 272377us
I20260709 13:17:00.487215  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:00.483964  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:00.488799  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:00.484829  8108 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
W20260709 13:17:00.371520 10492 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:17:00.363300 10530 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.343s	user 0.000s	sys 0.002s
I20260709 13:17:00.218194 10093 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:00.221843 10499 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.492280  8255 raft_consensus.cc:2410] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:00.492926  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:00.286837  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:00.491640  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:00.503078  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:00.363982  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:00.364449 10140 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:00.286079 10473 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:00.502080  8176 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.484335 10416 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:00.258802 10466 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:00.372435 10484 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:00.501677 10148 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.502481 10355 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:00.544627  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:00.555160  8104 raft_consensus.cc:2410] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:00.505307 10447 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:00.461171 10454 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:00.511444 10436 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:00.513633  8178 raft_consensus.cc:2368] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6.
I20260709 13:17:00.521768 10468 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.484596 10512 raft_consensus.cc:697] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:00.494884  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 315549us
I20260709 13:17:00.631282  8147 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:00.528237  8249 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:00.520630 10503 consensus_queue.cc:1059] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 13:17:00.496621 10462 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:00.521889  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:00.527181  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:00.496771 10428 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:00.366250 10427 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:00.502156 10232 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:00.491684  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:00.496838 10172 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.213449 10522 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.276s
I20260709 13:17:00.483784 10513 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:17:00.229517  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:00.517655 10140 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:00.478343 10477 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:00.659466 10500 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.524s	user 0.005s	sys 0.003s
I20260709 13:17:00.598471  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:00.605206  8176 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:00.448735  8252 rpcz_store.cc:276] 0709 13:16:58.767733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.769783 (+  2050us) service_pool.cc:224] Handling call
0709 13:16:58.791826 (+ 22043us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:58.816304 (+ 24478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.816334 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:58.837235 (+ 20901us) log.cc:844] Serialized 52 byte log entry
0709 13:16:59.053234 (+215999us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:59.053272 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.053332 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.030904 (+977572us) spinlock_profiling.cc:243] Waited 63.8 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:00.376054 (+345150us) raft_consensus.cc:1685] finished
0709 13:17:00.376074 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.376277 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1334,"raft.queue_time_us":7903,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4717,"spinlock_wait_cycles":146820480,"thread_start_us":156665,"threads_started":1,"wal-append.queue_time_us":175325}
I20260709 13:17:00.486589 10299 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.481321 10250 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:00.519027  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 334033us
W20260709 13:17:00.734772  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 241922us
I20260709 13:17:00.735762  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:00.737215  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:00.609328 10454 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:00.741684 10232 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:00.742270 10232 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.742684 10232 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.609790 10355 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:00.620318  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:00.621456  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 1958) took 1580 ms. Trace:
I20260709 13:17:00.511796 10506 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:17:00.506335 10519 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:17:00.506469 10457 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:17:00.520741 10508 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:00.532392 10538 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.772094 10538 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.560037 10148 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.774669 10538 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:00.524312 10532 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:00.775208 10148 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:00.512660 10434 consensus_queue.cc:1059] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:17:00.776908 10434 raft_consensus.cc:3055] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:00.777340 10434 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:00.778213 10434 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:00.779240 10470 consensus_meta.cc:287] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.000s
I20260709 13:17:00.779412 10434 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.779875 10470 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.632285  8147 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:00.782003  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 149780us
I20260709 13:17:00.520023  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:00.613739  8786 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:00.661099  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:00.524394 10535 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:00.528194 10473 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.597663  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:00.546706 10484 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.697146  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:00.824193  8105 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:00.824606  8787 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:00.537799 10466 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.656946 10442 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:00.655560 10462 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:00.666678 10476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.008s	sys 0.020s
W20260709 13:17:00.794389 10455 consensus_meta.cc:287] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.001s
I20260709 13:17:00.610982 10447 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.663532 10427 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:00.588055 10383 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.537604 10432 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.748512  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:00.823443 10531 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:00.632606 10468 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:00.761929  8102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1861) took 1283 ms (client timeout 1636 ms). Trace:
I20260709 13:17:00.762945 10512 consensus_queue.cc:237] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:00.764303 10541 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:17:00.766489 10179 consensus_meta.cc:287] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.003s
I20260709 13:17:00.767704 10525 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:00.770217 10469 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:00.771077 10508 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.787222  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 1956) took 1113 ms. Trace:
I20260709 13:17:00.790068  8791 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:00.749359 10518 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:00.700822  8784 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:00.670253 10172 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.874846  8788 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:00.851985 10531 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.829106  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:00.756438 10478 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:00.657231 10428 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.829443  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:00.699326 10477 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.752024  8254 rpcz_store.cc:276] 0709 13:16:59.041321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.041489 (+   168us) service_pool.cc:224] Handling call
0709 13:16:59.051831 (+ 10342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.475679 (+423848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.475709 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:59.491317 (+ 15608us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.910625 (+419308us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:59.910798 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.910960 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.362750 (+451790us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:00.621096 (+258346us) raft_consensus.cc:1685] finished
0709 13:17:00.621120 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.621370 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81696,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":21694,"spinlock_wait_cycles":5205376,"thread_start_us":791282,"threads_started":2,"wal-append.queue_time_us":503523}
I20260709 13:17:00.823329 10535 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.795269 10093 raft_consensus.cc:697] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:00.830214 10442 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:00.836297 10476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.008s	sys 0.020s
I20260709 13:17:00.828440 10436 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:00.836030 10462 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:00.828344  8101 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
W20260709 13:17:00.854478  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 344266us
W20260709 13:17:00.852977  8102 rpcz_store.cc:269] 0709 13:16:59.467455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.475786 (+  8331us) service_pool.cc:224] Handling call
0709 13:17:00.750534 (+1274748us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b54002a3854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:00.750736 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675736960}
I20260709 13:17:00.868997  8251 rpcz_store.cc:276] 0709 13:16:59.674016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.116300 (+442284us) service_pool.cc:224] Handling call
0709 13:17:00.116588 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.156707 (+ 40119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.156735 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.157124 (+   389us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.488537 (+331413us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:00.488575 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.786805 (+298230us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b5400071054. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:00.786858 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.786908 (+    50us) raft_consensus.cc:1685] finished
0709 13:17:00.786928 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.787159 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16255,"raft.queue_time_us":6740,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":2648,"spinlock_wait_cycles":91505408,"thread_start_us":275414,"threads_started":1,"wal-append.queue_time_us":452584}
I20260709 13:17:00.908661  8074 leader_election.cc:400] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6.
I20260709 13:17:00.909052  8074 leader_election.cc:403] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:17:00.872124 10518 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:00.911960  8074 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:00.890631 10531 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.877468  8072 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:00.851981 10552 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.852408 10416 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:00.854633  8782 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:00.894085  8787 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:00.847364 10455 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.863895 10383 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:00.870132 10237 raft_consensus.cc:2764] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:17:00.882922 10432 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:00.914636  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:00.916381  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:00.824015  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 194917us
I20260709 13:17:00.917965  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:00.956152  8177 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:17:00.921726  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 173313us
I20260709 13:17:00.891368 10428 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.860561 10179 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.926777 10558 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:00.897055 10535 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:00.928148 10542 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:17:00.928468 10522 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.929706  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:00.930023  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:00.931535  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:00.992120  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:00.932121 10093 consensus_queue.cc:237] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.932621  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:00.911988 10436 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.933743  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:00.998863  8179 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:00.934116  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1875) took 1029 ms. Trace:
I20260709 13:17:00.934386  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:01.001271  8178 raft_consensus.cc:2410] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 7 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:17:00.937141  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 59848.6us
I20260709 13:17:00.903470 10442 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:00.901538 10435 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.902359 10476 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:00.957331  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:00.956795  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:00.986925  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.993041  8183 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:00.993646  8174 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:01.007772  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:01.008558  8174 raft_consensus.cc:2410] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:17:00.993189  8107 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:17:00.889503 10355 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:00.954650 10206 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.995301  8181 raft_consensus.cc:2410] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:17:00.933054 10447 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:00.943957 10556 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:00.929728 10140 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.041447 10140 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:01.044023 10232 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.045799 10466 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:01.046697 10206 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:00.958623 10470 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:00.999805  8106 rpcz_store.cc:276] 0709 13:16:59.905229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.108194 (+202965us) service_pool.cc:224] Handling call
0709 13:17:00.108466 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.108781 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.108805 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.109245 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.270829 (+161584us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:00.270887 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.270984 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.933895 (+662911us) raft_consensus.cc:1685] finished
0709 13:17:00.933920 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.934055 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":808,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":161221,"threads_started":1,"wal-append.queue_time_us":466599}
I20260709 13:17:01.013382  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:00.986027 10526 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:00.945773 10513 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.945871 10446 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.990760 10234 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.083046 10234 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.086086 10477 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:01.086835 10446 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.088903 10446 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.089521 10526 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.092044 10526 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:01.023305 10518 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.049248 10206 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:00.993146  8182 raft_consensus.cc:2410] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:00.954341 10148 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:01.034600  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:01.034405  8177 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
W20260709 13:17:01.034799  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 78110.1us
I20260709 13:17:01.109797  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:01.026089 10476 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.038074  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:01.112910  8755 leader_election.cc:400] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6.
I20260709 13:17:01.113024  8183 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:01.024893 10435 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.050004  8176 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:01.050743  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:01.052774  8180 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:01.053759  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 96555us
I20260709 13:17:01.120399  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:01.122037  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:01.123248  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:01.015822  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.125808  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:01.126569  8789 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:01.129645 10567 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:01.130822 10416 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:01.131412 10416 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.131865 10416 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.946223 10552 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.066118  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:01.135020  8106 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:01.135291  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:01.067970  8108 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:01.137395  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:01.075544  8179 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:17:01.078016 10232 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.142278 10447 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:01.142541 10565 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:17:01.082319 10508 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.178500  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:01.004181  8783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 632) took 1506 ms. Trace:
I20260709 13:17:01.027446  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:01.180398  8178 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:01.039924 10454 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.102988 10518 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:01.103497 10513 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.104149 10010 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.184295  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 284) took 1236 ms. Trace:
I20260709 13:17:01.111541 10466 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:17:01.064510 10499 consensus_meta.cc:287] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.545s	user 0.006s	sys 0.005s
I20260709 13:17:01.085232 10234 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.035754  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:01.125090 10556 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:01.139711  8180 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:17:01.067394 10484 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.143100 10477 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:01.143757 10552 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.175330  8182 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 4. Ops: []
I20260709 13:17:01.177078 10562 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:01.178026  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:01.143594 10565 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:01.144667  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:01.182545  8177 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:01.053872 10566 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:01.181484  8183 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:01.114137  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:01.184718  8175 rpcz_store.cc:276] 0709 13:16:59.948254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.948403 (+   149us) service_pool.cc:224] Handling call
0709 13:16:59.948744 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.141804 (+193060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.141837 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.142236 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.459695 (+317459us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:00.459757 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.613631 (+153874us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400101154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:00.613689 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.179058 (+565369us) raft_consensus.cc:1685] finished
0709 13:17:01.179081 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.184227 (+  5146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13149,"raft.queue_time_us":13612,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":412762496,"thread_start_us":317125,"threads_started":1,"wal-append.queue_time_us":552849}
W20260709 13:17:01.194140  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 56846.1us
I20260709 13:17:01.229238  8108 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:01.104758 10568 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:01.139251 10250 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:01.203051  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.188090 10473 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:01.118461 10148 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.220332  8074 leader_election.cc:400] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6.
I20260709 13:17:01.189821 10232 raft_consensus.cc:2764] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:17:01.223206  8105 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:01.241269  8106 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:01.189263 10140 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:01.192188 10447 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:01.202157  8785 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:01.144186 10519 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 13:17:01.231585  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 117543us
I20260709 13:17:01.183410 10427 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.249464  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:01.195493 10567 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.200893 10172 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:01.188802 10010 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.190569 10468 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.193602 10466 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.225898 10565 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:01.245935  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:01.221716 10558 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:01.247649  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:01.248849  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:01.198618 10499 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.241796 10250 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:01.276085 10250 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.276484 10250 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:01.276476  8099 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:01.253039  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:01.234037 10562 raft_consensus.cc:697] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:01.255276  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:01.255877  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.250443 10140 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.289121  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:01.290871  8102 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 2. Current term is 4. Ops: []
I20260709 13:17:01.291066 10140 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:01.258152  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:01.287945  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:01.292930  8104 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:17:01.293352  8104 pending_rounds.cc:85] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 3
I20260709 13:17:01.293742  8104 pending_rounds.cc:107] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:17:01.294016  8104 raft_consensus.cc:2889] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:01.258890 10428 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.254323 10179 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:01.271553  8175 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:17:01.244793 10447 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:01.273087  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:01.297796  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:01.298820  8183 raft_consensus.cc:2410] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:17:01.242707 10531 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.249905 10455 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.284719  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:01.285099  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.285300 10576 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:01.265029 10416 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.270004 10436 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.311581  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:01.308684  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:01.312189 10442 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.313324  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:01.313939  8183 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:01.314710 10427 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:01.306540 10479 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:01.315394 10428 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:01.315536 10479 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:01.316045 10479 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:01.303702 10576 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.304320  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:01.275630 10535 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.307477  8104 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:01.298523 10519 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:01.300115 10447 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:01.337175 10148 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.311640 10416 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.293183 10140 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:01.313125  8787 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:01.328511 10513 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:01.329306 10454 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.339965 10140 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:01.332926  8175 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:01.341310  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:01.342666  8175 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:01.304831 10093 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:01.344954  8790 raft_consensus.cc:2368] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4.
I20260709 13:17:01.270426 10567 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.359326 10299 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:01.368315  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1874) took 1491 ms. Trace:
W20260709 13:17:01.371580  8782 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48096 (request call id 433) took 2439 ms (client timeout 1890 ms). Trace:
W20260709 13:17:01.372207  8782 rpcz_store.cc:269] 0709 13:16:58.932572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.933176 (+   604us) service_pool.cc:224] Handling call
0709 13:17:00.354529 (+1421353us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27eee 0000000000375939 00007fa5a5d9b1e0 00007fa5a5e640c4 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:00.620211 (+265682us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27f8c 00007fa59dd27ef6 0000000000375939 00007fa5a5d9b1e0 00007fa5a5e640c4 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:01.371284 (+751073us) spinlock_profiling.cc:243] Waited 98.2 ms on lock 0x7b540050fad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:01.371439 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352269184}
I20260709 13:17:01.389137  8786 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:01.393563 10513 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:01.394440 10513 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.398504 10010 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.333356 10576 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:01.180028  8783 rpcz_store.cc:276] 0709 13:16:59.498143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.109094 (+610951us) service_pool.cc:224] Handling call
0709 13:17:00.109395 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.109865 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:00.312896 (+203031us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.953246 (+640350us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.955157 (+  1911us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:00.985422 (+ 30265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.992686 (+  7264us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.000716 (+  8030us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16459,"prepare.queue_time_us":446293,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":3543,"raft.queue_time_us":101290,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4534,"thread_start_us":758568,"threads_started":3,"wal-append.queue_time_us":538424}
I20260709 13:17:01.368911  8107 rpcz_store.cc:276] 0709 13:16:59.877034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.072773 (+195739us) service_pool.cc:224] Handling call
0709 13:17:00.073148 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.009201 (+936053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.367973 (+358772us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b54001653d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:01.368235 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2115419008}
I20260709 13:17:01.336542 10519 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:01.304370 10468 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:17:01.330814 10462 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.483560  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:01.432287  8183 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:17:01.485481 10519 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:01.412787 10575 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:01.486896  8785 raft_consensus.cc:2410] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:17:01.475004  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 163484us
I20260709 13:17:01.482324 10499 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:01.489071  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:01.482391  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 303988us
I20260709 13:17:01.493891  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:01.499615  8223 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:01.503131  8174 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:17:01.504736  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:01.340381 10558 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:01.481470 10571 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:17:01.518641  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:01.410260 10442 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:01.515844  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:01.515962  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.508986 10179 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:01.401734 10140 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.511305  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:01.529002  8788 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:01.519629  8102 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:01.490751 10457 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:01.491699 10567 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.425334 10093 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:17:01.487421  8785 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 612) took 1327 ms (client timeout 1543 ms). Trace:
I20260709 13:17:01.521020  8147 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:01.527371  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:01.520134  8175 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:01.514048 10512 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 13:17:01.446543 10565 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:01.523185 10432 consensus_meta.cc:287] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260709 13:17:01.530463  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:01.714121  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 193173us
W20260709 13:17:01.707170  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 191437us
I20260709 13:17:01.611248  8072 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:01.514528 10566 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:01.531179  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:01.711819  8254 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:01.722121  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:01.733999  8255 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:01.729684  8788 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:01.579659  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:01.561196  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:01.521941 10428 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:01.513458 10434 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:01.706027  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:01.738224  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:01.714993  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:01.727506  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:01.728206  8253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 1964) took 1773 ms (client timeout 2147 ms). Trace:
W20260709 13:17:01.748301  8253 rpcz_store.cc:269] 0709 13:16:59.953354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.065638 (+112284us) service_pool.cc:224] Handling call
0709 13:17:01.698162 (+1632524us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400197b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:01.711118 (+ 12956us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2937971968}
W20260709 13:17:01.728394  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 201084us
I20260709 13:17:01.709096  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:01.730509  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:01.735764  8251 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:17:01.750428  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:01.750731  8108 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:17:01.751713  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:01.740676  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:01.724725  8785 rpcz_store.cc:269] 0709 13:17:00.160051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.228048 (+ 67997us) service_pool.cc:224] Handling call
0709 13:17:00.361882 (+133834us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:01.004492 (+642610us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27e9c 00007fa59dd27a5b 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:01.487359 (+482867us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208884224}
I20260709 13:17:01.742851 10567 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:01.736479 10010 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:01.746371  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:01.686751  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:01.628933 10179 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.609673 10499 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:17:01.786361  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 175236us
I20260709 13:17:01.788081  8072 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:01.748700 10434 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.745702  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:01.603220 10476 raft_consensus.cc:3055] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:01.730844 10552 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:17:01.603061 10383 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:01.731076 10587 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 13:17:01.731434 10522 consensus_meta.cc:287] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.731s	user 0.011s	sys 0.002s
I20260709 13:17:01.737844  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:01.627741 10172 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:01.756140  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:01.746256 10513 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:01.754431  8107 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:01.435262 10562 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.602777 10355 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:01.765544  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:01.767575  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:01.754034 10567 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.687184 10466 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:01.809201  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.809211  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:01.813094  8101 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:01.813642 10499 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:01.813967  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:01.790630 10179 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.816529 10538 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:01.816721 10574 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.762432  8108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:17:01.818043 10584 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:01.820475  8149 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:01.820822 10232 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:17:01.822098 10585 log.cc:927] Time spent T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:17:01.789307  8783 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:01.777849 10531 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:01.762317 10566 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.933502 10462 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.935150 10566 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:01.787094 10010 raft_consensus.cc:697] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:01.826627 10519 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.807508 10476 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:01.937717 10010 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.741647 10384 consensus_queue.cc:1059] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:17:01.777076 10442 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:01.831247 10093 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.832499 10575 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:01.833892  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:01.857519  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:01.809538 10434 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:01.861132  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 643) took 1075 ms. Trace:
I20260709 13:17:01.796048 10435 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:01.753062  8252 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:17:01.881521  8255 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:01.950690  8791 rpcz_store.cc:276] 0709 13:17:00.785588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.874400 (+ 88812us) service_pool.cc:224] Handling call
0709 13:17:00.876098 (+  1698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.887060 (+ 10962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.887098 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.926685 (+ 39587us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b2c00047c48. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:17:00.927118 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:17:01.004924 (+ 77806us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:01.005012 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.005095 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.743157 (+738062us) raft_consensus.cc:1685] finished
0709 13:17:01.743177 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.860923 (+117746us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b5400580f50. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:01.861057 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5324,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":8191,"spinlock_wait_cycles":10493440,"thread_start_us":77371,"threads_started":1,"wal-append.queue_time_us":212818}
I20260709 13:17:01.882463  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:01.877653  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 142482us
I20260709 13:17:01.892652  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:01.855208 10522 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6.
I20260709 13:17:01.913121  8253 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:01.914048  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 93645.3us
W20260709 13:17:02.002769  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 187664us
I20260709 13:17:02.003973  8149 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:01.894261 10567 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:01.885807 10468 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:01.880333 10355 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:02.010458  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:01.895020  8249 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:02.011546  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:01.895445 10512 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:17:01.928640 10499 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:01.932456 10479 consensus_meta.cc:287] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.003s
I20260709 13:17:01.940991  8789 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:01.852692 10383 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.946390  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:02.023679  8248 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:01.913152 10538 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:01.948881  8104 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:01.952561  8788 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:01.973628  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 214171us
I20260709 13:17:01.979116 10572 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:01.979993 10581 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:17:01.972615 10531 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:01.980878 10518 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.794s	user 0.004s	sys 0.008s
I20260709 13:17:01.920275 10574 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:01.923871 10232 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:01.981760 10447 consensus_meta.cc:287] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.636s	user 0.003s	sys 0.007s
I20260709 13:17:01.948853 10442 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.983074 10519 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:01.939136 10476 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.919902 10299 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:01.986214  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1047) took 1036 ms. Trace:
I20260709 13:17:02.026631 10468 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:01.952455 10575 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.893638 10172 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:01.994735  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:02.006930  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:01.986292 10466 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:01.995414 10250 consensus_meta.cc:287] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.716s	user 0.004s	sys 0.008s
I20260709 13:17:02.020424  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:02.111622 10053 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:02.031497  8223 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:02.033394  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1054) took 1008 ms. Trace:
W20260709 13:17:02.113446  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 81997.5us
I20260709 13:17:02.113281  8174 rpcz_store.cc:276] 0709 13:17:01.024936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.136078 (+111142us) service_pool.cc:224] Handling call
0709 13:17:01.502909 (+366831us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.510869 (+  7960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.033138 (+522269us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5400329450. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:02.033318 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842808192}
I20260709 13:17:02.034240  8108 raft_consensus.cc:606] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:02.114792  8108 raft_consensus.cc:614] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:02.008942 10416 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:02.021188 10355 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:02.132675  8103 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:02.070051  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:02.059895  8104 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:02.027025 10513 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:02.155961  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:02.156798  8104 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:02.073400 10576 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.638s	user 0.006s	sys 0.003s
I20260709 13:17:02.157562  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:02.162895  8102 raft_consensus.cc:2410] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:02.109951  8177 rpcz_store.cc:276] 0709 13:17:00.950141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.119439 (+169298us) service_pool.cc:224] Handling call
0709 13:17:01.119836 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.226061 (+106225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.985863 (+759802us) spinlock_profiling.cc:243] Waited 62.2 ms on lock 0x7b54000122d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:01.986126 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143152384}
W20260709 13:17:02.110980  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 105558us
I20260709 13:17:02.168416  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:02.112681  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:02.107493  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 397858us
I20260709 13:17:02.049466  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:02.066053 10476 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:02.059748 10442 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.049580 10592 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.076102  8101 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:02.187659  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:02.188318  8105 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 5: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:02.070199 10179 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:02.193348  8072 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:17:02.302495  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.070483 10574 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:02.066453 10383 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:02.033401 10531 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:02.029587 10479 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:02.112522 10518 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:02.301779  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 114202us
I20260709 13:17:02.061290 10535 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:02.068681 10232 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:02.307257  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 114012us
I20260709 13:17:02.348274  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:02.122426 10575 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:02.310636  8102 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:02.349804  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1009) took 1263 ms. Trace:
I20260709 13:17:02.155274 10468 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:02.317792  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1012) took 1230 ms. Trace:
I20260709 13:17:02.316057  8104 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:17:02.320549  8253 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:02.322520  8107 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:02.321512  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:02.353829  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1008) took 1267 ms. Trace:
I20260709 13:17:02.354221  8248 raft_consensus.cc:2410] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:02.197009 10299 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:02.111649 10250 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:02.076133 10512 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.224s
W20260709 13:17:02.344646  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 346462us
I20260709 13:17:02.322858 10594 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:02.350256  8102 rpcz_store.cc:276] 0709 13:17:01.086606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.194101 (+1107495us) service_pool.cc:224] Handling call
0709 13:17:02.310475 (+116374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.349483 (+ 39008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.349733 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:02.118803 10466 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:02.354297  8107 rpcz_store.cc:276] 0709 13:17:01.086336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.189897 (+1103561us) service_pool.cc:224] Handling call
0709 13:17:02.313996 (+124099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.353531 (+ 39535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.353763 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:02.058840 10447 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:02.314965 10416 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:02.352082  8105 rpcz_store.cc:276] 0709 13:17:01.087408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.316824 (+1229416us) service_pool.cc:224] Handling call
0709 13:17:02.317172 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.317379 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.317413 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.317486 (+    73us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:02.317540 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.317606 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.317727 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:02.322155 10519 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:02.393064 10519 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:02.321940  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 345) took 1016 ms. Trace:
I20260709 13:17:02.321630 10506 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.367093  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:02.322577  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.367295  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1014) took 1271 ms. Trace:
I20260709 13:17:02.066949 10538 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:02.347504 10383 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:02.370002  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:02.403954  8256 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:17:02.346333  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:02.195315 10576 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:02.351585 10518 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:02.374786  8180 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:02.378767 10250 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:02.379042 10447 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:02.380256 10531 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:02.370510 10594 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.385910  8183 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:02.386885  8105 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:02.387832  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:02.429705 10384 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:02.409979 10584 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.390599 10479 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:02.391785 10466 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:02.391980 10172 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:02.392153 10468 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:02.398571  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 283466us
I20260709 13:17:02.312145 10592 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:02.401075  8104 rpcz_store.cc:276] 0709 13:17:01.087932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.352786 (+1264854us) service_pool.cc:224] Handling call
0709 13:17:02.353179 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.359274 (+  6095us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:02.359319 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.359396 (+    77us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:02.359456 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.359549 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.359706 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6273,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6064}
I20260709 13:17:02.412230  8221 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:02.390614 10179 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:02.434403  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 300) took 1020 ms. Trace:
I20260709 13:17:02.388809  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:02.508893  8254 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:17:02.450064  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:02.400542 10473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.035s	sys 0.011s
I20260709 13:17:02.455406  8788 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
W20260709 13:17:02.456924  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 110885us
I20260709 13:17:02.395990  8101 rpcz_store.cc:276] 0709 13:17:01.305778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.728100 (+422322us) service_pool.cc:224] Handling call
0709 13:17:02.316154 (+588054us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:02.432765 10538 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:02.435560  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.449271  8782 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:02.430286 10383 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:02.403360 10506 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:02.444455 10416 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.435461 10594 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.433743 10562 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.390271  8176 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:02.680655  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 297) took 1359 ms. Trace:
I20260709 13:17:02.509860  8183 rpcz_store.cc:276] 0709 13:17:01.413844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.363513 (+949669us) service_pool.cc:224] Handling call
0709 13:17:02.385746 (+ 22233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.434118 (+ 48372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.434342 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:02.513470  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.508248 10179 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:02.610357  8147 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:02.622512  8788 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:02.467975 10584 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:02.607959 10473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.035s	sys 0.012s
I20260709 13:17:02.670379  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 343) took 1368 ms. Trace:
I20260709 13:17:02.672907  8782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 616) took 1160 ms. Trace:
I20260709 13:17:02.473016 10427 consensus_queue.cc:1059] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.146s
I20260709 13:17:02.673975 10466 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:02.622279  8786 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:02.674667 10603 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:17:02.514699 10604 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.681126  8176 rpcz_store.cc:276] 0709 13:17:01.321386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.389862 (+1068476us) service_pool.cc:224] Handling call
0709 13:17:02.390114 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.680287 (+290173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.680567 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:02.821532  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 286335us
I20260709 13:17:02.927490  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 350) took 1214 ms. Trace:
W20260709 13:17:02.776724  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.035091  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 424802us
W20260709 13:17:02.832355  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:02.684613  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 272162us
I20260709 13:17:03.036520  8221 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:02.919337 10476 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.618s	user 0.006s	sys 0.002s
W20260709 13:17:02.676936 10610 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:17:02.732939  8785 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:17:02.834331 10605 log.cc:927] Time spent T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
W20260709 13:17:02.833752 10620 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:17:02.947835 10250 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:02.987481 10575 consensus_meta.cc:287] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.628s	user 0.014s	sys 0.000s
W20260709 13:17:02.929675 10355 consensus_meta.cc:287] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.700s	user 0.009s	sys 0.001s
W20260709 13:17:02.833158 10622 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 13:17:02.844234 10609 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
W20260709 13:17:02.734597 10053 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.000s
W20260709 13:17:02.915865 10442 consensus_meta.cc:287] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.601s	user 0.002s	sys 0.012s
I20260709 13:17:03.122771 10442 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:02.834744 10608 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 13:17:03.126080  8179 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:17:02.921304 10434 consensus_meta.cc:287] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.947s	user 0.010s	sys 0.000s
I20260709 13:17:03.126976 10434 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:03.043627  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.020673 10484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.033s	sys 0.036s
W20260709 13:17:03.130324 10484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.033s	sys 0.037s
I20260709 13:17:02.757337 10592 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:02.684394 10567 consensus_meta.cc:287] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.009s
I20260709 13:17:03.033200  8102 rpcz_store.cc:276] 0709 13:17:01.302011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.370951 (+1068940us) service_pool.cc:224] Handling call
0709 13:17:02.396562 (+ 25611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.396761 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:02.408730 (+ 11969us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.668967 (+260237us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.669908 (+   941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.669973 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:02.670053 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.670144 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.670300 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12995,"prepare.queue_time_us":87831,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":37957,"raft.run_wall_time_us":15438,"spinlock_wait_cycles":46112256,"thread_start_us":212623,"threads_started":1,"wal-append.queue_time_us":519960}
I20260709 13:17:02.917814 10518 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:02.679430  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 69608.8us
I20260709 13:17:03.132342 10567 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:03.133203  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:03.134891  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:03.129215 10434 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:03.125239 10442 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:03.136296  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:03.136611 10442 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:03.051949  8791 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:03.137063  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.068085 10355 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:03.032375  8107 rpcz_store.cc:276] 0709 13:17:01.712677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.373718 (+661041us) service_pool.cc:224] Handling call
0709 13:17:02.374130 (+   412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:02.374518 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.374549 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:02.385801 (+ 11252us) log.cc:844] Serialized 52 byte log entry
0709 13:17:02.471755 (+ 85954us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:02.514481 (+ 42726us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.618430 (+103949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.618505 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:02.927171 (+308666us) raft_consensus.cc:1685] finished
0709 13:17:02.927199 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.927408 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103702,"prepare.queue_time_us":42494,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":54,"raft.queue_time_us":122022,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":28065,"thread_start_us":85370,"threads_started":1,"wal-append.queue_time_us":395937}
I20260709 13:17:02.907450 10479 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.832513 10519 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:02.830032 10615 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.230s
I20260709 13:17:03.032768 10466 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:02.906737 10506 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:02.679745 10416 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.039624 10617 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:03.037722 10604 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:03.041446 10594 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:02.781123 10607 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.336s
W20260709 13:17:03.107577  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.155071 10582 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:03.122146 10053 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:02.995520 10438 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.712858 10562 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.165017 10466 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.154937  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:03.064515 10427 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:02.992698 10619 consensus_queue.cc:1059] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 13:17:02.837862 10383 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:03.069048 10624 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:17:03.161615  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 127330us
I20260709 13:17:03.033455  8782 rpcz_store.cc:276] 0709 13:17:01.512348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.513919 (+  1571us) service_pool.cc:224] Handling call
0709 13:17:02.387686 (+873767us) spinlock_profiling.cc:243] Waited 75.8 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:02.664389 (+276703us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174400768}
I20260709 13:17:03.054524 10626 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 13:17:03.055660 10447 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:17:03.244385  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.245338  8254 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:03.191341  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 341) took 3046 ms. Trace:
I20260709 13:17:03.246361  8099 rpcz_store.cc:276] 0709 13:17:00.145233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.149264 (+  4031us) service_pool.cc:224] Handling call
0709 13:17:00.172591 (+ 23327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.277269 (+1104678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.182038 (+1904769us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003f3c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:03.191261 (+  9223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2522789120}
I20260709 13:17:03.247507  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:03.248224  8182 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:03.248286  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:03.161669 10179 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.137106 10442 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.072409 10584 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:03.165565  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 118233us
I20260709 13:17:03.134927 10567 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:03.201016 10586 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 1.226s	user 0.003s	sys 0.000s
I20260709 13:17:03.271109  8178 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:03.066706 10250 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:03.166744  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:03.202741 10594 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:03.168637  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:03.180138  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.180583  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.051637 10601 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:03.168188 10531 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:03.161604 10479 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.182971 10617 raft_consensus.cc:697] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:03.211443  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:03.240693  8175 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:03.288205  8251 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:03.241245  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:03.067914 10575 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.244557 10447 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:03.074455 10576 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:03.261253  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:03.261513 10442 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.190796  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:03.249301  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:03.193661 10538 consensus_meta.cc:287] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.004s
W20260709 13:17:03.272384  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 115268us
I20260709 13:17:03.138042 10299 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:17:03.200510 10466 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.188161 10562 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:03.281955  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.288864  8255 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:03.206521 10355 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:03.289790  8248 raft_consensus.cc:2410] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:03.282910  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:03.307334 10631 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:03.311080  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:03.320546 10631 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.314378  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:03.323117 10631 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:03.324474  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.325376 10479 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:03.316912  8254 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:03.319209  8105 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:17:03.292948 10427 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:03.327690 10427 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.294993 10601 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:03.331669 10601 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:03.295534 10447 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:03.332968 10447 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:03.334250  8180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 296) took 2015 ms (client timeout 2380 ms). Trace:
I20260709 13:17:03.199277 10604 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:03.282145  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:03.334879  8180 rpcz_store.cc:269] 0709 13:17:01.318769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.069790 (+751021us) service_pool.cc:224] Handling call
0709 13:17:03.334046 (+1264256us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54002486d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:03.334177 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506347776}
I20260709 13:17:03.335688  8102 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:03.336292  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:03.337105  8180 raft_consensus.cc:2393] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:17:03.337847  8100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1884) took 3162 ms (client timeout 1757 ms). Trace:
W20260709 13:17:03.338346  8100 rpcz_store.cc:269] 0709 13:17:00.175902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.356805 (+180903us) service_pool.cc:224] Handling call
0709 13:17:03.337609 (+2980804us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b5400212ad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:03.337740 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1926945664}
I20260709 13:17:03.316640 10466 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:03.343729  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51964 (request call id 21) took 1607 ms. Trace:
I20260709 13:17:03.344219  8108 rpcz_store.cc:276] 0709 13:17:01.749536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.762237 (+ 12701us) service_pool.cc:224] Handling call
0709 13:17:03.343498 (+1581261us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54003c3554. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e46853 00007fa5a5e1460a 00007fa59f39a7d4 00007fa59f39a762 00007fa59f39a691 00007fa59f39a60c 00007fa59f3998c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:03.343624 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278704384}
I20260709 13:17:03.318866 10575 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:03.345779  8102 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:03.346597 10427 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:03.285723  8177 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:03.294745  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.348222  8251 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:17:03.249219  8099 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:03.295886  8183 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:03.294656  8786 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:03.296306  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.296710 10617 consensus_queue.cc:237] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:03.293715  8790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 611) took 3133 ms (client timeout 2159 ms). Trace:
W20260709 13:17:03.355495  8790 rpcz_store.cc:269] 0709 13:17:00.159824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.491401 (+331577us) service_pool.cc:224] Handling call
0709 13:17:03.293538 (+2802137us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400750154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:03.293655 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1567523712}
I20260709 13:17:03.297817 10250 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:03.285601 10179 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.307304  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:03.321863 10565 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:03.317307  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.347402  8178 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:03.356962  8252 raft_consensus.cc:2410] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:17:03.305938  8182 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:03.206656 10438 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:03.291754  8223 connection.cc:256] RPC call timeout handler was delayed by -1.9306654419999632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
I20260709 13:17:03.668156  8248 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:03.722067  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:03.341265  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:03.288816 10626 consensus_queue.cc:1243] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:17:03.405320  8183 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
W20260709 13:17:03.358556  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.372052  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:03.727519  8180 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:03.723253  8174 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:03.724987  8791 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:17:03.569960  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.736514  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:03.711454  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:03.287998 10531 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:03.688501  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:03.740020  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:03.668804 10635 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:17:03.740707  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:03.564700 10140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.710s	user 0.026s	sys 0.040s
I20260709 13:17:03.741333  8180 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:03.710625 10631 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.357818 10582 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:03.426201 10567 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:03.446254 10299 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:03.334268 10447 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.720908 10457 consensus_queue.cc:1059] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:17:03.740728 10250 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.747727  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:03.752907  8255 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:17:03.741707 10626 raft_consensus.cc:2764] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:17:03.747514  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:03.668702 10479 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.775460 10479 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.556104  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:03.744817  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 56376.3us
I20260709 13:17:03.778316 10613 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.778834 10613 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.780507  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:03.781505  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:03.782127  8181 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 1.
I20260709 13:17:03.782193  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:03.782615  8181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2002) took 2461 ms (client timeout 2633 ms). Trace:
I20260709 13:17:03.754033  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:03.783007  8181 rpcz_store.cc:269] 0709 13:17:01.321775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.781250 (+2459475us) service_pool.cc:224] Handling call
0709 13:17:03.782553 (+  1303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:03.783594 10607 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:03.783979  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:03.786389  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.787679  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.788337  8255 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:03.788528  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:03.788722  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:03.789130  8788 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:03.756310  8178 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:03.741410 10531 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:03.724522 10427 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:03.793684 10427 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.795539  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:03.795622  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.796499  8178 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:03.796940  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.756170 10478 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:03.797818  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:03.798080  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:03.785175 10638 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:17:03.757058 10140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.909s	user 0.029s	sys 0.050s
I20260709 13:17:03.742074 10636 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.761130  8182 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:03.565223 10442 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:03.768754  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 46893.5us
I20260709 13:17:03.770112  8183 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:03.771497  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:03.756253  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:03.789857  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:03.808665  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:03.808892  8180 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:17:03.809718  8223 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:03.810081  8103 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 999) took 2798 ms (client timeout 1991 ms). Trace:
W20260709 13:17:03.810508  8103 rpcz_store.cc:269] 0709 13:17:01.011306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.014023 (+  2717us) service_pool.cc:224] Handling call
0709 13:17:03.809930 (+2795907us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54000fb4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:03.810018 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2074452352}
W20260709 13:17:03.810940  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.799526 10638 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:03.729557 10584 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.813154  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:03.812983  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.760583 10631 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.798573  8252 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:03.798382 10626 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:03.799938  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:03.804313  8178 raft_consensus.cc:2410] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:03.804633  8254 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:03.805086  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.753978 10632 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:03.806193  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:03.809389  8257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 1972) took 2042 ms (client timeout 1538 ms). Trace:
I20260709 13:17:03.795888 10427 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:03.813880  8103 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:17:03.815927  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:03.816490  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:03.817128  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:03.805217  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.818152  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:03.818922  8257 rpcz_store.cc:269] 0709 13:17:01.766800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.766969 (+   169us) service_pool.cc:224] Handling call
0709 13:17:03.808529 (+2041560us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b5800052298. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:03.809320 (+   791us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11278592}
I20260709 13:17:03.812975 10636 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:03.825563  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:03.767647 10299 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.767148 10567 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:03.811767  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:03.826857  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:03.828291  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:03.808198 10053 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.832839 10457 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.839169 10053 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:03.817792 10466 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:03.785734 10250 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.818730 10632 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.841554  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:03.836234  8181 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:03.836340  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.818207 10607 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:03.813874 10478 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.820674 10384 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:03.849702 10384 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:03.840083  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:03.844336  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.844303 10639 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:03.837507  8782 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:03.839421 10457 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.824084  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:03.848163  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:03.826270 10626 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:03.840772 10479 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:03.851029  8178 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:03.858655  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:03.859665  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:03.860301  8178 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:03.860666 10250 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:03.860129 10384 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.861735 10384 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.862754 10457 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:03.864404  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:03.864984  8176 raft_consensus.cc:2410] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:03.845692 10607 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:03.852576  8175 raft_consensus.cc:2410] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:03.818130 10584 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:03.871775  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:03.849539  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.855244  8791 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:17:03.855280  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:03.851032  8252 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:03.861162  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:03.845010  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:03.874619  8178 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:17:03.845683 10632 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:03.872967  8183 raft_consensus.cc:2393] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 6: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:03.851687 10639 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:03.879292  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:03.886552  8103 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:03.854297 10626 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:03.880705  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:03.882916  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:03.892647  8106 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:03.892994  8176 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 3: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:03.865150 10613 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:03.856914  8101 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 1.
I20260709 13:17:03.888918  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:03.871292 10607 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.838613 10427 consensus_queue.cc:1059] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:17:03.895335 10250 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:03.898175  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:03.912983  8251 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:03.908560 10601 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:03.915266  8785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 621) took 1610 ms. Trace:
I20260709 13:17:03.915352  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:03.916110  8786 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:03.915832  8785 rpcz_store.cc:276] 0709 13:17:02.304544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.325928 (+ 21384us) service_pool.cc:224] Handling call
0709 13:17:02.387422 (+ 61494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.059102 (+671680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.915017 (+855915us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b540065f4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:03.915205 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793659264}
I20260709 13:17:03.885756 10435 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:03.917284 10435 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.918447  8147 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:03.903483  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.880154  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.919793  8254 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:17:03.905823  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.906001  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.907510  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:03.891419  8178 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:03.914172  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.922745  8251 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:03.923009  8178 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:03.853348 10478 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.902426 10626 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.930868  8251 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:03.847183 10582 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:03.891176 10639 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:03.890479 10447 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:03.917711 10435 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.945190 10299 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:03.945621 10478 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:03.955739  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:03.945923 10447 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.946683  8251 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:17:03.956872  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 132407us
I20260709 13:17:03.866734 10638 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:03.945012 10532 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:03.954651  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:03.926380 10617 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:03.919174 10438 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:03.966166  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:03.967504  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 44818.2us
I20260709 13:17:03.970366  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:03.983032  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:03.983944  8251 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:03.969336  8252 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:03.986254  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:03.987385  8254 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:03.966775  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:03.982218  8785 raft_consensus.cc:2393] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 2: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:04.002250  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:03.964514  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:48648 (request call id 2) took 1648 ms. Trace:
I20260709 13:17:03.981555 10617 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.977766 10442 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:03.982446  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:04.014472  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 107054us
I20260709 13:17:03.989468 10532 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:04.016683  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.019543  8252 raft_consensus.cc:3055] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:04.019723  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:04.020181  8252 raft_consensus.cc:740] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:04.022197  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 295) took 2713 ms. Trace:
I20260709 13:17:03.973392 10427 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:17:04.022663  8179 rpcz_store.cc:276] 0709 13:17:01.308789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.363417 (+1054628us) service_pool.cc:224] Handling call
0709 13:17:02.372999 (+  9582us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:03.126580 (+753581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.021929 (+895349us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b5400248bd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:04.022128 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731342208}
I20260709 13:17:04.012460 10617 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.030822  8252 consensus_queue.cc:260] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.013326 10567 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.007640  8784 rpcz_store.cc:276] 0709 13:17:02.304886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.381311 (+ 76425us) service_pool.cc:224] Handling call
0709 13:17:03.917635 (+1536324us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b5400608bd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e52735 00007fa5a0e4a9fa 00007fa5a5e124c9 00007fa59f38ec54 00007fa59f38ebe2 00007fa59f38eb11 00007fa59f38ea8c 00007fa59f38dd42 00007fa59f18748c 00007fa59f1868c6
0709 13:17:03.950833 (+ 33198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1740023552}
I20260709 13:17:04.047485  8252 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:04.024485 10250 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:04.025545 10636 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.026239  8782 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:04.030696 10648 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.031961 10442 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:17:04.072149  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.024372  8786 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
W20260709 13:17:04.077907  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 111871us
I20260709 13:17:04.077255  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:04.080945  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:04.032300 10642 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:17:04.088236  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.024354 10643 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:17:04.095455  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:04.073351 10479 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.100019  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.079478 10613 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.093412 10250 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:04.118481  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.116107  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.116446  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.116818  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.117398  8108 raft_consensus.cc:3055] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:04.123258  8108 raft_consensus.cc:740] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:04.124140  8108 consensus_queue.cc:260] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.098240 10438 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:04.093886 10526 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.115298  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.094161 10636 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:04.094359 10442 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:04.117779  8252 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:17:04.134486  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:04.135206  8252 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.101622 10148 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.117923 10447 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:04.078078 10648 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.106478 10567 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:04.105249 10479 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.139074  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.144680  8104 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.128278 10647 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.147665  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:04.125880 10478 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:04.128988 10438 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.152456  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:04.152376 10660 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:04.143400 10567 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.137715 10148 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.143997  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:04.151897  8104 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:04.152839 10438 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:04.151170  8252 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:04.130388 10250 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:04.125249 10654 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:04.119514 10613 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.156438  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:04.159287  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:04.159682  8252 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:04.155323  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.158485  8102 raft_consensus.cc:2410] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:04.160422  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:04.161191  8248 raft_consensus.cc:2410] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:17:04.153421  8783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 620) took 1849 ms (client timeout 1974 ms). Trace:
W20260709 13:17:04.162117  8783 rpcz_store.cc:269] 0709 13:17:02.304197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.314209 (+ 10012us) service_pool.cc:224] Handling call
0709 13:17:04.144194 (+1829985us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:04.153349 (+  9155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9594240}
I20260709 13:17:04.162587  8248 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:04.164099  8248 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5. Ops: []
W20260709 13:17:04.165891 10650 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:17:04.107398 10532 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.170763 10148 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.144379 10447 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:04.171550 10447 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.153360 10567 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.152550 10478 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:04.178663  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.179232  8104 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:04.134713 10526 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.157516 10646 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:04.156199 10659 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:04.189152  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.159549 10654 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:04.189209  8251 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:04.156639 10172 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:04.191045  8074 connection.cc:256] RPC call timeout handler was delayed by -1.616340302000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
I20260709 13:17:04.174438 10636 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:04.192485 10659 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:04.194921  8074 connection.cc:256] RPC call timeout handler was delayed by -1.3733403020000878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 13:17:04.199520  8074 connection.cc:256] RPC call timeout handler was delayed by -1.2779403019999336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 13:17:04.200331  8074 connection.cc:256] RPC call timeout handler was delayed by -1.1992008429999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260709 13:17:04.159627 10643 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:17:04.186329 10148 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:04.186148 10478 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:04.200937  8074 connection.cc:256] RPC call timeout handler was delayed by -1.1824222590000772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 13:17:04.194478  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.203830 10526 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:04.211939  8074 connection.cc:256] RPC call timeout handler was delayed by -1.1685305790001621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260709 13:17:04.156595 10647 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:04.231920  8074 connection.cc:256] RPC call timeout handler was delayed by -1.012440301999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
I20260709 13:17:04.214643  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.238598  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.237972  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.194718 10654 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:04.219616  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.209844  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.198045 10667 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:04.211229 10636 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:04.281320  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.282099  8099 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:17:04.283051  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.283605  8099 raft_consensus.cc:2376] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6. Re-sending same reply.
I20260709 13:17:04.286511 10584 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.287777  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:04.288439  8783 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:04.290046  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 650) took 2403 ms. Trace:
I20260709 13:17:04.290467  8789 rpcz_store.cc:276] 0709 13:17:01.886677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.886830 (+   153us) service_pool.cc:224] Handling call
0709 13:17:01.887213 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.023106 (+135893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.289817 (+2266711us) spinlock_profiling.cc:243] Waited 53.6 ms on lock 0x7b540038e854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:04.289984 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123206400}
I20260709 13:17:04.195494 10442 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.294803  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:04.302739  8789 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:17:04.200747 10172 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.232467 10148 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:04.313566 10531 consensus_meta.cc:287] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.502s	user 0.003s	sys 0.008s
I20260709 13:17:04.324779 10531 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.325520  8101 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:04.326125  8174 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:04.326916  8101 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:04.304242  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.328555  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1070) took 1044 ms. Trace:
I20260709 13:17:04.285318 10626 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.331682 10651 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:04.332141  8255 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.332960 10447 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:04.314334 10636 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.340822  8255 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
W20260709 13:17:04.316844  8072 connection.cc:256] RPC call timeout handler was delayed by -1.7188112390001606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 13:17:04.232573 10250 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:04.318260 10658 log.cc:927] Time spent T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:17:04.319223 10416 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:04.272054 10632 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.321590  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:04.321889 10179 consensus_meta.cc:287] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
I20260709 13:17:04.328977  8174 rpcz_store.cc:276] 0709 13:17:03.284069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.739699 (+455630us) service_pool.cc:224] Handling call
0709 13:17:04.328339 (+588640us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b54002f8d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:04.328490 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1332785024}
I20260709 13:17:04.356817  8789 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:04.302594 10631 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:04.343227  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 230486us
W20260709 13:17:04.347384  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 114008us
I20260709 13:17:04.359973  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:04.343314  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:04.360951  8788 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:04.363006 10592 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:04.363106  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.363551 10592 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:04.364720  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.364516 10592 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.365450  8101 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:04.365676 10592 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:04.366454  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.367269  8101 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 7: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:04.364542  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.368391 10654 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.369907  8248 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:04.370468 10647 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.370595  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.371162 10654 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:04.371476  8099 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:04.361286  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.329016 10648 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.325320 10148 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:04.336730 10626 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:04.332135 10651 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:04.334230 10479 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.317149 10639 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.379024  8249 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
W20260709 13:17:04.383421 10670 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:17:04.374574 10435 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.384871  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.375687  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.275961 10667 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.404641  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.407186  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.408272  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.409806  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.379619 10675 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:04.416875  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.417444  8107 raft_consensus.cc:2410] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:17:04.418236  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.418545  8100 raft_consensus.cc:2368] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5.
I20260709 13:17:04.391404 10639 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.291833 10659 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.389679  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.420884  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 314) took 2692 ms. Trace:
I20260709 13:17:04.394682 10531 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.393555  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.379879 10567 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.394680 10646 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:04.410722 10648 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:04.410821 10148 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:04.424777  8250 rpcz_store.cc:276] 0709 13:17:01.725387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.725570 (+   183us) service_pool.cc:224] Handling call
0709 13:17:01.725959 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.954795 (+228836us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:01.973799 (+ 19004us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:01.986201 (+ 12402us) log.cc:844] Serialized 26 byte log entry
0709 13:17:02.316763 (+330562us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:02.316815 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.407575 (+2090760us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400196c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:04.407648 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:04.407705 (+    57us) raft_consensus.cc:1685] finished
0709 13:17:04.407722 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.417459 (+  9737us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96972,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":12590,"spinlock_wait_cycles":494580096,"thread_start_us":308165,"threads_started":1,"wal-append.queue_time_us":989278,"wal-append.run_cpu_time_us":2177,"wal-append.run_wall_time_us":1058757}
I20260709 13:17:04.405838 10478 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:04.431160 10611 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.825s	user 0.014s	sys 0.002s
I20260709 13:17:04.410634 10677 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:04.433466  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.433558  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.444214 10478 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.444782 10435 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.407145 10607 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.445509  8099 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:17:04.446498 10567 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.447146  8099 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:04.447780  8253 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.447198 10607 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:04.453881  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1069) took 1211 ms. Trace:
I20260709 13:17:04.454313  8175 rpcz_store.cc:276] 0709 13:17:03.241933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.288581 (+ 46648us) service_pool.cc:224] Handling call
0709 13:17:04.453678 (+1165097us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540031ecd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:04.453810 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302299520}
I20260709 13:17:04.458434 10632 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.459497 10172 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:04.461455 10667 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:04.463634  8253 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:04.464145 10619 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:04.464586 10619 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:04.476734  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1893) took 2705 ms. Trace:
I20260709 13:17:04.479373  8181 raft_consensus.cc:1240] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:04.487228  8182 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:04.477373  8105 rpcz_store.cc:276] 0709 13:17:01.771472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.435595 (+664123us) service_pool.cc:224] Handling call
0709 13:17:02.435937 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:03.327120 (+891183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.476312 (+1149192us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54000f4454. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:04.476638 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030769408}
I20260709 13:17:04.491063  8105 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:04.421312 10526 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:17:04.438964 10659 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.499336  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:04.457170 10617 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.507254 10613 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:04.508481  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.508819 10617 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:04.509171  8103 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:04.428323 10651 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.510035 10651 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.513652  8147 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:04.514103  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.495970 10601 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:04.515887  8177 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:04.521658  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:04.522859  8147 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:04.516026  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:04.523095  8182 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:04.523696 10617 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:04.517639  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 108038us
I20260709 13:17:04.526297  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:04.526845  8175 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:04.526911  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:04.528533  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:04.528753  8147 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:04.529119  8182 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:04.529685  8147 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:04.534452  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.536187  8182 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:04.539037  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:04.538044 10250 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:04.537101 10478 consensus_queue.cc:1059] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:17:04.542317 10250 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:04.542795 10250 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.537251 10435 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:04.543431 10435 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.538220 10685 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:04.544310 10589 raft_consensus.cc:3055] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:04.544729 10589 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:04.545290 10148 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:04.545718 10148 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:04.546082 10148 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.547519  8108 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.543790 10435 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.537542 10646 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:04.537175 10531 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:04.562059 10140 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:04.563239 10140 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:04.563607 10140 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:04.564507 10140 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:04.565688 10598 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:17:04.544332 10685 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:04.566913 10685 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.556910 10677 consensus_queue.cc:1059] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:17:04.567867 10562 raft_consensus.cc:3055] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:04.568032 10677 raft_consensus.cc:3055] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:04.568274 10562 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:04.568538 10677 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:04.569456 10677 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.570758 10677 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.572116  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:04.572705 10053 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.572872  8174 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:17:04.541404 10565 consensus_meta.cc:287] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.805s	user 0.005s	sys 0.008s
I20260709 13:17:04.537137  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:04.542979 10478 raft_consensus.cc:3055] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:04.539877 10526 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:04.574640  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:04.580288  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.525041 10601 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.587168  8787 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:04.496755 10619 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.588650  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.589514  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.531587 10684 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:17:04.592520  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.574890 10531 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.593533  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.590955 10456 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:04.586738 10478 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:04.589509  8782 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.595316 10478 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.600378 10619 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:04.603713  8782 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:04.604221 10148 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.573906 10646 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:04.606458  8147 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:04.606834  8175 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:04.590692 10250 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.616818 10250 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:04.618152 10648 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:04.559530 10589 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.589010 10140 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:04.588946 10552 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.619261  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.619603  8791 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:04.629292  8106 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:17:04.631089  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.632195  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.632560 10589 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:04.622529  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.609295 10646 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:04.634339  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.634931  8104 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:04.623871  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.627403  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.569154 10562 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.609792 10526 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:04.658318  8791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:36864
I20260709 13:17:04.638002  8100 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.659080  8791 raft_consensus.cc:606] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.608274 10531 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.629841  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.659466  8791 raft_consensus.cc:614] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:04.659749  8102 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.620639 10601 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.615804 10617 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:04.645100  8104 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 2.
I20260709 13:17:04.648432 10685 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.673444 10685 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:04.677897 10435 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.650071 10562 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.637537 10552 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.696585  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:04.652127  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 58706.1us
I20260709 13:17:04.654353 10646 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.658422 10526 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:04.633275  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.700807  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:04.662585  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.706502  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:04.707185  8253 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:04.708385  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:04.687233  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:04.686406  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:04.692579  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 65262us
I20260709 13:17:04.688221  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:04.701601  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:04.703262  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:04.712101  8791 raft_consensus.cc:2410] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:17:04.712157  8790 raft_consensus.cc:2368] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4.
I20260709 13:17:04.709595  8250 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:04.710368  8174 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 2.
W20260709 13:17:04.703661  7991 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9abaa411847e4bf9907f7af5e2689c7b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5033fc7e66374940a203908ea8b0078f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:04.713745  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:04.716074  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.715863  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:04.718654  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.719662  8789 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:04.722440  8108 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:17:04.722824  8108 pending_rounds.cc:85] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 6
I20260709 13:17:04.723093  8108 pending_rounds.cc:107] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:17:04.723194  8102 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:04.723374  8108 raft_consensus.cc:2889] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:04.724267  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:04.712989 10666 raft_consensus.cc:2764] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:17:04.727388  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.729004  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:04.690817  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:04.729506  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.726450  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:04.729784  8782 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.730341  8106 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:04.730508  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:04.730980 10053 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:04.727847  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:04.731429 10053 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.731791  8248 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:04.728359  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:04.733255  8784 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:04.733471 10526 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.734560  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.731429  8786 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:17:04.735077  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 375158us
I20260709 13:17:04.735526  8104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b491e7c261394e498f940b0169e957b6"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51964
I20260709 13:17:04.731467  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:04.732342  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:04.736377 10179 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:04.736753  8783 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:04.736929 10179 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:04.737721  8106 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:04.737882 10179 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.739061  8786 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:17:04.739794  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:04.740495  8785 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:17:04.731896 10053 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:04.742367  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.742834  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.742781  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:04.743525  8784 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:04.744242 10646 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:04.744748  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:04.745041  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:04.745685  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:04.745929  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.746471  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.735816  8223 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:04.746882  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:04.747469  8255 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:04.751571  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:04.752724  8100 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:04.752737  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:04.754812  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:04.754880 10648 consensus_queue.cc:1059] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:04.755486  8253 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:17:04.756342  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:04.757335  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:04.757416  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:04.757727  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:04.757885  8787 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48110 (request call id 646) took 3022 ms (client timeout 1874 ms). Trace:
I20260709 13:17:04.758123  8251 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:04.758373  8787 rpcz_store.cc:269] 0709 13:17:01.735422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.737601 (+  2179us) service_pool.cc:224] Handling call
0709 13:17:04.757718 (+3020117us) spinlock_profiling.cc:243] Waited 2.73 s on lock 0x7b540046dcd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:04.757817 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6288049536}
I20260709 13:17:04.760057 10682 raft_consensus.cc:3055] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:04.760473 10682 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:04.760612 10632 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:04.760751 10613 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:04.728579  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:04.697664 10617 raft_consensus.cc:697] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:04.697386 10675 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:17:04.761906  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:04.803642  8787 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:17:04.754221  8250 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:04.754462  8149 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:04.873287  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 118902us
W20260709 13:17:04.874009  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 137214us
I20260709 13:17:04.855114  8791 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:04.696532 10601 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:04.853646  8255 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:17:04.874778  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:04.816258  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 64823.1us
I20260709 13:17:04.875300  8102 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:04.762601  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 54526.6us
W20260709 13:17:04.875598  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.804442  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.880716  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.729310  8108 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:04.835947  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 317) took 1129 ms. Trace:
I20260709 13:17:04.817623  8251 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:04.698506 10456 raft_consensus.cc:697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:04.884405  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.884130 10435 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:04.883317  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:04.923231  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:04.923483 10532 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:04.923820  8785 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:04.924171 10532 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:04.924666 10532 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:04.764220 10438 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.000s
I20260709 13:17:04.924820  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:04.925307 10438 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.935200 10438 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.882592 10456 consensus_queue.cc:237] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:04.925650 10532 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:04.921362  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:04.920360  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 45661.1us
W20260709 13:17:04.928108  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.920887  8257 rpcz_store.cc:276] 0709 13:17:03.706772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.925827 (+219055us) service_pool.cc:224] Handling call
0709 13:17:03.932599 (+  6772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.932947 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:04.012099 (+ 79152us) log.cc:844] Serialized 14 byte log entry
0709 13:17:04.763982 (+751883us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b1800443d40. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa5a09f44bc 00007fa59dd4248b 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec23a
0709 13:17:04.825056 (+ 61074us) log.cc:844] Serialized 14 byte log entry
0709 13:17:04.835493 (+ 10437us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:04.835550 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:04.835622 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.835721 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.835872 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40539,"prepare.queue_time_us":128955,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":61933,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":10596,"spinlock_wait_cycles":68964224,"thread_start_us":144254,"threads_started":2,"wal-append.queue_time_us":132141}
I20260709 13:17:04.940841  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:04.941727 10584 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:04.942572 10584 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.943049 10584 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.945216 10148 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:04.824117 10695 consensus_queue.cc:1059] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.147s
I20260709 13:17:04.951274 10617 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:04.919857 10653 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:17:04.954758 10694 log.cc:927] Time spent T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:17:04.957376  8786 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:04.961815 10660 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:04.940713 10053 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:04.971622  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 50524.8us
I20260709 13:17:04.965698  8102 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:04.968374  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:05.018657  8104 raft_consensus.cc:606] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.973152  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:04.878078 10636 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:04.762398 10663 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:04.979728  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:05.041026  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 61375.7us
W20260709 13:17:04.980285  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.843623  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.023778  8104 raft_consensus.cc:614] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:05.043488  8103 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:04.824913 10384 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:04.962260 10660 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.042371  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:05.048404  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:05.052690  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:05.054126  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 81069.4us
I20260709 13:17:05.055348  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:04.976130 10651 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.057684  8223 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:04.980266 10667 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:05.060635 10598 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:05.065672 10466 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:05.065088 10531 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:05.066362 10693 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:05.067709 10053 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:05.070317 10552 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:05.072350  8783 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:05.102087 10651 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:05.114080 10478 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:05.115586 10651 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:05.116729  8177 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:05.086215 10613 raft_consensus.cc:2764] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:17:05.086589 10172 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:05.118217 10172 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:05.118739 10172 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:05.119957 10531 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:05.100093 10179 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:17:05.009804 10592 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:05.129693 10592 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.130280 10592 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.104300 10589 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:17:05.132521 10179 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:05.132930 10179 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:05.110044 10598 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:05.134011 10179 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:05.134594 10598 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:05.135412 10179 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:05.074406 10685 raft_consensus.cc:3055] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:05.101318 10512 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:05.137269 10685 raft_consensus.cc:740] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:05.138511 10685 consensus_queue.cc:260] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:05.140300 10685 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:05.074847  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 1988) took 1315 ms. Trace:
I20260709 13:17:05.141603  8254 rpcz_store.cc:276] 0709 13:17:03.759738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.011198 (+251460us) service_pool.cc:224] Handling call
0709 13:17:04.030087 (+ 18889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.478292 (+448205us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:04.497500 (+ 19208us) log.cc:844] Serialized 14 byte log entry
0709 13:17:04.756048 (+258548us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:04.756098 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:04.756154 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.074551 (+318397us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b5400071054. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:05.074618 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.074773 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168324,"prepare.queue_time_us":20105,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":2347,"raft.queue_time_us":168905,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":1029901056,"thread_start_us":89856,"threads_started":1,"wal-append.queue_time_us":96655}
I20260709 13:17:05.053472 10626 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:05.144555 10626 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:05.145746 10626 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:05.146868  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:05.073345 10565 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:04.953279 10584 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:05.152064 10584 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:05.073307  8786 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:05.017195 10582 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.963326 10567 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:17:05.047292 10384 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.046819 10663 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:05.049441 10140 consensus_queue.cc:1059] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 13:17:05.118260  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.056277 10660 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.763196 10682 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:05.056607 10438 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:05.097256 10667 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:17:05.197113  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.164073 10384 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:05.177989 10438 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:05.257680  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.166067 10663 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:05.266366  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.163636 10582 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:05.293522  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.298750  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 377467us
I20260709 13:17:05.301286  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:05.262033 10438 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:05.345649  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:05.346398  8251 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
W20260709 13:17:05.346659  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.347932  8255 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:17:05.350314  8074 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.131:45561 timed out after 1.663s (SENT) [suppressed 19 similar messages]
I20260709 13:17:05.289155 10589 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.351087  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:05.352859  8253 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:05.352675  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:05.353893  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 385584us
I20260709 13:17:05.354926  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:05.356072  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:05.357120 10250 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:05.357502 10250 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.357995 10250 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:05.358563  8251 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:17:05.360992  8789 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.013s	sys 0.005s
W20260709 13:17:05.361340  8789 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.013s	sys 0.005s
I20260709 13:17:05.366581  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:05.366837  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:05.367897  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:05.369272  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:05.355173  8782 consensus_meta.cc:287] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.003s
I20260709 13:17:05.370074  8786 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.370736  8782 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:05.373515  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:05.373883  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:05.372649 10250 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:05.375389  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:05.376256  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:05.374696  8787 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.376304  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:05.343770  8249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 1980) took 1973 ms (client timeout 1663 ms). Trace:
I20260709 13:17:05.350080 10675 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:05.391539  8787 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
W20260709 13:17:05.393885  8071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.008s	sys 0.017s
W20260709 13:17:05.395260  8071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.008s	sys 0.017s
I20260709 13:17:05.377161  8252 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:05.380738 10567 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:05.399202  8786 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:05.301883 10667 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:05.380389  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1027) took 1034 ms. Trace:
I20260709 13:17:05.369629 10589 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:05.398993 10562 consensus_meta.cc:287] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.699s	user 0.010s	sys 0.001s
I20260709 13:17:05.393572 10675 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:17:05.410010  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 354700us
W20260709 13:17:05.412963  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.416874  8252 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:05.423066  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:05.424518  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:05.429605  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:05.429759  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:05.435515  8788 raft_consensus.cc:2410] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:17:05.404870 10567 raft_consensus.cc:697] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:05.401788 10707 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:05.383172  8249 rpcz_store.cc:269] 0709 13:17:03.361624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.395982 (+ 34358us) service_pool.cc:224] Handling call
0709 13:17:05.291142 (+1895160us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b5400208d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:05.335177 (+ 44035us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1374589312}
W20260709 13:17:05.447079  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.428825 10565 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:05.443449  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:05.448690  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:05.452234  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:05.435936 10532 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:05.439374 10667 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:05.437983 10552 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:05.454555  8282 heartbeater.cc:646] Failed to heartbeat to 127.6.214.190:45311 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.6.214.190:45311 timed out after 15.000s (SENT)
I20260709 13:17:05.464241 10636 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:05.458007  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:17:05.466743  8073 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.007s	sys 0.029s
W20260709 13:17:05.467733  8073 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.007s	sys 0.029s
W20260709 13:17:05.468822  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.469270  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.469650  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1022) took 1124 ms. Trace:
I20260709 13:17:05.455226 10531 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:05.453164 10565 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.473881  8788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
mode: GRACEFUL
new_leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
 from {username='slave'} at 127.0.0.1:36864
I20260709 13:17:05.474650  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:05.478544  8788 raft_consensus.cc:606] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Received request to transfer leadership to TS 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:05.478902  8788 raft_consensus.cc:614] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:05.479574  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:05.471037  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.482491  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:05.483750  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:05.446808 10562 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:17:05.502758 10695 raft_consensus.cc:3055] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:05.503258 10695 raft_consensus.cc:740] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:05.481176 10565 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:05.504185 10562 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:05.504467  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:05.485596 10697 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:17:05.505196  8785 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.455442 10707 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:05.506784 10707 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:05.481321 10636 raft_consensus.cc:697] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:05.508484 10666 raft_consensus.cc:3055] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:05.508935 10666 raft_consensus.cc:740] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:05.508611 10636 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:05.509742 10666 consensus_queue.cc:260] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:05.510967 10666 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:05.486114  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:05.486822  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:05.473984 10140 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.512859 10140 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:05.487361 10250 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:05.488790  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:05.489229  8251 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:05.516492  8104 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:05.490147  8107 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:05.473284  8101 rpcz_store.cc:276] 0709 13:17:04.344961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.444612 (+ 99651us) service_pool.cc:224] Handling call
0709 13:17:04.444914 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.445357 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:05.062174 (+616817us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b18003f04c0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa5a09f44bc 00007fa59dd4248b 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5c455 00007fa5a48443c7 00007fa5a0e569a7 00007fa5a0e660bf
0709 13:17:05.062360 (+   186us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.431457 (+369097us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.444743 (+ 13286us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:05.447791 (+  3048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.455566 (+  7775us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.469587 (+ 14021us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6968,"prepare.queue_time_us":77519,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":4185,"raft.queue_time_us":12363,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":16150,"spinlock_wait_cycles":2610432,"thread_start_us":408847,"threads_started":2}
I20260709 13:17:05.472251 10613 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:05.492045  8250 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:17:05.518584  8250 pending_rounds.cc:85] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 3
I20260709 13:17:05.518481 10613 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:05.518963  8250 pending_rounds.cc:107] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:17:05.519114 10613 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:05.519289  8250 raft_consensus.cc:2889] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:05.521567 10592 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:05.523945  8257 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:17:05.485909  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.517227  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:05.525460  8251 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:05.492548 10701 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:05.493963  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:05.493304 10699 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:17:05.495010 10531 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:05.483772 10053 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:05.499321 10582 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:05.500929 10532 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:05.482266 10675 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:05.504678 10562 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.528537  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:05.517220  8006 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39814 (request call id 278) took 14797 ms (client timeout 15000 ms). Trace:
I20260709 13:17:05.589100  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:05.494483  8253 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:05.590310  8174 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:17:05.590361  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:05.591014  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 63433.6us
W20260709 13:17:05.535215  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.562536  8251 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:05.524104  8005 catalog_manager.cc:5697] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:05.577072  8106 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:05.579675  8789 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:05.576494  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:05.581488  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:05.526827 10696 log.cc:927] Time spent T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.193s	user 0.003s	sys 0.000s
I20260709 13:17:05.634438  8005 catalog_manager.cc:5697] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:17:05.593845  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.632133  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:05.639576  8104 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:05.639767  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:05.593647  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:05.593245  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:05.632211  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 281922us
I20260709 13:17:05.602593  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:05.475564 10639 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:17:05.638660  8005 catalog_manager.cc:5697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 2 to 5, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 5 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:05.565654 10531 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.645979  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:05.668545  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:05.669370  8252 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:17:05.642781  8177 raft_consensus.cc:2368] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:05.588207 10053 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:05.649909  8005 catalog_manager.cc:5697] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 2 to 5, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 5 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:17:05.678455  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.679175  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.678957  8005 catalog_manager.cc:5697] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 2 to 4, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 4 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:05.676229  8102 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:05.676316  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:05.682308  8254 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.680924  8005 catalog_manager.cc:5697] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:05.683056  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:05.683967  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:05.587819 10657 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.676774  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:05.683481  8005 catalog_manager.cc:5697] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 2 to 6, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 6 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:05.688678  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:05.591624 10179 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.592603 10562 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.693632  8005 catalog_manager.cc:5697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:05.694701  8105 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.696635  8253 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.699045  8005 catalog_manager.cc:5697] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 2 to 5, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 5 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:05.687646  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:05.704790  8005 catalog_manager.cc:5697] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 2 to 4, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 4 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:05.706329  8005 catalog_manager.cc:5697] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 5, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 5 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:17:05.588703  8006 rpcz_store.cc:269] 0709 13:16:50.719923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.720158 (+   235us) service_pool.cc:224] Handling call
0709 13:17:05.517141 (+14796983us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:58.821841 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:58.822551 (+   710us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:58.822613 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:16:58.822630 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:59.227619 (+404989us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:59.227735 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:59.227775 (+    40us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:16:59.229646 (+  1871us) tablet.cc:701] Row locks acquired
0709 13:16:59.229688 (+    42us) write_op.cc:260] PREPARE: finished
0709 13:16:59.229909 (+   221us) write_op.cc:270] Start()
0709 13:16:59.230140 (+   231us) write_op.cc:276] Timestamp: P: 1783603019229827 usec, L: 0
0709 13:16:59.230169 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:16:59.231181 (+  1012us) log.cc:844] Serialized 6720 byte log entry
0709 13:17:00.370052 (+1138871us) op_driver.cc:464] REPLICATION: finished
0709 13:17:00.934925 (+564873us) write_op.cc:301] APPLY: starting
0709 13:17:00.935065 (+   140us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:00.935447 (+   382us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:00.943275 (+  7828us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:01.023428 (+ 80153us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:01.023758 (+   330us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:17:01.023802 (+    44us) write_op.cc:312] APPLY: finished
0709 13:17:01.024215 (+   413us) log.cc:844] Serialized 119 byte log entry
0709 13:17:01.024413 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:01.024561 (+   148us) write_op.cc:454] Released schema lock
0709 13:17:01.024627 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:01.025000 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:01.025029 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1774355,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":501246,"apply.run_cpu_time_us":5058,"apply.run_wall_time_us":126737,"num_ops":17,"prepare.queue_time_us":99366,"prepare.run_cpu_time_us":23097,"prepare.run_wall_time_us":679277,"raft.queue_time_us":348748,"raft.run_cpu_time_us":38725,"raft.run_wall_time_us":328544,"replication_time_us":1139682,"spinlock_wait_cycles":3840,"thread_start_us":838562,"threads_started":4,"wal-append.queue_time_us":401097,"wal-append.run_cpu_time_us":33535,"wal-append.run_wall_time_us":2365720}]]}
I20260709 13:17:05.710953  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:05.712126  8104 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:05.713299  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:05.714599  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:05.715211  8104 raft_consensus.cc:2368] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:05.717130  8108 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:05.677176 10531 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:05.718627  8104 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:05.637203 10435 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:17:05.705638 10695 consensus_queue.cc:260] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:05.707309 10179 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:05.707733 10657 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:05.752974 10703 log.cc:927] Time spent T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.271s	user 0.000s	sys 0.000s
I20260709 13:17:05.577696 10567 consensus_queue.cc:237] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:05.722524  8005 catalog_manager.cc:5697] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:05.685128 10250 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:17:05.750174 10456 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:05.670235 10438 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:05.852912  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.854708  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 397234us
I20260709 13:17:05.787132 10713 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:05.722438 10702 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.118s
W20260709 13:17:05.889799  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.790638 10053 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:05.867563 10384 consensus_meta.cc:287] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.607s	user 0.014s	sys 0.000s
I20260709 13:17:05.927485  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:05.876668 10552 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:17:05.930691  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.822737 10478 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.948438  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:05.953174  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:05.954320  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:05.928432  8072 leader_election.cc:336] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.543s (SENT)
I20260709 13:17:05.950670  8790 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.907226 10626 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.955943  8182 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:05.957950  8147 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:05.956275  8072 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:05.959218  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 319510us
I20260709 13:17:05.968904  8790 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:05.406250  8099 rpcz_store.cc:276] 0709 13:17:04.346098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.448501 (+102403us) service_pool.cc:224] Handling call
0709 13:17:04.448887 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.449112 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:04.524321 (+ 75209us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.332315 (+807994us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.345522 (+ 13207us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:05.350396 (+  4874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.354462 (+  4066us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.377947 (+ 23485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17870,"prepare.queue_time_us":101288,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":142761,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":793666,"threads_started":3,"wal-append.queue_time_us":491055}
I20260709 13:17:05.931102 10713 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.943563 10582 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:05.954535 10677 consensus_meta.cc:287] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.383s	user 0.008s	sys 0.009s
I20260709 13:17:05.949353 10592 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:05.949246 10617 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:05.955435 10632 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:05.982357  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.000317 10708 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:06.002302  8100 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:17:05.914681 10709 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:06.002713 10140 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:05.952134 10384 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.004163 10639 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.005082 10711 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:17:06.005386 10435 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:06.006340  8253 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:06.008539 10179 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:05.957142 10626 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:05.978464  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 451248us
I20260709 13:17:05.960551  8147 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:06.011240  8105 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:06.010291  8254 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:05.981564  8149 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:06.018220  8100 pending_rounds.cc:85] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 3
I20260709 13:17:05.997627 10713 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:06.023440  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 304616us
W20260709 13:17:05.997897 10717 log.cc:927] Time spent T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:17:05.972815 10148 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:17:06.087421  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.957837 10478 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:06.063166  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.110425  8100 pending_rounds.cc:107] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:17:05.976625 10723 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:05.974632 10684 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:06.018651 10632 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:06.111264  8100 raft_consensus.cc:2889] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:06.107056  8074 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:06.113576  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.121620  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 161118us
W20260709 13:17:06.144928  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.124303  8257 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 6: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:17:06.147476  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 193224us
I20260709 13:17:06.011193 10582 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.029902 10708 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:06.106518 10725 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:06.151782  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:06.148326  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.022645 10617 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.016206 10613 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.112566 10592 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:06.121795 10632 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:06.138799 10565 consensus_meta.cc:287] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.634s	user 0.006s	sys 0.005s
W20260709 13:17:06.159091  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.159842  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:06.120198 10598 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:06.147605 10619 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:06.112300 10140 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:17:06.149993 10707 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:06.148692 10698 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:06.029609 10709 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.113922 10435 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.150115 10636 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:06.118410 10148 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.118566 10639 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.161763 10723 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:06.154089  8785 consensus_meta.cc:287] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.012s
I20260709 13:17:06.186808 10053 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:17:06.209014  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 227563us
I20260709 13:17:06.114136 10552 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.192917 10725 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:06.224098  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:06.224858  8177 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:06.224790  8183 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:06.227589  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 458) took 1411 ms. Trace:
I20260709 13:17:06.228003  8791 rpcz_store.cc:276] 0709 13:17:04.815870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.874956 (+ 59086us) service_pool.cc:224] Handling call
0709 13:17:05.149279 (+274323us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:17:05.149550 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.150010 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.150053 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.150728 (+   675us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.394457 (+243729us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:05.394511 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.394602 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.210225 (+815623us) raft_consensus.cc:1685] finished
0709 13:17:06.210251 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.227523 (+ 17272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4123,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":2871,"spinlock_wait_cycles":18962176,"thread_start_us":243189,"threads_started":1,"wal-append.queue_time_us":527112}
I20260709 13:17:06.233479  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:06.233896  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:06.234288  8177 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:06.234921  8183 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:06.199743 10731 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.240767  8183 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:06.210208 10179 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.213371 10636 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:06.210336 10657 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:06.208864 10739 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:06.190924 10565 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.191421 10592 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.191478 10730 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:17:06.192380 10598 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.268149 10613 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:06.269027 10721 log.cc:927] Time spent T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.103s	user 0.002s	sys 0.002s
I20260709 13:17:06.196477 10619 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.269444 10626 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:06.269795 10709 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:06.271262 10619 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:06.271530 10626 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.271898 10619 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.272161 10626 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.272473 10619 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.211829  8785 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:06.273172 10592 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:06.249819 10179 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:06.273674  8785 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48110 (request call id 683) took 1350 ms (client timeout 1594 ms). Trace:
I20260709 13:17:06.252251  8181 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: []
W20260709 13:17:06.274139  8785 rpcz_store.cc:269] 0709 13:17:04.923179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.924612 (+  1433us) service_pool.cc:224] Handling call
0709 13:17:05.504296 (+579684us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:06.273601 (+769305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104386816}
I20260709 13:17:06.275161 10179 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:06.232955 10438 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:06.271278 10148 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:06.247470  8183 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:06.244154 10708 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:06.277467 10685 consensus_meta.cc:287] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.137s	user 0.009s	sys 0.005s
I20260709 13:17:06.268188 10598 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:06.226493 10723 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:06.280179  8791 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:17:06.257292 10722 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:17:06.203912 10707 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.258219 10682 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.259375 10639 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:06.262661  8256 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:06.263638  8254 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:17:06.264254  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.304878  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.254338 10657 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.256644 10727 log.cc:927] Time spent T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:17:06.258093 10565 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:06.281543  8147 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:06.283039  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:06.255715 10663 consensus_meta.cc:287] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.963s	user 0.009s	sys 0.004s
W20260709 13:17:06.296487  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.301913  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 142168us
W20260709 13:17:06.311604  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 56177.3us
I20260709 13:17:06.388329  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:06.306600  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:06.388453  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:06.280531 10172 consensus_meta.cc:287] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.161s	user 0.012s	sys 0.001s
I20260709 13:17:06.377456  8174 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 6. Ops: []
I20260709 13:17:06.253458 10250 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.123s
I20260709 13:17:06.379284  8183 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:06.376083  8108 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
W20260709 13:17:06.302500 10724 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 13:17:06.380505  8181 raft_consensus.cc:2368] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7.
I20260709 13:17:06.244038 10053 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:17:06.378666 10179 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.394218  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:06.404891  8223 leader_election.cc:400] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5.
I20260709 13:17:06.405361  8223 leader_election.cc:403] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:17:06.378274  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.399164  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:06.396799  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 115399us
W20260709 13:17:06.407019  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.378010 10592 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:06.409372  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:06.388509 10384 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:06.411381  8253 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:06.412983  8250 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:06.410022  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:06.416319  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:06.413645  8256 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:06.422190  8181 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:06.422039  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:06.399502 10601 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:06.423861  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:06.246032 10731 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.406402 10598 raft_consensus.cc:2764] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:17:06.387562 10657 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.402401 10478 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:06.392316 10663 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:06.486229  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 70042.3us
I20260709 13:17:06.488122  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:06.414472 10148 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.490377  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:06.398260 10172 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.421144 10179 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.423107 10565 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:06.503060  8180 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:17:06.497030  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 73246.2us
I20260709 13:17:06.413064 10743 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.420801 10750 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:06.421576 10739 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:17:06.508034 10619 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:06.419607 10742 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:06.490232 10140 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.508787 10742 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:06.509034 10140 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.509768 10742 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.511147 10140 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:06.512471 10172 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:06.504850  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:06.513451  8252 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:06.513824 10613 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:06.513754  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:06.514235 10172 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:06.503610  8254 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:06.514336 10613 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:06.511164 10531 consensus_meta.cc:287] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.720s	user 0.008s	sys 0.000s
I20260709 13:17:06.515002 10702 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:06.515551 10598 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:06.515594 10684 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:06.516302 10598 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:06.516599 10684 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:06.516989 10684 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:06.517577  8223 leader_election.cc:400] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:06.517858  8223 leader_election.cc:403] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:17:06.518582 10589 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:06.505044  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:06.520774  8179 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:06.453397 10617 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:06.457574 10748 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.521628  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:06.491010 10384 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5.
I20260709 13:17:06.532702  8181 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:17:06.521628  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:06.762696  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.764885  8149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.000s	sys 0.014s
W20260709 13:17:06.805769  8149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.002s	sys 0.019s
W20260709 13:17:06.806248  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 593890us
I20260709 13:17:06.809092 10745 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:06.810549 10745 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:06.811383 10646 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:06.811988 10646 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:06.813994 10646 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.818365 10646 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.780984  8253 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:06.629338 10179 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:06.820613  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 298932us
I20260709 13:17:06.821933 10682 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:06.822481 10682 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.822883 10682 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:06.772737  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.826542  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.786242 10384 consensus_queue.cc:1059] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:06.828007 10384 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:06.828459 10384 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:06.531138 10435 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:06.631770 10562 consensus_meta.cc:287] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.914s	user 0.011s	sys 0.001s
I20260709 13:17:06.503367 10565 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:06.831751 10565 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:06.833069 10761 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:17:06.836133  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.526551 10626 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:06.453085 10639 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:17:06.421785 10709 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:17:06.426456 10723 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.517988 10531 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:06.785234  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 294987us
I20260709 13:17:06.672358 10735 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.504695 10736 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:06.844409  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:06.493623 10756 raft_consensus.cc:2764] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:17:06.830745 10562 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.846020 10531 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:06.846160 10756 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:06.421222 10592 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.847651  8177 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 6. Ops: []
I20260709 13:17:06.848444 10562 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:06.641081 10632 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.405985 10636 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.717119 10648 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:06.858182 10648 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:06.859932 10648 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:06.647101 10660 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.446s	user 0.010s	sys 0.004s
I20260709 13:17:06.844468 10735 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.862010 10660 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.863622  8255 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:06.612468 10684 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.873097  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:06.873973  8251 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:06.648567 10707 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:06.878355 10592 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:06.643744 10731 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:06.529824 10743 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.606317 10749 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:06.588354 10748 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.884110 10748 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:06.499982 10747 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:06.632879 10754 log.cc:927] Time spent T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:17:06.795183  8102 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:06.500233 10148 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.890756  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:06.892556 10148 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:06.722764 10716 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.815s	user 0.002s	sys 0.000s
I20260709 13:17:06.797386  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1038) took 1085 ms. Trace:
I20260709 13:17:06.894970  8223 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:06.565485  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.633322 10657 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:06.636271 10667 consensus_meta.cc:287] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.169s	user 0.012s	sys 0.000s
I20260709 13:17:06.633994 10663 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:06.897272 10731 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.554725 10677 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:17:06.897882  8103 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.897745  8108 rpcz_store.cc:276] 0709 13:17:05.711313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.717876 (+  6563us) service_pool.cc:224] Handling call
0709 13:17:05.768122 (+ 50246us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:06.396739 (+628617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.796520 (+399781us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54003f2854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:06.797102 (+   582us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320304512}
I20260709 13:17:06.529757 10702 raft_consensus.cc:2764] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:17:06.673341 10713 consensus_meta.cc:287] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.000s
I20260709 13:17:06.900882  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1037) took 1178 ms. Trace:
I20260709 13:17:06.901044 10713 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.901449  8102 rpcz_store.cc:276] 0709 13:17:05.711067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.711153 (+    86us) service_pool.cc:224] Handling call
0709 13:17:05.787129 (+ 75976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.794737 (+1007608us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54003cb2a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0dc3dc0 00007fa5a0e4e1c0 00007fa5a0e4f231 00007fa5a0e4bd8f 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c
0709 13:17:06.889046 (+ 94309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.889385 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335008640}
I20260709 13:17:06.901921  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:06.902822  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2016) took 1407 ms. Trace:
W20260709 13:17:06.605237 10732 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 13:17:06.903781 10763 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:06.904544 10763 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:06.633456 10737 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:17:06.799508  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1935) took 1308 ms. Trace:
I20260709 13:17:06.907477  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1033) took 1198 ms. Trace:
I20260709 13:17:06.907248  8100 rpcz_store.cc:276] 0709 13:17:05.490673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.493509 (+  2836us) service_pool.cc:224] Handling call
0709 13:17:05.535931 (+ 42422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.118238 (+582307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.798824 (+680586us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54001685d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:06.799259 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1071561088}
I20260709 13:17:06.815991 10708 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:06.906096 10763 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.818671  8249 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:17:06.770761  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.515010 10613 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:06.901458 10707 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:17:06.864077 10632 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:06.867090 10660 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:06.920429 10743 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:06.921836 10648 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.870965  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2019) took 1372 ms. Trace:
I20260709 13:17:06.925421  8248 rpcz_store.cc:276] 0709 13:17:05.498039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.671252 (+173213us) service_pool.cc:224] Handling call
0709 13:17:05.671661 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.931244 (+259583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.931273 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.931768 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.148135 (+216367us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:06.175703 (+ 27568us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.311316 (+135613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.495404 (+184088us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b18002f7b80. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f522 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:17:06.870262 (+374858us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400197154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:06.870332 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.870386 (+    54us) raft_consensus.cc:1685] finished
0709 13:17:06.870398 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.870609 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27354,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":107771,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":4821,"spinlock_wait_cycles":604608896,"thread_start_us":325695,"threads_started":2,"wal-append.queue_time_us":239373}
I20260709 13:17:06.927237 10613 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.928339  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:06.881263  8106 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:06.898121 10731 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.903256  8257 rpcz_store.cc:276] 0709 13:17:05.495698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.634970 (+139272us) service_pool.cc:224] Handling call
0709 13:17:06.902314 (+1267344us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54003c1254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:06.902577 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1006471040}
I20260709 13:17:06.908090  8107 rpcz_store.cc:276] 0709 13:17:05.708763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.708885 (+   122us) service_pool.cc:224] Handling call
0709 13:17:05.709169 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.709583 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.709620 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.710073 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.116814 (+406741us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:06.116859 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.116933 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.907006 (+790073us) raft_consensus.cc:1685] finished
0709 13:17:06.907055 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.907255 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8960,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":63201,"thread_start_us":307933,"threads_started":1,"wal-append.queue_time_us":495511}
I20260709 13:17:06.786058 10053 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.908427  8103 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:06.863734 10384 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.903893 10713 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:06.937019 10601 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:06.909693  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:06.913880  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:06.914867  8072 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.159s (SENT)
I20260709 13:17:06.932467 10748 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:06.933735 10750 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:06.934564 10731 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:06.935863 10751 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
I20260709 13:17:06.943138 10750 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:06.944525 10750 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.935377 10053 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:06.947642 10053 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:06.937538  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:06.938999 10601 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:06.954116  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.954634  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.939615  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 90479.6us
I20260709 13:17:06.939832 10713 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:06.940312  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:06.942030  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:06.942559  8784 consensus_meta.cc:287] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 1.500s	user 0.015s	sys 0.010s
W20260709 13:17:06.957075  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55379.1us
I20260709 13:17:06.958570  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:06.957553 10713 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.959698 10713 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.957036 10613 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:06.959851  8257 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:06.962520 10648 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:06.963465  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:06.965343  8257 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:17:06.965770 10456 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:06.966744 10456 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:06.967988 10456 raft_consensus.cc:3055] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:06.968397 10456 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:06.970520  8783 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:06.971487 10750 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:06.971813 10648 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:06.972352 10648 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:06.973604 10648 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.974506  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:06.975102 10648 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:06.975580  8791 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:17:06.959547  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:06.979398  8254 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:06.965015  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:06.962443  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 47706.1us
W20260709 13:17:06.984709  8072 leader_election.cc:336] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.974s (SENT)
I20260709 13:17:06.987130  8072 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:06.985320 10702 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.988309  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.988463 10702 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:06.985529 10677 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.950666 10148 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.994544  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 75764.3us
I20260709 13:17:06.938688 10682 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:07.014809  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:06.997474 10702 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:07.027668  8248 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 6: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:06.994324  8784 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
W20260709 13:17:07.031402  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.035948 10663 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:07.036924 10735 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:07.037595 10667 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.040814  8181 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:07.021521 10148 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:07.042994  8174 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:07.043476 10731 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:07.044052 10731 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.044595 10148 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:07.044591 10731 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:07.003114 10677 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:07.048254 10677 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:07.048967 10582 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:07.050148  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 85277.7us
I20260709 13:17:07.036796 10663 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:07.012787 10745 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.977087 10456 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:07.059715  8251 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:17:07.070112 10456 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:07.071079 10747 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:07.070789  8250 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:07.078248  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:07.065294 10613 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:17:07.085506  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 126072us
I20260709 13:17:07.089115  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:07.117890 10700 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.118836 10700 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:07.120235  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:07.092293  8254 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:17:07.121827  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:07.123129  8105 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:07.122720  8254 pending_rounds.cc:85] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 2
I20260709 13:17:07.121788  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:07.131664  8104 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:17:07.132196 10705 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:07.132501  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.133792 10748 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:07.134073  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.134565 10748 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:07.137872  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.138242 10700 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:07.140326  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.139922 10613 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:07.141327  8178 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 4: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:07.141652  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:07.142481  8182 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:07.143707  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.144025 10723 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.142303  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.104723  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:07.101276 10747 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:07.154181  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:07.149065  8254 pending_rounds.cc:107] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:17:07.155301  8254 raft_consensus.cc:2889] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:07.156633  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 172014us
I20260709 13:17:07.155277  8100 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:07.143190 10613 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:07.144793 10723 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:07.161255  8181 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:07.162412  8174 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:07.162315  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:07.176007  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 116292us
I20260709 13:17:07.181100  8147 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:07.182740  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.183533  8182 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:07.100975 10745 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:07.187376  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.185902 10677 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:07.189141 10705 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.175100  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.193584 10695 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:07.195737  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:07.196370  8755 connection.cc:256] RPC call timeout handler was delayed by -1.5682681820001108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 13:17:07.204646  8755 connection.cc:256] RPC call timeout handler was delayed by -1.3225681819999409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
I20260709 13:17:07.203730 10747 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:07.209951 10747 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:07.188300 10700 consensus_queue.cc:1059] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:17:07.211516 10700 consensus_queue.cc:1243] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:07.212049 10700 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:07.212188 10747 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:07.212437 10700 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:17:07.212648  8103 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1942) took 1711 ms (client timeout 2198 ms). Trace:
I20260709 13:17:07.213255  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:07.213814  8255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2001) took 1863 ms (client timeout 1508 ms). Trace:
I20260709 13:17:07.213761 10700 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:07.214567 10636 consensus_queue.cc:1059] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:07.215405 10700 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.215605 10636 raft_consensus.cc:3055] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:07.216058 10636 raft_consensus.cc:740] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:07.197919  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:07.214393  8255 rpcz_store.cc:269] 0709 13:17:05.350000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.352466 (+  2466us) service_pool.cc:224] Handling call
0709 13:17:07.213584 (+1861118us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400412dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:07.213753 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3471014144}
I20260709 13:17:07.198163  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:07.218761 10768 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:17:07.205720  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:07.220474  8106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1035) took 1511 ms (client timeout 1559 ms). Trace:
I20260709 13:17:07.220413  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:07.220729  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:07.220980  8106 rpcz_store.cc:269] 0709 13:17:05.710403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.710723 (+   320us) service_pool.cc:224] Handling call
0709 13:17:07.220240 (+1509517us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540036ddd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:07.220413 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2651407744}
I20260709 13:17:07.221380  8790 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:07.221843 10708 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:07.222302  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:07.222450  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:07.222687 10613 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.223416 10531 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:07.204032 10748 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:07.223863  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:07.224871 10750 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.225937 10384 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.178442 10682 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:07.230260  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:07.231019  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.231367  8174 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:07.232628  8072 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:07.208612 10723 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:07.208815  8782 raft_consensus.cc:2393] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 3: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:07.217744 10639 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:07.214397  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.243100  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 690) took 1309 ms. Trace:
I20260709 13:17:07.206655  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.241935  8102 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:07.196218 10601 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:07.222397  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:07.237629  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.208220 10053 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:07.179174  8249 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:07.255024 10748 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.255559 10748 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:07.213080  8103 rpcz_store.cc:269] 0709 13:17:05.501495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.528268 (+ 26773us) service_pool.cc:224] Handling call
0709 13:17:07.212470 (+1684202us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003f3254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:07.212585 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3010482944}
I20260709 13:17:07.241115  8783 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:07.257711  8182 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:07.258971  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.259228 10663 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:07.259887  8783 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:07.259943 10677 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:07.261458 10601 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:07.261956  8787 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:17:07.219560  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:07.248423  8178 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:07.245051  8223 leader_election.cc:400] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:07.264931  8223 leader_election.cc:403] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:07.247398  8074 leader_election.cc:400] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7.
I20260709 13:17:07.265486  8074 leader_election.cc:403] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:17:07.252089  8788 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 4: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:07.250581  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:07.252418 10053 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.246634  8789 rpcz_store.cc:276] 0709 13:17:05.932228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.932469 (+   241us) service_pool.cc:224] Handling call
0709 13:17:05.932810 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.226638 (+293828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.226670 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:06.226714 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:06.226750 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.240824 (+1014074us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54003165d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:07.240922 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.241140 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675260160}
I20260709 13:17:07.261276  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:07.270537  8783 raft_consensus.cc:2368] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7.
I20260709 13:17:07.270720 10705 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:07.271435  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2023) took 1032 ms. Trace:
I20260709 13:17:07.266364  8791 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:07.271917  8177 rpcz_store.cc:276] 0709 13:17:06.238977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.239160 (+   183us) service_pool.cc:224] Handling call
0709 13:17:06.239442 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.848262 (+608820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.270964 (+422702us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54003408d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:07.271375 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1397516544}
I20260709 13:17:07.273837  8175 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:07.274194 10053 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:07.249137 10582 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:17:07.277750  8104 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:17:07.261514  8784 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 632) took 2513 ms (client timeout 1974 ms). Trace:
W20260709 13:17:07.278898  8784 rpcz_store.cc:269] 0709 13:17:04.744386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.744507 (+   121us) service_pool.cc:224] Handling call
0709 13:17:07.257244 (+2512737us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54005226d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:07.257391 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586390400}
I20260709 13:17:07.278892 10639 raft_consensus.cc:697] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:07.284822 10700 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:07.217028 10636 consensus_queue.cc:260] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:07.286635  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:07.285502 10700 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:07.310400  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 134167us
W20260709 13:17:07.311025  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 112083us
I20260709 13:17:07.266268 10682 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:07.312448  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:07.313464  8107 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:07.314795  8105 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 3.
I20260709 13:17:07.316756  8106 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:07.248054 10713 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:07.288280 10705 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:07.323319  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 90791.1us
I20260709 13:17:07.330487  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:07.317948 10695 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7.
I20260709 13:17:07.338533  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:07.344293  8790 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:07.345999  8106 raft_consensus.cc:2368] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6.
I20260709 13:17:07.316745 10747 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
W20260709 13:17:07.344640  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 78772.5us
I20260709 13:17:07.333236 10613 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.311771 10639 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:07.359927  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.349550 10675 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.350627 10531 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:17:07.361261 10776 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:17:07.369684  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 58183.9us
W20260709 13:17:07.373991  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.377337  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.377719 10726 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:17:07.384455  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 51597.3us
I20260709 13:17:07.386813  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:07.387490 10771 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:17:07.400386 10685 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
W20260709 13:17:07.402773 10565 consensus_meta.cc:287] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.005s
I20260709 13:17:07.403245 10565 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:07.383450 10675 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:07.392323 10748 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:07.381229 10731 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:07.409297  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:07.417161  8149 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:07.421844  8791 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
W20260709 13:17:07.422825  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.427587  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 104046us
I20260709 13:17:07.417558  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.428715  8107 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:07.432753 10684 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:07.432667 10685 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:17:07.438182  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 75797.1us
W20260709 13:17:07.443485  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51652us
I20260709 13:17:07.444375  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:07.393059 10636 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:07.409619 10695 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:07.399140 10700 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:07.405421 10565 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:07.435352 10531 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:07.460939 10663 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:07.461488 10663 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.461880 10663 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:07.462370 10713 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:07.462664  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.465368  8175 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:07.465806  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2013) took 1065 ms. Trace:
I20260709 13:17:07.466209  8253 rpcz_store.cc:276] 0709 13:17:06.399940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.489318 (+ 89378us) service_pool.cc:224] Handling call
0709 13:17:06.489631 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.820365 (+330734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.453586 (+633221us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b5400268c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:07.465751 (+ 12165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666942208}
I20260709 13:17:07.466662  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.470371  8180 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:17:07.445307 10723 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:07.416617 10053 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:07.480671  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.448915 10695 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:07.481954  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:07.480800  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:07.418633 10705 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:17:07.487226  8182 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:07.488497  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:07.490244  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.490694  8177 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:07.486455  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.493652  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.494411  8789 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:07.458321 10531 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:07.497077  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:07.498720  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.500082  8105 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:07.502035  8103 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:07.496606  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.503063  8180 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:07.480070 10745 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:07.508186  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:07.490276  8784 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:07.490948 10695 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:07.506821  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.475593 10582 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:17:07.532627  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:07.525660  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.523270  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.538010  8103 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:07.506482  8176 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:07.538991  8787 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:07.523518  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:07.502871 10677 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:07.500136 10531 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:07.521793 10148 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.511201 10731 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:07.524863 10700 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.501322 10384 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:17:07.550407  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.553259  8791 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:07.554934  8103 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: []
W20260709 13:17:07.553593  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51951.1us
I20260709 13:17:07.554865 10148 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:07.555490  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:07.569026  8105 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 7: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:07.572659  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.578574  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:07.545544  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:07.581699  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:07.578639  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:07.586727  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:07.578451  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:07.570350 10648 consensus_meta.cc:287] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.595s	user 0.014s	sys 0.000s
I20260709 13:17:07.540340 10735 consensus_queue.cc:1059] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:17:07.559461 10747 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.606029  8103 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:07.543538 10702 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:17:07.608881  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.611964  8791 raft_consensus.cc:2393] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 7: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:07.612857  8255 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:07.613363  8257 raft_consensus.cc:2393] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 8: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:07.613737  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:07.614439  8103 raft_consensus.cc:2368] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:07.614291  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:07.614933  8257 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:07.615435  8787 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:07.615902  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:07.616508  8257 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:17:07.616586  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:07.562147 10685 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:17:07.617669 10685 consensus_queue.cc:1243] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:17:07.617714  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:07.618304  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:07.618779 10148 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:07.618953  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:07.558660 10456 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:17:07.617815  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:07.622067  8250 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:07.618871  8105 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:07.587391 10646 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:07.624209  8176 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:07.624727  8101 raft_consensus.cc:2410] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:17:07.633716  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.617340  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:07.622735  8251 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:07.649771  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.657289  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:07.658357  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:07.606642  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:07.666785  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:07.668885  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:07.672502  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 115181us
I20260709 13:17:07.672488  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:07.607887 10700 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:07.678171  8103 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:07.678390  8251 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:07.679904  8791 raft_consensus.cc:2368] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:07.689602  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:07.690454  8257 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:07.653646 10747 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:07.694695 10781 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:17:07.694847  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:07.695397 10639 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:07.696419 10747 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:07.699124  8223 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:07.695530  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:07.700366  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:07.691401  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:07.673457 10053 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:07.671438 10646 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:07.689359 10148 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:07.696997 10747 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:07.705752  8103 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:17:07.702920  8102 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:17:07.707408  8105 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:07.708250  8108 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:17:07.709561  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51330.7us
I20260709 13:17:07.707907 10148 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.687074 10384 consensus_queue.cc:1243] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:17:07.720518  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:07.723840  8105 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:07.701486 10763 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:07.729748  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.720288 10148 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:07.736016  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.736724  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:07.710503 10619 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.114s
I20260709 13:17:07.739408  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:07.740541  8107 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:07.741686  8251 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:07.743150  8104 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:17:07.743968  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:07.744787  8256 raft_consensus.cc:2410] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 6 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:07.745621  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:07.746394  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:07.746639  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:07.748140  8256 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:07.750730 10700 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:07.752069 10675 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:07.722523 10565 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:07.754678  8178 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:17:07.757910  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 62517.4us
I20260709 13:17:07.760603  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:07.772198  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 73129.9us
I20260709 13:17:07.770555  8789 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:07.781371  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:07.737838 10731 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.785681  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:07.786327  8107 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:07.789968  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:07.792349  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.793532 10619 consensus_queue.cc:1243] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:07.736464 10705 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:17:07.795787 10763 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:07.796978  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.797578  8178 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 2.
I20260709 13:17:07.797616  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:07.797956 10763 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:07.798264  8176 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:17:07.798617 10763 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:07.798964  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:07.800486  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:07.800961  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.801795 10791 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:07.802248 10791 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:07.802176 10053 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:07.802745 10791 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:07.802834  8257 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:07.803282  8257 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:07.803675 10053 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:07.804045  8257 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:07.800360 10793 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:07.813951  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:07.814702  8251 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:07.805258  8257 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:07.772986  8108 pending_rounds.cc:85] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 6
I20260709 13:17:07.816306  8108 pending_rounds.cc:107] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:17:07.816579  8108 raft_consensus.cc:2889] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:07.811031  8250 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:07.807412  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:07.838953  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:07.837656  8755 leader_election.cc:400] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6.
I20260709 13:17:07.839700  8755 leader_election.cc:403] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:17:07.839107  8107 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
W20260709 13:17:07.827507  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 65878us
I20260709 13:17:07.837559  8106 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:07.840685  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:07.828809  8251 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:07.845180  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:07.849864  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:07.798985 10763 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:07.855374  8099 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:07.855516 10763 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:07.857160  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:07.857306 10723 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6.
I20260709 13:17:07.861514  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:07.862975  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:07.850399  8105 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
W20260709 13:17:07.847898  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 58040.1us
I20260709 13:17:07.770990 10565 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:07.985646  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 121364us
I20260709 13:17:07.976512  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:07.976583  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 119532us
I20260709 13:17:07.976980 10807 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:07.981657  8254 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:07.973726  8251 raft_consensus.cc:3055] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:07.989643  8251 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:07.992401  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:07.992882  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.996974  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:07.997745  8106 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:07.866973 10708 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:07.999261  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:07.974493 10705 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:07.984879 10785 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 13:17:07.985498 10677 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:07.988234 10456 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:08.006938  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:08.008104  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:08.013639  8105 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:08.015424  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:08.019534  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:08.017145  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:08.003818 10619 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:08.006510 10708 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:08.004886 10700 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:08.007033 10705 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.033917  8251 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.006124 10735 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:08.031126 10731 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:08.057600 10619 raft_consensus.cc:697] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:08.058761 10619 consensus_queue.cc:237] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:08.063341 10663 consensus_meta.cc:287] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.002s
I20260709 13:17:08.063779 10663 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.064993  8179 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:17:08.065603 10795 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:08.066207 10795 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:08.066929  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.025518 10702 raft_consensus.cc:2764] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:17:08.032023 10250 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.164s
I20260709 13:17:08.014191 10456 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.049590  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:08.051553  8149 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:07.974834 10646 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.013234 10726 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:17:08.049077 10705 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:08.027863 10713 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:08.017799 10053 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:17:08.033154 10677 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:08.075881  8257 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:17:08.109557  8257 pending_rounds.cc:85] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 3
I20260709 13:17:08.109705  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:08.098281  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 230911us
I20260709 13:17:08.046905 10735 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.110097  8257 pending_rounds.cc:107] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:17:08.135345  8257 raft_consensus.cc:2889] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:08.076854 10807 raft_consensus.cc:697] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:08.142246  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:08.088780 10456 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:08.044574 10747 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:17:08.068379 10723 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:17:08.141566 10735 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.195132  8251 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:08.195348  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 206353us
W20260709 13:17:08.191802 10531 consensus_meta.cc:287] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.002s
I20260709 13:17:08.067355 10795 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.198695  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:17:08.210430  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 212452us
W20260709 13:17:08.207041  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 190009us
W20260709 13:17:08.214212  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 162751us
I20260709 13:17:08.214293  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:08.228736  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:08.229952  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:08.215409  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:08.210898 10636 consensus_meta.cc:287] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.000s
I20260709 13:17:08.237238  8257 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:08.203768 10731 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:08.213603 10707 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:08.261821  8182 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:08.268087  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:08.265156  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:08.275147  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:08.276369  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 48075.5us
I20260709 13:17:08.236724 10747 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:08.235407 10809 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:08.269248  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:08.280036  8252 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 6: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:08.280318  8256 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:17:08.237663 10250 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:08.262665 10677 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:08.215703 10148 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.212929 10531 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:08.289577  8254 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:08.294901  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:08.255530 10582 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:17:08.276075 10804 log.cc:927] Time spent T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:17:08.304095  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:08.264901 10795 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:08.261014 10565 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:08.294118  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:08.295625  8789 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:08.299474  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:08.307485  8176 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:08.299736  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:08.300575  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:08.282754 10747 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:08.287181 10713 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:08.317386  8257 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:08.321877  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:08.324524  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:08.301988 10677 raft_consensus.cc:697] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:08.348922 10677 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:08.234925 10708 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.328822 10793 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:08.353231 10793 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.353955 10793 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:08.356315 10531 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:08.330139 10747 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.333534 10808 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:17:08.334724 10805 log.cc:927] Time spent T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:17:08.359444 10702 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.335450 10731 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.360074 10702 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.361506 10582 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.363139  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:08.363762 10582 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:08.364015  8108 raft_consensus.cc:2410] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:08.364989  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:08.340131  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1091) took 1173 ms. Trace:
I20260709 13:17:08.365754  8183 rpcz_store.cc:276] 0709 13:17:07.040252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.049674 (+  9422us) service_pool.cc:224] Handling call
0709 13:17:07.050138 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.050479 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:07.333486 (+283007us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.057075 (+723589us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b18003932e0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa5a09f44bc 00007fa59dd4248b 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec23a
0709 13:17:08.211746 (+154671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.211803 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:08.211853 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.212915 (+  1062us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.213741 (+   826us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32290,"prepare.queue_time_us":452747,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":9810,"raft.queue_time_us":136502,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7500,"spinlock_wait_cycles":5005056,"thread_start_us":579554,"threads_started":3,"wal-append.queue_time_us":258169}
I20260709 13:17:08.366750  8223 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:08.368109  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:08.368677  8183 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:08.343030 10799 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:17:08.345829 10675 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:08.346364 10667 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.281872 10807 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:08.347457 10713 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:08.349210  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:08.326048 10812 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:08.352662  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:08.353165  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:08.345384  8251 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:08.375216  8108 raft_consensus.cc:2393] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 7: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:08.378717  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:08.379343  8257 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:17:08.370265 10148 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:08.370425 10789 log.cc:927] Time spent T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.625s	user 0.004s	sys 0.000s
I20260709 13:17:08.385366  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:08.368103 10384 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:08.384476  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:08.386096  8178 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:08.389811  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:08.390468  8176 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:08.372071 10808 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 7 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:17:08.377883 10791 consensus_meta.cc:287] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 13:17:08.384606  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:08.403642  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.386974 10601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.008s	sys 0.016s
I20260709 13:17:08.376869 10675 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:08.411473 10808 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:08.413877 10713 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:08.420548  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:08.420724  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:08.407996 10791 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:08.358916 10705 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.409639  8221 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:08.429925  8223 leader_election.cc:400] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:08.389240 10384 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.432667  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:08.433020  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:08.406579 10788 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:08.426656 10601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.008s	sys 0.017s
I20260709 13:17:08.405138 10702 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:08.440387 10613 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:08.441150 10705 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:08.463245  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:08.445891 10685 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:08.376041 10810 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 13:17:08.458415  8101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1947) took 1339 ms (client timeout 1528 ms). Trace:
I20260709 13:17:08.460080  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:08.480800  8789 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:08.444064  8182 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:17:08.460992  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:08.464500  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 44027.8us
I20260709 13:17:08.468154  8183 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:17:08.380421 10667 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.473351  8176 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:17:08.488502  8174 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:08.436071 10384 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:08.503182  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 209121us
W20260709 13:17:08.479853  8101 rpcz_store.cc:269] 0709 13:17:07.119207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.131336 (+ 12129us) service_pool.cc:224] Handling call
0709 13:17:07.197811 (+ 66475us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b5800002798. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:08.458126 (+1260315us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54001662d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:08.458331 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":904888960}
I20260709 13:17:08.508077  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:08.524461  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:08.524717  8074 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:08.463668 10695 consensus_meta.cc:287] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.916s	user 0.005s	sys 0.007s
I20260709 13:17:08.438544 10788 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:08.532734  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:08.471105 10809 raft_consensus.cc:697] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:08.537238  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:08.476133 10685 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:17:08.537411  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 110379us
I20260709 13:17:08.538012  8183 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:08.536304  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:08.536784  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.539146  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 169043us
W20260709 13:17:08.542111  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.547251  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:08.421373 10735 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.555650  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:08.540023  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:08.535706 10788 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:08.535037 10148 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:08.562170  8108 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:08.561684  8104 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:08.563395  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:08.553020 10613 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:08.560909  8785 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 5: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:08.566179  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:08.556559 10677 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:08.569265  8105 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:08.535477 10705 raft_consensus.cc:2764] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:17:08.528294 10702 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:17:08.576345  8251 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:08.565402  8181 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:08.533577 10695 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.565613 10708 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:08.639250  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 254693us
I20260709 13:17:08.583813 10677 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:08.648547 10763 consensus_meta.cc:287] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.792s	user 0.012s	sys 0.000s
I20260709 13:17:08.646250 10148 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:08.644124  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:08.647183  8108 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:17:08.654734  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 119815us
I20260709 13:17:08.582924 10613 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:08.647259 10815 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:08.670166  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:08.582695 10582 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:17:08.610425 10531 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:17:08.657603 10677 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:08.666044 10763 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.676705 10148 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.686601 10667 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:08.650244 10646 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:17:08.687238  8252 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:08.672488 10809 consensus_queue.cc:237] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:08.688030 10791 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:08.768183  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 98119us
W20260709 13:17:08.750138 10829 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.056s	user 0.002s	sys 0.000s
I20260709 13:17:08.690558  8072 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:08.677367 10685 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.694305 10836 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:08.694733  8789 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:08.617595 10793 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.675055 10815 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:08.613996 10820 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:17:08.694752 10817 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.121s
I20260709 13:17:08.707420 10735 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:08.748106 10831 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:08.748775 10456 consensus_meta.cc:287] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.006s
I20260709 13:17:08.750102  8108 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:08.586266 10675 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.804811  8256 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:17:08.805085  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1054) took 1021 ms. Trace:
I20260709 13:17:08.805943  8108 rpcz_store.cc:276] 0709 13:17:07.784357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.710573 (+926216us) service_pool.cc:224] Handling call
0709 13:17:08.749856 (+ 39283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.804858 (+ 55002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.805033 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:08.688475 10695 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:08.750774 10619 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.777658  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:08.778853  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 369332us
I20260709 13:17:08.790083  8181 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:17:08.791749  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 251830us
I20260709 13:17:08.809048  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:08.667960 10708 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:08.794801 10815 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:08.790577 10667 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:08.766379 10839 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:08.822777  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:08.815574  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:08.820567 10832 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:17:08.830219 10793 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:08.821031 10807 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:08.817785 10619 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:08.811353 10685 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:08.841645  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1964) took 1048 ms. Trace:
I20260709 13:17:08.842048  8108 rpcz_store.cc:276] 0709 13:17:07.793728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.813875 (+1020147us) service_pool.cc:224] Handling call
0709 13:17:08.841094 (+ 27219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.841282 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.841306 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.841345 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:08.841381 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.841472 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.841573 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:08.843995 10619 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:08.852408  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:08.853518  8789 raft_consensus.cc:2393] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:08.857805  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:08.857965 10148 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:08.859226 10826 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:08.859521 10613 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:08.807829 10456 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:08.860513 10812 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:08.860802 10791 consensus_queue.cc:1059] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:17:08.858227 10793 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:17:08.861467  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 170985us
I20260709 13:17:08.861272  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:08.863785  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 54817.9us
I20260709 13:17:08.864703  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:08.857901 10842 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:08.875905  8176 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 4: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:08.876070  8223 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:08.879503  8106 raft_consensus.cc:2368] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7.
I20260709 13:17:08.887190  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:08.899183  8221 leader_election.cc:400] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:08.900084 10456 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:08.861886 10831 consensus_queue.cc:1059] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:17:08.901516 10831 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:17:08.901711 10843 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:17:08.901888 10831 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:08.900171  8221 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:08.850703 10384 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:08.902892 10831 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:08.904317 10384 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:08.867164 10793 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:08.906134 10788 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:08.907648 10793 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:08.908176  8251 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:08.911972 10788 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:08.915450  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1962) took 1156 ms. Trace:
I20260709 13:17:08.915721 10763 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:08.917097  8223 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:08.922539  8107 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:08.904350 10831 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:08.923425  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1966) took 1128 ms. Trace:
I20260709 13:17:08.923869  8107 rpcz_store.cc:276] 0709 13:17:07.794512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.916612 (+1122100us) service_pool.cc:224] Handling call
0709 13:17:08.922034 (+  5422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.923107 (+  1073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.923331 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:08.925800  8072 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:08.926561  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:08.926717  8221 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:08.927269  8072 leader_election.cc:400] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7.
I20260709 13:17:08.927911 10619 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:08.928382  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:08.928987  8107 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:17:08.915844  8104 rpcz_store.cc:276] 0709 13:17:07.759516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.577454 (+817938us) service_pool.cc:224] Handling call
0709 13:17:08.611871 (+ 34417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:08.646409 (+ 34538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.646457 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:08.654477 (+  8020us) log.cc:844] Serialized 26 byte log entry
0709 13:17:08.799443 (+144966us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:08.799508 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.799607 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.915243 (+115636us) raft_consensus.cc:1685] finished
0709 13:17:08.915268 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.915395 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2034,"raft.queue_time_us":28410,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":6662,"thread_start_us":128285,"threads_started":1,"wal-append.queue_time_us":225103}
I20260709 13:17:08.929234  8251 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 6: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:08.929741 10848 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:08.928555 10667 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:08.928391  8072 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:08.932713  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:08.939393  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.939987  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:08.878865 10812 raft_consensus.cc:697] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:08.930867  8107 pending_rounds.cc:85] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 2
I20260709 13:17:08.941857  8107 pending_rounds.cc:107] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:17:08.942193  8107 raft_consensus.cc:2889] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:08.943207  8791 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:08.945804  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:08.949946  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1969) took 1154 ms. Trace:
I20260709 13:17:08.950498  8107 rpcz_store.cc:276] 0709 13:17:07.795335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.924789 (+1129454us) service_pool.cc:224] Handling call
0709 13:17:08.925170 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.949654 (+ 24484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.949879 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:08.919998 10708 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:08.954996  8104 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:08.955597  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 379) took 1099 ms. Trace:
I20260709 13:17:08.955019  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:08.955937  8104 rpcz_store.cc:276] 0709 13:17:07.856003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.931517 (+1075514us) service_pool.cc:224] Handling call
0709 13:17:08.946894 (+ 15377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.955378 (+  8484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.955549 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:08.956899  8790 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.953516  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:08.942054 10684 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:08.936602 10848 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:08.946557 10842 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:08.961956  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 44969.5us
I20260709 13:17:08.948894 10791 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:08.963343  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:08.961766 10456 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:08.949525 10832 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:08.990547 10832 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.991065 10832 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.993157  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:08.993927  8785 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:08.947747 10795 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.996237 10839 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:08.996053 10795 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:08.996673 10839 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:08.947265 10619 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:08.974843  8104 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:08.975744  8107 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:09.004563  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1056) took 1012 ms. Trace:
I20260709 13:17:09.004981  8107 rpcz_store.cc:276] 0709 13:17:07.992227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.954392 (+962165us) service_pool.cc:224] Handling call
0709 13:17:08.973501 (+ 19109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.004296 (+ 30795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.004506 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:08.962548 10613 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:08.937938 10807 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 13:17:09.007419  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 79107.3us
I20260709 13:17:08.987233 10812 consensus_queue.cc:237] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:08.988485 10708 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:08.998303  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:09.011399 10795 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:09.012193 10845 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:09.013082  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:08.998240 10791 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.016023  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 370) took 1817 ms. Trace:
I20260709 13:17:09.016207 10707 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:09.016755  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:09.018411  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:09.029241  8104 pending_rounds.cc:85] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 5
I20260709 13:17:09.021126  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:09.040932  8104 pending_rounds.cc:107] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:17:08.988499 10824 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.022351 10827 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.371s	user 0.003s	sys 0.000s
I20260709 13:17:09.022706  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:09.023599  8107 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:09.030223 10601 consensus_queue.cc:1059] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:17:08.976004 10848 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:09.039243  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:09.020280 10613 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.022084  8175 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:09.041359  8104 raft_consensus.cc:2889] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:09.040630  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 53381.6us
I20260709 13:17:09.030884  8100 rpcz_store.cc:276] 0709 13:17:07.202395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.231361 (+ 28966us) service_pool.cc:224] Handling call
0709 13:17:07.231702 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:07.283951 (+ 52249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.283982 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:07.284671 (+   689us) log.cc:844] Serialized 52 byte log entry
0709 13:17:08.804321 (+1519650us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b18003579a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:17:08.936087 (+131766us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:08.936121 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.936202 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:09.015737 (+ 79535us) raft_consensus.cc:1685] finished
0709 13:17:09.015756 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.015962 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33170,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":32058,"spinlock_wait_cycles":3364736,"thread_start_us":131563,"threads_started":1,"wal-append.queue_time_us":1724905}
I20260709 13:17:09.052896  8255 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:09.060279  8147 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:09.046972 10707 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:09.040627 10791 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.046649 10636 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:09.051489 10148 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:09.065099  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 48431.6us
W20260709 13:17:09.072836  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.051995 10824 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.056679 10723 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.082767 10723 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.058668 10815 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.085086 10723 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:09.101114 10793 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:09.102962  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 333) took 1600 ms. Trace:
I20260709 13:17:09.103485 10663 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:09.090763 10613 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:09.091178 10584 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:17:09.093232  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:09.095801  8248 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:17:09.087049 10786 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 1.334s	user 0.001s	sys 0.001s
W20260709 13:17:09.106714  8103 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1051) took 1416 ms (client timeout 1583 ms). Trace:
W20260709 13:17:09.114090  8103 rpcz_store.cc:269] 0709 13:17:07.690032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.690137 (+   105us) service_pool.cc:224] Handling call
0709 13:17:09.073238 (+1383101us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b540040b0d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:09.106640 (+ 33402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23605632}
W20260709 13:17:09.108220  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 45332.1us
I20260709 13:17:09.116235  8147 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:09.112332  8789 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:09.067312 10601 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:09.103343  8253 rpcz_store.cc:276] 0709 13:17:07.502155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.506033 (+  3878us) service_pool.cc:224] Handling call
0709 13:17:07.587629 (+ 81596us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:07.722644 (+135015us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:07.980461 (+257817us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.560314 (+579853us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:08.614128 (+ 53814us) log.cc:844] Serialized 52 byte log entry
0709 13:17:08.614324 (+   196us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:08.614368 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.614465 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:09.021821 (+407356us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:09.102689 (+ 80868us) raft_consensus.cc:1685] finished
0709 13:17:09.102773 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.102906 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":215829,"prepare.queue_time_us":80831,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":304105,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":22247,"spinlock_wait_cycles":111812864,"thread_start_us":835068,"threads_started":4,"wal-append.queue_time_us":572725}
I20260709 13:17:09.072453 10845 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:09.103353 10793 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:09.073019  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:09.116925  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:09.116595  8221 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:09.107739 10384 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:09.149964  8790 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:09.135286  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:09.135550  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:09.156456  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:09.157315  8103 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:09.167640  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:09.167907  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.167840  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:09.171981  8107 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 7: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:09.110292 10831 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:17:09.173321  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 63069.3us
I20260709 13:17:09.178535  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:09.179139  8103 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.152940  8785 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.162003 10795 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:09.190692  8223 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:09.135782 10695 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:17:09.139583 10731 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:17:09.196195 10823 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:09.196355 10695 consensus_queue.cc:1243] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:17:09.196674 10854 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:17:09.197245 10835 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.501s	user 0.002s	sys 0.000s
I20260709 13:17:09.178305  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:09.170665 10384 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:09.190445 10795 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.190124 10845 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.238466 10857 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:17:09.244114 10824 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:09.248111 10384 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:09.248951 10384 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:09.249476  8784 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:09.251230 10667 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:09.251502  8252 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:17:09.252017  8252 pending_rounds.cc:85] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 3
I20260709 13:17:09.252283  8252 pending_rounds.cc:107] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:17:09.252542  8252 raft_consensus.cc:2889] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:09.254657 10677 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:09.254979 10707 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:09.255580 10842 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:09.259155 10763 raft_consensus.cc:3055] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:09.268913 10763 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:09.269981 10763 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:09.236735 10795 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.271167 10763 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.265455 10848 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.275642 10848 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:09.263449  8108 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:09.278463 10791 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.278333 10845 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:09.281044 10845 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:09.281680 10667 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.282271 10667 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:09.283049 10791 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:09.273087  8785 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
W20260709 13:17:09.283782  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 137369us
I20260709 13:17:09.284795  8221 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:09.292723  8103 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:09.293766  8074 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:09.305025  8072 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:09.303184  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:09.316552  8221 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:09.262770 10830 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.615s	user 0.002s	sys 0.000s
W20260709 13:17:09.356544  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 50473us
I20260709 13:17:09.359386  8785 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:09.263682  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1965) took 1469 ms. Trace:
I20260709 13:17:09.236821 10823 raft_consensus.cc:697] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:09.314105 10845 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:09.314141 10648 raft_consensus.cc:3055] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:09.379854  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:09.314656 10677 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:09.323413 10685 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:09.322516 10848 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:09.281731 10839 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:09.322731 10663 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:17:09.377132  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:09.384748 10695 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:09.447062  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 256447us
W20260709 13:17:09.450184  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.425752 10682 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:09.458858  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:09.461644  8223 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:09.422761 10825 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:09.386849 10791 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:09.381251 10648 raft_consensus.cc:740] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:09.384001 10848 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:09.428146  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:09.458710 10667 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:09.485908 10848 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.488237  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:09.488881  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:09.488935 10648 consensus_queue.cc:260] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.490341  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:09.490734 10648 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:09.491442  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:09.492008  8251 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.493698 10791 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:09.424217 10795 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.494797 10791 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.496657 10795 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:09.478780 10825 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.498183 10825 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:09.500388 10800 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 1.245s	user 0.000s	sys 0.002s
I20260709 13:17:09.500785  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2048) took 1881 ms. Trace:
I20260709 13:17:09.472150 10832 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.501214  8250 rpcz_store.cc:276] 0709 13:17:07.619763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.851869 (+232106us) service_pool.cc:224] Handling call
0709 13:17:07.852177 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.988497 (+136320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.988529 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.996468 (+  7939us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.240192 (+1243724us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b18003422e0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:17:09.388167 (+147975us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:09.388228 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.388326 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:09.500479 (+112153us) raft_consensus.cc:1685] finished
0709 13:17:09.500502 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.500714 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121695,"raft.queue_time_us":172754,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":49209,"spinlock_wait_cycles":5427072,"thread_start_us":147731,"threads_started":1,"wal-append.queue_time_us":1492105}
I20260709 13:17:09.503319  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:09.503919 10832 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:09.381305 10842 consensus_queue.cc:1059] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:17:09.504581  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:09.464337 10384 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:09.504980  8251 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:09.475389  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:09.475750 10748 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:17:09.476003 10873 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:09.535574 10871 log.cc:927] Time spent T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:17:09.465975 10682 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:09.538429 10682 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:09.539430 10682 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:09.541908  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 66613.5us
W20260709 13:17:09.477372 10863 log.cc:927] Time spent T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:17:09.410418 10845 raft_consensus.cc:697] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:09.497745 10836 raft_consensus.cc:3055] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:09.504817 10842 consensus_queue.cc:1243] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 5033fc7e66374940a203908ea8b0078f log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:09.474318 10839 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:09.374483  8099 rpcz_store.cc:276] 0709 13:17:07.794205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.908281 (+1114076us) service_pool.cc:224] Handling call
0709 13:17:08.908667 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:08.909071 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.909100 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:08.959001 (+ 49901us) log.cc:844] Serialized 52 byte log entry
0709 13:17:09.142613 (+183612us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:09.151288 (+  8675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.171921 (+ 20633us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:09.263400 (+ 91479us) raft_consensus.cc:1685] finished
0709 13:17:09.263432 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.263620 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9600,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":1399,"thread_start_us":159998,"threads_started":1,"wal-append.queue_time_us":215692}
I20260709 13:17:09.488957  8255 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:17:09.542778  8223 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:09.541934  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.543967  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.550714  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:09.556836  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.576845  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:09.581758  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:09.582578  8250 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:17:09.585409 10839 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:17:09.590270  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 47603.6us
I20260709 13:17:09.579483 10735 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:09.591265  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:09.591785 10735 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.592175 10795 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:09.592540  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:09.592815 10790 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:09.593622 10790 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:09.594923  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:09.595505  8256 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:09.596306 10790 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:09.597513 10845 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.599129 10788 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:09.596537  8256 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:09.601240 10788 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:09.602216  8256 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:17:09.602465 10790 raft_consensus.cc:3055] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:09.602857 10790 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:09.603631 10790 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:09.603631  8256 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:09.597185 10848 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.607319 10848 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:09.608952  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:09.555373 10748 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:17:09.610917  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 182462us
I20260709 13:17:09.611181  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:09.611814  8103 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:09.554891 10836 raft_consensus.cc:740] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:09.592378 10735 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:09.623090  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:09.625141  8099 raft_consensus.cc:2368] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5.
I20260709 13:17:09.622534  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:09.625850  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:09.625953  8108 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:09.626638  8100 raft_consensus.cc:2410] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:17:09.618615 10863 log.cc:927] Time spent T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:09.627195  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:09.424798 10823 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.632908  8103 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.633884  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:09.635341  8099 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:09.574636 10667 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.637234  8250 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:09.563230 10675 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.641837  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.645370  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:09.647984  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:09.649046  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:09.650324  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.656388  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:09.656981  8100 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.674935  8250 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:09.679204  8252 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:17:09.679921 10836 consensus_queue.cc:260] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.681535 10836 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:09.685909 10795 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:09.686777  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:09.687992  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.692425  8103 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:09.690694  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:09.694258  8099 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:09.657625  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:09.701124  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:09.703786  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:09.650712 10667 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.706878  8250 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:09.691262 10700 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.697335 10820 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:09.656098 10675 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.708274 10731 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:09.706451 10601 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:09.704619  8784 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:09.710947 10877 log.cc:927] Time spent T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:17:09.713539 10828 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.062s	user 0.002s	sys 0.000s
W20260709 13:17:09.716406  8105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1061) took 1488 ms (client timeout 1823 ms). Trace:
I20260709 13:17:09.719156 10675 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:09.720849  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:09.721107 10667 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:09.722565  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:09.733798  8103 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:17:09.709640 10700 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:09.736114  8105 rpcz_store.cc:269] 0709 13:17:08.231486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.267784 (+ 36298us) service_pool.cc:224] Handling call
0709 13:17:09.716217 (+1448433us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54003a4b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:09.716348 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":690554240}
I20260709 13:17:09.709858 10820 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:09.739890  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:09.740293  8250 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:09.740629  8103 pending_rounds.cc:85] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 7
I20260709 13:17:09.743300  8252 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:09.743465  8103 pending_rounds.cc:107] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:17:09.741245  8100 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:09.743870  8103 raft_consensus.cc:2889] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:09.745654  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:09.739087 10613 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:09.749580  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:09.750619  8100 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:09.744508 10820 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.746380 10731 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:09.762095  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:09.769879 10708 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:17:09.771092 10891 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:17:09.773712  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:09.775291  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:09.775512  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:09.779544  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1060) took 1578 ms. Trace:
I20260709 13:17:09.783072 10707 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:09.787310  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:09.788215  8102 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:09.789098  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:09.789762  8102 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:17:09.790561 10700 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:09.791882  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:09.792485  8250 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:09.793529 10795 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:09.794065 10795 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.796047  8099 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:09.779543  8100 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:09.797294  8099 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:09.779994  8104 rpcz_store.cc:276] 0709 13:17:08.201494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.004099 (+802605us) service_pool.cc:224] Handling call
0709 13:17:09.029055 (+ 24956us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.109206 (+ 80151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.109235 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.130799 (+ 21564us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.382786 (+251987us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:09.382905 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.383188 (+   283us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:09.779341 (+396153us) raft_consensus.cc:1685] finished
0709 13:17:09.779362 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.779483 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":209738,"threads_started":1,"wal-append.queue_time_us":432211}
W20260709 13:17:09.803910 10896 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:17:09.810520 10897 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:17:09.817058  8107 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:09.818552  8107 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:09.819388  8102 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:09.762060 10825 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:09.780521  8249 raft_consensus.cc:2376] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6. Re-sending same reply.
W20260709 13:17:09.822450  8249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60806 (request call id 336) took 2315 ms (client timeout 2526 ms). Trace:
W20260709 13:17:09.822863  8249 rpcz_store.cc:269] 0709 13:17:07.507301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.524298 (+ 16997us) service_pool.cc:224] Handling call
0709 13:17:09.775121 (+2250823us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b5800052298. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27e9c 00007fa59dd27a5b 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:09.822364 (+ 47243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4042496}
I20260709 13:17:09.823690 10825 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:09.820847 10700 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.824648 10700 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.818398  8784 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:09.830775  8100 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:17:09.831976  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:09.832206 10881 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:09.834189  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:09.835294  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:09.841384  8223 leader_election.cc:400] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5.
I20260709 13:17:09.841847  8223 leader_election.cc:403] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:09.824568 10815 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:09.859021  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:09.859843  8250 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:09.859859  8223 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:09.854156 10793 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5.
W20260709 13:17:09.863026  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.848611 10810 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:09.864219 10700 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:09.864328 10810 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:09.865051 10810 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:09.851435 10845 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:09.865816 10845 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.866209 10845 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.870339 10873 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:09.873003  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:09.871588 10148 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:09.883431  8223 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:09.892030  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:09.892875  8175 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:09.900830  8223 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:09.904994  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:09.908926  8181 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:09.909772  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:09.911280  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:09.914460  8180 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:09.911341  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:09.915723  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:09.891012 10148 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:09.891284 10873 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:09.919608  8181 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:09.909104 10584 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:09.923806 10584 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:09.920166  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:09.918454 10820 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:09.926292  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.927687 10820 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:09.929083 10584 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:09.929697  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:09.929765 10148 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:09.930322  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:09.930941 10148 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:09.931602  8101 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:17:09.932737  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:09.921099 10873 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:09.933864 10873 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.935344 10810 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:09.938562 10735 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:09.939715  8105 raft_consensus.cc:2368] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5.
I20260709 13:17:09.940724 10735 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:09.909935 10748 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:09.942186  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:09.942463  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:09.943468  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:09.944070  8177 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:09.944523  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:09.944612  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:09.945021  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:09.946300  8107 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:09.946453  8183 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:09.912349 10793 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:09.930965  8100 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:17:09.951197  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:09.951444  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:09.951810  8107 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.942813  8180 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:09.971782  8174 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:09.984874  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:09.986096  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 81291.2us
I20260709 13:17:09.986255  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:09.987147  8179 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 4: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:09.987830 10885 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.995846  8175 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
W20260709 13:17:10.007699  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.984153 10810 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:10.012327  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:09.977937 10826 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:10.020272  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.990978 10881 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.012627  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:09.984007 10748 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:09.985603 10793 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:10.024649  8252 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:10.021067  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:10.035665 10684 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:10.036228 10684 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.025584  8107 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:10.030297  8175 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:17:10.042106  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.045922  8107 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:10.051074  8105 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:10.052985  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:10.053102  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:10.053929  8178 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:10.055403 10810 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:10.055488 10748 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.057106  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:10.057720  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:10.059027  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:10.060316  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:10.065821  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:10.057761  8179 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:10.069762  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:10.070577  8179 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:10.077385  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:10.078192  8175 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:10.090438 10613 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:10.091149 10613 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.011802 10885 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.102725 10613 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:10.103247  8783 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:10.073983 10384 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:10.106796  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:10.027364 10826 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.114217  8175 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
W20260709 13:17:10.117296  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.117712 10613 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.118261 10613 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.118988  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:10.120504 10613 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:10.120955  8182 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:10.124550  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:10.126411  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:10.067420 10795 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.084756 10825 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 13:17:10.121577  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 363731us
W20260709 13:17:10.134028  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 358464us
I20260709 13:17:10.128144  8783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 721) took 1670 ms. Trace:
I20260709 13:17:10.150336  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:10.132736 10619 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:10.164218  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:17:10.165953  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.147158 10808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.460s	user 0.014s	sys 0.008s
I20260709 13:17:10.169198  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:10.135643 10675 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:10.176491  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:10.151398  8783 rpcz_store.cc:276] 0709 13:17:08.457280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.463165 (+  5885us) service_pool.cc:224] Handling call
0709 13:17:10.102392 (+1639227us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:17:10.102758 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.107784 (+  5026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.128051 (+ 20267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34008448}
I20260709 13:17:10.128278 10793 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:10.174010 10808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.487s	user 0.014s	sys 0.009s
I20260709 13:17:10.149410 10565 raft_consensus.cc:3055] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:10.176426 10438 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:17:10.178804 10565 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:10.172617  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:10.179920 10565 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.181161 10565 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:10.181536  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.176379  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:10.183650  8250 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:10.184549 10823 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:10.176759 10817 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:10.185753 10817 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:10.186225 10817 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.187759  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:10.190208  8149 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:10.146960 10695 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:10.192468  8175 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:10.161808 10815 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:10.197259 10053 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:10.197705 10053 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.167429 10825 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:10.133157 10384 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.199824  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:10.175163 10648 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.161547 10636 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:17:10.188256 10735 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:10.189152 10619 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:10.189684 10823 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:10.196213 10881 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:10.174325 10763 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:17:10.195351 10815 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:10.201237 10802 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:10.197719 10882 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:10.200304 10053 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:10.200403 10582 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.201857 10675 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:10.207906 10700 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.210606 10584 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:10.207259 10810 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:10.212363 10735 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:10.202793 10695 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.210054 10820 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:17:10.209888 10531 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:17:10.227329 10745 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:17:10.235118 10675 raft_consensus.cc:697] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:10.240481 10735 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.305984  8149 leader_election.cc:400] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5.
I20260709 13:17:10.233322 10802 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.235208 10582 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.289515 10584 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:10.341660  8105 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:10.237912 10845 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.350270  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:10.258095 10700 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.345726  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:10.356254  8102 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:10.259635 10810 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.345108  8248 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:10.357023  8105 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:10.358247  8250 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:10.350212 10747 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:10.384835  8252 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:10.347502 10795 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:10.350059 10885 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:10.417306  8252 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 13:17:10.394930  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 341903us
I20260709 13:17:10.338421 10820 consensus_queue.cc:1059] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
W20260709 13:17:10.421743  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.367369 10826 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:10.436460  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:10.437862  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:10.380025 10906 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:10.436950  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:10.469481  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.474092  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.477393  8102 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:17:10.479097  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.416554 10793 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:10.487241  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:10.348196 10619 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:10.490700  8074 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.130:46389 timed out after 1.748s (SENT) [suppressed 19 similar messages]
I20260709 13:17:10.384857 10695 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:10.495282  8179 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:10.395905 10531 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:17:10.393872 10763 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:17:10.501600  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:10.483439 10795 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:10.390934 10815 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.499275 10832 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:10.509250 10763 consensus_queue.cc:1243] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:17:10.507237 10695 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:10.419910 10675 consensus_queue.cc:237] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.544158 10438 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.482568 10906 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.584388  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:10.585616  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:10.588660  8250 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:10.590251 10912 log.cc:927] Time spent T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:17:10.591544  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2034) took 2200 ms. Trace:
I20260709 13:17:10.497270 10793 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:10.577325 10908 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 13:17:10.578116 10913 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:17:10.578787 10845 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:10.579059 10790 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:10.506803 10584 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.572091 10881 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:17:10.579937 10695 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.518653 10905 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.294s
I20260709 13:17:10.519044 10918 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:17:10.581658 10848 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:17:10.544637 10910 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:17:10.518960 10795 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:10.569653 10832 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.591905  8257 rpcz_store.cc:276] 0709 13:17:08.391216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.391444 (+   228us) service_pool.cc:224] Handling call
0709 13:17:08.425879 (+ 34435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:08.555157 (+129278us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:17:08.555206 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:08.569330 (+ 14124us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.042719 (+1473389us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b1800122ec0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:17:10.205477 (+162758us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:10.205534 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.205627 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.591244 (+385617us) raft_consensus.cc:1685] finished
0709 13:17:10.591261 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.591474 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149349,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":32142,"spinlock_wait_cycles":3910016,"thread_start_us":272697,"threads_started":2,"wal-append.queue_time_us":1793645}
W20260709 13:17:10.596194 10909 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 13:17:10.598408  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:10.600365  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.608007  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 116921us
I20260709 13:17:10.566838 10885 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:10.577355 10648 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:10.604633 10907 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 13:17:10.608769 10667 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.611330 10802 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:10.595633 10438 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.598004 10636 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:17:10.612748 10825 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:10.625631 10873 consensus_meta.cc:287] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.691s	user 0.008s	sys 0.004s
I20260709 13:17:10.628320 10795 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:10.603767 10763 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:17:10.641314 10700 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:10.647250 10667 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.666038 10667 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:10.668540 10438 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:10.670627 10915 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:10.672159  8104 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:10.673401  8103 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:17:10.668998 10148 consensus_meta.cc:287] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.738s	user 0.008s	sys 0.004s
I20260709 13:17:10.681653 10582 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:10.684082 10695 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:10.639562 10885 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.687026 10885 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:10.693499  8105 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:10.698323  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 196827us
I20260709 13:17:10.699309  8223 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:10.702561 10922 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:17:10.706036 10748 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:17:10.706450 10684 consensus_meta.cc:287] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.670s	user 0.012s	sys 0.000s
I20260709 13:17:10.706861 10684 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.701543 10885 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.707567  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:10.649546 10920 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:17:10.714789  8106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 377) took 2930 ms (client timeout 2852 ms). Trace:
I20260709 13:17:10.656118 10808 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:10.715315  8106 rpcz_store.cc:269] 0709 13:17:07.782904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.002109 (+219205us) service_pool.cc:224] Handling call
0709 13:17:10.712581 (+2710472us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b540036ddd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:10.712721 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976046976}
I20260709 13:17:10.714920 10845 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:17:10.712921 10565 consensus_meta.cc:287] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.001s
I20260709 13:17:10.721195  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:10.726975  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 728) took 1586 ms. Trace:
I20260709 13:17:10.735847  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:10.733603  8791 rpcz_store.cc:276] 0709 13:17:09.140744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.141059 (+   315us) service_pool.cc:224] Handling call
0709 13:17:09.141482 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.141923 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.141951 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.948228 (+806277us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b2c00047c48. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:17:09.948649 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.168121 (+219472us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:10.168177 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.168246 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.718614 (+550368us) raft_consensus.cc:1685] finished
0709 13:17:10.718637 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.726904 (+  8267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":78,"spinlock_wait_cycles":10178816,"thread_start_us":218871,"threads_started":1,"wal-append.queue_time_us":278834}
I20260709 13:17:10.655378 10825 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.739846  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1977) took 1040 ms. Trace:
I20260709 13:17:10.655778 10873 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.716282 10920 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:10.716995 10685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.281s	user 0.022s	sys 0.016s
I20260709 13:17:10.712443 10763 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:17:10.775729  8099 rpcz_store.cc:276] 0709 13:17:09.699420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.800926 (+101506us) service_pool.cc:224] Handling call
0709 13:17:09.801310 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.803751 (+  2441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.803778 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.804440 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.142505 (+338065us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:10.142571 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.142672 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.739563 (+596891us) raft_consensus.cc:1685] finished
0709 13:17:10.739594 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.739770 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9677,"raft.queue_time_us":19579,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":337611,"threads_started":1,"wal-append.queue_time_us":418535}
W20260709 13:17:10.782341  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 46578.3us
I20260709 13:17:10.709682 10885 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:10.740742  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.728428 10748 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:10.729079 10053 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.801079  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:10.791666 10685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.363s	user 0.022s	sys 0.017s
I20260709 13:17:10.725781 10808 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.729262 10735 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.794193 10845 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:10.823956 10808 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:10.825402 10911 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:17:10.826676 10845 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:10.827744 10845 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.827919 10920 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.829099 10920 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.829617 10793 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:10.807430 10685 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:10.834350 10873 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:10.824781 10802 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:10.846122  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.838529  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2047) took 1344 ms. Trace:
I20260709 13:17:10.839296 10795 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:10.843784  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.807173 10748 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:10.849215  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2035) took 1905 ms. Trace:
W20260709 13:17:10.857446  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.853045  8253 rpcz_store.cc:276] 0709 13:17:08.944266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.187880 (+243614us) service_pool.cc:224] Handling call
0709 13:17:09.195457 (+  7577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.257674 (+ 62217us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:09.257985 (+   311us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.426453 (+168468us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.427600 (+  1147us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:09.427650 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.848944 (+1421294us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b540030cfd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:10.848994 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.849149 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32024,"prepare.queue_time_us":26133,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":62413,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":16454,"spinlock_wait_cycles":142523264,"thread_start_us":126063,"threads_started":1,"wal-append.queue_time_us":227510,"wal-append.run_cpu_time_us":1187,"wal-append.run_wall_time_us":1001208}
I20260709 13:17:10.841544 10836 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.841244 10848 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:17:10.848805 10817 consensus_meta.cc:287] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.660s	user 0.006s	sys 0.005s
W20260709 13:17:10.863719  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.848824 10882 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.846580  8256 rpcz_store.cc:276] 0709 13:17:09.494274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.606387 (+112113us) service_pool.cc:224] Handling call
0709 13:17:09.612587 (+  6200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.624880 (+ 12293us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:09.651226 (+ 26346us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.706603 (+ 55377us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.706666 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:09.706721 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.838262 (+1131541us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b54002e8954. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:10.838314 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.838468 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26641,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1953,"raft.queue_time_us":93,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":27811200,"thread_start_us":54399,"threads_started":1,"wal-append.queue_time_us":70342,"wal-append.run_cpu_time_us":2210,"wal-append.run_wall_time_us":1082792}
I20260709 13:17:10.866792  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:10.866900  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:10.869452  8257 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:10.870762  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:10.866665 10887 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 1.277s	user 0.006s	sys 0.000s
I20260709 13:17:10.852567 10582 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:17:10.897680  8256 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:10.858389 10802 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.901839  8253 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:10.911949  8257 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:10.892841 10053 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:10.866652 10836 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.894039 10832 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:10.920455  8250 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:10.870463 10817 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:10.872145 10882 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:10.918398 10816 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.219s	user 0.026s	sys 0.019s
W20260709 13:17:10.929970  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 75769us
I20260709 13:17:10.938556 10802 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:10.923808 10748 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:10.940758 10817 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:10.916378 10685 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:10.945467  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.957142  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.928893 10816 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.230s	user 0.026s	sys 0.020s
I20260709 13:17:10.967753 10882 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:10.968937 10795 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:10.955650 10885 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:10.977912 10842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.008s	sys 0.002s
W20260709 13:17:10.978509 10842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.008s	sys 0.002s
I20260709 13:17:10.969169 10684 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:11.006198  8248 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
W20260709 13:17:11.055038  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.125792 10795 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:11.136734 10795 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:11.148409 10795 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:11.146206 10684 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:11.149039 10684 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.152521 10684 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:11.174288  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2040) took 1883 ms. Trace:
I20260709 13:17:11.174741  8254 rpcz_store.cc:276] 0709 13:17:09.291152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.173467 (+1882315us) service_pool.cc:224] Handling call
0709 13:17:11.173784 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.173962 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.173986 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:11.174026 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:11.174061 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.174111 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.174231 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:11.182665 10456 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:11.186815 10456 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:11.190356 10456 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:11.192340 10823 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:11.192785 10823 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:11.193904 10823 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:11.194895 10823 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:11.212993 10815 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:11.221685 10904 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.869s	user 0.008s	sys 0.003s
I20260709 13:17:11.223754  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:11.224164  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:11.224449  8100 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:11.225598  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:11.227905  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.230086  8182 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:11.232702  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.232957  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.233633  8181 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:11.235150  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.241971 10810 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:11.264845 10873 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.265450 10873 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:11.267654 10873 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:11.269739 10735 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:11.270579  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.271243  8180 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:11.271255 10885 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.271967 10885 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.274660 10885 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:11.275393 10885 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:11.276032 10885 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:11.277480 10903 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.175s	user 0.006s	sys 0.004s
I20260709 13:17:11.280107  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:11.284097  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:11.281507  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1975) took 1582 ms. Trace:
I20260709 13:17:11.294009  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:11.296543  8181 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:11.298853  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.300094  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.300853  8177 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:11.301662  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.281252 10816 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:11.302613 10816 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:11.302964  8176 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:17:11.303635  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2064) took 1358 ms. Trace:
I20260709 13:17:11.303452 10816 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:11.303968  8176 rpcz_store.cc:276] 0709 13:17:09.945402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.302379 (+1356977us) service_pool.cc:224] Handling call
0709 13:17:11.302728 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:11.303387 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.303580 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:11.304450 10816 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.305146  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.302626 10582 raft_consensus.cc:3055] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:11.306245 10582 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:11.307709  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.308036  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:11.308243  8183 raft_consensus.cc:2410] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:11.306205  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.302994  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.309182  8176 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:11.310158  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.289633  8108 rpcz_store.cc:276] 0709 13:17:09.698959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.797544 (+ 98585us) service_pool.cc:224] Handling call
0709 13:17:09.797868 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.798207 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.798236 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.798699 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.955592 (+156893us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:10.009333 (+ 53741us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.009629 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.009739 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:11.277106 (+1267367us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b24003f9518. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dbe59c4 00007fa59dbe3acb 00007fa59dd9edc9 00007fa59dd9ea55 00007fa59dd9e09d 00007fa5a09d010e 00007fa5a09e788c 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221
0709 13:17:11.281229 (+  4123us) raft_consensus.cc:1685] finished
0709 13:17:11.281322 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.281452 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3508,"prepare.queue_time_us":55635,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":3912,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":9716,"spinlock_wait_cycles":4392704,"thread_start_us":156438,"threads_started":1,"wal-append.queue_time_us":303159}
I20260709 13:17:11.275681 10832 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:11.316483  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.317373  8178 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:11.321269  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.322492  8181 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:17:11.286307 10456 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.289270 10812 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.298105 10954 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:11.294528 10885 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:11.315661 10708 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.339118  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:11.338573 10812 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.316054 10873 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:17:11.307098 10582 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.333457 10905 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.345535 10810 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:11.346077 10810 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.345671 10905 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.346487 10810 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:11.348153 10905 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:11.348917 10582 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.335134 10636 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.343788  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:11.351992  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:11.352681  8099 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:11.355226  8182 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:11.361765  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:11.364996  8099 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:11.340356 10885 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:11.365217  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:11.373791  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:11.333707 10832 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.360692 10748 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:11.336979 10456 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:11.371213 10791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.786s	user 0.013s	sys 0.011s
I20260709 13:17:11.362617 10840 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:11.340245 10954 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.343165 10708 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:11.370954 10735 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.373339 10873 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:11.413630 10684 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.415901 10953 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:11.423586 10791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.842s	user 0.014s	sys 0.011s
I20260709 13:17:11.362879 10636 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.418507 10748 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:11.479745 10953 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:11.477895 10684 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.444252 10735 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:11.543018  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.553730 10956 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.414918 10885 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.434234 10840 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.599882 10840 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:11.600287 10812 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:11.605515 10956 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.554332 10832 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:11.551901 10708 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:11.550549 10456 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:11.553200 10954 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:11.608978 10956 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:11.615062 10885 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:11.613590 10456 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:11.557976 10873 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:11.620949  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 69924.2us
I20260709 13:17:11.559157 10815 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:11.610536 10748 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:11.651773  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:11.635053 10955 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:11.658468  8791 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:11.654928  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:11.651968  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:11.661957 10636 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:11.675720  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.663966 10832 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:17:11.676916  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.664952 10956 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:11.622339 10810 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:11.665612 10954 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:11.673954 10962 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:11.665721 10748 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.679153 10956 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.636287 10456 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:11.682408  8179 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:11.638934 10815 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:11.645632 10885 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:17:10.489665  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:11.707177 10959 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.343s	user 0.002s	sys 0.000s
I20260709 13:17:11.710028 10839 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:11.687305 10956 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.717995  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.718573  8174 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:11.718894  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2072) took 1661 ms. Trace:
W20260709 13:17:11.719450  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.719099  8174 rpcz_store.cc:276] 0709 13:17:10.057808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.717739 (+1659931us) service_pool.cc:224] Handling call
0709 13:17:11.718852 (+  1113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:11.677362 10955 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.733623  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:11.680714 10873 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:11.789865  8791 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:11.776261 10920 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:11.778291 10825 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:11.780115 10735 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:11.796649  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 116736us
I20260709 13:17:11.797941  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:11.781181 10953 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:11.800860  8183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2073) took 1742 ms (client timeout 1576 ms). Trace:
I20260709 13:17:11.785514 10684 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:11.809952  8183 rpcz_store.cc:269] 0709 13:17:10.058126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.279816 (+1221690us) service_pool.cc:224] Handling call
0709 13:17:11.800623 (+520807us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b54001c39d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:11.800780 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62676224}
I20260709 13:17:11.795852 10885 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.799273 10825 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.809705 10735 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.839380 10968 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.839226 10735 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.840191 10968 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.823192 10954 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:17:11.848361 10810 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:11.849571  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.850068  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.850258  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:11.826802 10684 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:11.850885 10684 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.851397 10684 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:11.797778 10920 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.853044 10812 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:17:11.854868 10384 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:11.850914  8786 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:17:11.856614 10885 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.858914 10815 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:11.864207 10954 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:11.866139 10807 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:11.866755 10807 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:11.862895 10885 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:11.875897  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 76440.2us
I20260709 13:17:11.855508 10920 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:11.877053  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:11.879228  8755 leader_election.cc:400] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7.
I20260709 13:17:11.879635  8755 leader_election.cc:403] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:11.879791  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.881892  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:11.847185 10955 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:11.888986  8786 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:11.836028 10842 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.851778 10825 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:11.905953  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.909854  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 176329us
I20260709 13:17:11.893085 10456 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:11.892581 10885 raft_consensus.cc:2764] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:17:11.914354  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:11.915406  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:11.917150  8099 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:11.911176  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:11.953750  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:11.954463  8108 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:11.905833  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:11.960328  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:11.963346  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:11.969009  8105 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:17:11.956372  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45302.8us
I20260709 13:17:11.967249  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:11.970312  8104 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:11.955582  8785 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:11.971626  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:11.972499  8147 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:11.972407  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:11.972707  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:11.986955  8103 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:17:11.987421  8100 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.899214 10842 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:11.989902  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:11.992358  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:11.992946  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:11.993927  8252 raft_consensus.cc:2410] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:11.978053 10954 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:11.978703  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:11.979228  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.003726  8255 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 6: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:11.981817  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:11.983395 10825 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:11.906785 10955 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:11.953507 10965 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.972152 10953 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:17:11.988170  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:12.054373  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.054857  8177 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:11.995874 10708 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:12.055886  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:12.055819 10684 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:11.988793  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.056932  8177 raft_consensus.cc:2410] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:12.057581  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.988101  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.058310  8176 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:12.058900  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.059168  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.059746  8176 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:17:12.060041  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.060633  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:11.905712 10969 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7.
I20260709 13:17:11.996001  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:11.995934  8252 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:17:12.061820  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 65899.3us
I20260709 13:17:12.062458  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:12.063591  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:12.063952  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:12.064114  8252 raft_consensus.cc:2376] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5. Re-sending same reply.
W20260709 13:17:11.997040  8248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2085) took 1655 ms (client timeout 1575 ms). Trace:
W20260709 13:17:12.064767  8248 rpcz_store.cc:269] 0709 13:17:10.341542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.401673 (+ 60131us) service_pool.cc:224] Handling call
0709 13:17:11.996838 (+1595165us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540020a154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:11.996962 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837875968}
I20260709 13:17:12.065892 10972 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:17:12.066215  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:11.997753  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.066799 10745 raft_consensus.cc:3055] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:12.067178 10745 raft_consensus.cc:740] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:12.067333  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.067657  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.067955  8248 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:12.068795  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.068852  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:11.997814  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:12.069635 10815 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:12.070039 10815 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.070406 10815 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:12.067957  8106 raft_consensus.cc:2368] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:12.065073  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.071511  8252 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:17:12.072364  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:12.000082 10939 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:12.000512 10836 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:11.964999 10967 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:11.997702  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:12.002077  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:11.968276 10735 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:12.004885  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.008503  8108 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:11.971513  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:12.018448  8254 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:12.019351  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2075) took 1537 ms. Trace:
I20260709 13:17:12.020367  8105 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 2 index: 2. (term mismatch)
I20260709 13:17:12.091296  8105 pending_rounds.cc:85] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 1
I20260709 13:17:12.091612  8105 pending_rounds.cc:107] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:17:12.091902  8105 raft_consensus.cc:2889] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:12.092283  8105 pending_rounds.cc:107] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:17:12.092520  8105 raft_consensus.cc:2889] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:12.023103  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:12.093673  8251 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:12.024313  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.095753  8252 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:12.029721  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.030957 10968 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:12.031391  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:12.042162 10965 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.016556 10820 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:12.051071 10842 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:11.911515 10807 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.053283 10840 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.056326 10708 raft_consensus.cc:697] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:12.057740  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.147015  8177 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:11.989524  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.061117  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:11.999396  8103 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:12.074144  8248 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:12.074522  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:12.150602  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 76162us
I20260709 13:17:12.069181  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.096786  8257 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 8: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:12.016785 10954 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.099268  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.104763  8100 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:12.097854  8256 raft_consensus.cc:2376] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5. Re-sending same reply.
I20260709 13:17:12.114233  8174 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:12.155239  8252 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:12.069677 10970 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:17:12.081420 10939 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.089349  8175 rpcz_store.cc:276] 0709 13:17:10.482258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.482399 (+   141us) service_pool.cc:224] Handling call
0709 13:17:10.483156 (+   757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.586134 (+102978us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:10.586378 (+   244us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.865923 (+279545us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.266177 (+400254us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b1800393d00. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dcd9c0a 00007fa5a7419219 00007fa59dd61a40 00007fa59dd5c4e4 00007fa59dd5c455 00007fa5a0e44060 00007fa5a0e56716 00007fa5a0e67287 00007fa5a0e67208
0709 13:17:11.296391 (+ 30214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:11.296464 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:11.296530 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.019098 (+722568us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400331654. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:12.019158 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:12.019290 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":411166,"prepare.queue_time_us":421474,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":417640,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":22959,"spinlock_wait_cycles":274541696,"thread_start_us":297167,"threads_started":2,"wal-append.queue_time_us":316083,"wal-append.run_cpu_time_us":1646,"wal-append.run_wall_time_us":1024629}
I20260709 13:17:12.084164 10384 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:12.108635 10820 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:12.069198 10684 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:12.148137  8181 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:17:12.073624 10456 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:17:12.087416 10825 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:12.154592 10842 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:12.178099 10939 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.202128  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1993) took 1835 ms. Trace:
I20260709 13:17:12.181725 10920 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:12.153775  8251 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:12.184396  8253 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:12.189692 10791 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:12.179311  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 295007us
I20260709 13:17:12.154971 10968 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.145987 10836 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:12.162922 10735 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:12.163103 10954 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.202658  8101 rpcz_store.cc:276] 0709 13:17:10.366948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.367121 (+   173us) service_pool.cc:224] Handling call
0709 13:17:10.367471 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:10.416952 (+ 49481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:10.416988 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:10.418818 (+  1830us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.600974 (+182156us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:10.863944 (+262970us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.864848 (+   904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.197992 (+1333144us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b540036f6d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:12.198042 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:12.198093 (+    51us) raft_consensus.cc:1685] finished
0709 13:17:12.201915 (+  3822us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:12.202063 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36706,"prepare.queue_time_us":68696,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":80446,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":22116,"spinlock_wait_cycles":56444800,"thread_start_us":334579,"threads_started":2,"wal-append.queue_time_us":291114,"wal-append.run_cpu_time_us":2668,"wal-append.run_wall_time_us":1192655}
I20260709 13:17:12.256584  8101 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:12.106003 10967 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.107481 10745 consensus_queue.cc:260] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.184846 10384 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.206182 10810 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.221129  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:12.106901 10663 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.262905  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:12.215160  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:12.267299  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:12.270581  8101 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:12.269294  8105 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:17:12.200048 10842 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.320818  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:12.257019  8249 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260709 13:17:12.321027  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 348850us
W20260709 13:17:12.326668  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.328577  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:12.329210  8105 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:12.331390  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:12.332212  8100 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:17:12.332600  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:12.334483  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:12.337368  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:12.333657  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 182146us
I20260709 13:17:12.290409 10745 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:12.341177  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:12.325977  8249 pending_rounds.cc:85] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 3
I20260709 13:17:12.342957  8785 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:12.343829  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.257253 10836 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.347376  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:12.257351 10920 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.317456 10906 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:12.258769 10791 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.355520 10983 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:12.284449 10810 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.286954 10968 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.356626  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.343829 10832 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:12.361914  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.362918  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.364115  8100 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:12.288084 10646 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:17:12.356232  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:12.365203  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:12.292855 10663 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.252847 10820 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.356626  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.345422  8249 pending_rounds.cc:107] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:17:12.381309  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.359699  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:12.385177  8755 connection.cc:256] RPC call timeout handler was delayed by -1.0411732390000452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
I20260709 13:17:12.330062 10582 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:17:12.424557  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:12.351632 10456 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:17:12.377694 10840 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:12.430382  8099 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:12.421240  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.431552  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:12.433883  8101 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:12.452576  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:12.452886  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:12.453298  8101 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:12.435640  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:12.450448  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.455494  8100 raft_consensus.cc:2410] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:12.322949 10708 consensus_queue.cc:237] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.398276 10985 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:12.457233  8178 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
W20260709 13:17:12.464206  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 137331us
I20260709 13:17:12.421940  8249 raft_consensus.cc:2889] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:12.467716  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.477367  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:12.483871  8099 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:12.388094 10816 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:17:12.419930 10982 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:12.498072  8785 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:17:12.455278  8783 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:12.436936 10981 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:12.387850 10983 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:12.508555  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 143422us
I20260709 13:17:12.456893 10986 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:12.527644  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:12.528328  8791 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:12.525085  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:12.519387  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.491081 10906 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:12.532804  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:12.494591 10971 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:12.544354  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.506888 10997 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.518604 10918 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:12.550448  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.554636  8251 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:12.555766  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.556526  8251 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:12.559294  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.552462  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:12.560010  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:12.560869  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1130) took 1277 ms. Trace:
I20260709 13:17:12.561234  8180 rpcz_store.cc:276] 0709 13:17:11.283362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.534818 (+1251456us) service_pool.cc:224] Handling call
0709 13:17:12.560812 (+ 25994us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:12.561848  8107 raft_consensus.cc:2410] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:12.562642  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:12.563254  8251 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:12.563194  8107 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:17:12.564834  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:12.494975 10582 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:17:12.543334 10816 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:12.571393 10842 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:12.567420 10971 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.571796 10582 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:12.572319 10582 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:12.573516 10971 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:12.573601 10983 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:12.573241 10582 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.517503 10982 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.574409 10971 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:12.541332 10906 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:12.573537  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:12.576491  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 72536.5us
I20260709 13:17:12.574810 10971 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.592749 10971 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:12.552475 10986 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.517652 10980 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:17:12.604169 10992 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:12.604367 10967 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:12.604686 10992 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:12.605085 10384 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:12.606063 10456 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:12.605868 10992 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.606630 10456 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:12.553273 10997 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.540185 10981 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.567981 10873 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.607537 10992 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:12.612296 10956 consensus_meta.cc:287] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.883s	user 0.010s	sys 0.000s
I20260709 13:17:12.613771 10836 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:12.614727 10968 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:12.574913 10582 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.615592 10663 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:12.616420  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.609189 10999 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:12.617491 10906 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.618371 10999 raft_consensus.cc:697] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:12.619096 10906 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.599814 10986 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.619338 10999 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.603284 10982 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:12.493021 10985 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.610293  8100 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:12.429714 10531 consensus_queue.cc:1175] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a0f96c12124b4e1a816d9fa970464091" responder_term: 5 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: [4.2-4.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:12.612800 10956 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.575699 10816 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:12.624612  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.626917  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 120172us
W20260709 13:17:12.639998  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 107260us
I20260709 13:17:12.630986  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.640478  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:12.575210 10965 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:12.662981  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:12.667243  8149 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:12.661175  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.668411  8251 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:12.669261  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.670130  8786 raft_consensus.cc:2368] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8.
W20260709 13:17:12.610929 10815 consensus_meta.cc:287] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.000s
I20260709 13:17:12.664531 10053 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:12.607988  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.673755  8251 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:12.568202 10918 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.661806 10986 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:12.682770  8105 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:12.652737 10968 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:12.666687 10663 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:12.686444 10997 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:12.685074  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.681910 10815 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.690469 10985 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:12.692507 10939 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.693682  8183 raft_consensus.cc:2410] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:12.694062 10745 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:12.705818 10745 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:12.706455 10745 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:12.696009 10956 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:12.696563 10582 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:12.607645 10456 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.704422 10968 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.722241  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:12.723958 10968 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:12.697072 10991 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.336s	user 0.001s	sys 0.001s
I20260709 13:17:12.637730 10873 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:12.698899  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.676987 10980 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:12.709285  8176 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:12.710605 10939 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:12.709831 10815 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:12.703959 10816 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.748201 10816 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:12.681859 10967 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.750885  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.715834 10663 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:12.720664  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.739215  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:12.701277 10992 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.718250 10820 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:12.746083  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:12.749717 10967 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.741863 10968 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:12.757031  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.738229 10980 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.720139 10735 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:12.754474 11007 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:12.777310  8248 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:17:12.787251  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:12.785296 10980 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.754817 11016 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.803048  8101 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:12.801031  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:12.810074  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 74087.3us
I20260709 13:17:12.776674  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:12.815008  8250 raft_consensus.cc:2410] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:12.816397  8255 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:17:12.816392  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.822183  8248 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:12.773038 10992 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.822355  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:12.787782 11014 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:12.806039 11004 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.808979 11007 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:12.824666  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:12.779637 10968 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.825105 10815 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:12.826956  8782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 732) took 1177 ms. Trace:
I20260709 13:17:12.822412 11016 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.828867 10967 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:12.819383 10735 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:12.838549  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:12.844415  8074 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:12.845217 11007 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.846547 10986 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:12.847030 10986 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.847453 10986 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:12.846680 11015 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:17:12.848357  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:12.824548 11014 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.851119  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:12.853657  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:12.851861  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:12.856703 11014 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:12.858238 11000 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:12.861714 11012 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:12.862028 11009 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:17:12.864351 11006 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:17:12.866628  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:12.869550 10815 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:12.870007 10873 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:12.870106 10815 raft_consensus.cc:697] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:12.871416 10968 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:12.825500 10663 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.871695 10815 consensus_queue.cc:237] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.865468 11014 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.874485 10967 consensus_queue.cc:1059] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:12.874974 10962 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:12.875326 10873 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:12.875747 10873 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:12.876149 11014 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:12.876595 10873 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.885736 10873 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.886224 10967 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.886742 10967 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.888702 10967 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:12.884831 11016 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:12.875423 10962 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:12.890576 10962 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.891788 10962 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:12.892752 10954 consensus_meta.cc:287] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.616s	user 0.003s	sys 0.005s
I20260709 13:17:12.876993 10845 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:12.884799 10980 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.899359 10845 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:12.848134 10985 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:12.895987 10825 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:17:12.936468  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.837037  8782 rpcz_store.cc:276] 0709 13:17:11.649312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.651209 (+  1897us) service_pool.cc:224] Handling call
0709 13:17:11.651513 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.775993 (+124480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.777527 (+  1534us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:11.781920 (+  4393us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:11.783209 (+  1289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.826695 (+1043486us) spinlock_profiling.cc:243] Waited 96.2 ms on lock 0x7b5400316854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:12.826750 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:12.826886 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221289344}
I20260709 13:17:12.870167 10745 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.982831 10918 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:12.841800 10971 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:12.895727 11014 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.893199 10954 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.982398 10992 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:12.899895 10845 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:12.990571  8100 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:17:12.980912 10825 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:12.990691  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 318602us
I20260709 13:17:12.834930 11004 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.894865 10986 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:12.997362  8789 raft_consensus.cc:2368] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8.
I20260709 13:17:12.997648  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:12.998430  8252 raft_consensus.cc:2376] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4. Re-sending same reply.
W20260709 13:17:12.999528 11019 log.cc:927] Time spent T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:17:12.999673  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:13.005455 10810 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:13.010866  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:13.011747  8252 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:13.012997 10971 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:13.013612  8181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:13.019738  8181 raft_consensus.cc:606] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.020210  8181 raft_consensus.cc:614] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:13.020804 11004 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:13.023180 10986 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:13.026381 10954 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:13.026957  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:12.996264 10825 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:13.033505  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.043726  8103 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:12.991283 11014 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.037786  8252 raft_consensus.cc:2410] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:17:13.046600 11014 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:13.038591  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:13.049227  8249 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:13.051362 10745 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:13.052942  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2082) took 1067 ms. Trace:
I20260709 13:17:13.053369  8183 rpcz_store.cc:276] 0709 13:17:11.985835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.986031 (+   196us) service_pool.cc:224] Handling call
0709 13:17:13.052711 (+1066680us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54002f8d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:13.052858 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434476288}
I20260709 13:17:13.064507  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:13.065632 10810 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:13.066213 10920 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:13.067809 10920 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:13.051414  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2102) took 1025 ms. Trace:
I20260709 13:17:13.068665  8257 rpcz_store.cc:276] 0709 13:17:12.025999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.179145 (+153146us) service_pool.cc:224] Handling call
0709 13:17:12.196628 (+ 17483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:12.400707 (+204079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:12.400750 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:12.400806 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:12.400858 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.051125 (+650267us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54000898d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:13.051176 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.051348 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468823936}
I20260709 13:17:13.077708 11012 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:13.082114  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.084192 10735 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:13.069175  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:13.086580  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:13.090583  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:13.091341  8257 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
W20260709 13:17:13.099458  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.099761  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.100770  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.101913  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.102931  8790 raft_consensus.cc:2410] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:17:13.106940  8183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:13.107728  8183 raft_consensus.cc:606] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.111706  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.112536  8179 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:17:13.116477  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.117110  8175 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:13.118817  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.120941  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.121665  8182 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:17:13.122534  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:13.124467  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.126513  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.099030 11004 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:17:13.128455  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.135485  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:13.139194  8181 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.135108  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:13.140303  8183 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:13.141541  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.142567  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:13.143257  8175 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.127382  8176 raft_consensus.cc:2410] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:13.147675  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:13.148322  8174 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:13.148537  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.147801  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.152184  8180 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:13.076735 10825 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.122107 10845 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.179142 10845 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:13.160084 10979 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.803s	user 0.003s	sys 0.000s
I20260709 13:17:13.160714 11004 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:13.181457  8180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:13.182093  8180 raft_consensus.cc:606] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:13.182211 11004 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.184792  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1104) took 1266 ms. Trace:
I20260709 13:17:13.185230  8106 rpcz_store.cc:276] 0709 13:17:11.918597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.918747 (+   150us) service_pool.cc:224] Handling call
0709 13:17:13.184592 (+1265845us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540036e7d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:13.184741 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245679360}
I20260709 13:17:13.188643 10873 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:13.191056  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.162824 11007 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.196875  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:13.197780  8788 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.163746 10939 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:13.164022  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.200649  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:13.200915  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.204186  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.104671 10810 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
W20260709 13:17:13.207805 10970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.011s	sys 0.000s
W20260709 13:17:13.208205 10970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.011s	sys 0.000s
I20260709 13:17:13.166368 10967 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.209642  8180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:13.210263  8180 raft_consensus.cc:606] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:13.210021 10967 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.210700 10939 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:13.210700  8180 raft_consensus.cc:614] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:13.212769 10967 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:13.173283 10791 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:13.176398 10973 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.837s	user 0.007s	sys 0.002s
I20260709 13:17:13.213332  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 13:17:13.216238  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 784763us
I20260709 13:17:13.217197 10972 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:13.217473 10825 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:13.217738  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.217860 10972 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:13.219580 10972 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:13.220470  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.221100 10956 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:13.221822 11010 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:13.223744  8174 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:13.226053  8181 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:13.226557 10816 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:13.228762  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.229072  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.229853  8179 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
W20260709 13:17:13.230159  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 159435us
I20260709 13:17:13.228576  8182 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:13.110251 10918 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:17:13.231438  8183 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:13.232314 10918 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.232477  8175 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:13.233119  8180 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:13.232831 10918 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.233781  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.234514 10962 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:13.235018 10918 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:13.235117 10962 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.223788  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 740) took 1478 ms. Trace:
I20260709 13:17:13.235654 10953 raft_consensus.cc:2764] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:17:13.235638  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.241155  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.242213 10816 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:13.243279  8176 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:13.243461 11023 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:13.243979 11023 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:13.244748 10962 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:13.245970  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:13.247049 11020 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:13.247571 11020 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:13.244863 11023 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.246021  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.248786  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.248544 11020 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:13.249363  8176 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:13.249737  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.250334  8179 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:13.254426  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.255581  8182 raft_consensus.cc:2410] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:13.256223  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.256886  8174 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:13.257898 10970 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:13.258704 11010 consensus_queue.cc:1059] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:13.236334  8784 rpcz_store.cc:276] 0709 13:17:11.745468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.745948 (+   480us) service_pool.cc:224] Handling call
0709 13:17:11.779858 (+ 33910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:11.799499 (+ 19641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.807425 (+  7926us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:11.841934 (+ 34509us) log.cc:844] Serialized 26 byte log entry
0709 13:17:12.162783 (+320849us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:12.402726 (+239943us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.102342 (+699616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.113413 (+ 11071us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.175816 (+ 62403us) spinlock_profiling.cc:243] Waited 7.17 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:13.223477 (+ 47661us) raft_consensus.cc:1685] finished
0709 13:17:13.223578 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.223725 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":774352,"prepare.queue_time_us":32968,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":681576,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":21402,"spinlock_wait_cycles":16495872,"thread_start_us":491718,"threads_started":2,"wal-append.queue_time_us":411078}
I20260709 13:17:13.262467 10636 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:13.262909 10636 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:13.262763 10980 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:13.269023  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.300786  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.301589  8177 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:13.302534  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:13.304667  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.263741 10636 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:13.277252  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.278072 10981 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:13.306668 10981 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.307195 10981 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:13.308056 10636 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:13.307868  8002 catalog_manager.cc:5697] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 2 to 3, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 3 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.309362 10981 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:13.282164  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.310897  8002 catalog_manager.cc:5697] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.282897 10970 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:13.312039 10970 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:13.309494  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:13.312953 10970 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.314589 10970 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:13.316715  8005 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36106 (request call id 198) took 15726 ms (client timeout 15000 ms). Trace:
I20260709 13:17:13.310559 10873 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.318481 10873 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.320680 10873 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:13.322660  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:13.322964  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:13.323218  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:13.323729  8255 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 8: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:13.323828  8256 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.324025  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:13.324321  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:13.325026  8250 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
I20260709 13:17:13.325838  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:13.326363  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:13.326933  8250 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.327085  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:13.328083  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.291543  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:13.286554  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 52852us
W20260709 13:17:13.336120  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 44670.2us
I20260709 13:17:13.336760  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:13.292048 10839 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.004s	sys 0.008s
I20260709 13:17:13.296344 10807 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.299427 11023 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.337613 10832 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:13.338049 10832 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.338418 10832 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.269829  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.329041  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:13.342376  8181 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:13.345675 10839 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.005s	sys 0.008s
I20260709 13:17:13.349057  8250 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
W20260709 13:17:13.350594 11037 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:17:13.351899  8787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 750) took 1016 ms. Trace:
I20260709 13:17:13.352269  8787 rpcz_store.cc:276] 0709 13:17:12.335302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.335445 (+   143us) service_pool.cc:224] Handling call
0709 13:17:12.665838 (+330393us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:17:12.666019 (+   181us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.104841 (+438822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.104873 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:13.122594 (+ 17721us) log.cc:844] Serialized 26 byte log entry
0709 13:17:13.211972 (+ 89378us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:13.212005 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.212063 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.351597 (+139534us) raft_consensus.cc:1685] finished
0709 13:17:13.351616 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.351828 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":434978,"raft.queue_time_us":547189,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":4857088,"thread_start_us":53217,"threads_started":1,"wal-append.queue_time_us":147325}
I20260709 13:17:13.357131 10745 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:13.357582 10745 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.357936 10745 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.359638 10826 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.360038  8255 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:13.360132 10826 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:13.363850 10826 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:13.365422  8254 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:13.332314  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.334173  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.366478  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:13.366767  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:13.367233  8253 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:13.331787  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.368136  8177 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:17:13.368183  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:13.369279  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:13.369586 11038 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:13.369982 11038 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.334782  8256 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:13.370307 11038 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:13.365141 10745 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.373169 10745 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:13.369158 10961 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:13.295327  8788 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:13.374487 10961 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.374905 10961 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.376828  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:13.377579  8101 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:13.377892  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.335433  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.378656  8182 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:13.378758 11012 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.380102  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.380968 10986 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.382578  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.382967  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.393945  8101 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 2.
I20260709 13:17:13.394093 10986 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.330830  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:13.397830  8183 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:13.366503 10825 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:13.385898  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.388105  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:13.387812  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:13.399852  8108 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.385238  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.390285  8104 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:13.391047 11027 raft_consensus.cc:993] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:17:13.402923 11027 raft_consensus.cc:1081] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Signalling peer 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:17:13.401276 11020 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:13.403985  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:13.383970  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.404148 11020 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:13.405854  8106 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:13.388778  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:13.406270 10961 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.407023  8256 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.408406 10961 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:13.408195 10832 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:13.409606 11038 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.410434  8108 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:13.411720  8787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:48110
I20260709 13:17:13.411777 11038 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:13.412334  8787 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:13.412711  8787 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.415863  8256 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
W20260709 13:17:13.417927  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 81223us
I20260709 13:17:13.448053  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:13.419436  8787 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:13.449721  8788 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:13.421383 10986 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:13.453130  8106 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:13.421598 10970 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:13.424286 11012 consensus_queue.cc:1059] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:13.424463  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.425182 10971 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.406174 11020 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:13.433336 10832 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:13.443899  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:13.467955  8254 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.469849  8103 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:13.470966  8257 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:13.472357  8178 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:13.474255  8174 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:13.446586  8181 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:13.454871  8787 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:13.455075  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:13.475997  8182 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:13.458647  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:13.461539  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:13.453068 11042 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:17:13.464535  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:13.485556  8183 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:17:13.317327  8005 rpcz_store.cc:269] 0709 13:16:57.589980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.590144 (+   164us) service_pool.cc:224] Handling call
0709 13:17:13.316512 (+15726368us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:06.242372 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:06.261940 (+ 19568us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:06.261982 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:17:06.262002 (+    20us) tablet.cc:662] Decoding operations
0709 13:17:06.263107 (+  1105us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:06.263168 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:06.263197 (+    29us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:17:06.264267 (+  1070us) tablet.cc:701] Row locks acquired
0709 13:17:06.264289 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:17:06.264565 (+   276us) write_op.cc:270] Start()
0709 13:17:06.264679 (+   114us) write_op.cc:276] Timestamp: P: 1783603026264514 usec, L: 0
0709 13:17:06.264696 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:17:06.265500 (+   804us) log.cc:844] Serialized 4809 byte log entry
0709 13:17:06.736125 (+470625us) op_driver.cc:464] REPLICATION: finished
0709 13:17:06.872411 (+136286us) write_op.cc:301] APPLY: starting
0709 13:17:06.872657 (+   246us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:06.873137 (+   480us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:06.873338 (+   201us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:06.913744 (+ 40406us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:06.914204 (+   460us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:17:06.914251 (+    47us) write_op.cc:312] APPLY: finished
0709 13:17:06.914787 (+   536us) log.cc:844] Serialized 89 byte log entry
0709 13:17:06.931985 (+ 17198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:07.011162 (+ 79177us) write_op.cc:454] Released schema lock
0709 13:17:07.017912 (+  6750us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:07.092503 (+ 74591us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:07.094740 (+  2237us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39956,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":135850,"apply.run_cpu_time_us":6440,"apply.run_wall_time_us":207806,"num_ops":12,"prepare.queue_time_us":257414,"prepare.run_cpu_time_us":32827,"prepare.run_wall_time_us":236109,"raft.queue_time_us":83386,"raft.run_cpu_time_us":52667,"raft.run_wall_time_us":189740,"replication_time_us":471175,"spinlock_wait_cycles":51584,"thread_start_us":521611,"threads_started":4,"wal-append.queue_time_us":342522,"wal-append.run_cpu_time_us":27569,"wal-append.run_wall_time_us":1358584}]]}
I20260709 13:17:13.466346 10999 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:13.440295  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:13.486411  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:13.486831  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 46609.3us
I20260709 13:17:13.459270  8253 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:13.488039  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.489064  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.479934  8254 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:13.489391  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.491508  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.492198  8106 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:13.492127  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:13.495520  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:13.460819 11023 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.500427  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.473059 10745 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:13.506875  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 48294.8us
I20260709 13:17:13.510291  8103 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:13.508689  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.511426  8106 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:13.512913  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:13.511830  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:13.471772 11040 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:13.513742  8182 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.506398  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:13.516240  8149 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:13.493841 10816 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:13.533160  8223 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:13.534121  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:13.535665  8223 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:13.493616 10992 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:13.515213  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.494153 10956 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:13.541132  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.538085  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:13.541785  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.530277  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.502883 10832 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:13.503441 10962 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:13.544023  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.514194 10981 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:13.536378 10845 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:13.550616 10845 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.551028 10845 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.551602  8182 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:13.550978  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:13.513331 10735 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:13.498853 10873 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:13.553297  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:13.555897  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:13.556559  8106 raft_consensus.cc:2376] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8. Re-sending same reply.
I20260709 13:17:13.544428  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:13.556697  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.557539  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.554235  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:13.554462  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.557682  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:13.493983 10582 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:13.556774  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.555363  8105 raft_consensus.cc:2368] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:13.555410  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:13.506685 10972 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:13.525516 10745 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:13.557629  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.567765  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.568344  8102 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:13.571111  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:13.514031 11004 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:17:13.554662  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.547003 10918 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:13.502635 10970 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:13.555794 10997 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:13.527977 10826 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:13.556269 10962 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:13.526834 11040 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:13.562548  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:13.560144  8106 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: [2.2-6.3]
W20260709 13:17:13.617745  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 55280.8us
I20260709 13:17:13.543260 10939 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:13.617250 11002 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:13.509721 11023 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.618490  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:13.618780 11002 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:13.620355 11002 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.508962 10791 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:17:13.620976 11023 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:13.580168  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:13.621361 10920 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:13.621778 10456 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:13.554667 10810 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:13.622145 11004 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:13.622511 10810 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.622673 11004 raft_consensus.cc:697] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:13.622949 10810 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.623169 10812 raft_consensus.cc:2764] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:17:13.547755 10956 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.623653 11004 consensus_queue.cc:237] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.591172  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.624315 10956 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.624748  8787 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:13.582773  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.625839  8108 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:13.621819 10920 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.501680 10839 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:17:13.587222 10918 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.626502 11040 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.626806 10918 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.626899 10839 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:13.627391 10839 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:13.628230 10839 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.549376 10832 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:13.572844 10983 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:13.626502 10920 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.573133 11010 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:13.615470 10997 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.630324 10997 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.587752 10972 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.601413 10531 consensus_queue.cc:1059] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:13.604040 10053 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.606297 10965 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.632567  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:13.632915 10965 consensus_queue.cc:1243] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:17:13.594419  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.629630 10832 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.558764 10873 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:13.563280 10582 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.634258  8177 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:13.634433 10582 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.599488 10961 raft_consensus.cc:3055] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:13.635035 10961 raft_consensus.cc:740] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:13.572934 11008 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:13.635907 10961 consensus_queue.cc:260] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.636523 11008 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.636897 11008 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:13.637128 10961 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.555974 10981 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:13.647500  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.648339  8786 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:13.648470  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.649142  8072 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.615769  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:13.595351 10745 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:13.595148 10808 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:13.620733  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:13.623941 10812 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:13.618486 10939 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:13.576498  8149 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:13.573333 10735 raft_consensus.cc:697] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:13.572674 10807 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:13.597330 10970 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.629334 10839 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.558748 10992 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:13.639061  8103 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:13.640183  8099 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: [5.6-6.7]
I20260709 13:17:13.641058  8254 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:13.645041  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:13.670279  8182 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.653769 11010 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:13.645695  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.646852  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:13.678220  8177 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.649868  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:13.679791  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:13.680428  8785 raft_consensus.cc:2368] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8.
I20260709 13:17:13.650038  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:13.650440  8251 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:17:13.651893  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.654299  8178 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:13.655663  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:13.682538  8106 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.676918  8787 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:13.683367 10531 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:13.684015  8787 raft_consensus.cc:3055] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:13.684365  8787 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:13.664669 10986 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:13.687417 10920 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.663905 11002 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.689762 10967 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:13.690840 10981 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.693941 10992 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.664592 10939 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:13.697786  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.698835  8786 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:13.655709  8072 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:13.706187  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 50541.1us
I20260709 13:17:13.681200  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.707355  8072 leader_election.cc:400] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8.
I20260709 13:17:13.658936  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.652829  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:13.659157  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:13.629791 10983 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:13.709128  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 56376.7us
I20260709 13:17:13.666476  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.663234  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.663537  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:13.664882  8790 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:13.726359  8105 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:13.665612  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 89181.5us
W20260709 13:17:13.666051  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 50392us
I20260709 13:17:13.668016  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.632663 10053 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.659520 10965 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:13.645695  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:13.685066  8787 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:13.614483 10845 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.618608 10999 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:13.634277 10873 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.717154  8221 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:13.722596  8182 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:13.728973  8791 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:13.730790  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:13.696158 10956 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:13.659158 10971 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:17:13.675796  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:13.761996  8106 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:13.744964 10965 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:13.715183 10983 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.763437 11010 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.764147 10053 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:13.761029 10531 raft_consensus.cc:697] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:13.764806 10735 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:13.765364 10456 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:13.745882 11006 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:17:13.718005 10791 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:13.718315 10986 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:13.725769 10920 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:13.826145  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 98785.9us
I20260709 13:17:13.868645  8782 raft_consensus.cc:2410] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:17:13.855837  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.807267  8787 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.856998  8105 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
W20260709 13:17:13.861081  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 144000us
W20260709 13:17:13.865635  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 244974us
I20260709 13:17:13.826507 10999 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:13.826912  8174 raft_consensus.cc:3055] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:13.874866  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:13.887151  8174 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:13.872231 11055 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:17:13.895561  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:13.881987  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:13.882086  8223 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:13.882922  8790 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:17:13.883199  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 153864us
I20260709 13:17:13.868251 10965 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.923466 10791 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:13.923938 10791 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:13.924300 10791 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.891279  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:13.929745  8106 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.888003  8174 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:13.932765  8174 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.892877  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.934024  8099 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:13.935176  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.935766  8099 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:13.893337  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:13.894024  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:13.894840  8788 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:13.897107  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:13.938308  8255 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:17:13.902091 10531 consensus_queue.cc:237] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:13.903510 11004 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:13.873332 10456 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.904024  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:13.895195 11012 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:13.904985 10999 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.907230 10920 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:13.907960  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.910282 10956 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:13.912366  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:13.914259 11054 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:17:13.915951  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:13.917567 10832 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:13.980225 10920 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:13.918618 10708 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:13.919131 10745 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:13.938221  8785 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:13.988420  8255 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:13.989301  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.994889 11002 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.995558 11002 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.996299  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.997530  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.940342 10810 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:13.997747  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.998144  8782 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:13.998826  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.999547  8786 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 7: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:13.999750 10810 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:14.000072  8177 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:14.000655  8786 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:14.003728 10456 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:14.011638  8251 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:13.985098  8784 raft_consensus.cc:2410] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:17:13.888374 10967 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:13.964656  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.894766 11020 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.867214 10997 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:13.984314  8789 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:13.946205  8106 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:14.015566  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:14.076435  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:14.077224  8786 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:13.964898 10971 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:17:13.974124 11012 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:13.984882 11004 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:14.048852  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:14.028650  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 115661us
I20260709 13:17:14.063197  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:13.988379 11007 raft_consensus.cc:993] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:17:14.067490  8174 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:14.071768  8099 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:17:14.139050  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 235080us
I20260709 13:17:14.080143  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:14.082068 11020 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:14.087901 11034 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:17:14.013666 10708 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:14.089617 10966 consensus_queue.cc:1059] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:14.095140 10920 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:14.087963 10997 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:14.159929 11070 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.097952  8249 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:14.099030 10845 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:14.031030 10582 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.107200 11002 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:14.108098 10832 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:14.114307  8782 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
W20260709 13:17:14.134447  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.145677  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:14.173753  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:14.118121  7991 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9abaa411847e4bf9907f7af5e2689c7b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5033fc7e66374940a203908ea8b0078f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:14.104612 10918 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.158202 10708 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:14.160521 11070 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:14.160961  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.163376  8181 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:17:14.174585  7991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 56674.6us
I20260709 13:17:14.176162  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:14.013623 11008 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:14.212007  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:14.142382 11004 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:14.173408  8782 pending_rounds.cc:85] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 7
I20260709 13:17:14.163877 11067 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.217998  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:14.226336  8174 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:17:14.139230 11040 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.200843 10966 raft_consensus.cc:3055] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:14.202569 10845 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:14.233223  8253 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:14.231737  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:14.242489  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:14.174521 10812 consensus_queue.cc:1059] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:17:14.229807  8782 pending_rounds.cc:107] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:17:14.227643 11004 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:14.250260  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 52664.2us
I20260709 13:17:14.230746 11026 raft_consensus.cc:1081] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:17:14.226001 10810 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:14.225793 10969 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:14.204284 10808 consensus_queue.cc:1059] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:17:14.262151  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:14.208588 10997 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:17:14.208170 10920 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:17:14.235711 10966 raft_consensus.cc:740] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:17:14.274418  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 137964us
I20260709 13:17:14.264387 10832 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:17:14.269888 10839 consensus_meta.cc:287] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.001s
I20260709 13:17:14.263419  8782 raft_consensus.cc:2889] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:14.266274 10981 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:14.235563 11067 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:14.237249 10965 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.289808  8223 leader_election.cc:400] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:14.258678 11012 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:14.290992 10582 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:14.292167 10582 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:14.305536  8177 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:17:14.308400  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:14.309059  8177 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.310828  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:14.311507  8182 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.312070  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:14.312737  8176 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:14.314689  8174 pending_rounds.cc:85] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 1
I20260709 13:17:14.315030  8174 pending_rounds.cc:107] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:17:14.315320  8174 raft_consensus.cc:2889] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:14.266327 10873 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:14.316937  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:14.318071  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:14.318413  8103 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:14.319552  8176 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.323637  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:14.324510  8178 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:17:14.325731 11077 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:14.325227  8180 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:14.326877  8256 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:14.329926  8175 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:17:14.330370  8175 pending_rounds.cc:85] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 3
I20260709 13:17:14.330623  8175 pending_rounds.cc:107] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:17:14.330976  8175 raft_consensus.cc:2889] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:14.337357  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 119565us
I20260709 13:17:14.306639 10845 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.297318 10832 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:14.358345  8177 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:14.359337  8256 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:14.361586  8176 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:14.306121 10981 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:14.377454  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:14.314268 10956 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.380280  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:17:14.384099  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 170564us
I20260709 13:17:14.388644  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:14.390961  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:14.391359 10839 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:14.392166  8221 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:14.392771 10839 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:14.393473  8221 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:14.393473 10839 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:14.394213 10967 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:14.395871 10967 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:14.425096  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 141088us
I20260709 13:17:14.430002  8182 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
W20260709 13:17:14.453675  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 71003.3us
I20260709 13:17:14.379554 11020 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:14.418195 11065 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:14.462853  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:14.420861 10873 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:14.473109  8221 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:14.477980  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:14.485376  8788 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:14.486611  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:14.486933  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:14.351564 10791 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.470554  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:14.376120 11082 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
I20260709 13:17:14.478672  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:14.497778  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 105010us
W20260709 13:17:14.496973  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 223575us
I20260709 13:17:14.500517  8221 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:14.351872 10966 consensus_queue.cc:260] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.385684 10956 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.478215 11008 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:14.510187  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:14.513955  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 51753.5us
I20260709 13:17:14.479498 11087 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.489413 10812 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:14.524017  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:14.495697 10845 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:14.497838 11070 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:14.518695  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:14.506781 10939 consensus_meta.cc:287] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.774s	user 0.005s	sys 0.007s
I20260709 13:17:14.513001 10920 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:14.491669 11040 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:14.522161 10992 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.008s	sys 0.026s
I20260709 13:17:14.516218 10873 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.543900  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:14.545643  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:14.556396  8182 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:14.558947  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:14.526845 10971 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.561770  8786 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 7: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:14.538451 10961 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.561961  8175 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:17:14.547129 10992 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.008s	sys 0.026s
I20260709 13:17:14.566239  8786 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:14.566916  8787 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:14.520566 10967 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:17:14.531271 10845 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:14.572688  8786 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:14.530880 11085 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:14.554702 10966 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:14.584218 10808 raft_consensus.cc:3055] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:14.584589 10808 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:14.571275 10971 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.585543 10808 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:14.586570 11068 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.286s	user 0.001s	sys 0.001s
I20260709 13:17:14.553802 10735 consensus_queue.cc:1059] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:17:14.587276 10735 raft_consensus.cc:3055] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:14.587635 10735 raft_consensus.cc:740] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:14.589579  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2114) took 1077 ms. Trace:
I20260709 13:17:14.590019  8183 rpcz_store.cc:276] 0709 13:17:13.512567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.512698 (+   131us) service_pool.cc:224] Handling call
0709 13:17:14.589372 (+1076674us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540031f6d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:14.589522 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2471968128}
W20260709 13:17:14.590713 10983 consensus_meta.cc:287] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.719s	user 0.003s	sys 0.007s
I20260709 13:17:14.591321  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1131) took 1047 ms. Trace:
I20260709 13:17:14.591701  8104 rpcz_store.cc:276] 0709 13:17:13.543496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.543784 (+   288us) service_pool.cc:224] Handling call
0709 13:17:14.591124 (+1047340us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b540040bad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:14.591265 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1176675072}
I20260709 13:17:14.579139 11007 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:14.579838 11020 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:14.611924 10791 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:14.579975 11026 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:14.580762 10845 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.617811  8787 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:17:14.621662 10965 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:14.578063  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:14.622417 11083 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:17:14.622572  8786 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
W20260709 13:17:14.623770 11062 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.541s	user 0.002s	sys 0.000s
I20260709 13:17:14.625771 11020 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:14.626310 11020 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:14.628368  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:14.628584 11020 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:14.521250 10981 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:14.617848 11026 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:14.631845 11026 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:14.633100  8147 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:14.632988 11026 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.634042 10636 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:14.635102 11026 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.635960 10967 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:14.578207  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 59617.4us
I20260709 13:17:14.643740  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:14.644528  8181 raft_consensus.cc:2368] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:14.647749  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:14.648330  8181 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:14.639122  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:14.581992 10812 raft_consensus.cc:697] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:14.583460 11072 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:14.583829 10920 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.540688 11094 consensus_queue.cc:1059] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:17:14.500263 10832 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.546360 10939 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.678404  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:14.672246  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:14.680815  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:14.578040  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 79253.5us
I20260709 13:17:14.688122  8256 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:14.592942  8108 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:17:14.690387  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:14.691298  8101 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.598814  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:14.600867 10953 consensus_queue.cc:1059] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:14.574673 10961 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:14.592641 11085 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.707942 11085 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:14.708565  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:14.592907 11067 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:14.606956 11007 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.709187  8183 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
W20260709 13:17:14.608179 11089 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:17:14.609330 10956 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:14.610209 11079 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:17:14.715813  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:14.709535 11007 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.663936  8181 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:14.664628 10969 raft_consensus.cc:697] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:14.667877 10812 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.621223 10810 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:14.637591 11008 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:14.591125 10983 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:14.684378  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:14.731977  8251 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:14.680941  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:14.693871  8254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57566
I20260709 13:17:14.733212  8254 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:14.733700  8254 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:14.693872  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:14.734740  8099 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.694554  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:14.660049 10582 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:14.696646  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.696821  8072 leader_election.cc:400] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8.
I20260709 13:17:14.739280  8072 leader_election.cc:403] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:17:14.740549  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:14.697044  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:14.741783  8256 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:14.698609  8107 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:14.672253 11074 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:17:14.687489 10920 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.702893 11004 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:14.704236  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:14.751936  8100 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 5: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:14.658799 10873 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:17:14.706040  8103 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:14.706193 10939 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:14.760172  8254 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.706684  8179 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:14.707258 10961 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:14.672821 10918 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:14.710618  8101 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:14.794044  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:14.794793  8101 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.702773  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:14.797849  8102 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
W20260709 13:17:14.610941 11092 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:17:14.609067 10808 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:14.671278 11072 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:14.678067 11020 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:14.705927 11040 raft_consensus.cc:3055] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:14.720293  8248 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:17:14.724552  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:14.819478  8253 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:14.724632  8249 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:14.862691  8254 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:14.864159  8250 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:17:14.864754  8250 pending_rounds.cc:85] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 8
I20260709 13:17:14.865103  8250 pending_rounds.cc:107] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:17:14.865451  8250 raft_consensus.cc:2889] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:14.743752  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.739326  8181 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 2. (index mismatch)
I20260709 13:17:14.741916 10582 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.745345  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:14.742384 10970 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8.
I20260709 13:17:14.746004  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:14.877942  8106 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:14.746618 10965 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.747219 10845 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.750174  8072 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:14.881026  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 130925us
I20260709 13:17:14.882205  8072 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:14.757548 10456 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:14.743582 10953 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.130s
I20260709 13:17:14.767204  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:14.770263  8099 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:14.772408  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:14.758733 10983 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:14.893869  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:14.893605  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:14.894665  8106 raft_consensus.cc:2368] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
W20260709 13:17:14.892323  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 125234us
I20260709 13:17:14.893599  8100 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:14.890300  8101 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:14.861405 11040 raft_consensus.cc:740] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:14.896061  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:14.763069 11016 consensus_queue.cc:1059] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 13:17:14.878888 10582 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.898801  8099 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:17:14.902061  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 235660us
I20260709 13:17:14.904831 11040 consensus_queue.cc:260] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.882493 11020 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:14.885986 10961 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:14.909214  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:14.887305 11097 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:14.899230 11026 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:14.933868  8223 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:14.863420 10969 consensus_queue.cc:237] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:15.053977  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 158022us
W20260709 13:17:15.058398  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 124670us
I20260709 13:17:15.059955  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:14.909981 10980 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:15.059511  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:15.065759  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:15.061239 11064 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.005s	sys 0.023s
I20260709 13:17:15.066877  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:15.067092 11064 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.005s	sys 0.023s
I20260709 13:17:15.067703 11065 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:15.068205 11065 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:15.069087 11065 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:15.072786  8223 leader_election.cc:400] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:15.073136  8223 leader_election.cc:403] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:17:15.073836 11008 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:15.064656  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:14.988703 11114 log.cc:927] Time spent T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:17:15.081640  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:15.084115  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:15.084867  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:15.085997 10845 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:14.951535 10791 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:15.089062  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:15.112555  8791 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 7: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:15.108952  8072 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:15.109474  8182 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:14.993284 10920 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:15.109884  8790 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:15.114071  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:15.064582 10956 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:15.118230  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:15.118870  8183 raft_consensus.cc:3055] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:17:15.119171 11108 log.cc:927] Time spent T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:17:15.078186 10918 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:15.119987 10918 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.120362 10918 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.088528 11101 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:17:15.124063 11111 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:17:15.124876 11085 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:15.119174  8183 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:15.127105 11110 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:17:15.079471 10983 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:15.062144 11020 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:14.954221 11074 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.160s
I20260709 13:17:15.079758 11070 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:15.143282  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:15.143908  8101 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:15.129149 10918 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:15.129704 11004 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:15.079139 11096 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:15.151665  8182 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:15.132407  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:15.115003 10961 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:15.064838 10873 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:15.124703 11007 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:15.136373  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:15.137315  8072 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:15.138176 10970 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:15.146763  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:15.139218  8183 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:14.914254 11072 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:15.169843  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:15.174405  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:15.090008 11093 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:17:15.187522  8183 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:15.146005 10920 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:15.169652 11096 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:15.171150 10970 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:15.193297  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:15.193994  8105 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:15.194813  8072 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:15.187094 10456 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:15.192131 11072 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:15.195775  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:15.196997  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:15.194880  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:15.198617  8101 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:15.192441 11096 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:15.152339 10983 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:15.160167 11027 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:15.202841  8182 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:15.160187 10961 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:15.188256 10825 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.212126  8183 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:15.212970  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:15.196305 10920 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:15.197753 10970 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.203908 11087 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:15.200850 11016 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:15.214982 10961 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:15.225095  8072 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:15.217654 11074 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.225660 10582 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:15.237685 10920 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:15.225219 11087 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:15.238927 10920 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:15.239248 11087 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.215425 11027 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:15.246364  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.217624 10825 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:15.252286 10983 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:15.265806 11027 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:15.266911 10918 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:15.268649  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:15.270725 11007 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:15.276994  8105 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:15.282632  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:15.282851  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:15.284420 10812 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:15.261140  8099 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:17:15.286659 11073 raft_consensus.cc:3055] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:15.286881 10825 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:15.287096 11073 raft_consensus.cc:740] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:15.287948 11073 consensus_queue.cc:260] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:15.289052 11073 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:15.289408  8791 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:17:15.289809  8791 pending_rounds.cc:85] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 6
I20260709 13:17:15.290027  8791 pending_rounds.cc:107] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:17:15.290279  8791 raft_consensus.cc:2889] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:15.290314 10971 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:15.292876  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2116) took 1058 ms. Trace:
I20260709 13:17:15.242050 11074 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:15.293308  8174 rpcz_store.cc:276] 0709 13:17:14.234877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.235442 (+   565us) service_pool.cc:224] Handling call
0709 13:17:14.258319 (+ 22877us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:14.386242 (+127923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:14.386272 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:14.386828 (+   556us) log.cc:844] Serialized 52 byte log entry
0709 13:17:14.491036 (+104208us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:14.491069 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.292359 (+801290us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b5400331b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:15.292421 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:15.292482 (+    61us) raft_consensus.cc:1685] finished
0709 13:17:15.292500 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:15.292798 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70195,"raft.queue_time_us":71586,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"spinlock_wait_cycles":129016064,"thread_start_us":103889,"threads_started":1,"wal-append.queue_time_us":239768}
I20260709 13:17:15.296284  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:15.296358  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:15.297243  8099 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.319298 10997 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:17:15.335276 11123 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:17:15.354249  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:15.369035  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.391767 10918 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.393539 10918 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:15.406572 10961 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:15.408100  8101 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:15.369706 10920 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:15.409359 10920 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:15.410658 10920 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:15.435587 10970 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:15.437446  8103 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:15.440132 10918 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:15.441649  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:15.442477  8174 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:15.444849 10961 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:15.565892  8099 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
W20260709 13:17:15.568085  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.569088 10997 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.569861 10997 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:15.571951 10997 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:15.504846 10816 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:15.573025  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 290280us
I20260709 13:17:15.505167 11016 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:15.575456  8100 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:17:15.584616  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:15.589795  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:15.590186  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:15.607335  8786 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:15.586897  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:15.611045 11072 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:15.611661 11072 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:15.612715 11072 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:15.617391  8789 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 7: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:15.618384  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:15.619055  8789 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.586710 10918 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:15.622887 10745 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:15.623868 10745 raft_consensus.cc:3055] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:15.623662 11007 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:15.624282 10745 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:15.617203 11067 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:17:15.627300  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:15.628194  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:15.639477  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 52638us
W20260709 13:17:15.591194  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.602264  8072 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:15.584651  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.594974  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:15.573593 10970 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:15.643926  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:15.679718  8786 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:15.686020  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:15.689406  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:15.692329  8789 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:15.688719  8100 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:15.638608  8784 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:15.734591  8252 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:17:15.535285 11087 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:15.719317  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:15.720104  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.701104  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:15.698081  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 103152us
I20260709 13:17:15.748286  8250 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.748982  8221 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:15.625154 10745 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:15.751116 10745 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:15.617203 10816 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:15.622936 10918 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:15.666850 10825 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:15.699908 11065 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:15.757391 11020 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:15.714450 11002 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:15.714857 11004 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.784202 11074 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:15.783675 11027 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.700098 11096 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:15.841267  8250 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:15.766577  8254 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:15.802152  8072 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.080s (SENT)
I20260709 13:17:15.843946  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:15.823139  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.775285 11002 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:15.782346 11004 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:15.873023  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 70928.7us
I20260709 13:17:15.843554 10873 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:15.847005 11096 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:15.888088 11096 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:15.889223 11087 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:15.876976 11073 consensus_meta.cc:287] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.558s	user 0.002s	sys 0.009s
I20260709 13:17:15.875325 10825 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:15.894908  8254 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:15.850428 11027 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:15.896560  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:15.892688 10918 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:15.893811 11087 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:15.908979 11067 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:15.925374 10825 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:15.926229 10962 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:15.931025 10816 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:15.935664 11067 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:15.925307 11087 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:15.985940  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:16.015926  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 374562us
W20260709 13:17:16.016750  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 267891us
I20260709 13:17:16.020190  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:16.022073  8255 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:16.023839  8786 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:17:16.023989  8789 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:17:15.936163 10825 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.029031  8177 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:16.028514  8252 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:17:16.026990  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:15.963937 11020 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.027896  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:16.034437  8252 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:16.040410  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:16.041528  8177 raft_consensus.cc:2410] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:16.042668  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:16.043658  8784 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:15.954620 10962 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.045406  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:16.053093  8252 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 2. (term mismatch)
I20260709 13:17:16.053658  8252 pending_rounds.cc:85] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 1
I20260709 13:17:16.053977  8252 pending_rounds.cc:107] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:17:16.054275  8252 raft_consensus.cc:2889] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.054664  8252 pending_rounds.cc:107] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:17:16.055235  8252 raft_consensus.cc:2889] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.057044  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:16.037506 11020 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.059695  8249 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:16.052877 11137 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:16.060312 11020 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:16.060674 11137 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:16.061628 11137 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:16.030601 11141 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:16.037243 11002 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:16.065856  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:16.068607  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:16.073637  8252 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:16.074090  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:16.074656  8099 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:16.076717  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:16.070358  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.068737  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:16.077682  8254 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.078293  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:16.082794  8249 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:17:16.083377  8249 pending_rounds.cc:85] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 3
I20260709 13:17:16.083619  8249 pending_rounds.cc:107] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:17:16.083765  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:16.083849  8249 raft_consensus.cc:2889] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.072038 10920 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:16.087826  8223 leader_election.cc:400] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:16.088640  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:16.091056  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:16.092242  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:16.095342  8099 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:16.036939 10999 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:17:16.052982 10918 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:16.036370 11096 consensus_queue.cc:1059] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:17:16.097069  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:16.096755  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:16.100322  8254 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:16.055732 11004 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:16.111742  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:16.112455  8782 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 4.
W20260709 13:17:16.113091  8782 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 678) took 1657 ms (client timeout 2080 ms). Trace:
W20260709 13:17:16.113536  8782 rpcz_store.cc:269] 0709 13:17:14.455433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.457105 (+  1672us) service_pool.cc:224] Handling call
0709 13:17:16.111552 (+1654447us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:16.113013 (+  1461us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19881856}
I20260709 13:17:16.108860  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:16.107254 10918 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.110402  8099 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:16.090092 11020 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:16.124915  8783 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:17:16.094553 11065 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:16.142163  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:16.071655 11133 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:17:16.110406 11027 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:16.149194  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 60623.8us
I20260709 13:17:16.151489  8223 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:16.086704 11140 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:17:16.123956 11096 consensus_queue.cc:1243] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer 5033fc7e66374940a203908ea8b0078f log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:16.140929 10918 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.097900 10920 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:16.154547  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:16.072402 11067 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.141602 11020 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:16.159848  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 51078.5us
I20260709 13:17:16.160395  8107 raft_consensus.cc:2410] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:16.160634  8221 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:16.144371 11004 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:16.085959 11141 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.180994  8107 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:16.184791 10962 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:16.185359 10962 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:16.185580 11141 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:16.160142 11020 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:16.185832 10962 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.186383 11141 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:16.187021 11141 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:16.187963 10962 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:16.189651 11150 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:16.189894 11128 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.424s	user 0.004s	sys 0.004s
I20260709 13:17:16.191836 10981 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:16.192322 10981 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:16.193221 10981 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.194264 11004 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:16.194766 11004 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:16.153419 11147 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:16.198477  8248 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:16.161927  8783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 680) took 1705 ms. Trace:
W20260709 13:17:16.215601  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 118923us
I20260709 13:17:16.163463 11135 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:16.188090 11141 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.149201 11065 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:16.223523  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:16.224997  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:16.189841 11087 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:16.228191  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:16.236073  8107 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
W20260709 13:17:16.230001  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.237483  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:16.213841 11096 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:16.195587 11004 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.248564  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:16.251200  8107 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:17:16.226142 11133 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:16.226402 11140 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:16.258711  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 97289.3us
I20260709 13:17:16.255167  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:16.253851  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:16.260591  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:16.261694 11152 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:16.262223 11152 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:16.262712 11152 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:16.219839 10646 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 13:17:16.267164  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 103190us
I20260709 13:17:16.275642  8250 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:16.237140 10962 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:16.220006  8783 rpcz_store.cc:276] 0709 13:17:14.456130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.458722 (+  2592us) service_pool.cc:224] Handling call
0709 13:17:16.124480 (+1665758us) spinlock_profiling.cc:243] Waited 9.67 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27eee 0000000000375939 00007fa5a5d9b1e0 00007fa5a5e640c4 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:17:16.124654 (+   174us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.147655 (+ 23001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.157612 (+  9957us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22237952}
I20260709 13:17:16.266517 11133 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.246951 10825 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:16.246192 11087 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:16.281327  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:16.283098  8223 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:16.283126  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:16.298764  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:16.254298 11096 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:16.319293  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 49155.4us
I20260709 13:17:16.304481 11002 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:16.302465 10816 raft_consensus.cc:3055] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:16.284786 10962 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.274042 11140 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.318519 11134 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:16.323586 11133 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:16.300550 11158 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:16.321302  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:16.342970  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:16.346258  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:16.354861  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:16.355392  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:16.347280  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:16.347203  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:16.358067  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 398) took 2721 ms. Trace:
I20260709 13:17:16.358194  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:16.358608  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:16.347733  8181 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:16.359354  8175 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:16.359679  8249 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:17:16.360219 11162 log.cc:927] Time spent T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.072s	user 0.001s	sys 0.001s
I20260709 13:17:16.361326  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:16.361519 11157 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:17:16.362807 10582 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:16.363844 10582 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.348395  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:16.293728 11087 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.353080 10986 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:16.366765 11129 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.610s	user 0.001s	sys 0.001s
I20260709 13:17:16.366561 10986 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.367580 11087 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:16.367830 11016 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:16.316322 11155 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:17:16.348390  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:16.358448  8108 rpcz_store.cc:276] 0709 13:17:13.630559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.634369 (+  3810us) service_pool.cc:224] Handling call
0709 13:17:14.592679 (+958310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:14.689630 (+ 96951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.351928 (+1662298us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b540040bad0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:16.352058 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2203122944}
W20260709 13:17:16.390892 11127 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.645s	user 0.001s	sys 0.000s
I20260709 13:17:16.395571 11093 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:16.396226 11093 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:16.405946  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:16.370615  8254 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:16.404464 10735 consensus_queue.cc:260] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.418924 10961 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.419672 10961 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:16.423810  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:16.425763  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 684) took 1341 ms. Trace:
I20260709 13:17:16.426326  8791 rpcz_store.cc:276] 0709 13:17:15.084526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.226102 (+141576us) service_pool.cc:224] Handling call
0709 13:17:15.238314 (+ 12212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:15.290787 (+ 52473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.425396 (+1134609us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b54005c8d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:16.425673 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116724608}
I20260709 13:17:16.429689 10970 raft_consensus.cc:3055] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:16.430284 10970 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:16.431411 10970 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.437449  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1151) took 1748 ms. Trace:
I20260709 13:17:16.438027  8105 rpcz_store.cc:276] 0709 13:17:14.688928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.205548 (+516620us) service_pool.cc:224] Handling call
0709 13:17:15.206029 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:15.277365 (+ 71336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.437120 (+1159755us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b540040b5d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:16.437348 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162509568}
I20260709 13:17:16.397356 11093 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:16.515308 11093 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.524695 10961 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:16.547676  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 192879us
I20260709 13:17:16.339231 10816 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:16.605746  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 182038us
I20260709 13:17:16.606142 10053 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:16.606683 10053 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:16.607249 10053 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:16.622156 10986 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:16.355319 11158 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:16.384096 11133 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:16.368353 11016 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:16.626843  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.653746  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:16.613046 11163 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
I20260709 13:17:16.662570  8105 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:16.662642  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:16.548768 10920 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:16.636018  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 293145us
W20260709 13:17:16.633157  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.655303  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:16.656332  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:16.592386 10808 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.666895 10808 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.669219 11157 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.669898  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:16.364291 10582 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:16.663764  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:16.622148 11085 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:16.646489 10970 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:16.623924 11096 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:16.663556  8251 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:16.671772 10953 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:16.646472 11040 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:16.677654  8249 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:16.669133 10808 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:16.660590 10053 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:16.679224  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.623035 10966 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:16.680776  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 363) took 2999 ms. Trace:
I20260709 13:17:16.686152  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:16.626821 10980 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.675979  8105 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:17:16.695441  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.699159 11166 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:16.727232 10053 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:16.653580 10986 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.727306 11166 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.728147 10986 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.731374 10986 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:16.731992 10986 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.732466 10986 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:16.733527 10808 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:16.734603 11166 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:16.661218 11156 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:16.735668 10582 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:16.735955 11156 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.736495 11156 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:16.737632 11164 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:17:16.741297  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:16.744084 11074 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:16.744544 11074 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:16.744673 11065 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:16.745033 11074 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:16.719172  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.672463 11067 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.719121  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:16.758095  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:16.721869  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1155) took 2027 ms. Trace:
I20260709 13:17:16.759405  8106 rpcz_store.cc:276] 0709 13:17:14.694553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.206710 (+512157us) service_pool.cc:224] Handling call
0709 13:17:15.207179 (+   469us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:15.216581 (+  9402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:15.216601 (+    20us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:15.219386 (+  2785us) log.cc:844] Serialized 52 byte log entry
0709 13:17:15.480960 (+261574us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:15.481019 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.481125 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:16.389958 (+908833us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:16.702464 (+312506us) raft_consensus.cc:1685] finished
0709 13:17:16.702485 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.721787 (+ 19302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8938,"raft.queue_time_us":9056,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":3225,"spinlock_wait_cycles":15628544,"thread_start_us":241430,"threads_started":1,"wal-append.queue_time_us":422918}
W20260709 13:17:16.679116 11142 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:16.704741  8179 rpcz_store.cc:276] 0709 13:17:13.673745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.674307 (+   562us) service_pool.cc:224] Handling call
0709 13:17:13.674670 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.789449 (+1114779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.672496 (+1883047us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540031e2d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:16.672745 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2373038976}
I20260709 13:17:16.626495 11158 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:16.751287  8223 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:16.763535  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:16.769613  8102 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:17:16.694378 10791 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:16.698225 10953 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.775015  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:16.706733 11096 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.778993  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:16.781633  8181 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:16.701001 11007 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:17:16.802019  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.680552 10825 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:17:16.786392  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:16.803900  8178 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:16.685747 11038 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:17:16.815253  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:16.816093  8174 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:16.775571 11147 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:16.775230 11065 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:16.669935 11157 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:16.779630 10953 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.820525  8175 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:16.847028  8249 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
W20260709 13:17:16.808075 11027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.015s	sys 0.065s
W20260709 13:17:16.856127 11027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.018s	sys 0.069s
I20260709 13:17:16.696281 10816 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:16.756649 10980 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:16.778182 11067 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:16.851181 11152 consensus_meta.cc:287] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.588s	user 0.012s	sys 0.000s
W20260709 13:17:16.866827  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 97883.5us
I20260709 13:17:16.805368 10582 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.800503 10832 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:16.815450 11007 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:16.848297 11133 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:16.938441  8177 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:17:16.871769  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.874722  8253 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:16.788192 10791 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.858204 10825 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:16.849908 11073 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:17:16.944315  8149 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.129:45123 timed out after 1.650s (SENT) [suppressed 22 similar messages]
W20260709 13:17:16.945847  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.815976 10873 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.108s
W20260709 13:17:16.966454  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 208423us
I20260709 13:17:16.967564  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:16.968976  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:16.803889 11096 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:16.950824  8179 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:17:16.946702  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 291498us
I20260709 13:17:16.957310 11175 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:16.948886 10961 raft_consensus.cc:3055] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:16.920120 10582 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:16.958173 10962 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:16.874253 11172 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 13:17:16.956274 11141 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:16.953825 10825 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:16.956655 10808 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:16.956424 11166 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.939522 10832 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.882035 11147 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:16.880836 11152 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:16.971763 11140 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:16.962100 11073 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.110709 10839 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:17:17.111133 11040 consensus_queue.cc:1059] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:17.118855 11186 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:17.118412 10808 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:17.119202 11177 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:17:17.118594 11133 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.134541 10808 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:17.135197 10808 raft_consensus.cc:3055] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:17.135551 10808 raft_consensus.cc:740] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:17.138212 11157 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:17.139443 11020 consensus_meta.cc:287] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.953s	user 0.010s	sys 0.000s
I20260709 13:17:17.139780 10832 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.091962 11016 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.096403 10961 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:17.120390 11067 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.119644 11166 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.098681 11183 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:17.107993 11004 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:17:17.117834 11141 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.112776 11175 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:17.131753 11186 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:17.132740 11173 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:17:17.127529 11147 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.143380 11152 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:17.136433 11156 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:17.171651 11150 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.981s	user 0.021s	sys 0.014s
I20260709 13:17:17.248647 11166 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.249272 11147 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:17.249714 11150 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.022s	sys 0.014s
I20260709 13:17:17.210669 11183 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.251154 11150 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:17.259357 11156 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:17.259546 11150 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.244144 11186 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.267364 11141 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.286633 11183 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:16.947813  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 289648us
I20260709 13:17:17.327013 11202 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:17.327737  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 357224us
I20260709 13:17:16.961361  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.329778  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.337270  8104 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:17:17.331113  8102 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:17:17.095109  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 150810us
W20260709 13:17:17.344929  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 254247us
W20260709 13:17:17.347442  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.348814  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.349479  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.349560  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1191) took 2209 ms. Trace:
W20260709 13:17:17.350392  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.350253  8176 rpcz_store.cc:276] 0709 13:17:15.139431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.139948 (+   517us) service_pool.cc:224] Handling call
0709 13:17:15.140325 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:15.140761 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:15.140802 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:15.141351 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 13:17:16.455539 (+1314188us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b1800393460. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:17:16.849378 (+393839us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:16.849491 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.850056 (+   565us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.348654 (+498598us) raft_consensus.cc:1685] finished
0709 13:17:17.348716 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.349216 (+   500us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":10802432,"thread_start_us":393450,"threads_started":1,"wal-append.queue_time_us":1820050}
I20260709 13:17:17.355041  8102 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:17.356485  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.358786  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.360503  8783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 523) took 1039 ms. Trace:
I20260709 13:17:17.361258  8783 rpcz_store.cc:276] 0709 13:17:16.320503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.325165 (+  4662us) service_pool.cc:224] Handling call
0709 13:17:16.362307 (+ 37142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.362532 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:16.847884 (+485352us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.359190 (+511306us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.359609 (+   419us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:17.359694 (+    85us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:17.359823 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.359974 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.360255 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":506843,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":78427,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":873682,"threads_started":3,"wal-append.queue_time_us":292591}
I20260709 13:17:17.112500  8785 raft_consensus.cc:2410] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:17:17.364646  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:17.113067 10825 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.136364 10808 consensus_queue.cc:260] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.368525 10582 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.369124 10808 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:17.371196  8108 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:17.374153  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.379448  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:17.380007  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:17.380533  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:17.380741  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:17.381773  8181 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:17.381871  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.382992  8104 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 7: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:17.385587  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:17.385998  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:17.388152  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.391477  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.392436  8104 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
W20260709 13:17:17.402674  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 66732.6us
W20260709 13:17:17.406188 10918 consensus_meta.cc:287] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.241s	user 0.011s	sys 0.001s
I20260709 13:17:17.406836 10918 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.408823  8254 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:17.409025 10873 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.409969 10873 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.410674 10918 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:17.413601 10873 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:17.414389 10873 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:17.415308 10873 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.420849 10873 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:17.100349 10969 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.142607 10980 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.120040 10986 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.288030 11186 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.460574 11186 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.462509  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.461982 10961 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.456504 11183 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.463714 10961 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:17.464432 11183 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.151793 11007 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.425900 11202 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.151909 11016 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.294s
I20260709 13:17:17.141112 11020 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.282979 11158 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.451999 11151 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.478070 11151 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.481171  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.482245 10969 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.484895 10969 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.486518  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.487919  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:17.488744 11096 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.488854  8104 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:17.489104  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.489742 11207 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:17:17.491992  8106 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:17.492895  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:17.493813  8108 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.494472  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.497167 11157 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:17.497489 11002 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:17.499027 11156 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:17.499338 11158 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:17.499471 11156 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:17.462050 11179 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:17:17.492925 11202 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.503782 11020 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:17.514029 11158 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:17.514169  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:17.515049  8251 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:17.514971 11158 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.516451  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:17.516913  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 50059.5us
I20260709 13:17:17.519341 11158 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.520481  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1154) took 2826 ms. Trace:
I20260709 13:17:17.522569  8101 rpcz_store.cc:276] 0709 13:17:14.694302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.204085 (+509783us) service_pool.cc:224] Handling call
0709 13:17:15.204448 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:15.408547 (+204099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.519908 (+2111361us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540043c6d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:17.520258 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467854080}
I20260709 13:17:17.525143  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1159) took 2445 ms. Trace:
I20260709 13:17:17.525672  8103 rpcz_store.cc:276] 0709 13:17:15.079510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.273826 (+194316us) service_pool.cc:224] Handling call
0709 13:17:15.274058 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:15.437964 (+163906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.521748 (+2083784us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400211bd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:17.524963 (+  3215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375137024}
I20260709 13:17:17.500939 11156 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.515079 11183 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.529673 11179 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:17:17.535282 11096 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:17.537173 11202 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:17.540057  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:17.544822  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2163) took 1224 ms. Trace:
W20260709 13:17:17.546849  8072 leader_election.cc:336] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.117s (SENT)
I20260709 13:17:17.549116 11156 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.549463  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:17.556653  8785 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 687) took 2465 ms (client timeout 2117 ms). Trace:
I20260709 13:17:17.559789  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:17.560214  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 44014.2us
I20260709 13:17:17.553211  8108 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:17.557981  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:17.558110  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:17.566250 11205 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:17.545228  8256 rpcz_store.cc:276] 0709 13:17:16.319930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.321901 (+  1971us) service_pool.cc:224] Handling call
0709 13:17:16.322192 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.353509 (+ 31317us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:16.547549 (+194040us) log.cc:844] Serialized 14 byte log entry
0709 13:17:16.625957 (+ 78408us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.626020 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:16.626070 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.544358 (+918288us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b5400386654. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:17.544426 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.544629 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101605,"prepare.queue_time_us":252329,"prepare.run_wall_time_us":54,"raft.queue_time_us":78559,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":25441,"spinlock_wait_cycles":98583040}
I20260709 13:17:17.566850 11205 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:17.570309 11205 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:17.566278  8250 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
W20260709 13:17:17.557139  8785 rpcz_store.cc:269] 0709 13:17:15.091017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.136183 (+ 45166us) service_pool.cc:224] Handling call
0709 13:17:17.556255 (+2420072us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b5400544cd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:17.556440 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4462996352}
I20260709 13:17:17.567914 11183 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:17.568414  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:17.568913  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:17.574800 10953 consensus_meta.cc:287] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.708s	user 0.015s	sys 0.004s
I20260709 13:17:17.575450 10953 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.576915  8257 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:17.577105  8180 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:17.577267 10791 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:17.581619  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 46442us
W20260709 13:17:17.582149  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.582468 10808 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:17.585193 11020 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.590771 11020 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.584997 11007 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.584554 10053 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.584156  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:17.597648 11007 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.597826 10825 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.600221 11007 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:17.600468 10053 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.600212 10825 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.601998  8103 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:17.602694 10053 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:17.592675 10953 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.572398 11183 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:17.610190  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 373) took 1381 ms. Trace:
I20260709 13:17:17.610739 11183 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:17.614566  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:17.615942  8074 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:17.618723  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.619274  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.619388 11168 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:17.620134 11168 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.620654 11007 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.621255 11007 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.618615 10992 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.617333  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:17.625890  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:17.625756 10992 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.626245 10839 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:17.626621  8179 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:17.626748 10839 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.627209 10839 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.628162 10992 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:17.628345 10981 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:17.631294  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 51253.9us
I20260709 13:17:17.634950 11168 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:17.646593 11072 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.030s	user 0.015s	sys 0.019s
I20260709 13:17:17.647099 10971 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:17.647264 11072 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.031s	user 0.015s	sys 0.019s
I20260709 13:17:17.649802  8104 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:17.633750 10825 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:17.610980  8183 rpcz_store.cc:276] 0709 13:17:16.228807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.229007 (+   200us) service_pool.cc:224] Handling call
0709 13:17:16.229395 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.384116 (+154721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.384166 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:17.552152 (+1167986us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b2c000e6688. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:17:17.552758 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.571723 (+ 18965us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:17.579318 (+  7595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.596077 (+ 16759us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.609769 (+ 13692us) raft_consensus.cc:1685] finished
0709 13:17:17.609791 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.610021 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37111,"raft.queue_time_us":58187,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5484,"spinlock_wait_cycles":380177792,"thread_start_us":135550,"threads_started":2,"wal-append.queue_time_us":54730}
I20260709 13:17:17.673154 11195 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:17:17.673400  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:17.675168 10920 consensus_queue.cc:1059] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:17.675838 11148 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:17:17.679608 11148 raft_consensus.cc:3055] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:17.682181 11148 raft_consensus.cc:740] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:17.683398 11148 consensus_queue.cc:260] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:17.682018  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 64799us
I20260709 13:17:17.684430  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2159) took 1465 ms. Trace:
I20260709 13:17:17.684839 11148 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:17.703715  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 49138.4us
I20260709 13:17:17.686307  8248 rpcz_store.cc:276] 0709 13:17:16.218885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.219052 (+   167us) service_pool.cc:224] Handling call
0709 13:17:16.219442 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.095252 (+875810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.095281 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:17.095321 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:17.095356 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.683815 (+588459us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b54000898d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:17.683908 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.684182 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2013692672}
I20260709 13:17:17.679217 11134 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:17.709038  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:17.719453  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:17.729100 11004 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:17.729789 11004 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:17.730860 11004 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:17.732574  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.733605  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:17.734305 10970 consensus_meta.cc:287] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.957s	user 0.007s	sys 0.011s
I20260709 13:17:17.734463  8178 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:17.735713  8102 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:17.720541 11202 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:17.745570  8183 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
W20260709 13:17:17.753983  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 52950.6us
I20260709 13:17:17.721405 11205 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.756276 11198 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:17.756999 11198 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:17.758414 11198 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.759917 11198 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:17.761560  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.763152 11072 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:17.763860 11072 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.769177  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:17.769914  8178 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.780511  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:17.780865  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:17.780992 11207 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:17.782560 10970 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:17.782722  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:17.783494  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1204) took 1006 ms. Trace:
W20260709 13:17:17.783715  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.783903  8177 rpcz_store.cc:276] 0709 13:17:16.777112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.779552 (+  2440us) service_pool.cc:224] Handling call
0709 13:17:16.779850 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.939244 (+159394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.783092 (+843848us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400180954. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:17.783334 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271619456}
I20260709 13:17:17.785386 11096 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:17.785959 11096 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:17.786432 11096 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.794713 11151 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:17.796746  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.747748 11010 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:17.817737  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:17.809973 10791 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:17:17.819454 11139 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:17.820004 11139 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:17.821126 11205 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:17.841833  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:17.842730  8183 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
W20260709 13:17:17.847051  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.821317 11139 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.849514 11072 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:17.852775 11074 consensus_meta.cc:287] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.073s	user 0.010s	sys 0.007s
I20260709 13:17:17.853509 11074 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:17.871330  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.874320 11074 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:17.876645  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.866222 11195 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:17.882241  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:17.889046  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.890854  8178 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
W20260709 13:17:17.878070 11127 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:17:17.881677 11074 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.883104 10839 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.884315 11195 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.916417 11145 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.916527 10735 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.917227  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.921715  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:17.929505  8175 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:17.930290  8784 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:17.922560  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.931744  8100 raft_consensus.cc:2393] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:17.932127  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2049) took 1209 ms. Trace:
I20260709 13:17:17.932432 11145 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:17.933254  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.934501  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.937934  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:17.923367  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:17.938017  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:17.939294  8104 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.942231 11195 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.923005 10839 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:17.943691  8108 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:17.944584 11073 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.944746  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:17.944914 10839 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:17.932480  8100 rpcz_store.cc:276] 0709 13:17:16.722480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.922145 (+1199665us) service_pool.cc:224] Handling call
0709 13:17:17.932078 (+  9933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:17.945425  8108 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:17.946122  8099 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:17.928498 11074 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.954155 11007 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:17.956286 11074 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:17.919124  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:17.957998  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.958670  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:17.959292  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.959597  8783 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:17.960109  8101 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:17.952477  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:17.945497 10839 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:17.966166  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.969504  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:17.969888 10839 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:17.970275  8784 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:17.970491  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:17.971230  8179 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.973973 11139 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.974843  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:17.976253  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:17.976491 10812 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:17.976967  8783 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:17.967365  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1206) took 1122 ms. Trace:
I20260709 13:17:17.977594  8182 rpcz_store.cc:276] 0709 13:17:16.777783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.780029 (+  2246us) service_pool.cc:224] Handling call
0709 13:17:16.780321 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.780546 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:16.805036 (+ 24490us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.685358 (+880322us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b18003936a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec23a 00007fa5a0e56a2a
0709 13:17:17.827380 (+142022us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:17.834470 (+  7090us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:17.861614 (+ 27144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.890773 (+ 29159us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.900467 (+  9694us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24324,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":7965,"raft.queue_time_us":2673,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":5185,"spinlock_wait_cycles":31448832,"thread_start_us":64201,"threads_started":1}
I20260709 13:17:17.982620  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:17.983258  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.988611  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:17.981906 10812 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:17.998489 10812 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.999812  8785 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:18.000957  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:18.001814  8099 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:18.008163  8175 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:18.011308  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2169) took 1236 ms. Trace:
I20260709 13:17:18.011766  8253 rpcz_store.cc:276] 0709 13:17:16.774509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.774691 (+   182us) service_pool.cc:224] Handling call
0709 13:17:18.010788 (+1236097us) spinlock_profiling.cc:243] Waited 95.2 ms on lock 0x7b5400412dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:18.011027 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218865408}
I20260709 13:17:18.015940  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1205) took 1238 ms. Trace:
I20260709 13:17:18.016733  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:18.017565  8788 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.021940  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:18.022377 11027 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:18.022716  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:18.022975 11070 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:18.024474  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:18.025177  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:18.016335  8180 rpcz_store.cc:276] 0709 13:17:16.777449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.777595 (+   146us) service_pool.cc:224] Handling call
0709 13:17:16.777994 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.577599 (+799605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.015650 (+438051us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b5400332054. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:18.015886 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1836758400}
I20260709 13:17:18.022017  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:18.028791  8785 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:18.028843 11096 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:18.030174  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2167) took 1349 ms. Trace:
I20260709 13:17:18.034096  8254 rpcz_store.cc:276] 0709 13:17:16.681188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.681349 (+   161us) service_pool.cc:224] Handling call
0709 13:17:16.681642 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.409302 (+727660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.029959 (+620657us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b5400089dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:18.030124 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671474048}
I20260709 13:17:18.031944 11020 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:18.034679 10969 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:18.034788  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 52250.8us
I20260709 13:17:18.015780  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:18.035421 10969 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.041658 10969 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:18.041792 10992 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:18.042294 10992 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.042631 10992 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:18.044273 10816 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:18.046729 11073 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:18.048256 11153 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:18.048667 11153 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:18.048813 11145 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:18.035204 11225 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.050267 11225 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:18.049676 11153 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:18.052398 11153 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:18.036401  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:18.052464 11225 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:18.055243  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:18.037680  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:18.058344  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:18.054747  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 53753.2us
I20260709 13:17:17.963656 11183 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:18.060235  8179 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:18.062230  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:18.063717  8788 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:18.061501 11206 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.061609 11195 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:18.065729  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:17.982316 11074 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.069293  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:18.071717  8102 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:17:18.080893  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.065011 11137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.616s	user 0.024s	sys 0.035s
I20260709 13:17:18.062616 11225 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.086045  8784 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:18.085325  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:18.088131  8789 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.086019  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:18.087141  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:18.085616  8100 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:18.085048  8106 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:18.058693  8783 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:17:18.099005 11206 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:18.061444 10983 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:17:18.106501 10791 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.108336 10791 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:18.111862 10791 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:18.112957  8102 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:18.115012  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:18.117702  8104 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:18.071082 11195 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:17:18.084589 11137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.818s	user 0.024s	sys 0.036s
W20260709 13:17:18.127249  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 61958.5us
I20260709 13:17:18.140993  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:18.143812  8105 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:17:18.144197  8105 pending_rounds.cc:85] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 7
I20260709 13:17:18.144939  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:18.145771  8104 raft_consensus.cc:2393] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:17:18.147740  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 83479us
W20260709 13:17:18.148780  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 90517.3us
I20260709 13:17:18.149809  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:18.153024  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.153393 11155 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:18.154011 11155 raft_consensus.cc:697] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:18.154960 11155 consensus_queue.cc:237] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:18.157974  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:18.169519  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:18.144429  8105 pending_rounds.cc:107] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:17:18.172536  8105 raft_consensus.cc:2889] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:18.143157 11195 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:18.134220 11027 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:18.185250  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:18.118198 11074 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:18.180572  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:18.184365  8108 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:18.186198  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:18.128810 11188 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:18.183054  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:18.192982  8254 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:18.198377  8784 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:18.187822 11145 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:18.203059 11145 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:18.203462 11145 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:18.205849  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.191118  8182 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:17:18.161953 11096 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:18.157253 10992 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:18.142855 11225 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:18.212469  8102 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:18.213594  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.216320 10969 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:18.218137  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:18.218909  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:18.221028  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:18.221738  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:18.222224 11183 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:18.222339 11087 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.239403  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:18.222944  8147 connection.cc:256] RPC call timeout handler was delayed by -1.5965122950001387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
I20260709 13:17:18.223140  8255 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:17:18.223543 10456 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.225059 11074 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:18.210284 11206 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:18.233208  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.235284  8788 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:18.235371  8785 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:18.236806  8100 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:18.241127  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.231729  8789 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:18.262753  8787 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:18.233049 10735 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:18.269217 10962 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:18.262759 10456 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:18.269215 10735 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:18.273036 10735 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:18.257751  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 108046us
I20260709 13:17:18.265558  8179 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:17:18.266991  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.267108  8784 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:17:18.267609  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 91111us
I20260709 13:17:18.283033  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:18.283838  8181 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:18.265563 10839 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:18.286201  8104 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:17:18.275144 11148 consensus_meta.cc:287] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.004s
I20260709 13:17:18.279603  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:18.294132  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:18.293017  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:18.293764 11096 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.245445 11188 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:18.289099 10839 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:18.311050  8256 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:18.314657  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.319905  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.316475  8108 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:18.316639  8101 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
W20260709 13:17:18.317672  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.322355  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 46177.9us
I20260709 13:17:18.325758  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:18.274240 11087 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:18.335304 11087 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:18.336032  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:18.336840  8178 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:18.338709  8176 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: [7.2-7.2]
I20260709 13:17:18.331029  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:18.333485 11183 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:18.342417  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.342533  8248 raft_consensus.cc:2410] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:18.341104  8782 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:18.335979  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:18.347702  8180 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:18.321867 10839 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:18.355633  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.356416  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.358039  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:18.418197  8181 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
W20260709 13:17:18.419504 11229 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.067s	user 0.001s	sys 0.002s
I20260709 13:17:18.358742 10456 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:18.363247  8257 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:18.362586  8147 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:18.365950  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.420994  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 415) took 2167 ms. Trace:
I20260709 13:17:18.421241  8252 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:18.366685  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.421705 11070 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:18.367343  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.422767  8249 raft_consensus.cc:2410] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:18.421528  8107 rpcz_store.cc:276] 0709 13:17:16.253300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.274694 (+ 21394us) service_pool.cc:224] Handling call
0709 13:17:16.277534 (+  2840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.277991 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:16.278028 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.280290 (+  2262us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.031424 (+1751134us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b1800357fa0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:17:18.137560 (+106136us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:18.137600 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.137676 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.418902 (+281226us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:18.420592 (+  1690us) raft_consensus.cc:1685] finished
0709 13:17:18.420617 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.420792 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2009,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":8902,"spinlock_wait_cycles":42870400,"thread_start_us":105872,"threads_started":1,"wal-append.queue_time_us":1982592}
I20260709 13:17:18.369935 11139 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:18.424373  8223 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:18.370405 11202 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:18.425230  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:18.425647 10791 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:18.426098 10791 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:18.373569 10735 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.426512 11149 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:18.427091 11149 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:18.426961 10735 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:18.428068 11149 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:18.426522 10791 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:18.425289 11202 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:18.432015 11202 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:18.429220 10735 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:18.325053 11096 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:18.421541  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 59238.8us
W20260709 13:17:18.376010  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.434583  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.434605  8147 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:18.435322  8249 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 3: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:18.435169  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.435904  8257 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:18.436304 10953 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:18.436474  8252 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:18.436946  8147 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:18.376379 11206 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:18.379367  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.390271 11188 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:18.394627 10812 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:18.395819 10969 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:18.399032 11148 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:18.405725 11225 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:18.406742 10992 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:18.369000  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.414489  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:18.439018  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:18.438037  8253 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:18.444011  8256 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:18.447688  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:18.447383  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.470819  8249 raft_consensus.cc:2410] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:18.471855  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:18.447415  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.470069  8250 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:18.475016  8257 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:18.482576  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:18.485889  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:18.488548  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:18.493602  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 79215.8us
I20260709 13:17:18.493803  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:18.492794  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:18.494537  8788 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:18.444204 11148 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:18.497035  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 153164us
I20260709 13:17:18.501811  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:18.442953 11206 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:18.482270 10983 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:18.520291  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:18.740957  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.602432  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:19.295688 11172 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:18.658754 10735 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:19.298246 11172 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.555207 10992 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:19.298708 11172 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.298507 10735 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:19.299084 10992 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.664338  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:18.520222 11148 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:18.623704 11183 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:19.301172 11183 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:18.652830 11225 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:18.516673 11096 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:18.507783  8252 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
W20260709 13:17:18.732604 11145 consensus_meta.cc:287] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.000s
I20260709 13:17:19.326824 10735 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:19.332952  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:19.333392  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2160) took 3097 ms. Trace:
I20260709 13:17:19.333760  8255 rpcz_store.cc:276] 0709 13:17:16.235799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.235977 (+   178us) service_pool.cc:224] Handling call
0709 13:17:16.236309 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.248866 (+2012557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.333145 (+1084279us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54001e5354. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:19.333318 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4546186112}
I20260709 13:17:19.335033  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:19.335530  8255 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:18.623052  8783 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:17:19.297463 11004 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:19.338617 11004 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.340396 11004 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:19.341578 11074 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:19.342196 11074 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.344143 11074 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:19.344193 11233 log.cc:927] Time spent T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.213s	user 0.003s	sys 0.001s
I20260709 13:17:19.344669 11074 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:19.299614 10992 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.345460  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:18.523311  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:18.482551 10918 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:18.487939 11070 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:18.488422 10969 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.308219  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:18.521178 11188 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:18.446885 11195 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:18.941123 11137 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.623346  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:19.310976  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:18.522645  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:19.311412 11183 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:19.311481  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 788683us
I20260709 13:17:19.292286  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:18.675837 11228 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
I20260709 13:17:18.977689 10997 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:18.623983  8784 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:17:19.319847  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:19.086459  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 424) took 1655 ms. Trace:
W20260709 13:17:19.323632  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.324929 11206 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:19.325446 11227 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 1.046s	user 0.003s	sys 0.011s
I20260709 13:17:19.293685 10983 raft_consensus.cc:697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:19.326330 11145 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:19.328111 11153 consensus_meta.cc:287] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.275s	user 0.011s	sys 0.000s
I20260709 13:17:19.328568  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:19.338045  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:19.494445  8100 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:17:19.351141  8253 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: [7.2-7.2]
I20260709 13:17:19.478062  8179 raft_consensus.cc:2410] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:19.317381 11172 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:19.496008  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:19.479770  8105 rpcz_store.cc:276] 0709 13:17:17.386921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.388714 (+  1793us) service_pool.cc:224] Handling call
0709 13:17:17.389186 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.205589 (+816403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.041937 (+836348us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b5400212ad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:19.042213 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1723772800}
I20260709 13:17:19.427441  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:19.364663  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:19.427449  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 990522us
I20260709 13:17:19.466112  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:19.425341  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:19.479131  8107 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:19.498378  8147 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:18.809710  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:19.499217  8789 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:18.721958  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:19.342172  8257 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:19.502961  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:19.423071  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:19.503612  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:18.925273  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:19.503983  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:19.504469  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2143) took 1153 ms. Trace:
I20260709 13:17:19.504557  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2150) took 1108 ms. Trace:
I20260709 13:17:19.503101  8790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 695) took 1064 ms. Trace:
I20260709 13:17:19.504742  8101 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:19.503170  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2148) took 1115 ms. Trace:
I20260709 13:17:19.426429  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:19.486264  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2133) took 1012 ms. Trace:
I20260709 13:17:19.465355  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:19.486912  8177 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 3.
I20260709 13:17:18.816655  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:19.388103 11139 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.499035  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1203) took 1007 ms. Trace:
I20260709 13:17:19.516795  8107 rpcz_store.cc:276] 0709 13:17:18.491649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.491784 (+   135us) service_pool.cc:224] Handling call
0709 13:17:19.498978 (+1007194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.517232  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:19.515488  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:19.518071  8174 raft_consensus.cc:2410] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:17:19.345574  8782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48110 (request call id 807) took 1127 ms. Trace:
I20260709 13:17:19.452416 11198 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.465255 10735 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:19.504874  8178 rpcz_store.cc:276] 0709 13:17:18.350691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.781899 (+431208us) service_pool.cc:224] Handling call
0709 13:17:19.504419 (+722520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.505563  8790 rpcz_store.cc:276] 0709 13:17:18.438620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.438796 (+   176us) service_pool.cc:224] Handling call
0709 13:17:19.503044 (+1064248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.503010  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1229) took 1002 ms. Trace:
W20260709 13:17:19.515815  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 995553us
I20260709 13:17:19.532297  8181 rpcz_store.cc:276] 0709 13:17:18.496891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.767508 (+270617us) service_pool.cc:224] Handling call
0709 13:17:19.499547 (+732039us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.533492  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:19.533653  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:19.499835  8104 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:19.489681 11225 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.534718  8181 raft_consensus.cc:2393] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:19.534874 11225 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.505039  8179 rpcz_store.cc:276] 0709 13:17:18.387916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.523487 (+135571us) service_pool.cc:224] Handling call
0709 13:17:19.496253 (+972766us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.506268  8182 rpcz_store.cc:276] 0709 13:17:18.387404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.652437 (+265033us) service_pool.cc:224] Handling call
0709 13:17:19.503117 (+850680us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.520816  8785 raft_consensus.cc:2410] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:17:19.516350  8249 rpcz_store.cc:276] 0709 13:17:18.473923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.487849 (+ 13926us) service_pool.cc:224] Handling call
0709 13:17:19.486216 (+998367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.522518  8251 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 6: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:19.522742  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:19.519367  8176 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 3.
I20260709 13:17:19.535669  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:19.496338 11027 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:19.465013 11096 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:19.526566  8787 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:19.427099  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:19.527211  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:19.540787  8786 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:19.527851  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1231) took 1003 ms. Trace:
I20260709 13:17:19.528363  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:19.552237  8175 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:19.527998  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:19.501612 11188 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:19.504730 11183 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.528304  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2147) took 1141 ms. Trace:
I20260709 13:17:19.560752  8180 rpcz_store.cc:276] 0709 13:17:18.387108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.816338 (+429230us) service_pool.cc:224] Handling call
0709 13:17:19.528246 (+711908us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.494369 10997 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.543690  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:19.522351  8782 rpcz_store.cc:276] 0709 13:17:18.217949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.218618 (+   669us) service_pool.cc:224] Handling call
0709 13:17:19.345376 (+1126758us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54003165d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:19.345498 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237507968}
I20260709 13:17:19.550999 11153 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:17:19.515333 11155 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.154s	user 0.001s	sys 0.013s
I20260709 13:17:19.553094  8253 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:19.580324  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2181) took 1218 ms. Trace:
I20260709 13:17:19.554208  8255 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:19.551888  8174 rpcz_store.cc:276] 0709 13:17:18.524717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.516979 (+992262us) service_pool.cc:224] Handling call
0709 13:17:19.527782 (+ 10803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.524698 11070 raft_consensus.cc:697] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:19.526432 10812 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:19.501755 11137 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.494400 10969 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.566346  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:19.567206  8176 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:19.594378  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2142) took 1258 ms. Trace:
I20260709 13:17:19.568693 11004 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.513782 10918 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.541884 11139 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.574162  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1221) took 1716 ms. Trace:
I20260709 13:17:19.580802  8251 rpcz_store.cc:276] 0709 13:17:18.362259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.366425 (+  4166us) service_pool.cc:224] Handling call
0709 13:17:19.580065 (+1213640us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002aeed4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:19.580251 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2511317888}
I20260709 13:17:19.602982  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:19.603912 11195 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:19.604120  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:19.565188 11096 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.607441 11096 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:19.607975 11096 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.608319 11148 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:19.608811 11096 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:19.609411  8252 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:19.583986  8254 raft_consensus.cc:1240] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:19.583992  8105 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:19.565151  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:19.591854  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:19.579614 11155 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.001s	sys 0.013s
I20260709 13:17:19.564767  8177 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:19.614060  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2151) took 1191 ms. Trace:
I20260709 13:17:19.614516  8177 rpcz_store.cc:276] 0709 13:17:18.422648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.526894 (+1104246us) service_pool.cc:224] Handling call
0709 13:17:19.613989 (+ 87095us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.530285 11198 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.595198  8179 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:19.536230 10735 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:19.595839  8175 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:19.619032  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2146) took 1232 ms. Trace:
I20260709 13:17:19.594897  8176 rpcz_store.cc:276] 0709 13:17:18.335576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.542693 (+1207117us) service_pool.cc:224] Handling call
0709 13:17:19.566998 (+ 24305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.594027 (+ 27029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.594304 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.597361  8174 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:19.599515  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:19.577798 11153 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:19.574752  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2144) took 1220 ms. Trace:
W20260709 13:17:19.591715 10791 consensus_meta.cc:287] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.162s	user 0.006s	sys 0.005s
I20260709 13:17:19.611475  8182 raft_consensus.cc:2410] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:17:19.624027  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1230) took 1103 ms. Trace:
I20260709 13:17:19.625735  8174 rpcz_store.cc:276] 0709 13:17:18.520818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.582445 (+1061627us) service_pool.cc:224] Handling call
0709 13:17:19.595616 (+ 13171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.623797 (+ 28181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.623975 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.619452  8175 rpcz_store.cc:276] 0709 13:17:18.386811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.577267 (+1190456us) service_pool.cc:224] Handling call
0709 13:17:19.593270 (+ 16003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.618734 (+ 25464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.618965 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.602088  8183 rpcz_store.cc:276] 0709 13:17:17.862844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.873333 (+ 10489us) service_pool.cc:224] Handling call
0709 13:17:17.873879 (+   546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.892704 (+ 18825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.892740 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:17.911976 (+ 19236us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.128204 (+216228us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:18.128259 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.128347 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.324808 (+1196461us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:19.551820 (+227012us) raft_consensus.cc:1685] finished
0709 13:17:19.551842 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.574095 (+ 22253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15637,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":17213,"spinlock_wait_cycles":11099008,"thread_start_us":191633,"threads_started":1,"wal-append.queue_time_us":252977}
I20260709 13:17:19.626960  8177 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:19.624809  8181 rpcz_store.cc:276] 0709 13:17:18.354018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.543002 (+1188984us) service_pool.cc:224] Handling call
0709 13:17:19.574162 (+ 31160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.574369 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.574405 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:19.574456 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:19.574501 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.574564 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.574686 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.609226 11096 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.598006 10953 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:19.628705  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:19.609869 11246 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:19.629871 11238 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.243s	user 0.002s	sys 0.000s
I20260709 13:17:19.646149  8255 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:19.634196 11148 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:19.599946 10812 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.671561 10812 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:19.674181 10839 consensus_meta.cc:287] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.259s	user 0.010s	sys 0.000s
I20260709 13:17:19.674618 10839 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:19.675676  8250 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:19.675767  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2128) took 1240 ms. Trace:
I20260709 13:17:19.676107  8254 rpcz_store.cc:276] 0709 13:17:18.435094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.435276 (+   182us) service_pool.cc:224] Handling call
0709 13:17:19.581910 (+1146634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.612189 (+ 30279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.675573 (+ 63384us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002aeed0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:19.675712 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2636367104}
I20260709 13:17:19.676764 10839 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:19.677263  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2134) took 1179 ms. Trace:
I20260709 13:17:19.677645  8250 rpcz_store.cc:276] 0709 13:17:18.498346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.520202 (+ 21856us) service_pool.cc:224] Handling call
0709 13:17:18.617616 (+ 97414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.676049 (+1058433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.677056 (+  1007us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400197654. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:19.677210 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432943488}
I20260709 13:17:19.677703 11070 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.665206  8001 catalog_manager.cc:5697] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:19.682142  8174 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:19.682472 10969 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:19.683882  8255 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:19.685477 11225 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:19.686059 11225 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:19.686389 11225 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:19.687252 11225 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.2, Last appended by leader: 2, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:19.688481 11225 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.609673 11004 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.690263 10812 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:19.680549  8001 catalog_manager.cc:5697] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:19.691694 11004 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:19.575946 11183 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.692898  8001 catalog_manager.cc:5697] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 6, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 6 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:19.705984 11183 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:19.623226  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 279609us
I20260709 13:17:19.638176 11155 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:19.714392 11155 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:19.714890 11155 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:19.714564 11004 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:19.715829 11155 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:19.717125 11155 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.635739 11153 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:19.639160 10791 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.640199 11139 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:19.641206  8176 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:19.628789  8179 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:17:19.543749 10983 consensus_queue.cc:237] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:19.649897  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:19.658138 11246 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.658964 10997 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:19.659731 11198 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:19.659457 11188 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:19.660077 11236 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.246s	user 0.003s	sys 0.000s
I20260709 13:17:19.660190 11137 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:19.662465  8002 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39828 (request call id 274) took 29405 ms (client timeout 15000 ms). Trace:
I20260709 13:17:19.775450  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:19.664049 11172 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:19.664424 11245 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.646242 11096 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.665949 10735 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:19.666524 11232 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:17:19.666936 11145 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:19.641933 10953 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.670729 10918 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:19.638617  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:19.718799  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:19.763010  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 178680us
W20260709 13:17:19.787225  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 68549.8us
W20260709 13:17:19.766860  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.779078  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 136271us
W20260709 13:17:19.771000  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 272694us
I20260709 13:17:19.779261  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2145) took 1393 ms. Trace:
I20260709 13:17:19.777810  8251 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:19.787355 10953 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:19.779654  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 217027us
I20260709 13:17:19.790437  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:19.790736  8072 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:19.792580 11252 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:19.792626 11172 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:19.794703 11172 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.795159 11172 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.796065  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:19.796599 10791 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:19.787998 10918 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:19.797071 11172 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:19.786185 11245 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:19.805899  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 309948us
I20260709 13:17:19.788625 11183 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:19.807469  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:19.787240 11145 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:19.809485  8221 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:19.812650  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.813076  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.792421 11253 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:19.818305  8221 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:19.815003  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 44405us
I20260709 13:17:19.819476  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:19.808387 10735 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:19.775615  8002 rpcz_store.cc:269] 0709 13:16:50.257199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.257339 (+   140us) service_pool.cc:224] Handling call
0709 13:16:50.651683 (+394344us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b540006a9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db6090 00007fa5a0e54f3a 00007fa5a6c0b1cc 00007fa5a6d0937e 00007fa5a51ca2a4 00007fa5a51ca232 00007fa5a51ca161 00007fa5a51ca0dc 00007fa5a51c9392 00007fa59f18748c 00007fa59f1868c6
0709 13:17:19.662218 (+29010535us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:13.564404 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:13.565195 (+   791us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:13.565252 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:17:13.565278 (+    26us) tablet.cc:662] Decoding operations
0709 13:17:13.565828 (+   550us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:13.565925 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:13.565956 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:17:13.566476 (+   520us) tablet.cc:701] Row locks acquired
0709 13:17:13.566529 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:17:13.566695 (+   166us) write_op.cc:270] Start()
0709 13:17:13.566850 (+   155us) write_op.cc:276] Timestamp: P: 1783603033566632 usec, L: 0
0709 13:17:13.566872 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:17:13.614004 (+ 47132us) log.cc:844] Serialized 919 byte log entry
0709 13:17:14.085554 (+471550us) op_driver.cc:464] REPLICATION: finished
0709 13:17:14.719805 (+634251us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa59dd420ac 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a4882ef0
0709 13:17:15.166715 (+446910us) write_op.cc:301] APPLY: starting
0709 13:17:15.171565 (+  4850us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:15.197054 (+ 25489us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:15.202287 (+  5233us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:15.230764 (+ 28477us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:15.245635 (+ 14871us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:17:15.249802 (+  4167us) write_op.cc:312] APPLY: finished
0709 13:17:15.262269 (+ 12467us) log.cc:844] Serialized 29 byte log entry
0709 13:17:15.560481 (+298212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:15.560615 (+   134us) write_op.cc:454] Released schema lock
0709 13:17:15.560676 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:15.561238 (+   562us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:15.561286 (+    48us) write_op.cc:454] Released schema lock
0709 13:17:16.366214 (+804928us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
Metrics: {"mutex_wait_us":2373600,"reported_tablets":20,"spinlock_wait_cycles":8484224,"child_traces":[["op",{"apply.queue_time_us":1053913,"apply.run_cpu_time_us":19552,"apply.run_wall_time_us":413930,"num_ops":2,"prepare.queue_time_us":111701,"prepare.run_cpu_time_us":20256,"prepare.run_wall_time_us":123162,"raft.queue_time_us":241648,"raft.run_cpu_time_us":35360,"raft.run_wall_time_us":1082929,"replication_time_us":446507,"spinlock_wait_cycles":18475136,"thread_start_us":1520090,"threads_started":5,"wal-append.queue_time_us":610189,"wal-append.run_cpu_time_us":103792,"wal-append.run_wall_time_us":2857771}]]}
I20260709 13:17:19.706085  8001 catalog_manager.cc:5697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 5 to 7, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 7 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:19.809345 11172 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:19.811091 11145 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:19.830047  8221 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:19.814266 11027 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:17:19.828087 11249 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:19.831410  8249 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:19.831970 11246 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:19.823499 11198 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:19.836587 11074 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:19.836907  8221 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:19.839478  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:19.789177  8180 rpcz_store.cc:276] 0709 13:17:18.386437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.561620 (+1175183us) service_pool.cc:224] Handling call
0709 13:17:19.580839 (+ 19219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.595370 (+ 14531us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:19.602546 (+  7176us) log.cc:844] Serialized 14 byte log entry
0709 13:17:19.778563 (+176017us) log.cc:844] Serialized 14 byte log entry
0709 13:17:19.778935 (+   372us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:19.778980 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:19.779021 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.779083 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.779207 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7978,"prepare.queue_time_us":7580,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":18388,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":22609280,"thread_start_us":164107,"threads_started":1,"wal-append.queue_time_us":158553}
I20260709 13:17:19.845783 11256 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:19.847451  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:19.830744 11183 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:19.844601 11145 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:19.873714 11139 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:19.874279 11246 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:19.881705 10918 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:19.893947 11246 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.884835 11245 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:19.883553  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:19.854954 10735 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:19.894596 11232 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:17:19.864527 10812 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:19.844715 10992 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:19.893930  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:19.905802  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:19.922017  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:19.887010 11250 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:17:19.887569 11149 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:19.894510 11139 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.852340 11249 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:19.910279  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 62907.4us
I20260709 13:17:19.858501 11198 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:19.912621 11246 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:19.914538 10839 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:19.914659 10997 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.936124  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:19.916066  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:19.858361 11074 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:19.916399  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2188) took 1552 ms. Trace:
I20260709 13:17:19.853214 11172 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.922611  8104 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:19.863962 11256 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:19.924592  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:19.951201  8101 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:19.926680  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:19.819340 11253 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:19.920709  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 102749us
I20260709 13:17:19.935062  8178 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:19.913695 11252 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:19.936663  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:19.939100  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:19.956281 11225 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:19.927569 11139 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.968622  8179 pending_rounds.cc:85] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 4
W20260709 13:17:19.968772  8149 connection.cc:256] RPC call timeout handler was delayed by -1.223771485000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260709 13:17:19.968986  8179 pending_rounds.cc:107] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:17:19.959025  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:19.969501  8179 raft_consensus.cc:2889] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:19.936276 11198 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.961192  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:19.961777  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2075) took 1875 ms. Trace:
W20260709 13:17:19.972862  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 46226.3us
I20260709 13:17:19.968772  8100 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:19.974691  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:19.944310  8248 rpcz_store.cc:276] 0709 13:17:18.364387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.416308 (+ 51921us) service_pool.cc:224] Handling call
0709 13:17:18.416562 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.309358 (+892796us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:19.536588 (+227230us) log.cc:844] Serialized 14 byte log entry
0709 13:17:19.804632 (+268044us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:19.804702 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:19.804777 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.916094 (+111317us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54004137d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:19.916145 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.916272 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2200,"prepare.queue_time_us":269393,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":1780,"raft.queue_time_us":1001,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":7213,"spinlock_wait_cycles":2052690816,"thread_start_us":480854,"threads_started":2,"wal-append.queue_time_us":321724}
I20260709 13:17:19.946368 11137 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:19.946146 11074 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:19.934762 11249 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:19.976426  8174 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:19.926048 11149 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:19.977375  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:19.983703  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:19.995464  8099 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:19.995833  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:19.996611  8104 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:19.980033  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 173791us
I20260709 13:17:19.973060  8106 rpcz_store.cc:276] 0709 13:17:18.086843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.269838 (+182995us) service_pool.cc:224] Handling call
0709 13:17:18.270170 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:18.270608 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.270662 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:18.271333 (+   671us) log.cc:844] Serialized 52 byte log entry
0709 13:17:18.511005 (+239672us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:18.601158 (+ 90153us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.624839 (+ 23681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.624941 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.961484 (+1336543us) raft_consensus.cc:1685] finished
0709 13:17:19.961515 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.961694 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23346,"prepare.queue_time_us":89934,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":54751,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":14605,"thread_start_us":239274,"threads_started":1,"wal-append.queue_time_us":1268903}
I20260709 13:17:19.982252  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:19.995390  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:19.994627  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:19.998499  8101 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:19.998265  8147 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:20.003890  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:20.008078  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1232) took 1437 ms. Trace:
I20260709 13:17:20.001253  8102 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:20.008509  8178 rpcz_store.cc:276] 0709 13:17:18.563695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.598988 (+1035293us) service_pool.cc:224] Handling call
0709 13:17:19.616334 (+ 17346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.957529 (+341195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.001002 (+ 43473us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54000d75d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:20.001191 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732419328}
I20260709 13:17:19.971909 10812 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:19.947517 10997 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.018301  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:19.975165 11245 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:20.013631  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:19.980957 11137 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.021361  8174 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:17:20.021535  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 192353us
I20260709 13:17:20.002496 11149 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:20.023381  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:20.027539  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:20.027901  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:19.963553 10839 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:19.980983 11004 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:17:20.040752  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:20.046732  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:20.047356  8100 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
W20260709 13:17:20.053992  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 73800.8us
I20260709 13:17:20.040971  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:20.041332  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:20.056175  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 58004.7us
I20260709 13:17:20.056890  8147 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:20.042467  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:20.010387 11183 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.044080  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:20.071707  8183 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:19.909914  8001 catalog_manager.cc:5697] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 5 to 7, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 7 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:17:20.088335  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 44338.7us
W20260709 13:17:20.079700  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 105091us
I20260709 13:17:20.020874 11137 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:20.089775  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:20.085641  8104 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:20.019994 11264 raft_consensus.cc:3055] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:20.003815 11225 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.091089  8101 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:17:20.097162 11255 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
W20260709 13:17:20.158771  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 69117.1us
W20260709 13:17:20.194017  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:20.183210  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 108427us
I20260709 13:17:20.184780 11270 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:20.226934 11270 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.092159 10918 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:20.092551 11264 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:20.099404 10812 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:20.213042 11267 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:17:20.153218 10983 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:17:20.093968 11258 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.137s
I20260709 13:17:20.179347 10992 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:20.248356  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:20.165699 11268 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:20.238581 11269 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:20.092649 11252 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.254237 11266 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:20.256083 11266 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:20.256569 11266 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:20.237169 11283 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.251838 11276 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:17:20.252144 10918 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:20.252902 11281 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:20.252295 11264 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:20.253600 11280 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:20.254402 11269 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:20.194720 11272 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:20.195478 10735 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:20.263422 10997 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:20.245697 11027 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:20.284821 10812 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:17:20.286525  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 193215us
I20260709 13:17:20.254335 11268 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.317466 11268 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:20.317668  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 262174us
I20260709 13:17:20.258309 11172 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:20.285342 10918 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:20.319592  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:20.290086 11281 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:17:20.297624 11155 consensus_meta.cc:287] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.538s	user 0.004s	sys 0.007s
W20260709 13:17:20.297394 10953 consensus_meta.cc:287] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.002s
I20260709 13:17:20.314572 11264 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:20.098686 11256 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.319324 11027 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.253607 11278 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
W20260709 13:17:20.339679  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 282852us
W20260709 13:17:20.313624  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 104971us
I20260709 13:17:20.324545  8223 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:20.351006  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:20.340972  8175 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:17:20.351858  8175 pending_rounds.cc:85] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 4
I20260709 13:17:20.352100  8175 pending_rounds.cc:107] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:17:20.352418  8175 raft_consensus.cc:2889] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:20.353538  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:20.319633 10812 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.320438 11253 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:20.363768  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:20.338232 11245 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:17:20.367094  8074 connection.cc:256] RPC call timeout handler was delayed by -1.0230127240001821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
W20260709 13:17:20.368602  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 44152.8us
I20260709 13:17:20.285003 11283 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.370325  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:20.371693  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:20.372450  8256 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:20.373577  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:20.374320  8257 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:20.375711  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:20.336359 11281 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:20.380262  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:20.380501  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:20.369997  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:20.381096  8249 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:20.383569  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:20.347244 11027 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:20.357930 10812 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:20.358536 10839 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:20.395649  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:20.385746 11096 consensus_meta.cc:287] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.002s
I20260709 13:17:20.345307 10953 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.247761  8001 catalog_manager.cc:5697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 4 to 6, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 6 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:20.385218 11225 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:20.423846 11289 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:20.424459 11289 raft_consensus.cc:697] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:20.425443 11289 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:20.426882 11294 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:20.429071 11286 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:20.429543 11286 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:20.430322 11275 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 13:17:20.432001 11288 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:17:20.433398  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.369626 11245 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:20.435482 11245 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.436507 11245 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:20.412233 11282 raft_consensus.cc:3055] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:20.437785 11282 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:20.437877 11290 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:20.438820 11282 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.440173 11282 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:20.441931 11274 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:17:20.386566 11277 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.300727 11280 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.417755 11266 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:20.418218 11096 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.420444 10953 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:20.422518  8001 catalog_manager.cc:5697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:20.425597 10918 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.415331  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:20.414386  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:20.348060 11249 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.464293 11249 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:20.339726 11272 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.466470 11272 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:20.466907 11277 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:20.469861  8257 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
W20260709 13:17:20.471315 11153 consensus_meta.cc:287] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.000s
I20260709 13:17:20.471761 11153 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:20.446513  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 127006us
I20260709 13:17:20.475570  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:20.477756 11299 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.477862 10918 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:20.447448 11155 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:20.450712  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 101190us
W20260709 13:17:20.479724  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.480275  8147 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:20.451287 11295 consensus_queue.cc:1059] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:20.388588 11269 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.482124 11295 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:20.482438 11269 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:20.483093 11096 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:20.483531 11295 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:20.483848  8108 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:20.484333 11293 raft_consensus.cc:3055] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:20.484743 11293 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:20.485069  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 70778.4us
I20260709 13:17:20.485929  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:20.486440  8782 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:20.487485  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:20.453006 11270 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:20.461517 11275 consensus_queue.cc:1243] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:20.473250  8182 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:20.460196 11137 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.407012 11244 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:20.499398  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:20.502872  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:20.466765 11280 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:20.457296 10812 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:20.535974  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.560534  8791 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:20.560609  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:20.561503  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:20.562345  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:20.584867  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 62090.6us
I20260709 13:17:20.483919 11295 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:20.469305 11277 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:20.586642  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:17:20.501859 11139 consensus_meta.cc:287] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.504s	user 0.005s	sys 0.004s
I20260709 13:17:20.501523 11249 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.505548 11266 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:20.618517 11268 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:20.619575  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:20.524348 11299 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:17:20.502060 11272 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:20.560077 11225 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:17:20.583889 11198 consensus_meta.cc:287] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.000s
I20260709 13:17:20.521265 11278 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:20.524925 11283 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:20.642138  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 393862us
W20260709 13:17:20.627637  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 67732.3us
I20260709 13:17:20.627362  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:20.591169 11295 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:20.613521 11280 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:17:20.646677  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:20.641019  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.642871  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:20.623225 11074 consensus_meta.cc:287] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.000s
I20260709 13:17:20.637655 11251 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:20.662926  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:20.592461 11270 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:20.654973 11273 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:20.670997  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:20.641649 11278 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.648123 11070 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:20.658473 11280 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:20.658882  8001 catalog_manager.cc:5697] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 4 to 5, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 5 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:20.757370  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:20.655756  8782 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:20.660830 11074 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:20.646077 11225 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:20.661307 11297 consensus_queue.cc:1059] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:17:20.815208 11297 raft_consensus.cc:3055] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:20.815657 11297 raft_consensus.cc:740] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:20.661053  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:20.817771  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 156789us
I20260709 13:17:20.818573  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:20.819375 11148 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:20.819913  8223 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:20.820029 11148 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:20.642222 11266 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:20.821480 11266 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:20.655133 11145 consensus_meta.cc:287] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.743s	user 0.010s	sys 0.001s
I20260709 13:17:20.825284 11145 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.827302 11145 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:20.677690  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:20.832700  8255 raft_consensus.cc:2410] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:17:20.677801  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:20.678511  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:20.678666  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:20.626842 11139 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:20.759235 10812 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:20.679256 11280 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:20.672968 11272 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:20.837770 11272 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:20.837795 10812 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:17:20.842199  8001 catalog_manager.cc:5697] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 1 to 3, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 3 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:20.753667 11070 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.847685 11070 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:20.848521 11282 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.849128 11282 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.754521 11303 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:20.857923 11303 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.858366 11303 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:20.859701 11225 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:20.862936 11137 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:20.867679 11283 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:20.868249 11283 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:20.768718  8257 raft_consensus.cc:2368] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4.
W20260709 13:17:20.660518 11149 consensus_meta.cc:287] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.580s	user 0.006s	sys 0.003s
I20260709 13:17:20.873592 11149 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:20.876471  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.876924 11149 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:20.674059 11253 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:20.667907 11251 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.664162 11290 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:20.801512  8104 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.003s	sys 0.021s
I20260709 13:17:20.644626 11198 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:20.749874 11273 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:20.877626  8251 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:20.675915 11270 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:20.851760 11282 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:20.894276  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 74367.4us
I20260709 13:17:21.066919  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:21.068835  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 397489us
I20260709 13:17:20.836740 11280 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:20.921636  8107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.019s	sys 0.026s
W20260709 13:17:21.076113  8107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.020s	sys 0.026s
I20260709 13:17:20.664062 11153 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:20.674261 11278 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:20.948418 11253 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.093243  8250 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:20.989615  8248 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:20.758565 11268 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:20.968873  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:20.969583  8787 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:21.032311  8074 leader_election.cc:400] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4.
I20260709 13:17:21.120018  8074 leader_election.cc:403] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:17:21.063418  8104 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.003s	sys 0.035s
I20260709 13:17:20.591311 11096 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:17:20.869336 11283 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.293383  8001 catalog_manager.cc:5697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 6 to 8, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 8 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:17:21.142483  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 259418us
I20260709 13:17:20.948171 11004 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:21.167950 11292 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:21.302852  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:20.956848 11251 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:21.303478 11283 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.363039  8102 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:21.068470 11270 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.063030 11290 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:21.234532  8784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.006s	sys 0.014s
W20260709 13:17:21.383988  8784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.006s	sys 0.019s
I20260709 13:17:21.213698  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:21.167738  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.305289  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 238463us
I20260709 13:17:21.390280  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:21.356964  8789 raft_consensus.cc:2368] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5.
W20260709 13:17:21.316792  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.317317  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1246) took 1343 ms. Trace:
I20260709 13:17:21.392272  8175 rpcz_store.cc:276] 0709 13:17:19.973531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.012795 (+ 39264us) service_pool.cc:224] Handling call
0709 13:17:20.037305 (+ 24510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.352951 (+315646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.317031 (+964080us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b5400328a54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:21.317234 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":697576192}
W20260709 13:17:21.359843  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 773251us
I20260709 13:17:21.360111  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:21.270673 11246 consensus_meta.cc:287] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.317s	user 0.008s	sys 0.004s
I20260709 13:17:21.330068 11074 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:21.371304 11266 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:21.374385  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:20.816619 11297 consensus_queue.cc:260] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:21.315119 11275 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:21.397919  8223 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:21.297730 11198 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:21.116514 11253 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:21.167853 10983 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:17:21.301611 11289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.054s	sys 0.104s
W20260709 13:17:21.234287 11183 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.000s	sys 0.020s
I20260709 13:17:21.286221 11172 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:21.245767 11139 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:21.379315 11269 consensus_meta.cc:287] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.896s	user 0.008s	sys 0.002s
I20260709 13:17:21.225077 11272 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:21.401206  8223 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:21.404184  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:21.273739 11273 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.304224 11004 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.400296 11256 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:21.417395  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:21.315284 11096 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:21.423838  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:21.426611 11289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.054s	sys 0.105s
I20260709 13:17:21.397754 11290 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:21.408438 11281 consensus_meta.cc:287] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.013s	user 0.010s	sys 0.000s
W20260709 13:17:21.465710  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 395834us
W20260709 13:17:21.453227  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.408370 10735 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:17:21.408162 11306 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
W20260709 13:17:21.461163  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 44087.7us
I20260709 13:17:21.427131 11317 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:21.405035 11027 consensus_meta.cc:287] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.995s	user 0.005s	sys 0.004s
W20260709 13:17:21.426903 11183 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.005s	sys 0.021s
I20260709 13:17:21.431691 11296 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:21.400480 11246 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:21.471164  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:21.457787  8105 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:21.485188 11296 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.458091 11004 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.430523 11266 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.493127 11324 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:21.461959 11172 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:21.495297 11316 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:21.497263 11331 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:21.483569 11027 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.473585 10735 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:21.498973 11246 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:21.499533 11183 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:21.500772 11329 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:21.467641 11096 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:21.428388 11275 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.304584  8001 catalog_manager.cc:5697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 7, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 7 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:17:21.547055  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 96875.5us
I20260709 13:17:21.504951 11296 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:21.471984 11281 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.554183 11027 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:21.554690  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:21.562289  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.568569 11172 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:21.570012 11096 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:21.568619 11266 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:21.571926 11271 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:21.572444 11271 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:21.572032 11281 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:21.573796  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1231) took 1431 ms. Trace:
I20260709 13:17:21.574342  8001 catalog_manager.cc:5697] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 4 to 5, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 5 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:21.582418 11329 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:21.582939 11329 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:21.583998 11329 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.584724  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 819) took 1085 ms. Trace:
I20260709 13:17:21.585193  8784 rpcz_store.cc:276] 0709 13:17:20.499517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.499662 (+   145us) service_pool.cc:224] Handling call
0709 13:17:20.559660 (+ 59998us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:20.588767 (+ 29107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.588814 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:20.611862 (+ 23048us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.384495 (+772633us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:21.384553 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.384641 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.584465 (+199824us) raft_consensus.cc:1685] finished
0709 13:17:21.584489 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.584627 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32080,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":12734,"thread_start_us":737132,"threads_started":1,"wal-append.queue_time_us":843716}
I20260709 13:17:21.574208  8104 rpcz_store.cc:276] 0709 13:17:20.142049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.144342 (+  2293us) service_pool.cc:224] Handling call
0709 13:17:20.166370 (+ 22028us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.301333 (+1134963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.301385 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.374927 (+ 73542us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.402940 (+ 28013us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:21.402985 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.408343 (+  5358us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.573567 (+165224us) raft_consensus.cc:1685] finished
0709 13:17:21.573587 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.573738 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98950,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":1144642,"threads_started":2,"wal-append.queue_time_us":196784}
I20260709 13:17:21.592617 11330 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:21.592455 11278 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.591120 11329 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.573333 11271 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:21.608083  8182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2154) took 1257 ms (client timeout 1543 ms). Trace:
W20260709 13:17:21.608577  8182 rpcz_store.cc:269] 0709 13:17:20.350892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.351018 (+   126us) service_pool.cc:224] Handling call
0709 13:17:21.607883 (+1256865us) spinlock_profiling.cc:243] Waited 91.8 ms on lock 0x7b5400247a54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:21.607994 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211058048}
W20260709 13:17:21.610845  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 209707us
I20260709 13:17:21.611838  8223 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:21.612300 11149 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:21.612752 11149 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.613093 11149 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.613668 11256 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:21.614159 11256 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.614550 11256 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.616284 11246 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.616770 11246 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:21.613165  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:21.632669 11286 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:21.633853 11286 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.634964 11246 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:21.638666  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 167601us
I20260709 13:17:21.600922 11270 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:21.646055 11302 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.649541  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:21.649932  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2189) took 1691 ms. Trace:
I20260709 13:17:21.650564  8251 rpcz_store.cc:276] 0709 13:17:19.958482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.958635 (+   153us) service_pool.cc:224] Handling call
0709 13:17:19.975732 (+ 17097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.087219 (+1111487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.649628 (+562409us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b5400070b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:21.649851 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2073766144}
I20260709 13:17:21.651865  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:21.652463  8256 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:21.654292  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1229) took 1614 ms. Trace:
I20260709 13:17:21.652508  8253 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:21.654613  8107 rpcz_store.cc:276] 0709 13:17:20.039865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.040023 (+   158us) service_pool.cc:224] Handling call
0709 13:17:20.087386 (+ 47363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.154440 (+ 67054us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:20.154811 (+   371us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.083795 (+928984us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.083847 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:21.083889 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.654119 (+570230us) spinlock_profiling.cc:243] Waited 66.8 ms on lock 0x7b54003f2d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:21.654176 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.654252 (+    76us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7193,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3310,"raft.queue_time_us":31832,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":44917,"spinlock_wait_cycles":153645824,"thread_start_us":917919,"threads_started":1,"wal-append.queue_time_us":1248994}
I20260709 13:17:21.657755  8257 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:21.643414 11246 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:21.663405  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:21.642999 11271 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:21.673571  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:21.646629 11302 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:21.681881  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 127289us
I20260709 13:17:21.685086  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:21.674508  8254 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:21.675948  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:21.671758 11246 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:21.695879 10735 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:21.696108 11278 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:21.697351 11251 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.700170 11251 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:21.692610 11279 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:17:21.702965 11246 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:21.704329  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.707058 11302 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:21.683374 11289 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:17:21.700956 11149 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.678462 11293 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.710345 11293 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:21.694027 11316 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:21.713109 11329 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:21.715395  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:21.715231 11296 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.717825 11296 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:21.687065  8001 catalog_manager.cc:5697] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 4 to 6, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 6 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:21.718587 11329 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:21.719103 11329 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:21.719514 11329 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:21.727365  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.729216  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2159) took 1365 ms. Trace:
I20260709 13:17:21.729336  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2160) took 1365 ms. Trace:
I20260709 13:17:21.729847  8179 rpcz_store.cc:276] 0709 13:17:20.364065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.446058 (+ 81993us) service_pool.cc:224] Handling call
0709 13:17:20.446390 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.446611 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:20.446874 (+   263us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.728974 (+1282100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.729036 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:21.729089 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.729161 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.729279 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":930339,"prepare.queue_time_us":1455,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"thread_start_us":351365,"threads_started":1,"wal-append.queue_time_us":1119384}
I20260709 13:17:21.729689  8178 rpcz_store.cc:276] 0709 13:17:20.363776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.364592 (+   816us) service_pool.cc:224] Handling call
0709 13:17:20.387617 (+ 23025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.388138 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:20.417503 (+ 29365us) log.cc:844] Serialized 14 byte log entry
0709 13:17:20.773069 (+355566us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.726004 (+952935us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b18002f9fe0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:17:21.728698 (+  2694us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b18002f9fe0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dcd9c0a 00007fa5a7419219 00007fa59dd61a40 00007fa59dd5c4e4 00007fa59dd5c455 00007fa5a0e44060 00007fa5a0e56716 00007fa5a0e67287 00007fa5a0e67208
0709 13:17:21.728861 (+   163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.728914 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:21.728966 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.729035 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.729159 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4563,"prepare.queue_time_us":31780,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":5225,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":44317,"spinlock_wait_cycles":108161536,"thread_start_us":351940,"threads_started":1,"wal-append.queue_time_us":945906}
I20260709 13:17:21.732080 10953 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:21.736357  8783 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:17:21.736793  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.692637 11331 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:21.737761 11331 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:21.738217 11331 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:21.740201  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.712901  8249 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 8: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:17:21.742257  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51218us
I20260709 13:17:21.748018  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:21.762684  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:21.762962  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:21.763526  8783 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:21.763620  8784 raft_consensus.cc:2410] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:17:21.765301  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:21.720468  8001 catalog_manager.cc:5697] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 6 to 9, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 9 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:21.762102  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:21.712294 11270 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:21.779320  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.779513  8787 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:21.776074  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:21.766155  8786 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:21.781888  8788 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:21.712720 11149 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:21.786870  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:21.798693  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:21.799321  8786 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:21.789069  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:21.800272  8174 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:21.800642  8180 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:21.790452 11027 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.793635  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 45682.2us
I20260709 13:17:21.802138  8181 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:17:21.793756  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 389630us
I20260709 13:17:21.794294 11279 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:21.794844  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:21.807463  8176 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:21.795503  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:21.807857  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 164991us
I20260709 13:17:21.808502  8175 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:21.796113  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:21.796557  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:21.797626  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:21.764642 11153 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.777984  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:21.818840  8072 leader_election.cc:336] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.982s (SENT)
I20260709 13:17:21.819250  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:21.819387  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:21.764883 10992 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:21.810681  8182 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:21.811537  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:21.815048  8177 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:21.810463  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:21.826875  8177 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:21.827031  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:21.754940 11264 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:21.762192 11292 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 3. Current term is 4.
I20260709 13:17:21.822228  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:21.747098 11302 consensus_queue.cc:1059] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:17:21.824735  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:21.820268  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:21.824973  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:21.830142  8103 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:21.832536  8180 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:21.806864 11270 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:21.831045  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:21.806892 11278 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:21.838950  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:21.839617  8175 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:21.834053 11296 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:21.835536  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:21.836318  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:21.838061  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:21.843509  8251 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:21.843755  8786 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.807129 11279 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:21.827662  8177 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:21.852394  8755 connection.cc:256] RPC call timeout handler was delayed by -1.3704276810001375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
I20260709 13:17:21.853250  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:21.854236  8788 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:21.855392  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:21.853138  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:21.883939  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:21.884323  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:21.883348  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:21.883514  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:21.883378  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 64568.7us
I20260709 13:17:21.885798  8106 raft_consensus.cc:2393] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:17:21.886410  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.887230  8102 raft_consensus.cc:2410] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:17:21.887678  8177 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.887956  8787 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
W20260709 13:17:21.889307  8755 connection.cc:256] RPC call timeout handler was delayed by -1.2777276809999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
I20260709 13:17:21.858162  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:21.885408  8182 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:21.894085  8102 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:21.895872  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:21.896605  8100 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:21.891031  8105 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:21.897822  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:21.894582  8755 connection.cc:256] RPC call timeout handler was delayed by -1.2435276809999323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
I20260709 13:17:21.898700  8104 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:21.895766  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:21.899729  8175 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:21.899654  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:21.902093  8106 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 2. Preceding OpId from leader: term: 8 index: 2. (term mismatch)
I20260709 13:17:21.902539  8106 pending_rounds.cc:85] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 1
I20260709 13:17:21.903337  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:21.903446  8106 pending_rounds.cc:107] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 7.2
I20260709 13:17:21.904095  8106 raft_consensus.cc:2889] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:21.817871 11027 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.907457  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:21.820407 11329 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.835755 11334 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.911355  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:21.911761  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:21.912441  8107 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:21.890187  8101 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:21.902386 11244 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.907970  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:21.921140  8106 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:21.825188 11153 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:21.839856 11252 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:21.842919 11296 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.923573  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:21.929706  8182 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:21.884673 11286 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:21.831357 11264 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:21.933053  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:21.935361  8105 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:21.902161 11282 raft_consensus.cc:3055] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:21.899817 11276 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:21.894157 11279 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.855927 11278 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.952056 11027 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:21.857306 11070 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.953629  8175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:21.953717 11070 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:21.954677  8175 raft_consensus.cc:606] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:21.955030  8175 raft_consensus.cc:614] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:21.956022  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:21.956432  8074 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.130:46389 timed out after 1.543s (SENT) [suppressed 20 similar messages]
I20260709 13:17:21.956583  8175 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:21.856493 11330 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.933032 11296 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.966384 11330 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.967101  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:21.967732  8788 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:17:21.968844 11330 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:21.970113 11070 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:21.936097 11334 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:21.972725 11279 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.973349 11329 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:21.975016 11279 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:21.930744  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:21.828431 11253 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:21.856973 11316 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:21.976394  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:21.903941  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:21.926090  8101 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:21.839484 10992 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:21.908560 11337 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:21.941655  8176 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:21.958891  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:21.988973  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:21.924345  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 67203.5us
I20260709 13:17:21.993067  8101 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:17:21.978384  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 74528.2us
I20260709 13:17:21.995631  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:21.996539  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:21.979024  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 53259.1us
I20260709 13:17:21.997087 10812 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:21.978942  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:21.891928 11246 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:21.984036  8182 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:17:21.999070  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:22.000029 11246 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:21.964147  8104 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:22.000116  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:22.002552  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:22.003525  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:22.004478  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:21.989529  8791 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 7: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:21.953141  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:21.997375  8257 raft_consensus.cc:2410] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:17:21.987514  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.006412 11316 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.007031  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.007578 10992 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:22.008189  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.008389 11253 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:22.009526  8105 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:22.010300  8179 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:22.009007 11316 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:22.014781  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.009284  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.020823  8784 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:21.941272 11282 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:22.031219  8074 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:22.032227 11286 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:22.032694 11286 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:22.033150 11286 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.032917 11279 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:22.036015  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:22.037395 11279 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:22.037856 11279 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.038254 11279 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.031754  8178 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 3.
I20260709 13:17:22.041174 11283 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:22.041906  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.042394 10992 consensus_queue.cc:1059] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:22.043015  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.043542 10992 raft_consensus.cc:3055] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:22.043979 10992 raft_consensus.cc:740] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:22.044030  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.045192 11316 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:22.045495  8147 leader_election.cc:400] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5.
I20260709 13:17:22.045904  8147 leader_election.cc:403] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:17:22.045753 11316 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.047838 11316 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:22.044862  8784 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:17:22.049640 11290 consensus_meta.cc:287] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.577s	user 0.004s	sys 0.006s
I20260709 13:17:22.050120 11290 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.051184  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:22.052176 11290 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:22.052489  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.053112  8784 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:22.055060  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:21.976559 11276 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:22.056950  8784 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:22.059414  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:22.041234  8782 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:22.050117  8072 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:22.060467  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:22.061053  8256 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:17:22.056756  8099 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 4.
I20260709 13:17:22.062135  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:22.052855  8783 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:22.065896  8174 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:22.064924  8147 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:22.066857  8785 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:21.981144 11329 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:22.071127  8106 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:22.076820 11278 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:22.077028 11153 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:22.066888 11316 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:22.077553 11276 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:21.932833 11244 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.077852 11316 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.078943 11334 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:22.071750  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:21.937209 11302 consensus_queue.cc:1059] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:17:22.083050  8788 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:21.942498 11149 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.118s
I20260709 13:17:22.073338  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:22.018436 11004 consensus_meta.cc:287] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 13:17:22.074280  8072 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:22.090139  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:22.091840  8256 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 6: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:22.080487  8174 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:22.081633  8177 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:21.937057 11252 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.097132  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:22.098546  8783 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:22.086112  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:22.101712  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.102371  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.102905  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.103024  8782 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:22.103802  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:22.103968  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.104617  8099 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:22.105233 11347 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:22.105777  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:22.106150 11295 consensus_meta.cc:287] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.448s	user 0.005s	sys 0.006s
I20260709 13:17:22.106377  8104 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:22.106582 11295 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.108595 11286 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.110723  8101 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:22.111904 11286 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:22.011633 11256 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.113817 11153 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:22.114353 11256 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:22.114948 11340 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:22.116500 11264 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:22.088737 11244 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:22.073172 11268 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5.
I20260709 13:17:22.074764 11139 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:22.119079 11303 consensus_meta.cc:287] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 1.260s	user 0.006s	sys 0.006s
I20260709 13:17:22.118940 11139 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:22.119500 11303 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:22.121769  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.104650  8782 raft_consensus.cc:2393] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:22.094431  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:22.123414  8177 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:22.122869  8101 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:22.126276  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:22.127578  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:22.128265  8783 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:22.129706  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.099727  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.132087  8784 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:22.133463  8147 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:22.133140  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:22.095636  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:22.135641  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:22.138019  8105 raft_consensus.cc:2368] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8.
I20260709 13:17:22.139268  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.139997 11347 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:22.136955  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:22.083487 11324 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:22.141557  8177 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:22.141916  8221 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:22.142431  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:22.097095  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:22.121256 11139 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:22.125017  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:22.096915 11337 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:22.095547  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:22.143429  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.198796 11286 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:22.300503  8784 raft_consensus.cc:2376] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9. Re-sending same reply.
I20260709 13:17:22.300781 11286 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:22.301417 11286 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:22.301759  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.306247  8784 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:22.306326  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:22.307044  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:22.307143  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:22.307772  8787 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:22.308833  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:22.309468  8174 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:22.310294  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:22.310830  8174 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
W20260709 13:17:22.155861  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 81685.4us
I20260709 13:17:22.312269  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:22.263479  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.314013  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.312685  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:22.181667  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.144383  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:22.316123  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 171814us
I20260709 13:17:22.188891  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:22.299328  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:22.299479  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.317025  8105 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:22.307282  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 221285us
W20260709 13:17:22.200381  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 67043.2us
I20260709 13:17:22.317533  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:21.904982  8001 catalog_manager.cc:5697] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 7, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 7 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:22.307071  8788 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.299584  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:22.321915  8257 raft_consensus.cc:2368] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8.
W20260709 13:17:22.299816  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 157972us
I20260709 13:17:22.097460 11272 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:22.322909  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:22.319444  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:22.329668  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:22.330240  8177 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.330557  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:22.331708  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:22.188174  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.253671  8104 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:17:22.249073  8176 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:22.324029  8072 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:22.333101  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:22.307955  8784 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.132459 11295 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:22.137071 11183 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:22.339176  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:22.241976 11276 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:22.341027  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:22.328274  8101 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 7: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:22.328529  8106 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:22.140424 11347 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.336710  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:22.337801 11149 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:22.338114 11334 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:22.345862 11276 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:22.163554 11303 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:22.348767  8787 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:22.174074 11153 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:22.349861  8784 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:22.353004  8177 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
W20260709 13:17:22.356648 11270 consensus_meta.cc:287] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.513s	user 0.006s	sys 0.000s
I20260709 13:17:22.357813 11271 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:22.173823 11329 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:22.140823 11253 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:22.364616  8105 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:22.191105 11338 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:22.194293 11155 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.143684 11246 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.242270 11275 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:22.366562  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 43747.3us
I20260709 13:17:22.367452  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:22.099306 11004 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.137928 10992 consensus_queue.cc:260] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.209789 11250 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:22.322232 11293 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.342061 11278 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:17:22.440598  8221 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:22.328259 11346 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:22.441223 11149 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.442384  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:22.341883 11302 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:22.442849 11329 raft_consensus.cc:697] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:22.338171 11292 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:22.442950  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.444329 11338 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.401732  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:22.443473 11250 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:22.436556  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:22.383523 11348 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:22.432449  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:22.528533  8782 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.446653  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.529492  8787 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:22.414129  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:22.450099  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.531010  8147 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:22.413133  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:22.419960  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:22.534183  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:22.409726  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:22.442385  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.210078 11264 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:22.390302  8788 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:22.537758  8254 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 8: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:22.466838  8221 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:22.468614  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 131986us
W20260709 13:17:22.540477  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 201360us
I20260709 13:17:22.434520  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1238) took 1073 ms. Trace:
I20260709 13:17:22.541255  8072 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:22.541585  8103 rpcz_store.cc:276] 0709 13:17:21.360666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.368009 (+  7343us) service_pool.cc:224] Handling call
0709 13:17:21.368394 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.832476 (+464082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.434167 (+601691us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b540036e7d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:22.434440 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1061182336}
I20260709 13:17:22.542518  8072 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:22.543677  8072 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:22.475128  8106 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:22.143340 11324 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:22.493707 11270 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:22.495014  8181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:22.548550  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:22.549196  8181 raft_consensus.cc:606] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:22.328078 11337 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:22.477841  8786 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.622s	user 0.010s	sys 0.000s
I20260709 13:17:22.498324  8257 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 8: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:22.554234  8786 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:22.554965  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:22.442276 11246 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:22.556281  8786 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:22.557523 11246 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:22.359109 11290 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:22.524691 11292 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:22.225113 11296 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:22.335060 11317 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.442478 11253 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.473466 11347 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.403631 11252 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:22.411731 11280 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:22.432922  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.473102 11289 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:22.526006  8249 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.422906 11316 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:22.495268 11149 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.447103 11334 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:22.535290  8784 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:22.617590  8784 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:17:22.498010 11346 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:17:22.547955  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 81232.3us
I20260709 13:17:22.580124 11292 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.500728 11302 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.551479  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.553133  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.558796  8175 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:17:22.526335 11309 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:22.528221 11348 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:22.550271 11324 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.404485  8001 catalog_manager.cc:5697] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 2 to 4, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 4 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:22.535921 10992 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:22.527678 11338 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.501061  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:22.719696  8177 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:22.491613 11293 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.494709 11155 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.559790  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:22.733515  8099 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:22.564529  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:22.561301  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:22.734679  8106 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.560499  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.537577 11264 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.561360  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:22.738498  8176 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:22.566016  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:22.567358  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:22.740000  8253 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 8: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:22.539954 11295 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:22.574404 11290 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:22.565800  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:22.583402  8782 raft_consensus.cc:2410] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:22.584733  8783 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:22.585253  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:22.586349  8101 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:22.547626 11275 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.612181  8790 raft_consensus.cc:2376] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8. Re-sending same reply.
I20260709 13:17:22.547942 11172 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:22.571040 11331 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.832s	user 0.011s	sys 0.002s
I20260709 13:17:22.553876 11251 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:22.496300  8179 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:17:22.796679 11357 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:17:22.559265 11356 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:22.673301  8256 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 4.
I20260709 13:17:22.597025 11139 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.598011 11253 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:22.687933  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 134826us
I20260709 13:17:22.689904  8788 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:17:22.824286  8788 pending_rounds.cc:85] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 9
I20260709 13:17:22.824630  8788 pending_rounds.cc:107] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:17:22.825014  8788 raft_consensus.cc:2889] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:22.562239 11329 consensus_queue.cc:237] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.619071 11334 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.691290 11348 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.563464 11004 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:22.736294  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 180228us
I20260709 13:17:22.840233  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:22.558995 11153 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.686139 11302 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.757928  8784 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:22.757761  8174 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
W20260709 13:17:22.741083 11279 consensus_meta.cc:287] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.702s	user 0.015s	sys 0.000s
I20260709 13:17:22.839008 11198 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:17:22.849140 11279 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:22.839005 11139 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.851367 11279 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:22.783831  8106 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:22.757016  8254 raft_consensus.cc:2368] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8.
I20260709 13:17:22.786516  8251 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:22.741938 11264 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:22.785626  8253 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:17:22.789472  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.752453 11290 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:22.855821  8791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48110 (request call id 822) took 1974 ms (client timeout 2131 ms). Trace:
I20260709 13:17:22.793046  8177 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:17:22.856271  8791 rpcz_store.cc:269] 0709 13:17:20.881184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.881470 (+   286us) service_pool.cc:224] Handling call
0709 13:17:22.855639 (+1974169us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b5400316854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:22.855768 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980987648}
I20260709 13:17:22.858254  8177 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 8 index: 2. (index mismatch)
I20260709 13:17:22.757596 11276 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:22.758263 11295 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:22.795516 11252 raft_consensus.cc:993] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:17:22.860018 11252 raft_consensus.cc:1081] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Signalling peer 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:17:22.860147 11295 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:22.805604  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.863202  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:22.863519 11309 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:22.864027 11309 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:22.806531 11293 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:22.865945 11367 log.cc:927] Time spent T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:17:22.866997  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2162) took 1081 ms. Trace:
I20260709 13:17:22.867359  8178 rpcz_store.cc:276] 0709 13:17:21.786074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.786216 (+   142us) service_pool.cc:224] Handling call
0709 13:17:22.866836 (+1080620us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54000127d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:22.866941 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":385951104}
W20260709 13:17:22.868288 11363 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:17:22.869040 11362 log.cc:927] Time spent T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:17:22.817600  8099 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:22.625516  8221 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:22.815749  8790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48096 (request call id 540) took 1071 ms. Trace:
I20260709 13:17:22.871919  8149 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:22.872828 11268 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:22.873289 11268 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:22.819456  8179 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:22.876605  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:22.827947  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.790004 11297 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:22.877310  8785 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
W20260709 13:17:22.821276  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.880168  8147 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:22.881225  8790 rpcz_store.cc:276] 0709 13:17:21.744363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.744488 (+   125us) service_pool.cc:224] Handling call
0709 13:17:22.432728 (+688240us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:22.815687 (+382959us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3147520}
I20260709 13:17:22.881686 11343 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:17:22.882460  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 257052us
I20260709 13:17:22.883556 11343 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:22.883973 11343 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.884286 11343 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.813912 10735 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:22.885725 10983 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:22.886256 10983 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:22.886827  8755 leader_election.cc:400] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8.
I20260709 13:17:22.887161  8755 leader_election.cc:403] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:17:22.887053 10983 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.888537  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:17:22.890049 11359 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:22.818591 11250 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:22.891296 11337 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:22.893394  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:22.823706 11272 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:22.894667  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:22.874119 11268 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:22.894795  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:22.899217  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:22.840093 11361 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:17:22.900044  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:22.877352  8176 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:22.909636  8253 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:22.913101  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:22.917814  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 77660.2us
I20260709 13:17:22.918740  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:22.917285  8248 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:22.922353  8256 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:22.821048 11331 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:22.820128 11275 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:22.920255  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:22.943900  8790 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:22.929173  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:22.944262  8255 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:22.954743  8253 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:22.928192  8252 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:22.944355  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:22.948149  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:22.889156 11149 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:22.901933 11250 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:22.902133 11303 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:17:22.958078  8176 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:22.954514  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:22.913501 11296 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:22.965956  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:22.902269 11316 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8.
I20260709 13:17:22.968952  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:22.843034 11074 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:17:22.917142 10812 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:22.901777 11252 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:22.987675  8102 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:22.925856 11269 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:22.992157  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:22.995376  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:22.969177  8249 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:22.918416 11299 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:22.974526  8099 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:23.003827  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:22.966954  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:23.006095  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:23.007601  8101 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 4: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:23.005190  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:23.009178  8099 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:22.973750 11155 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:22.924010 11337 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:22.985603 11273 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:22.978683  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:22.984795  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:22.985965  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:23.032372  8788 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:22.989975  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:23.032994  8105 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:22.990767  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:22.949775  8785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:48110
I20260709 13:17:23.033975  8785 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:22.986924 10812 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:22.997761  8107 raft_consensus.cc:2410] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:22.917268 11276 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:17:22.990654 11371 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:23.008411  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:23.018247  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:23.018682  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 98500us
I20260709 13:17:23.034055  8248 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 6: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:23.034408  8785 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:22.971365 11250 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:22.902024 11332 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:17:23.013736 11299 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.992710 11252 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:22.998027  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:23.013535 11316 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:23.040194 10812 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:23.096771 11316 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:23.041762  8105 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:22.900895 11346 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:22.989004 11183 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:17:23.013074 11374 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:23.099427  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:23.107781 11316 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.035059 11155 consensus_queue.cc:1059] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
W20260709 13:17:23.105909  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 197524us
I20260709 13:17:23.185678  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2178) took 1094 ms. Trace:
I20260709 13:17:23.187275  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:23.100240 11371 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:23.097630 11252 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:23.053715 11376 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:23.119252 11250 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:23.191306  8249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:47520
I20260709 13:17:23.192294  8249 raft_consensus.cc:606] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:23.039228 11139 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:23.192734  8249 raft_consensus.cc:614] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:23.193562 11273 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:23.038992 11337 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:23.191164 11371 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:23.038736 11027 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:23.265051  8786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 825) took 1216 ms. Trace:
I20260709 13:17:23.266466  8249 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:23.099257 11299 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:23.285048 11374 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:17:23.286056  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 166114us
I20260709 13:17:23.273799  8786 rpcz_store.cc:276] 0709 13:17:22.048834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.556977 (+508143us) service_pool.cc:224] Handling call
0709 13:17:22.557301 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:22.576370 (+ 19069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.576401 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:22.610897 (+ 34496us) log.cc:844] Serialized 52 byte log entry
0709 13:17:22.816953 (+206056us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:22.816989 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.817049 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:23.264731 (+447682us) raft_consensus.cc:1685] finished
0709 13:17:23.264757 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.264971 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16323,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":4123,"thread_start_us":119087,"threads_started":1,"wal-append.queue_time_us":348692}
I20260709 13:17:23.280494  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:23.040114  8100 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:23.291920  8248 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:23.291158  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 103965us
W20260709 13:17:23.288693  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 310101us
I20260709 13:17:23.186251  8175 rpcz_store.cc:276] 0709 13:17:22.091364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.860825 (+769461us) service_pool.cc:224] Handling call
0709 13:17:22.861124 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.861482 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.861510 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:22.861923 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:17:23.185193 (+323270us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:23.185250 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.185349 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:23.185421 (+    72us) raft_consensus.cc:1685] finished
0709 13:17:23.185456 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.185616 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3318,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":322851,"threads_started":1,"wal-append.queue_time_us":148521}
W20260709 13:17:23.286644  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 454921us
I20260709 13:17:23.298025  8149 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:23.301357  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.322259  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 336757us
I20260709 13:17:23.294572  8223 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:23.323748 11269 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:23.335131  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:23.273141 11303 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:23.343607  8183 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:17:23.343482  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:23.346066  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 828) took 1027 ms. Trace:
I20260709 13:17:23.347935  8784 rpcz_store.cc:276] 0709 13:17:22.318465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.626127 (+307662us) service_pool.cc:224] Handling call
0709 13:17:22.748909 (+122782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.846837 (+ 97928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.345879 (+499042us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400650250. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:23.346006 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281417984}
I20260709 13:17:23.327158 11316 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:23.342749 11155 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:23.336962 11139 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:23.344218 11149 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:23.343343 11383 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:23.344276 11303 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:23.380553  8177 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:23.356752 11074 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:17:23.400698  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 99420.3us
W20260709 13:17:23.400982  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 111550us
I20260709 13:17:23.403862  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:23.404572  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:23.406235  8099 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
W20260709 13:17:23.408777 11324 consensus_meta.cc:287] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.672s	user 0.005s	sys 0.013s
I20260709 13:17:23.409195 11324 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.410259  8106 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:23.369629 11339 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:23.361878 11153 consensus_queue.cc:1059] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:17:23.381945 11331 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:23.415381  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1281) took 1105 ms. Trace:
W20260709 13:17:23.384207 11286 consensus_meta.cc:287] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.082s	user 0.018s	sys 0.006s
I20260709 13:17:23.370565 11198 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:17:23.418680  8180 rpcz_store.cc:276] 0709 13:17:22.309573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.080375 (+770802us) service_pool.cc:224] Handling call
0709 13:17:23.136637 (+ 56262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.136903 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:23.190983 (+ 54080us) log.cc:844] Serialized 14 byte log entry
0709 13:17:23.415026 (+224043us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:23.415077 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:23.415124 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.415182 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.415292 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33060,"thread_start_us":190600,"threads_started":1}
I20260709 13:17:23.420082  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:23.427520  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 58984.7us
I20260709 13:17:23.400029 11383 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:23.434332 11352 consensus_queue.cc:1059] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:23.435562 11352 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:23.436602  8180 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:23.437001  8180 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:23.435127 11383 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.425403 11303 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.443368 11303 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:23.447654  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:23.414192 11074 raft_consensus.cc:697] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:23.438277  8180 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.459359  8180 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:23.421900 11198 consensus_queue.cc:1243] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:17:23.424217 11339 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:23.435984 11352 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:23.436599 11275 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:23.441727 11276 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:23.446983 11183 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:23.488493 11392 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:23.493927 11388 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:17:23.426601 11286 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.533710 11352 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.535000 11352 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.536139  8103 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: []
W20260709 13:17:23.503484 11379 log.cc:927] Time spent T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:17:23.483337  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 63304.3us
I20260709 13:17:23.505249 11394 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:23.537540  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.415271 11337 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:23.520143  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 70849.1us
I20260709 13:17:23.520179  8755 leader_election.cc:400] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8.
I20260709 13:17:23.542160  8755 leader_election.cc:403] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:23.428478 11153 raft_consensus.cc:3055] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:23.523023  8248 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:23.554729  8787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 831) took 1017 ms. Trace:
I20260709 13:17:23.415894 11282 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:23.532243 11253 consensus_meta.cc:287] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.691s	user 0.011s	sys 0.011s
I20260709 13:17:23.525553  8223 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:23.418498 11269 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.482332 11384 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.532802 11331 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:23.532994 11392 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:23.533521 11183 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.494460 11387 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.133s
I20260709 13:17:23.542337  8147 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:23.543334  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:23.423913 11374 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.545123 11398 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8.
I20260709 13:17:23.535820 11286 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:23.545307  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:23.545855 11394 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.546841 11295 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:23.549867 11376 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.551134  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:23.529712 11302 consensus_meta.cc:287] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.679s	user 0.015s	sys 0.012s
W20260709 13:17:23.529812 11338 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.777s	user 0.009s	sys 0.013s
I20260709 13:17:23.555177  8787 rpcz_store.cc:276] 0709 13:17:22.537240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.703408 (+166168us) service_pool.cc:224] Handling call
0709 13:17:23.060784 (+357376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.060965 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.060988 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:23.061028 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:23.061063 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.061114 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.554541 (+493427us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b540039d0d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:23.554661 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750871296}
W20260709 13:17:23.529532 11343 consensus_meta.cc:287] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.011s
I20260709 13:17:23.525481  8180 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 13:17:23.532457 11347 consensus_meta.cc:287] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.919s	user 0.019s	sys 0.004s
I20260709 13:17:23.559859  8785 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:23.563969  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 79313.6us
I20260709 13:17:23.596762  8786 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 4. Current term is 5. Ops: []
W20260709 13:17:23.599157 10992 consensus_meta.cc:287] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.866s	user 0.013s	sys 0.009s
W20260709 13:17:23.599536 11309 consensus_meta.cc:287] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.735s	user 0.014s	sys 0.014s
I20260709 13:17:23.599961 11309 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.566010 11253 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.603251 11253 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:23.603564  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:23.605001  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:23.605459 11396 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:17:23.570284 11271 consensus_meta.cc:287] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.127s	user 0.007s	sys 0.004s
I20260709 13:17:23.606292 11271 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:23.606441  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:23.607029  8107 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:23.570297 11392 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:23.609160  8101 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:23.609601 11386 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:23.610167 11386 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.610543 11386 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:23.586519 11376 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:23.581507  8784 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:23.554633 11153 raft_consensus.cc:740] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:23.571302 11282 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:23.614548  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 69322.2us
I20260709 13:17:23.593487  8180 pending_rounds.cc:85] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 4
I20260709 13:17:23.561131 11074 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.570362 11139 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:23.605733  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:23.618541  8105 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:23.619753  8105 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:17:23.611939  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.612489  8789 raft_consensus.cc:2368] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7.
I20260709 13:17:23.612862  8100 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:23.617028  8785 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:23.566318 11331 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:23.624037  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 80786.9us
I20260709 13:17:23.622756  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2183) took 1076 ms. Trace:
I20260709 13:17:23.590534 11398 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:23.625226  8180 pending_rounds.cc:107] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:17:23.593209 11277 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:23.626803  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:23.632176  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:23.628605  8180 raft_consensus.cc:2889] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:23.570292 11384 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.633242  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2181) took 1089 ms. Trace:
I20260709 13:17:23.633610  8180 rpcz_store.cc:276] 0709 13:17:22.543903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.420037 (+876134us) service_pool.cc:224] Handling call
0709 13:17:23.436480 (+ 16443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.632959 (+196479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.633189 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.626551  8176 rpcz_store.cc:276] 0709 13:17:22.544488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.448577 (+904089us) service_pool.cc:224] Handling call
0709 13:17:23.519016 (+ 70439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:23.530285 (+ 11269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.530317 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:23.530772 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:17:23.613661 (+ 82889us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:23.613702 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.613770 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:23.620943 (+  7173us) raft_consensus.cc:1685] finished
0709 13:17:23.620972 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.621143 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16103,"raft.queue_time_us":11578,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":27922,"thread_start_us":40065,"threads_started":1,"wal-append.queue_time_us":56679}
I20260709 13:17:23.634881 11384 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:23.638692 11382 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.113s	user 0.000s	sys 0.003s
I20260709 13:17:23.642521  8755 leader_election.cc:400] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8.
I20260709 13:17:23.587131 11387 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:17:23.622944 10992 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:23.631736 11297 consensus_meta.cc:287] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.753s	user 0.011s	sys 0.000s
I20260709 13:17:23.594273 11343 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.592311 11302 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.627710 11139 raft_consensus.cc:697] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:23.647089  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:23.626892 11396 raft_consensus.cc:697] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:23.637310 11296 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.654053  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:23.655305  8783 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 8: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:23.651064 11279 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.655948  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:23.656275  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:23.655992 11279 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.630366 11277 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:23.641621 11004 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:23.637066 11324 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:23.638717 11329 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:23.667878  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 399) took 1553 ms. Trace:
I20260709 13:17:23.611892 11347 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.674224  8787 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:23.675227  8174 rpcz_store.cc:276] 0709 13:17:22.114791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.340797 (+226006us) service_pool.cc:224] Handling call
0709 13:17:23.667723 (+1326926us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400014354. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:23.667819 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":895539456}
I20260709 13:17:23.681340  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:23.682153  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:23.667896  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1258) took 1085 ms. Trace:
I20260709 13:17:23.680195  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:23.683132  8790 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:23.680778  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:23.683269  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:23.683768  8101 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: [8.2-8.2]
W20260709 13:17:23.679111  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 66422.1us
I20260709 13:17:23.684041  8180 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:23.684597  8180 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:23.685734  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:23.685341  8180 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.686691  8180 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:23.682789  8102 rpcz_store.cc:276] 0709 13:17:22.582097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.584988 (+  2891us) service_pool.cc:224] Handling call
0709 13:17:23.667723 (+1082735us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540001b8d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:23.667819 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467869056}
I20260709 13:17:23.611299 11338 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:23.689457 11290 consensus_meta.cc:287] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.833s	user 0.006s	sys 0.004s
I20260709 13:17:23.695179 11290 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.696539 11332 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:23.696957 11332 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:23.697731  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:23.690845 11253 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:23.694300  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:23.694401  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:23.690006 11250 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.657903 11398 raft_consensus.cc:2764] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:17:23.686942 11334 consensus_meta.cc:287] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.840s	user 0.013s	sys 0.010s
W20260709 13:17:23.693001 11292 consensus_meta.cc:287] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.006s	user 0.007s	sys 0.004s
I20260709 13:17:23.706166  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:23.680969 11273 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:23.692240 11264 consensus_meta.cc:287] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.838s	user 0.008s	sys 0.013s
W20260709 13:17:23.699877 11172 consensus_meta.cc:287] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.881s	user 0.009s	sys 0.012s
W20260709 13:17:23.710768  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.700672 11317 consensus_meta.cc:287] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.116s	user 0.008s	sys 0.004s
I20260709 13:17:23.724978  8250 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:23.725503  8174 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:23.730324  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1277) took 1529 ms. Trace:
I20260709 13:17:23.730772  8179 rpcz_store.cc:276] 0709 13:17:22.201139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.874360 (+673221us) service_pool.cc:224] Handling call
0709 13:17:22.874658 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.874999 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.875024 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:22.875413 (+   389us) log.cc:844] Serialized 26 byte log entry
0709 13:17:23.324250 (+448837us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:23.423158 (+ 98908us) log.cc:844] Serialized 14 byte log entry
0709 13:17:23.527852 (+104694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.527943 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:23.730111 (+202168us) raft_consensus.cc:1685] finished
0709 13:17:23.730130 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.730268 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38551,"prepare.queue_time_us":234084,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2989,"raft.queue_time_us":48018,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":11983,"thread_start_us":616120,"threads_started":3,"wal-append.queue_time_us":486194}
I20260709 13:17:23.701251 11253 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.666173 11296 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.737003  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:23.737663 11250 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:23.737866  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:23.738200  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:23.738591  8178 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:23.738834 11253 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:23.739228  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:23.704879 11309 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:23.687641 11004 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.730018 11264 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.738448 11296 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:23.703361 11290 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:23.753495 11408 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:17:23.743322 11366 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.957s	user 0.000s	sys 0.002s
I20260709 13:17:23.743076 11402 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:17:23.743876  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:23.744767 11348 consensus_meta.cc:287] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.852s	user 0.013s	sys 0.007s
I20260709 13:17:23.725343 11292 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.748278  8107 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:23.702078 11268 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:17:23.651823 11153 consensus_queue.cc:260] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.723968 11334 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.665273 11371 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.730154 11172 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:23.729616 11317 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:23.764036  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:23.793876  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:23.714958 11392 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.733635 11273 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.771780  8176 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:23.625934 11339 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.772663  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1257) took 1854 ms. Trace:
I20260709 13:17:23.774468  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:23.786312 11309 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:23.791260 11280 consensus_meta.cc:287] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.174s	user 0.024s	sys 0.024s
W20260709 13:17:23.769034  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 153145us
I20260709 13:17:23.798251  8783 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:23.790951 11406 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:23.801582  8099 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:23.770081 11343 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:23.804816  8180 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:17:23.805359  8107 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:23.805971  8104 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:23.806005  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:23.735896 11139 consensus_queue.cc:237] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.812469  8102 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:23.806864  8108 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:23.763607 11348 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.814400  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:23.815155 11198 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:23.815699 11348 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:23.815766 11256 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:23.801368  8183 rpcz_store.cc:276] 0709 13:17:21.918362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.688437 (+770075us) service_pool.cc:224] Handling call
0709 13:17:22.702191 (+ 13754us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:23.344802 (+642611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.772375 (+427573us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b5400011154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:23.772597 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1474528000}
I20260709 13:17:23.807374  8174 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:23.796586  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 397) took 1946 ms. Trace:
I20260709 13:17:23.763134 11332 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:23.741684 11277 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.811890  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:23.817950  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:23.820163  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1272) took 1832 ms. Trace:
I20260709 13:17:23.819836  8182 rpcz_store.cc:276] 0709 13:17:21.850079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.005338 (+155259us) service_pool.cc:224] Handling call
0709 13:17:22.005658 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.073818 (+ 68160us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:22.244468 (+170650us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b1800378b20. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:17:23.373734 (+1129266us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b1800378b20. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5c455 00007fa5a48443c7 00007fa5a0e569a7 00007fa5a0e660bf 00007fa5a0e66038
0709 13:17:23.427708 (+ 53974us) log.cc:844] Serialized 14 byte log entry
0709 13:17:23.779346 (+351638us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:23.782677 (+  3331us) log.cc:844] Serialized 26 byte log entry
0709 13:17:23.782845 (+   168us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:23.782892 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.782986 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:23.796132 (+ 13146us) raft_consensus.cc:1685] finished
0709 13:17:23.796160 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.796508 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82704,"prepare.queue_time_us":43839,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":51,"raft.queue_time_us":77863,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":14430,"spinlock_wait_cycles":22307968,"thread_start_us":301839,"threads_started":2,"wal-append.queue_time_us":325133}
I20260709 13:17:23.806213 11309 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.822373 11365 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.831328  8177 rpcz_store.cc:276] 0709 13:17:21.987888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.858913 (+871025us) service_pool.cc:224] Handling call
0709 13:17:22.859166 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.390384 (+531218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.819865 (+429481us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54002f9254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:23.820088 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198683520}
I20260709 13:17:23.780306 11244 consensus_queue.cc:1059] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:17:23.817641 11331 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:23.850092  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:23.817315 11394 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:23.851413  8787 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:23.826471 11264 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:23.829731 11302 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:23.852272 11277 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:23.869071  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:23.847232 11343 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 13:17:23.912506 11360 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.179s	user 0.006s	sys 0.000s
I20260709 13:17:23.870309  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:23.853603 11296 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:17:23.856876 11332 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:23.920979  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 51984us
W20260709 13:17:23.870728 11409 log.cc:927] Time spent T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:17:23.869618 11348 consensus_queue.cc:1059] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:17:23.925482  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:23.926788  8177 raft_consensus.cc:2410] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:17:23.932544 11403 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:17:23.936097  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.947103  8102 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:23.870836 11309 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:23.949205  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:23.890012 11264 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.870136 11292 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:23.871604 11004 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:23.870905 11416 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:23.956259  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:23.763921 11396 consensus_queue.cc:237] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:23.919731 11347 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:23.952970  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:23.961684  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:23.962278  8183 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:23.962519  8102 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:23.963840  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:23.964071  8149 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:23.864459 11149 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:17:23.942405 11356 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:23.868595 11198 consensus_queue.cc:1059] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:17:23.957044 11392 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:23.966470  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:23.957530 11299 consensus_meta.cc:287] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.628s	user 0.005s	sys 0.011s
I20260709 13:17:23.863641 11365 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:23.965896 11252 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.012s
I20260709 13:17:23.959821 11346 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:23.962967 11343 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:23.958742 11348 consensus_queue.cc:1243] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:23.967126 11155 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:23.958985 11264 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.041695 11264 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.024039  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:23.937799 11419 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:17:24.025122  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.045806 11419 consensus_queue.cc:1243] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:24.046424 11419 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:24.046823 11419 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:24.047562  8183 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:24.047839 11419 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:23.978643 10812 consensus_meta.cc:287] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.881s	user 0.015s	sys 0.000s
I20260709 13:17:24.049716 10812 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.052186 10812 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:24.053295  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.056371 11419 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:24.061079 11292 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:24.061920 11292 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.070403 11292 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:24.073321  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 106714us
I20260709 13:17:23.977377 11371 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:23.975870 11273 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:23.976173 11347 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:23.977233 11356 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:23.978770 11338 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:24.120193  8174 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:24.114012  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:24.146261  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.151587  8102 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:24.153278  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:24.156356  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.039459 11155 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.026926 11296 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:23.978446 11299 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.196242  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.197007  8254 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:24.117823 11402 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.022891 11252 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.113793 11343 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:24.198535  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45404.5us
I20260709 13:17:24.193463  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.202992  8174 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:24.025552 11346 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.204272  8254 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:24.113485 11348 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:17:24.207665  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:24.224572  8102 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:24.182055 11264 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.189046 10983 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:24.205787  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:24.211539  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2093) took 1246 ms. Trace:
I20260709 13:17:24.232951  8175 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:24.232915  8106 rpcz_store.cc:276] 0709 13:17:22.965258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.965394 (+   136us) service_pool.cc:224] Handling call
0709 13:17:22.965697 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.410769 (+445072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.211294 (+800525us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b540036ecd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:24.211475 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021930880}
I20260709 13:17:24.213296 11253 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.216300  8177 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:24.217485 11299 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.190441 11155 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:24.241140  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:24.224340 11387 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:17:24.267023  8221 connection.cc:256] RPC call timeout handler was delayed by -1.133053911999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260709 13:17:24.272130  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:24.228552 10812 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:24.242782 11386 consensus_meta.cc:287] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.632s	user 0.013s	sys 0.000s
I20260709 13:17:24.286041  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:24.292937  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 76014.7us
I20260709 13:17:24.294956  8254 raft_consensus.cc:3055] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:24.298245  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:24.288914  8782 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:24.283223  8256 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:24.291612 11251 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:17:24.301306  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.301648  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:24.290067 11376 consensus_meta.cc:287] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.662s	user 0.014s	sys 0.000s
I20260709 13:17:24.209021 11402 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.295514  8254 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:24.303678  8252 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:17:24.297578 11419 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:17:24.306442  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:24.309010  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 87926.4us
I20260709 13:17:24.309212  8251 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:17:24.306501  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:24.293494 11371 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:24.312179  8221 connection.cc:256] RPC call timeout handler was delayed by -1.1063933419998193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
I20260709 13:17:24.235898 11264 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.310936  8253 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:24.298167 11292 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:24.294986 11387 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:24.324514  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:24.325292  8785 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:24.329627 11332 consensus_queue.cc:1059] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:24.330102  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:24.319350  8254 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.331079  8254 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:24.333791  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:24.334388 10992 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:24.334780 10992 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:24.335345  8255 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:24.333925  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.335737 10992 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.337030 10992 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:24.338178  8252 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:24.340027  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:24.342275  8248 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:24.343473  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.344765  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:24.345065 11299 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:24.345798  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:24.347129  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.347949  8249 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 8: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:24.348810  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:24.350310  8249 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:24.351979  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:24.306355 10983 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:24.315716 11424 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:17:24.326400  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.355594  8252 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:24.356197  8786 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:17:24.307194 11251 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.360456  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:24.356550  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:24.321823 11430 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.298518 11386 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.364895  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:24.296658 10812 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.307360 11376 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.354694 11371 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:24.399171 10812 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:24.397405 11387 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.399780 11376 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.402511 11264 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:24.400046  8105 raft_consensus.cc:1217] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[5.3-8.5]   Dedup: 5.3->[6.4-8.5]
I20260709 13:17:24.403368  8105 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: [5.3-8.5]
I20260709 13:17:24.403074 11430 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:24.404273 11282 consensus_meta.cc:287] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.781s	user 0.005s	sys 0.008s
I20260709 13:17:24.400345 11371 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.378888  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:24.292451 11356 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.390679  8251 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:24.390830  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:24.391405  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 49998.1us
I20260709 13:17:24.392896  8102 raft_consensus.cc:2410] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:24.405400  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:24.409528  8100 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:24.407303  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:24.409338  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:24.408380  8254 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:17:24.406118  8255 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:24.355242 11292 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:24.414101  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:24.414765  8102 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:24.411172  8254 pending_rounds.cc:85] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 6
I20260709 13:17:24.416074  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:24.416432  8254 pending_rounds.cc:107] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:17:24.416816  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:24.416911  8254 raft_consensus.cc:2889] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:24.417516  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:24.419540  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:24.425020  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 111829us
I20260709 13:17:24.429296  8106 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:24.345842 11299 consensus_queue.cc:1059] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:17:24.431058  8107 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:24.405207 11302 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.428196  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.397528 11417 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:24.434914  8785 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:17:24.439709 11269 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:24.440173 11410 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:24.440210 11401 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:24.441571 11410 consensus_queue.cc:1243] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:24.442214 11273 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:24.442590 11273 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:24.442975  8149 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:24.443446 11273 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.311846 11343 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.445032  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.448632  8100 raft_consensus.cc:2410] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:24.422719 11139 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.450919  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.452142  8257 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:17:24.432840 11352 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:17:24.423996 11264 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:24.456949  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:24.427143 11270 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:24.453733  8102 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:24.409124 11280 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:17:24.461063  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:24.432813 11250 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:24.462854  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:24.465202  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.475296  8249 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:24.444196 11410 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:24.479017  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:24.490635  8107 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:24.487804  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:24.401257 10983 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.492571  8249 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:24.491866  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:24.472616 11273 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:24.464852 11346 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.475843 11252 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.477128 11430 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:24.502251  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:24.502838  8107 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:24.503348  8102 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:24.503945  8107 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:24.449615 11392 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:17:24.489495 11417 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:24.489037 11339 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:24.511219  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.513022  8257 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:24.463392 11269 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:17:24.511868  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:24.515333  8221 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:24.445791 11295 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:17:24.446020 11302 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.523175 10812 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.523309 11155 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.523805 10812 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.514470 11417 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.525410 11070 raft_consensus.cc:3055] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:24.525858 11070 raft_consensus.cc:740] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:24.526648 11070 consensus_queue.cc:260] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:24.528087 11423 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.576s	user 0.009s	sys 0.010s
I20260709 13:17:24.498275 11410 raft_consensus.cc:697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:24.528901  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:24.529249  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1282) took 2126 ms. Trace:
I20260709 13:17:24.500397 11338 consensus_queue.cc:1059] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:17:24.529631  8175 rpcz_store.cc:276] 0709 13:17:22.402794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.293690 (+890896us) service_pool.cc:224] Handling call
0709 13:17:23.295632 (+  1942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.236006 (+940374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.529029 (+293023us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b5400011dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:24.529184 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2155080576}
I20260709 13:17:24.499342 11253 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:24.518596 11402 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.519542 11386 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:24.526643 11417 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.548049 11416 raft_consensus.cc:3055] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:24.548453 11416 raft_consensus.cc:740] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:24.550151  8072 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:24.520407 11371 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.498270 11347 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:24.529376 11410 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.532279  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:24.533751 11431 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:17:24.465197 11139 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.555665  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:24.556460  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1254) took 1997 ms. Trace:
I20260709 13:17:24.557070 11139 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:24.496304 11292 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.538864  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:24.531450 11396 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:24.537504 11183 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.561587  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:24.562574  8176 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:24.539891  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:24.528057 11070 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:24.542560 11418 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.627s	user 0.007s	sys 0.012s
I20260709 13:17:24.530232 11430 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:24.578182  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:24.544132 11276 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:24.545123 11251 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.585331  8252 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:17:24.551683  8072 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:24.517361  8221 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:24.524533 11406 consensus_meta.cc:287] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.699s	user 0.003s	sys 0.005s
W20260709 13:17:24.518596 11316 consensus_meta.cc:287] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 1.150s	user 0.014s	sys 0.003s
I20260709 13:17:24.556962  8103 rpcz_store.cc:276] 0709 13:17:22.558905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.560418 (+  1513us) service_pool.cc:224] Handling call
0709 13:17:22.564829 (+  4411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.539050 (+974221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.556248 (+1017198us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b54002125d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:24.556407 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233440000}
I20260709 13:17:24.558034  8101 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
W20260709 13:17:24.524509  8108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2099) took 1557 ms (client timeout 1527 ms). Trace:
I20260709 13:17:24.598661  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:24.558636  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:24.563854  8175 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:24.532279  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:24.600900  8107 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:24.599061  8108 rpcz_store.cc:269] 0709 13:17:22.967211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.995163 (+ 27952us) service_pool.cc:224] Handling call
0709 13:17:24.524343 (+1529180us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54001662d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:24.524442 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864770944}
I20260709 13:17:24.570807  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.602005  8108 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:24.602572  8787 raft_consensus.cc:2410] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:24.573917  8249 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 5.
I20260709 13:17:24.575078  8174 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:24.603926  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 80146.9us
I20260709 13:17:24.553895 11272 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:24.582391  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.564237 11396 raft_consensus.cc:697] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:24.591986  8072 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:24.536681 11155 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:24.579634 11277 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.681s	user 0.012s	sys 0.000s
I20260709 13:17:24.610491  8072 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:24.580801 11276 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:24.549252 11416 consensus_queue.cc:260] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.600157 11376 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:24.612751  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:24.607339 11419 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:24.619797  8221 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:24.609177 11406 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:24.620520 11183 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.612948 11251 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:24.613250 11329 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.621039  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:24.621876 11396 consensus_queue.cc:237] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.623253  8107 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:24.626762  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:24.608610 11253 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:24.635121  8788 raft_consensus.cc:2376] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8. Re-sending same reply.
I20260709 13:17:24.611073 11316 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:24.636340 11183 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.606719 11343 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:17:24.646369 11334 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:24.647892  8104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 447) took 2535 ms (client timeout 3048 ms). Trace:
W20260709 13:17:24.648311  8104 rpcz_store.cc:269] 0709 13:17:22.112674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.343177 (+230503us) service_pool.cc:224] Handling call
0709 13:17:24.647660 (+2304483us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54003f3754. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:24.647811 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2946093440}
I20260709 13:17:24.639472 11419 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:24.651186 11419 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.638396 11329 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.642269 11338 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:24.641563 11253 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.618319 11436 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:24.642750 11316 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.635566 11416 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:24.635074 11347 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:24.667882 11329 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.667906 11316 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:24.665271 10983 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:24.638803  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:24.686097  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 47356.7us
I20260709 13:17:24.687090  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:24.688207  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:24.690788  8783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 731) took 1035 ms. Trace:
I20260709 13:17:24.691213  8783 rpcz_store.cc:276] 0709 13:17:23.655383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.656062 (+   679us) service_pool.cc:224] Handling call
0709 13:17:24.690593 (+1034531us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400580f54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:24.690730 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309984000}
I20260709 13:17:24.645332 11183 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.694330  8221 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:24.661561 11338 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:24.706076  8789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48096 (request call id 537) took 2964 ms (client timeout 2111 ms). Trace:
W20260709 13:17:24.706630  8789 rpcz_store.cc:269] 0709 13:17:21.741766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.741880 (+   114us) service_pool.cc:224] Handling call
0709 13:17:22.899084 (+1157204us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27e9c 00007fa59dd27a5b 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:24.705807 (+1806723us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54004ced54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:24.705988 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1642272512}
I20260709 13:17:24.710208 11253 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.716228  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:24.728487  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:24.698463 11198 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:24.730258  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:24.698057 11347 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:24.733485  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.735260  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:24.736246  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:24.711747 11348 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:24.711562 11338 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:24.721763 11429 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:24.758018  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.777623  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.734499 11253 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:24.728315 11436 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:17:24.758600  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.780071  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:24.758494  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.729063 11251 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:24.781608  8257 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 8: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:24.781800  8256 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:24.786582  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2195) took 2788 ms. Trace:
I20260709 13:17:24.739481 11316 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:24.741604 11329 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:24.790647  8250 rpcz_store.cc:276] 0709 13:17:21.997906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.582605 (+584699us) service_pool.cc:224] Handling call
0709 13:17:22.611198 (+ 28593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.729495 (+1118297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.786279 (+1056784us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001e6254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:24.786495 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2561093376}
I20260709 13:17:24.740437 11183 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:24.793601  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:24.794965  8789 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:24.795715 11421 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:24.795858 11198 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:24.796252 11406 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:24.744069 11273 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:24.803467  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:24.801874  8791 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:24.740481 11332 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.805861 11253 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:24.805780 11273 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.806421 11280 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.796430 11198 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.785243 11153 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:24.739583 11334 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:17:24.797885 11329 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.811725 11329 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:24.813328 11303 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:24.813862 11303 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:24.814707 11303 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.815446 11279 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.820400  8104 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:24.822685  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:24.823298  8102 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:24.822341 11276 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.739670 11371 consensus_queue.cc:1059] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:17:24.826685 11365 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.837481  8107 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:24.839578 10983 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.846813 10983 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.847193  8789 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:17:24.849579 11276 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:24.850317 11371 raft_consensus.cc:3055] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:24.850523 11384 raft_consensus.cc:3055] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:24.850733 11371 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:24.850980 11384 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:24.851676 11371 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.851807 11384 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.852967 11371 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:24.808538 11155 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.037s
W20260709 13:17:24.855151 11452 log.cc:927] Time spent T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:17:24.809001 11332 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.852986 11384 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:24.863611  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:24.856125 10983 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:24.810859 11280 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.871196 11280 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.867327  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:24.881062 11198 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:24.894371 11428 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:24.894877 11428 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.895285 11428 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:24.896677 11425 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.492s	user 0.003s	sys 0.000s
I20260709 13:17:24.897794 11198 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.898466 11273 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:24.899178 11198 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:24.862069 11074 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:17:24.900118 11074 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:24.900555 11074 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:24.901396 11256 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:24.902240 11256 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:24.902557 11256 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:24.903225  8787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 726) took 1249 ms. Trace:
I20260709 13:17:24.903331 11256 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.2, Last appended by leader: 2, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.903640  8787 rpcz_store.cc:276] 0709 13:17:23.654211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.861525 (+207314us) service_pool.cc:224] Handling call
0709 13:17:24.903029 (+1041504us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b540051a4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:24.903168 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572178176}
I20260709 13:17:24.901448 11074 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:24.906316 11443 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:17:24.907331 11302 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:24.908424  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:24.909011  8789 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:24.910197  8787 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:24.910379  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:24.911114  8783 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:24.912227  8782 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:24.909695  8785 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:24.909173 11256 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:24.906314 11074 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:24.925005  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:24.925854  8787 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 7: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:24.900151 11198 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:24.929757 11198 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:24.930656 11198 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.931177 11399 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:24.931834 11198 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:24.931710 11399 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.932581 11428 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:24.937320  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:24.938005  8789 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:24.905176 11457 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:17:24.942631  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:24.941450  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:24.954372  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:24.955968  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:24.956527  8784 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:24.892568 11329 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:24.958964  8789 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:24.959900  8178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:24.970765  8178 raft_consensus.cc:606] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:24.971174  8178 raft_consensus.cc:614] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:24.970247  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:24.971804  8789 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:24.975075  8790 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 11. Ops: []
I20260709 13:17:24.949760 11401 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.976249  8147 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:24.949976 11299 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.956110 11244 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.984861  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:24.995709  8107 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:24.986202  8105 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:17:24.995939  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.987119  8108 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:24.989518  8102 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:24.954237 11386 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:24.998023  8789 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:24.941846 11347 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:17:24.943414 11419 consensus_queue.cc:1059] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:17:25.010437  8147 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:25.013046  8105 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:24.942445 11456 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:17:25.016469  8784 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:24.989080 11396 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:17:24.999333 11457 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:24.994822 11332 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:25.023058  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.008428 11410 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:25.008039 11386 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.006436 11244 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.030303 11386 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.030359 11244 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.025671 11399 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:24.979404 10953 consensus_queue.cc:1059] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:17:25.036259  8147 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:25.036928  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:25.038079  8784 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:25.003151 11276 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:17:25.000870 11401 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:25.032765 11399 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:25.021993 11457 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.006278 11299 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.013392 11004 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:17:25.008220 11429 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:17:25.043592 11410 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:25.016106 11356 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:17:25.016980 11153 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:17:25.053659  8178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:25.058939  8178 raft_consensus.cc:606] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:25.059443  8178 raft_consensus.cc:614] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:25.055804 11352 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:25.047883 11457 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:25.062565  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.049468 11244 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:25.065339  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:25.065496 11244 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.066048  8105 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:25.067737 11244 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.069640 11410 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:25.070312 11299 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.070649 11410 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:25.071647 11004 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:25.072168 11004 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.052429 11399 raft_consensus.cc:697] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:25.073710 11399 consensus_queue.cc:237] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:25.076221 11329 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.087802  8105 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:25.077242 11428 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:25.093936  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:25.100291  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:25.123359  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.134853 11347 consensus_queue.cc:1243] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:17:25.138245  8105 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:25.140065 11454 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.294s	user 0.003s	sys 0.000s
I20260709 13:17:25.127552 11428 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:25.137300 11386 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.124460 11338 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:25.169243  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.176029 11401 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:25.177501 11256 consensus_queue.cc:1059] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:25.169239  8108 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:25.179560 11428 raft_consensus.cc:697] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:25.186949 11356 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:25.180658 11428 consensus_queue.cc:237] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.165627 11386 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.191687 11386 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.191781  8108 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:17:25.195560  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 141052us
I20260709 13:17:25.200189  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.203238  8106 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:25.212700  8788 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:25.210415 11244 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:25.225253  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.199371 11356 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:17:25.228137  8103 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:25.230321  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:25.231992  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.232641  8103 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:25.233582  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:25.234198  8103 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:25.239315  8788 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:17:25.251909  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:25.221966 11153 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.247514  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:25.258488  8104 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:25.260583  8103 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:25.263665  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:25.264881  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:25.266135  8072 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:25.264349  8252 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:25.217994 11299 consensus_queue.cc:1059] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:17:25.267885  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:25.275601  8174 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:25.276470  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:25.276644  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:25.277127  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:25.277963  8249 raft_consensus.cc:2410] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:25.277791  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:25.278327  8250 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:25.279625  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:25.273226  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:25.274576  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.281378  8101 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:25.283663  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.284468  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.285283  8103 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:25.293601  8248 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:25.298166  8257 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:25.278779  8256 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:25.301806  8103 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:25.303188  8103 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:25.309808  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:25.310734  8252 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:25.312073  8103 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:25.314889  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.316891  8248 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:25.287024 11371 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:25.305227  8104 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:25.270807 11153 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:25.322947  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.323326  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.323503  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.328855  8103 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 6: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:25.329057  8104 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:25.329859  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.331266  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.329752  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.333843  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:25.339007  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.316329 11277 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.312166 11402 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:25.295660 11429 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:17:25.283377 11139 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:17:25.319271 11268 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:25.320519 11371 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.349803  8181 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:25.350299  8101 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:25.332626 11299 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:17:25.357039  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.319654 11465 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:17:25.361418  8103 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:25.418437  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.419510  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.357281  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:25.420610  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 63416.1us
I20260709 13:17:25.421595  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.335508 10812 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.369953  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.331733 11384 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:17:25.331877 11329 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:17:25.406365  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 75167.1us
I20260709 13:17:25.476672  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.408257 11478 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:25.336301 11256 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:17:25.354575 11334 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:25.327924 11456 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:17:25.402489  8248 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:25.334499 11464 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:17:25.475732  8103 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:25.352128 11277 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.500325  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.394157 11280 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.414975 11371 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.500996  8103 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:25.511842  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.410836 11268 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:17:25.504165  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.521353 11268 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.475795 11386 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:25.516038 11252 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:25.517787  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:25.520699 11471 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:17:25.481096 11394 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:25.530328  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 108798us
I20260709 13:17:25.548596  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:25.541291  8101 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:25.496572 11466 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.496503 11356 raft_consensus.cc:3055] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:25.501941 10812 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:25.545816  8175 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:25.412901 11402 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:25.507427 11368 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:25.559659  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.550863  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:25.547740  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 71150.4us
I20260709 13:17:25.555902  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.494443 11303 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:17:25.563429  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.560763  8177 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:25.564129  8105 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:25.539891 11339 raft_consensus.cc:3055] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:25.566131  8176 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:25.566906  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.552299  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.562799  8175 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:17:25.477797 11299 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.571816 11348 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:25.572191 11348 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:25.573191 11299 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.568385  8174 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:25.570140 11394 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:25.570519  8101 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:25.570937  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.552100 11253 raft_consensus.cc:2764] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:17:25.506471 11334 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:25.583143  8183 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:25.552718 11356 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:25.529081 11280 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.578492  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.591254  8177 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:25.596813  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.597271  8177 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 5.
I20260709 13:17:25.546670 11252 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.595854  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.561313  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.553058 11477 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:25.558821 11368 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:25.595285  8175 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:25.565737 11339 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:25.590034 11329 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:25.604887  8104 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:25.572979 11348 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.581615 11244 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:25.599656 11394 raft_consensus.cc:697] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:25.604816  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.617691  8183 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:25.563648 11466 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:25.616159  8181 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:25.621223  8175 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:17:25.621660  8175 pending_rounds.cc:85] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 3
I20260709 13:17:25.622030  8175 pending_rounds.cc:107] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:17:25.623202  8175 raft_consensus.cc:2889] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:25.600696  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:25.605261 11299 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:25.628326  8177 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:25.629556  8183 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:25.605094 11153 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:25.617703 11329 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.628968 11299 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:25.635831 11299 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:25.639678  8252 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:25.643108 11299 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.645303 11299 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.645897 11277 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.650032 11402 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:25.651657 11457 consensus_meta.cc:287] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.003s
I20260709 13:17:25.651780 11466 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:25.652068 11457 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.647446 11329 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.658793  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.663813 11252 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.664011  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.664745  8181 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:25.665824 11334 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:25.666407 11339 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:25.667827 11339 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.670460  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.671561  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.672524  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.672935 11386 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:25.673630  8179 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:25.650267 11368 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.674777  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.675994  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.677466 11280 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.675041  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.679416  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.679816  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:25.659968 11475 log.cc:927] Time spent T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:17:25.685215  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.682797  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.683557 11252 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:17:25.684149  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 83532us
I20260709 13:17:25.688810  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.683828 11394 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:25.686017  8180 raft_consensus.cc:2410] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:25.686507  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.675469 11368 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:25.700107  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.688163 11252 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.703536 11252 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:25.705073  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.705844  8179 raft_consensus.cc:2393] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:25.705999 11457 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:25.711117  8177 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:25.694751 11277 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.717819  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.723757  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.745571  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.746963  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:25.751861  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.752939  8179 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:25.699594 11386 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:17:25.699309 11402 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:17:25.698709 11299 consensus_queue.cc:1059] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:17:25.760802  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.744474 11384 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.764330 11481 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.749709 11153 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:25.749342 11480 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:25.709069 11329 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:25.778782 11465 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:25.779250 11465 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:25.780332 11329 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.754021 11484 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.780205 11465 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.781894  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.784672  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.785293  8099 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:25.785387  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:25.771384 11384 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:25.786211  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.787384  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.787919 11384 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.745383 11268 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.768095 11371 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:25.788970  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.790486  8103 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:25.790153  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.790879  8180 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:25.778450 10812 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:25.799045 11070 raft_consensus.cc:3055] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:25.799484 11070 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:25.801635  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:25.806759  8791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48096 (request call id 570) took 2153 ms (client timeout 2799 ms). Trace:
W20260709 13:17:25.807220  8791 rpcz_store.cc:269] 0709 13:17:23.652900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.653007 (+   107us) service_pool.cc:224] Handling call
0709 13:17:25.806542 (+2153535us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b5400730354. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:25.806687 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2277415296}
I20260709 13:17:25.809084 11198 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:25.809566 11198 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:25.810454 11198 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.811508 11198 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:25.777621 11481 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:25.793286  8100 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:25.797757  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.815471  8102 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:25.798061 11371 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:25.812878  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.821782  8179 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:25.832113  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:25.791983 11268 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.837128 11481 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:25.824687 11465 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:25.840077 11252 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:25.843478 11368 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:25.847654  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:25.849228  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.854393  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.860504  8179 raft_consensus.cc:2410] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:25.856245 11484 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:25.849238  8183 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:25.861121  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.867640  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:25.868117  8178 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:25.868261  8107 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.869189  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:25.873005  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:25.884377  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.886396  8788 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:25.885373  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:25.886487  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.887176  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.887439  8183 raft_consensus.cc:2410] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:25.869334  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:25.889029  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.898983  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.897145  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.852864 11004 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:25.921763  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:25.918579  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:25.923521  8786 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:25.915663  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.919503  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:25.918007  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:25.910691  8785 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:25.924662  8784 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.926057  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.885084 11302 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:25.928043  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.932070  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:25.883953 10812 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.932631  8179 raft_consensus.cc:2376] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8. Re-sending same reply.
I20260709 13:17:25.866334 11244 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:25.858960 11368 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:25.935025  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.908748 11329 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.910128 11352 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:25.953585 11352 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.954030 11352 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.941875  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:25.921156 11343 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.907989 11282 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:25.908164 11436 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:25.888082 11280 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:25.914650 11256 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:17:25.950719  8788 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:25.910902 11384 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:17:25.927183 11276 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.931748 11253 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:17:25.884924 11371 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:17:25.942162  8107 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:25.915000 11485 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:25.927495 11483 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.909591 11419 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:17:25.949946  8784 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:25.996311  8072 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:25.922088 11074 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:17:25.991503  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:25.998734  8183 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:25.927347 11303 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:17:25.995257 11276 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.014889  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:26.015918 11276 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:25.927434 11430 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:17:26.018524 11384 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:26.019958 11303 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:26.020373 11303 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.020725 11303 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.023334 10983 raft_consensus.cc:3055] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:26.023744 10983 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:26.024554 10983 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:26.025771 10983 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:25.950276 11368 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:26.006938 11489 log.cc:927] Time spent T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.345s	user 0.004s	sys 0.000s
W20260709 13:17:26.007479  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.008064 11334 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:26.009743 10953 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:26.045637 10953 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:26.045817 11302 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:26.046402 11302 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.046590 10953 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.048561 11302 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:26.016108  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:26.166695  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 150648us
I20260709 13:17:25.943588 10812 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.169624  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:26.171018 10812 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:26.171545 10812 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:25.964454 11282 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.942319 11417 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:17:26.037807  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:26.040947  8176 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:17:26.049947  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:26.052410 11485 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:25.979310 11343 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:26.054714 11252 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:26.058566 11295 raft_consensus.cc:3055] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:26.177205 11282 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:26.181417 11295 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:26.181681  8107 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:26.181926  8103 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:26.182310 11295 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.183344 11295 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:26.062325 11348 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:26.065138 11303 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.069327 11368 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:26.176970 11394 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:17:26.000195 11436 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.186345 11303 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:26.092954 11501 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:26.187633  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:26.188681  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:26.189162  8183 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:26.190263  8791 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:26.191507  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:26.105091 10953 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:25.964653 11329 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.045639 11503 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:26.115655 11253 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.205367 11253 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.207408 11253 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:26.125222  8790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 851) took 1188 ms. Trace:
I20260709 13:17:26.130389 11356 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:26.132745  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1271) took 2195 ms. Trace:
W20260709 13:17:26.139168  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.208242 11356 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:26.141932  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 95320.2us
I20260709 13:17:26.207918  8790 rpcz_store.cc:276] 0709 13:17:24.936723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.936890 (+   167us) service_pool.cc:224] Handling call
0709 13:17:24.937182 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.975485 (+ 38303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.124973 (+1149488us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b5400650254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:26.125155 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86756224}
I20260709 13:17:26.149803 11244 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:26.156459 11396 raft_consensus.cc:3055] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:26.210012  8787 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:26.210342 11396 raft_consensus.cc:740] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:26.211534 11472 log.cc:927] Time spent T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.883s	user 0.002s	sys 0.000s
I20260709 13:17:26.211198 11396 consensus_queue.cc:260] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:26.212375 11396 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:26.158195 11334 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.163761 11338 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:26.174131  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:26.214659  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:26.215098 11329 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:26.215396 11485 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:26.215652 11329 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:26.215955 11485 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:26.216904 11485 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.218082 11070 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.219468 11070 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.222139 11253 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.222647 11253 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.224700 11253 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:26.225632 11334 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:26.227522 11334 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:26.174216  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:26.174844  8179 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:17:26.228677  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:26.229210  8181 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:26.178303  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.225083  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:26.178417  8176 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:26.193357  8782 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:17:26.193480  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:26.208106  8106 rpcz_store.cc:276] 0709 13:17:23.937207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.430058 (+492851us) service_pool.cc:224] Handling call
0709 13:17:25.203063 (+773005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.203670 (+   607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.132513 (+928843us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b540036e2d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:26.132686 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1777146624}
I20260709 13:17:26.186345 11368 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:26.232583  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:26.196027  8107 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:26.233664  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:26.234242  8106 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:26.194406 11419 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.197795 11343 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:26.201494  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.204249  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:26.171990 10812 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:26.229030  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:26.262687  8179 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:26.263805  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:26.175676  8178 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:26.231292  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.234918  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:26.266283  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:26.267338  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:26.237227  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:26.268242  8255 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:17:26.268712  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:26.258847  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:26.239073  8248 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:26.239849  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:26.234606  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:26.243177  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:26.249632  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:26.257931 11296 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:26.233196 11503 raft_consensus.cc:697] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:26.258823  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:26.261698  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:26.194052 11153 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:26.289708  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:26.290449  8789 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:26.267409  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:26.291121  8254 raft_consensus.cc:2368] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7.
I20260709 13:17:26.269234  8252 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:26.270532  8103 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:26.293344  8103 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:26.294668  8103 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:26.248085  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 43893.8us
I20260709 13:17:26.272343  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:26.297781  8251 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:26.272944  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:26.299201  8248 raft_consensus.cc:2410] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:17:26.273183  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:26.300194  8256 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:26.272959  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:26.301234  8257 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
W20260709 13:17:26.274477  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.275157  8107 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:26.172449 11352 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.256767  8183 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:26.225195 11253 consensus_queue.cc:1059] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:17:26.284500  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:26.286203  8249 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:26.270133 11276 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:26.331403  8177 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:26.331660  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:26.288708  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:26.305073  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:26.306942  8104 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:26.333469  8250 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:26.340142  8252 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
W20260709 13:17:26.343936  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 59527.9us
I20260709 13:17:26.349498  8147 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:26.260018 11282 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:26.357544  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:26.304878 11497 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:26.327498 11303 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:26.342217 11463 log.cc:927] Time spent T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:17:26.358847  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:26.384053  8178 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:26.259974 11419 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.386111  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:26.331046 11276 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.365334  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:26.397121  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:26.402225  8104 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:26.403695  8149 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:26.412732  8108 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 7: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:26.331012 11339 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:17:26.363080 11252 raft_consensus.cc:2764] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:17:26.361445 11253 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:26.414508  8074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.006s	sys 0.005s
I20260709 13:17:26.416348  8104 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:26.422734  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.413129  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:26.393350 11153 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:26.401849 11276 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:26.387393 11303 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.431959  8149 leader_election.cc:400] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7.
W20260709 13:17:26.422217  8074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.006s	sys 0.005s
I20260709 13:17:26.433717 11481 consensus_queue.cc:1059] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:17:26.434226  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 535282us
I20260709 13:17:26.434854 11481 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:26.435303 11481 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:26.436257 11481 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.405541 11244 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:26.406414 11477 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:26.421485 11253 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.483273  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:26.410092 11476 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:17:26.424834 11153 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.443105 11155 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:26.489923  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:26.493258  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:26.494396  8251 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:26.442970 11303 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.425381 11417 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:17:26.462675 11386 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:26.491205 11253 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:26.492398 11277 consensus_meta.cc:287] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.000s
I20260709 13:17:26.571472  8181 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:26.400805 10812 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.460939 11477 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.502302 11153 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:26.493620 11280 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:26.596155  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 106335us
I20260709 13:17:26.461788 11457 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
W20260709 13:17:26.596933  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 91127.1us
I20260709 13:17:26.597675  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:26.598367  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 309768us
I20260709 13:17:26.570770 11394 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:26.500383 11302 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.611945  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:26.418356 11503 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.507620 11481 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:26.668632  8107 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:26.704154 11302 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.613534 11295 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:26.602491 11277 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:26.600054 11477 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:26.671557  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 73963.2us
I20260709 13:17:26.720263  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:26.665547 11490 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 1.002s	user 0.004s	sys 0.000s
W20260709 13:17:26.699532  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:26.724680  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 112853us
I20260709 13:17:26.725494  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:26.725948  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:26.671054  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:17:26.740806  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 69829.1us
I20260709 13:17:26.743541  8103 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:26.709233 10953 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:26.667850 11502 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:26.755035 11302 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:26.717833 11339 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.713960 11506 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.714082 11295 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:17:26.782477  8105 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.003s	sys 0.003s
I20260709 13:17:26.737754 11334 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:26.790805  8105 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.003s	sys 0.003s
W20260709 13:17:26.792857  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.748399 11476 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:26.780805 11475 log.cc:927] Time spent T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:17:26.798734  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:26.766206 11155 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:26.708066 11394 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.794312 11295 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:26.782095 11282 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:26.798893 11332 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:26.795724 11476 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:26.795743 10953 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:26.780817 11410 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:17:26.801409 11419 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:26.813694 11457 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.788270 11339 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:26.912582  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:26.804486 11302 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:26.918720  8787 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
W20260709 13:17:26.921777 11504 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 13:17:26.923440 11516 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:17:26.792392 11506 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:26.915548 11507 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.414s	user 0.001s	sys 0.000s
I20260709 13:17:26.852279 11476 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:26.913317 11436 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.727s	user 0.005s	sys 0.005s
I20260709 13:17:26.849123 11518 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.851404 11296 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.842218 11332 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:26.965696  8182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.007s	sys 0.010s
W20260709 13:17:26.966142  8182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.007s	sys 0.010s
I20260709 13:17:26.908988 10983 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:17:26.935279 11510 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:17:26.966063  8786 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:17:26.971390  8102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.029s
W20260709 13:17:26.975840  8102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.000s	sys 0.030s
W20260709 13:17:26.998553  8221 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.000s	sys 0.033s
W20260709 13:17:26.998986  8221 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.000s	sys 0.033s
W20260709 13:17:26.999287  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 696709us
W20260709 13:17:26.973492  8255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.002s	sys 0.004s
W20260709 13:17:27.000882  8255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.002s	sys 0.004s
W20260709 13:17:26.974845 11520 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
I20260709 13:17:26.962777 11436 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:27.012838  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:26.945835  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 220445us
I20260709 13:17:26.925980 11457 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.978137 11332 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:27.015367  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:27.017515 11464 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.018121 11506 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:27.018479 11521 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:26.988430 11485 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:26.937937 11523 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
W20260709 13:17:27.014570 11489 log.cc:927] Time spent T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:17:27.052058  8099 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.006s	sys 0.019s
I20260709 13:17:27.001893 11139 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.988793 10983 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.002972 11348 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.014916 11368 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.019824 11430 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:27.050336 11511 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.096s	user 0.001s	sys 0.001s
I20260709 13:17:27.077262 11419 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:27.078888  8783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 858) took 1232 ms. Trace:
I20260709 13:17:26.975716 11296 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:27.051258 11483 consensus_meta.cc:287] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 1.031s	user 0.008s	sys 0.004s
W20260709 13:17:27.086233  8099 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.006s	sys 0.019s
W20260709 13:17:27.100687 11509 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
W20260709 13:17:27.140003 11542 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:17:27.140867 11528 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:17:27.142366 11394 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:27.143528  8180 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:27.176398  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 470) took 1159 ms. Trace:
I20260709 13:17:27.223661  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 431) took 1002 ms. Trace:
W20260709 13:17:27.145407 11530 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:17:27.148795 11514 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:17:27.010581 10953 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:27.149637 11508 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:17:27.089322 11485 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:26.976480 11518 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.053221 11464 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:27.215909  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.167414 11457 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:27.101560 11522 log.cc:927] Time spent T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 13:17:27.224319  8101 rpcz_store.cc:276] 0709 13:17:26.016980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.017130 (+   150us) service_pool.cc:224] Handling call
0709 13:17:26.017475 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.276090 (+258615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.276117 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.304800 (+ 28683us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.837173 (+532373us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:26.837250 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.837313 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.176149 (+338836us) raft_consensus.cc:1685] finished
0709 13:17:27.176171 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.176338 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10,"raft.queue_time_us":132266,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":70,"thread_start_us":751741,"threads_started":2,"wal-append.queue_time_us":869622}
I20260709 13:17:27.220230  8783 rpcz_store.cc:276] 0709 13:17:25.846703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.848206 (+  1503us) service_pool.cc:224] Handling call
0709 13:17:25.848506 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:25.848872 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.848905 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:25.849456 (+   551us) log.cc:844] Serialized 52 byte log entry
0709 13:17:26.395106 (+545650us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:26.817032 (+421926us) log.cc:844] Serialized 14 byte log entry
0709 13:17:26.826379 (+  9347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.826467 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.078679 (+252212us) raft_consensus.cc:1685] finished
0709 13:17:27.078694 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.078834 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9063,"prepare.queue_time_us":568275,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":6507,"raft.queue_time_us":165158,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":26596,"thread_start_us":872672,"threads_started":2,"wal-append.queue_time_us":607324}
W20260709 13:17:27.156421 11070 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.937s	user 0.007s	sys 0.002s
W20260709 13:17:27.173934 11513 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.331s	user 0.000s	sys 0.003s
W20260709 13:17:27.153363 11276 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.693s	user 0.004s	sys 0.003s
W20260709 13:17:27.155167 11396 consensus_meta.cc:287] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.942s	user 0.011s	sys 0.000s
W20260709 13:17:27.227584 11253 consensus_meta.cc:287] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.002s
I20260709 13:17:27.135452 11483 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:27.168735 11384 raft_consensus.cc:3055] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:27.224399  8180 rpcz_store.cc:276] 0709 13:17:26.221621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.142791 (+921170us) service_pool.cc:224] Handling call
0709 13:17:27.143103 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.223304 (+ 80201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.223588 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.166998 11302 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:27.175671 11386 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:27.268553  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1321) took 1083 ms. Trace:
I20260709 13:17:27.100201 11139 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.128376 11430 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:27.104931 11368 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.132673 11348 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:27.264827 11485 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:27.257097 11153 consensus_meta.cc:287] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.003s
I20260709 13:17:27.264753 11276 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:27.157559 11477 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:27.268512  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 255724us
I20260709 13:17:27.227388 11295 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:27.284842 11430 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:27.269503  8175 rpcz_store.cc:276] 0709 13:17:26.184941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.188681 (+  3740us) service_pool.cc:224] Handling call
0709 13:17:26.189072 (+   391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:26.194453 (+  5381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.194479 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:26.198374 (+  3895us) log.cc:844] Serialized 52 byte log entry
0709 13:17:26.570299 (+371925us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:26.826681 (+256382us) log.cc:844] Serialized 14 byte log entry
0709 13:17:26.827676 (+   995us) log.cc:844] Serialized 14 byte log entry
0709 13:17:26.827883 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.827973 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.173216 (+345243us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:27.268316 (+ 95100us) raft_consensus.cc:1685] finished
0709 13:17:27.268345 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.268493 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5036,"prepare.queue_time_us":138056,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":13784,"raft.queue_time_us":19067,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":20446,"spinlock_wait_cycles":177970176,"thread_start_us":584098,"threads_started":2,"wal-append.queue_time_us":583200}
I20260709 13:17:27.267557 11457 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.283545  8249 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:27.284819 11348 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:27.285573  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:27.286000 11464 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:27.286047  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:27.286751  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:27.304409  8254 raft_consensus.cc:2410] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:17:27.305716  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:27.306056  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:27.306388  8254 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:27.307402  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:27.287489  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:27.268740 11384 raft_consensus.cc:740] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:27.288717 11276 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:27.289403  8179 raft_consensus.cc:2368] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9.
I20260709 13:17:27.290192  8250 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:17:27.291324 11477 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:27.272059 11386 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.268229 11253 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.286307  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:27.297159  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:27.317129  8252 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:27.298955  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1307) took 1121 ms. Trace:
W20260709 13:17:27.293572 11244 consensus_meta.cc:287] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.832s	user 0.011s	sys 0.000s
I20260709 13:17:27.317322  8249 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:27.278209 11339 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:27.320971  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:27.325532 11295 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:27.326066 11518 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:27.326895 11303 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.741s	user 0.012s	sys 0.000s
I20260709 13:17:27.327390 11303 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.328605 11476 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:27.304590 11457 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:27.331560 11457 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:27.332894 11502 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:27.333829 11502 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:27.318387  8105 rpcz_store.cc:276] 0709 13:17:26.177712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.179104 (+  1392us) service_pool.cc:224] Handling call
0709 13:17:26.202929 (+ 23825us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:26.229662 (+ 26733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.229692 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:26.230270 (+   578us) log.cc:844] Serialized 52 byte log entry
0709 13:17:26.799430 (+569160us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:26.799486 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.799574 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.298653 (+499079us) raft_consensus.cc:1685] finished
0709 13:17:27.298686 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.298872 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38503,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":30101,"thread_start_us":568741,"threads_started":1,"wal-append.queue_time_us":767095}
I20260709 13:17:27.338201 11244 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:27.339210  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 467) took 1472 ms. Trace:
I20260709 13:17:27.339884 11303 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:27.339764  8072 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:27.341169 11436 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.341936 11253 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:27.348498  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:27.348948  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:27.349754  8101 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:27.352312  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:27.353259  8783 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:27.355178  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:27.342576 11506 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:27.358421  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:27.372315  8255 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:27.357393 11506 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.393350 11384 consensus_queue.cc:260] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.394025 11506 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.394611 11384 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:27.398628 11303 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:27.293895 11153 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.403110 11545 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.402897 11332 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.403546 11153 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:27.403741 11545 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:27.404846  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 389669us
I20260709 13:17:27.339579  8102 rpcz_store.cc:276] 0709 13:17:25.866585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.867328 (+   743us) service_pool.cc:224] Handling call
0709 13:17:25.896360 (+ 29032us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:26.395058 (+498698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.395089 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:26.395694 (+   605us) log.cc:844] Serialized 52 byte log entry
0709 13:17:26.976526 (+580832us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:27.003297 (+ 26771us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.338914 (+335617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.338982 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.339023 (+    41us) raft_consensus.cc:1685] finished
0709 13:17:27.339035 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.339155 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":344540,"prepare.queue_time_us":34885,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":398694,"raft.run_cpu_time_us":673,"raft.run_wall_time_us":73208,"thread_start_us":997487,"threads_started":2,"wal-append.queue_time_us":712750}
I20260709 13:17:27.405421  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1327) took 1157 ms. Trace:
I20260709 13:17:27.405766 11282 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:27.405956  8179 rpcz_store.cc:276] 0709 13:17:26.248061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.263529 (+ 15468us) service_pool.cc:224] Handling call
0709 13:17:27.405195 (+1141666us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001c39d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:27.405356 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2356836608}
I20260709 13:17:27.407773 11476 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:27.407891  8783 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:27.391891  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1317) took 1199 ms. Trace:
I20260709 13:17:27.409046  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:27.391163 11546 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:17:27.410879  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:27.411087  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:27.411686  8783 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:27.412384  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:27.409216  8099 rpcz_store.cc:276] 0709 13:17:26.195452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.200151 (+  4699us) service_pool.cc:224] Handling call
0709 13:17:26.200407 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.200581 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:27.134773 (+934192us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.391065 (+256292us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.391425 (+   360us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.391544 (+   119us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.391588 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:27.391636 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.391704 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.391822 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152060,"prepare.queue_time_us":297159,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":92,"raft.queue_time_us":121683,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":186,"thread_start_us":994294,"threads_started":2,"wal-append.queue_time_us":163331}
I20260709 13:17:27.377089  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:27.416432  8177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2204) took 1672 ms (client timeout 1993 ms). Trace:
I20260709 13:17:27.415747  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:27.416898  8177 rpcz_store.cc:269] 0709 13:17:25.744440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.748842 (+  4402us) service_pool.cc:224] Handling call
0709 13:17:27.416271 (+1667429us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b540031e7d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:27.416372 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1310642560}
I20260709 13:17:27.418534  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:27.425900  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1315) took 1235 ms. Trace:
I20260709 13:17:27.426345  8108 rpcz_store.cc:276] 0709 13:17:26.190049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.191291 (+  1242us) service_pool.cc:224] Handling call
0709 13:17:27.425693 (+1234402us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54001662d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:27.425838 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506939648}
W20260709 13:17:27.442999  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 65998.1us
I20260709 13:17:27.444240  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:27.446170  8782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 746) took 1276 ms. Trace:
I20260709 13:17:27.446606  8782 rpcz_store.cc:276] 0709 13:17:26.173772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.173904 (+   132us) service_pool.cc:224] Handling call
0709 13:17:26.176695 (+  2791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.231731 (+ 55036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.445919 (+1214188us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b540051a4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:27.446112 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37768576}
I20260709 13:17:27.449249  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:27.450160  8099 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.451360  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:27.452450  8103 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:27.405507 11457 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.458359  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:27.459757  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:27.460439  8253 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.413935 11302 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:27.450210  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:27.457078  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:27.468530  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:27.470021  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:27.414254 11371 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:27.471066  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:27.367192 11253 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:17:27.478040  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:27.478727  8784 raft_consensus.cc:2376] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8. Re-sending same reply.
I20260709 13:17:27.479135  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:27.414081 11533 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:27.453956 11303 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:27.453688 11505 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:27.481096  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:27.454780 11356 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.455029 11396 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.341878 11436 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.455713 11334 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:27.497356  8099 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:27.497824  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:27.458828 10812 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:27.500110  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:27.502238  8072 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:27.503094  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:27.472024 11282 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:27.509886 11282 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:27.510219 10812 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.510386 11282 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:27.510694 10812 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.447926 11518 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:17:27.513890 11538 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:27.514498 11538 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.517755 11545 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:27.518607 11549 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.145s	user 0.003s	sys 0.000s
I20260709 13:17:27.518860  8786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 584) took 1231 ms. Trace:
I20260709 13:17:27.519315  8786 rpcz_store.cc:276] 0709 13:17:26.287857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.287955 (+    98us) service_pool.cc:224] Handling call
0709 13:17:26.288276 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.975667 (+687391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.518573 (+542906us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54004cf9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:27.518796 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1557713152}
I20260709 13:17:27.519946  8790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 581) took 1233 ms. Trace:
I20260709 13:17:27.520398  8790 rpcz_store.cc:276] 0709 13:17:26.287030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.287185 (+   155us) service_pool.cc:224] Handling call
0709 13:17:26.334883 (+ 47698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.815588 (+480705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.829162 (+ 13574us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:27.181739 (+352577us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b2c00047c48. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:17:27.197502 (+ 15763us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.280966 (+ 83464us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:27.281007 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.281097 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.519619 (+238522us) raft_consensus.cc:1685] finished
0709 13:17:27.519643 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.519870 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11214,"raft.queue_time_us":18812,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":22452,"spinlock_wait_cycles":7464832,"thread_start_us":548469,"threads_started":2,"wal-append.queue_time_us":160258}
I20260709 13:17:27.521925 11436 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:27.513944 11518 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:27.523494 11518 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:27.524499 11518 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.522368 10812 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.527256  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1324) took 1341 ms. Trace:
I20260709 13:17:27.529072  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1325) took 1343 ms. Trace:
I20260709 13:17:27.529950  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1322) took 1344 ms. Trace:
I20260709 13:17:27.530699  8783 raft_consensus.cc:2393] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 9: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:27.508867  8256 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.531962  8181 rpcz_store.cc:276] 0709 13:17:26.185847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.589737 (+403890us) service_pool.cc:224] Handling call
0709 13:17:26.590044 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.590262 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:26.940152 (+349890us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.528717 (+588565us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.528783 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:27.528838 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.528909 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.529017 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":608291,"prepare.queue_time_us":174564,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"thread_start_us":242267,"threads_started":1}
I20260709 13:17:27.527671  8178 rpcz_store.cc:276] 0709 13:17:26.185609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.419868 (+234259us) service_pool.cc:224] Handling call
0709 13:17:26.452871 (+ 33003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.453120 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:26.495460 (+ 42340us) log.cc:844] Serialized 14 byte log entry
0709 13:17:26.842920 (+347460us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.521387 (+678467us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b48001e0258. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a5d75aa1 00007fa5a5d6cb37 00007fa5a5d6c9ca 00007fa5a5e6426f 00007fa5a5e63f37 00007fa5a5e7855c 00007fa5a5e78508 00007fa5a5e78488 00007fa5a5e78443 00007fa5a5e776ec 00007fa5a4da1a96
0709 13:17:27.526733 (+  5346us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b180037e7c0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dcd9c0a 00007fa5a7419219 00007fa59dd61a40 00007fa59dd5c4e4 00007fa59dd5c455 00007fa5a0e44060 00007fa5a0e56716 00007fa5a0e67287 00007fa5a0e67208
0709 13:17:27.526883 (+   150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.526932 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:27.526996 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.527064 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.527185 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47448,"prepare.queue_time_us":253659,"prepare.run_cpu_time_us":8678,"prepare.run_wall_time_us":101364,"raft.queue_time_us":696371,"raft.run_cpu_time_us":12565,"raft.run_wall_time_us":670729,"spinlock_wait_cycles":142946944,"thread_start_us":338141,"threads_started":1,"wal-append.queue_time_us":425371}
I20260709 13:17:27.533150  8182 rpcz_store.cc:276] 0709 13:17:26.185158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.202410 (+ 17252us) service_pool.cc:224] Handling call
0709 13:17:26.212817 (+ 10407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.249598 (+ 36781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.249643 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.250178 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.966764 (+716586us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:27.013774 (+ 47010us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.529621 (+515847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.529698 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.529755 (+    57us) raft_consensus.cc:1685] finished
0709 13:17:27.529774 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.529890 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":607897,"prepare.queue_time_us":116278,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":47319,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":10686,"thread_start_us":707711,"threads_started":1,"wal-append.queue_time_us":917698}
W20260709 13:17:27.565374  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 63224us
I20260709 13:17:27.571213  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1326) took 1385 ms. Trace:
I20260709 13:17:27.480119 11502 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:17:27.469782 11457 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:27.571614  8183 rpcz_store.cc:276] 0709 13:17:26.186063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.783672 (+597609us) service_pool.cc:224] Handling call
0709 13:17:26.784060 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.792091 (+  8031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.792125 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.792590 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.972592 (+180002us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:27.225579 (+252987us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.570928 (+345349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.570998 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.571044 (+    46us) raft_consensus.cc:1685] finished
0709 13:17:27.571055 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.571163 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":389605,"prepare.queue_time_us":123087,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2271,"raft.queue_time_us":354332,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":9210,"thread_start_us":385178,"threads_started":2,"wal-append.queue_time_us":372512}
I20260709 13:17:27.507313 11523 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:27.527987 10812 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:27.604322  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:27.564106 11505 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:27.605916 11523 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.686990 11523 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:27.573117 11545 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.691664 11545 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.692672 11352 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:27.693765 11545 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:27.694239 11338 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:27.694618 11338 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:27.695387 11338 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.696728 11485 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.697202 11485 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.699172 11485 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:27.507874 11396 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:27.508137 11356 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.570363 11483 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:27.742019  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:27.576618 11419 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:17:27.740000  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 236968us
I20260709 13:17:27.739979  8782 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
W20260709 13:17:27.777984  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:27.806710  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.604948 10983 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:27.590466 11538 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:27.576915 11518 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:27.808328  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 66435.9us
W20260709 13:17:27.791944  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.579039 11280 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:27.696337 11338 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:27.826646 11554 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 13:17:27.828363 11153 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:27.804131 11485 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:27.835556  8149 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.131:45561 timed out after 1.623s (SENT) [suppressed 22 similar messages]
I20260709 13:17:27.810077 11481 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:27.802314 11303 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:27.822818 11419 raft_consensus.cc:697] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:27.576464 11334 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:27.834659 11410 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.867714 11538 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.809684 11302 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:17:27.829736 11299 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:17:27.875422 11303 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.910770 11480 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:27.911540 11480 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:27.912451 11303 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:27.812793 11282 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:27.875659 11334 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.878094 11356 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:27.897198 11396 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:27.895807 11465 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:17:27.913659 11334 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.897483  8223 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:27.898522  8256 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
W20260709 13:17:27.881841 11553 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
W20260709 13:17:27.882845 11550 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:17:27.915676  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:27.916412  8256 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:27.882328 11419 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.917268  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:27.814749 11506 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.839607 11485 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.811277 11483 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.918334  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:27.883599 11552 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:17:27.919351  8256 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:27.921319  8257 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:27.838405 11280 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:27.887658 11386 consensus_meta.cc:287] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.002s
I20260709 13:17:27.939185 11386 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.919922 11538 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.941987 11386 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:27.903095  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:27.943073  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.926492 11485 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:27.944154 11538 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:27.928460 11483 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:27.926126 11566 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:27.929852  8257 raft_consensus.cc:2410] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:17:27.945217 11566 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.946059  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:27.946835  8257 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:27.948047 11566 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:27.923754 11282 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:27.944217 10812 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.950281 10812 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.951947 11480 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:27.952764 10812 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:27.958352 11384 consensus_meta.cc:287] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 13:17:27.936585 11506 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:27.874686 11436 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:27.959889 11436 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:27.962334  8257 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:27.939551  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:27.963584  8256 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.897647 11505 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:27.934505 11457 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:27.936532  8253 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:27.962741 11436 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:27.908676 11410 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:27.971966 11568 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:27.972743 11410 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:27.973714 11523 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.976883 11523 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:27.972783 11568 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:27.980621 11568 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:27.993991 11332 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:27.988780 11334 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:28.004426 11334 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:27.876893  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 310168us
W20260709 13:17:28.041532  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 205736us
W20260709 13:17:28.045732  8074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.000s	sys 0.015s
W20260709 13:17:28.046413  8074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.000s	sys 0.015s
W20260709 13:17:28.046327  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 149190us
W20260709 13:17:28.047021  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 580367us
I20260709 13:17:28.048396  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:28.049647  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:28.052191  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:28.064625  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.069904  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:28.070698  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 428) took 1852 ms. Trace:
I20260709 13:17:28.070779  8183 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10. Ops: [6.7-9.9]
W20260709 13:17:28.073159  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.075721  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:28.078871  8223 leader_election.cc:400] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9.
I20260709 13:17:28.079298  8223 leader_election.cc:403] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:26.776393  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:28.071447  8174 rpcz_store.cc:276] 0709 13:17:26.218440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.078668 (+860228us) service_pool.cc:224] Handling call
0709 13:17:27.095828 (+ 17160us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:27.569758 (+473930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.569791 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:27.605528 (+ 35737us) log.cc:844] Serialized 52 byte log entry
0709 13:17:27.813534 (+208006us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:27.813578 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.813647 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.069835 (+256188us) raft_consensus.cc:1685] finished
0709 13:17:28.069891 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.070332 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":466972,"raft.queue_time_us":474694,"spinlock_wait_cycles":6671104,"thread_start_us":119691,"threads_started":1,"wal-append.queue_time_us":226592}
I20260709 13:17:28.097908 10983 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:28.098197  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:28.099745  8248 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:28.103379  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:28.103997  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:28.104714  8252 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:28.107101  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:28.108114  8249 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:28.111645  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:28.111837  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:28.105048  8257 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:28.053309  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1314) took 1863 ms. Trace:
I20260709 13:17:28.113829  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:28.114220  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:28.114795  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:28.111898  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:28.112987  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:28.099040 10983 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:28.114078  8100 rpcz_store.cc:276] 0709 13:17:26.189743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.193247 (+  3504us) service_pool.cc:224] Handling call
0709 13:17:28.052696 (+1859449us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540040bad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:28.053038 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2396564352}
I20260709 13:17:28.109287  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:28.139550  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:28.146137  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:28.148608  8249 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:28.149855  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:28.150820  8182 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:28.154696 11396 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:28.154922  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:28.155620 11396 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:28.156332  8251 raft_consensus.cc:2410] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:28.164548 11338 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.164644 11153 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:28.165861 11457 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:28.165622 11338 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:28.164750 11430 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.163971  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:28.170040 11252 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:28.170742 11252 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:28.172498 11276 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:28.173285 11276 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:28.175585 11352 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:28.176281 11276 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:28.176450 11352 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:28.176968 11277 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:28.177562 11244 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:28.177750 11277 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:28.178257 11244 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:28.181846  8248 raft_consensus.cc:2410] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:17:28.182039 11295 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.182802 11295 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:28.183314  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:28.184093  8248 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:28.185014  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:28.185711 11343 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.185827 11557 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:28.186453  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:28.186693 11557 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:28.187927  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:28.189217  8251 raft_consensus.cc:2410] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:17:28.194376 11570 raft_consensus.cc:2764] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:17:28.185106  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:28.189719  8223 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:28.191368  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:28.195449  8177 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:28.195986  8782 raft_consensus.cc:2368] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8.
I20260709 13:17:28.191855  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:28.196823 11299 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:28.197484  8788 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 10: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:28.197574  8248 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.193590  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:28.198491  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:28.198930 11348 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:28.199347  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:28.199901 11502 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:28.186831 11430 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:28.173300 11252 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:28.200927 11502 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:28.200026 11419 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:28.168411  8253 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.201196  8250 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:17:28.201763  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:28.191893  8099 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:28.186619 11343 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:28.198556 11070 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:28.208810 11476 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:28.213563  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:28.213810 11476 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:28.201525 11518 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.209812 11477 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.210539 11478 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.211251 11480 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.211777 11502 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:28.211930 11481 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:28.217748  8174 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:28.185282 11295 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:28.201954 11352 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:28.233872 11579 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.234530 11570 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:28.234324 11070 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:28.234454 11478 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:28.235509  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:28.223869 11518 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:28.235669 11481 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:28.236472  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:28.230535 11419 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:28.236614 11480 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:28.237561 11386 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.216691 11457 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:28.238260 11477 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:28.286760 11070 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:28.327203 11570 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:28.329753 11386 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:28.335249 11518 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:28.337479 11368 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:28.337752  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:28.243847  8249 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:17:28.197700 11299 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:28.277842  8785 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:28.288519 11478 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:28.364421  8253 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
W20260709 13:17:28.517748  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:28.425110  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.339001  8105 raft_consensus.cc:2410] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:17:28.289851  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 188444us
I20260709 13:17:28.463637  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2203) took 1098 ms. Trace:
I20260709 13:17:28.377072  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:28.949724  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:28.950699  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2206) took 1609 ms. Trace:
W20260709 13:17:28.954167  8248 consensus_meta.cc:287] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.756s	user 0.009s	sys 0.005s
I20260709 13:17:28.954576  8248 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:28.289772  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:28.419337  8099 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:28.923321  8250 rpcz_store.cc:276] 0709 13:17:27.298382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.223823 (+925441us) service_pool.cc:224] Handling call
0709 13:17:28.224267 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.388433 (+164166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.388481 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:28.395843 (+  7362us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:28.395913 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.395999 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.396154 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.951303  8253 rpcz_store.cc:276] 0709 13:17:27.305541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.109623 (+804082us) service_pool.cc:224] Handling call
0709 13:17:28.914377 (+804754us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.959250  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2199) took 1657 ms. Trace:
W20260709 13:17:28.358273  8074 connection.cc:256] RPC call timeout handler was delayed by -1.0716712579999239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 13:17:28.962033  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:28.962307  8074 connection.cc:256] RPC call timeout handler was delayed by -1.050071257999889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
I20260709 13:17:28.960086  8249 rpcz_store.cc:276] 0709 13:17:27.292361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.161304 (+868943us) service_pool.cc:224] Handling call
0709 13:17:28.214587 (+ 53283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.949806 (+735219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.950116 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.961229  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:28.968401  8181 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:28.969808  8788 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:28.420707 10953 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:28.923774 10983 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:28.970957 11280 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:28.426939 11557 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:28.569252 11153 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:28.971436 11356 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:28.971848 11280 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:28.973853  8256 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.010s	user 0.012s	sys 0.019s
I20260709 13:17:28.974460  8256 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
W20260709 13:17:28.975253  8256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2268) took 1530 ms (client timeout 1970 ms). Trace:
W20260709 13:17:28.975723  8256 rpcz_store.cc:269] 0709 13:17:27.444950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.923778 (+478828us) service_pool.cc:224] Handling call
0709 13:17:28.975136 (+1051358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.972678 11153 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:28.420399 11334 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:28.982699 11334 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:28.983997  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:28.985562  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:28.986351  8107 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:28.987982  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:28.988943  8106 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 7: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:28.989907  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:28.990619  8103 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:28.991858  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:28.992766  8104 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:28.987258  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:28.977309  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:28.997622  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:28.972666 11280 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:28.698956 11503 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:29.010295  8256 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:29.011452  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:29.011919  8783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48096 (request call id 589) took 1543 ms (client timeout 2025 ms). Trace:
I20260709 13:17:28.922869 11343 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:28.956800 11348 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.023562 11478 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:29.026655  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.027051 11478 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.015643 11545 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9.
I20260709 13:17:29.015910  8784 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:29.016734  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.018612 11476 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.019146  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.019744  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.020308  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:28.286003 11396 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:28.377722 11481 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:28.282732 11579 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:29.035796  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:29.022540 10953 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.023067  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:28.389653 11502 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.033618  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.027585  8106 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:29.015275 11430 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:29.025655  8783 rpcz_store.cc:269] 0709 13:17:27.468564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.470818 (+  2254us) service_pool.cc:224] Handling call
0709 13:17:29.001656 (+1530838us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b540049d4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:29.011731 (+ 10075us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132596096}
I20260709 13:17:29.031095  8182 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:28.420112 11505 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:29.032061  8180 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:29.041330  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:28.338325 11457 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.029847  8175 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:29.025067 11503 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:29.047407  8107 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:29.050968  8249 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
W20260709 13:17:29.050019  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 521503us
I20260709 13:17:29.037078 11570 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:29.034209 11334 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.058423  8252 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:17:29.058935  8181 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:29.061614  8103 raft_consensus.cc:2410] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:29.037855 11343 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:29.058995  8252 pending_rounds.cc:85] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 7
I20260709 13:17:29.064019  8249 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:29.064379  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:29.064921  8175 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:29.067093  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.061646  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.063037  8248 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:29.048254 11476 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:29.070688 11476 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.071846 11296 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:29.046154 11505 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.075143 11268 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:29.075680 11579 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:29.075804 11505 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.077394 11299 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.043684 11348 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.079322  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.080543 11338 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:29.081822  8250 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:29.082005  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.082516  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 444) took 1259 ms. Trace:
I20260709 13:17:29.082772  8103 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:29.082932  8250 rpcz_store.cc:276] 0709 13:17:27.823640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.036058 (+1212418us) service_pool.cc:224] Handling call
0709 13:17:29.068232 (+ 32174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.082238 (+ 14006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.082466 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:29.083916  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.049592 10953 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:29.085194 11582 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:29.086045 11582 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.087049 10953 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:29.087617 10953 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.080608  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.084746  8103 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:29.068606  8106 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:29.065985  8101 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:29.073153 11476 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.089900  8181 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:29.088135 10953 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:29.069275  8252 pending_rounds.cc:107] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:17:29.096608  8252 raft_consensus.cc:2889] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:29.061105 11481 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.057565 11502 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.088589 11582 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.061368 11570 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.107097  8104 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:29.109058  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.108686  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.096158 11299 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:29.091369 11579 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:29.111876  8146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.030s	sys 0.080s
W20260709 13:17:29.112746  8146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.030s	sys 0.080s
I20260709 13:17:29.114173  8182 raft_consensus.cc:2393] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:29.115825  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.075839 11268 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:29.119624 11584 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.120486  8101 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:17:29.097285 11481 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.119451 11343 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:29.121608  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.127323  8103 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:17:29.130061  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 84309us
I20260709 13:17:29.131887  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.123000 11584 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:29.135622  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:29.120704 11299 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:29.131523 11478 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.136211  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 440) took 1790 ms. Trace:
I20260709 13:17:29.140231  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.123628 11579 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.129226 11570 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.145329  8252 rpcz_store.cc:276] 0709 13:17:27.345741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.221915 (+876174us) service_pool.cc:224] Handling call
0709 13:17:29.000466 (+778551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.134610 (+134144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.136134 (+  1524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:29.139712 11584 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:29.134039 11280 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.146328  8106 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 4.
I20260709 13:17:29.146952 11417 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.149124  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.152089  8149 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:29.151058 11417 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.154654  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.156459  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:29.158708  8103 raft_consensus.cc:2393] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:29.162931  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:29.157193 11584 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:29.168576  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.172911  8182 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:29.169950  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.173619  8101 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:29.174110  8106 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:29.140247 11503 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.178779 11153 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:29.179368 11153 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.179804 11153 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.180832 11070 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:29.187012  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.174491 11584 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:29.191686  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.185961 11070 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.191697  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:29.200469  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.203972  8182 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:29.191074 11584 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.191886 11476 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:29.190532 11570 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.213308 11268 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:29.219667 11338 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:29.192864 11503 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.193110 10953 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:29.202205 11417 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.204476 11070 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:29.225106  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 1.01599e+06us
I20260709 13:17:29.204737 11502 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.230374  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:29.220445 11476 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:29.237926  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.230010 11338 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.241454 11338 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.241657 11579 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.240240 11476 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:29.243410 11576 log.cc:927] Time spent T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.089s	user 0.003s	sys 0.000s
I20260709 13:17:29.231277 11343 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:29.225204 11587 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.279253 11587 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:29.287160  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2158) took 1203 ms. Trace:
I20260709 13:17:29.287274  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:29.288399  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:29.289495 10983 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:29.291404 10983 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:29.291814 10983 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.292066 11457 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:29.292713 11457 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.293135 11457 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:29.297578 11557 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:29.301862  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:29.301937 11419 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:29.302712  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 45356us
I20260709 13:17:29.488517 11419 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:29.488957 11419 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.287808  8102 rpcz_store.cc:276] 0709 13:17:28.083348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.084023 (+   675us) service_pool.cc:224] Handling call
0709 13:17:28.084490 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.085207 (+   717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.085255 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.086136 (+   881us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.128426 (+ 42290us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:28.128475 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.139652 (+ 11177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.242650 (+1102998us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:29.286687 (+ 44037us) raft_consensus.cc:1685] finished
0709 13:17:29.286717 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.286962 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39087,"raft.queue_time_us":62998,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":46877,"spinlock_wait_cycles":10310528,"thread_start_us":41730,"threads_started":1,"wal-append.queue_time_us":67235}
I20260709 13:17:29.489343 11419 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.310930 11587 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:29.289703  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.492765  8101 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
W20260709 13:17:29.341387  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 216801us
I20260709 13:17:29.341512  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:29.280153  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 117278us
I20260709 13:17:29.354292 11589 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:29.292181 10983 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:29.365535  8175 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:29.369299 11566 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:29.370327  8099 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:29.372404 11244 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:29.377418  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 749) took 1873 ms. Trace:
I20260709 13:17:29.379055 11570 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.379184  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:29.380020  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.381362  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:29.498306  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.382901 11476 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.498423  8183 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:29.497666  8181 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:29.388937 11584 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.390745  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.392584 11604 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:29.500254  8177 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:29.502032  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:29.408291 11348 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:29.503634  8182 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:29.409211  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.420801 11299 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:29.423185 11480 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.427188  8254 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:29.428438  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.430032 11386 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:29.429899  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.440173  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.441922 11277 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:29.444814 11581 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.331s	user 0.001s	sys 0.002s
I20260709 13:17:29.447575 11481 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:29.449003 11583 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.467s	user 0.000s	sys 0.004s
I20260709 13:17:29.454916 11153 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:29.456408  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.377286 11338 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.459453  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.460382  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.461651  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.461951 11594 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:29.462641  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2267) took 2019 ms. Trace:
I20260709 13:17:29.463136  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.462654 11477 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:29.475304  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:29.487732  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 185988us
I20260709 13:17:29.496222  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:29.497359  8784 rpcz_store.cc:276] 0709 13:17:27.504165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.505003 (+   838us) service_pool.cc:224] Handling call
0709 13:17:29.015424 (+1510421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.038033 (+ 22609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.377155 (+339122us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540049d4d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:29.377339 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3472689024}
I20260709 13:17:29.499917 11589 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 10 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:29.482065 11557 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.502661  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1341) took 1256 ms. Trace:
I20260709 13:17:29.503530  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1337) took 1335 ms. Trace:
I20260709 13:17:29.417021  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.504827  8249 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:29.507426  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:29.496023 11566 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:29.610631  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:29.507964  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 57324.1us
I20260709 13:17:29.777973  8181 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
W20260709 13:17:29.606076  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 97550us
W20260709 13:17:29.651121  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.771498  8175 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:29.718590  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 45887.7us
I20260709 13:17:29.780354  8180 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:29.782580  8253 rpcz_store.cc:276] 0709 13:17:27.443762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.012565 (+1568803us) service_pool.cc:224] Handling call
0709 13:17:29.013118 (+   553us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:29.050699 (+ 37581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.050746 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:29.091932 (+ 41186us) log.cc:844] Serialized 26 byte log entry
0709 13:17:29.346400 (+254468us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:29.346456 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.346536 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.462428 (+115892us) raft_consensus.cc:1685] finished
0709 13:17:29.462445 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.462587 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14763,"raft.queue_time_us":26951,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":13021,"thread_start_us":248442,"threads_started":1,"wal-append.queue_time_us":247981}
W20260709 13:17:29.566991  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.771492  8257 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:29.778471  8255 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
W20260709 13:17:29.779204  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 283911us
W20260709 13:17:29.577733  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 88635.8us
I20260709 13:17:29.779704  8183 rpcz_store.cc:276] 0709 13:17:28.243008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.276100 (+ 33092us) service_pool.cc:224] Handling call
0709 13:17:29.381203 (+1105103us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b58000d7d98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:29.499319 (+118116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5226752}
I20260709 13:17:29.791424  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:29.772706  8177 rpcz_store.cc:276] 0709 13:17:28.203025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.205464 (+  2439us) service_pool.cc:224] Handling call
0709 13:17:29.390534 (+1185070us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b58000d7d98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27eee 0000000000375939 00007fa5a5d9b1e0 00007fa5a5e640c4 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:29.502439 (+111905us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4838144}
I20260709 13:17:29.622937  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:29.641072 11497 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.078s	user 0.003s	sys 0.005s
I20260709 13:17:29.796437  8179 raft_consensus.cc:2410] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:29.641247  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:29.798671  8254 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:29.799980  8174 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:29.799736  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:29.800570  8174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1338) took 1568 ms (client timeout 1595 ms). Trace:
W20260709 13:17:29.797993 11497 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.375s	user 0.004s	sys 0.015s
I20260709 13:17:29.707027 11584 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.513221 11503 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.810529  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.802335  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.719151 11476 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.663074 11533 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:29.804841  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:29.801070  8174 rpcz_store.cc:269] 0709 13:17:28.241659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.245865 (+  4206us) service_pool.cc:224] Handling call
0709 13:17:29.416853 (+1170988us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b58000d7d98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:29.800492 (+383639us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3209984}
W20260709 13:17:29.809067 11484 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.545s	user 0.001s	sys 0.010s
I20260709 13:17:29.667399 11480 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.154s
I20260709 13:17:29.809870 11566 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:29.695423  8001 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36106 (request call id 199) took 16186 ms (client timeout 15000 ms). Trace:
I20260709 13:17:29.821017 11566 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:29.820235 11484 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.605s	user 0.001s	sys 0.011s
W20260709 13:17:29.798785  8176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1345) took 1554 ms (client timeout 1769 ms). Trace:
W20260709 13:17:29.822531  8176 rpcz_store.cc:269] 0709 13:17:28.244590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.288121 (+ 43531us) service_pool.cc:224] Handling call
0709 13:17:29.459089 (+1170968us) spinlock_profiling.cc:243] Waited 935 us on lock 0x7b58000d7d98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:29.798714 (+339625us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2151296}
I20260709 13:17:29.507275 11604 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:29.824860 11604 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.789803 11557 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.639340 11502 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:29.811517  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:29.723973 11587 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:29.832108 11338 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:29.832194 11587 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:29.821095  8001 rpcz_store.cc:269] 0709 13:17:13.509224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.567907 (+ 58683us) service_pool.cc:224] Handling call
0709 13:17:13.990703 (+422796us) spinlock_profiling.cc:243] Waited 84.5 ms on lock 0x7b540006a9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db6090 00007fa5a0e54f3a 00007fa5a6c0b1cc 00007fa5a6d0937e 00007fa5a51ca2a4 00007fa5a51ca232 00007fa5a51ca161 00007fa5a51ca0dc 00007fa5a51c9392 00007fa59f18748c 00007fa59f1868c6
0709 13:17:29.695153 (+15704450us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:23.436259 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:23.495530 (+ 59271us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:23.495593 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:17:23.495620 (+    27us) tablet.cc:662] Decoding operations
0709 13:17:23.571333 (+ 75713us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:23.586399 (+ 15066us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:23.590211 (+  3812us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:17:23.603416 (+ 13205us) tablet.cc:701] Row locks acquired
0709 13:17:23.603479 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:17:23.603681 (+   202us) write_op.cc:270] Start()
0709 13:17:23.603959 (+   278us) write_op.cc:276] Timestamp: P: 1783603043603600 usec, L: 0
0709 13:17:23.603990 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:17:23.604825 (+   835us) log.cc:844] Serialized 6278 byte log entry
0709 13:17:23.809004 (+204179us) op_driver.cc:464] REPLICATION: finished
0709 13:17:24.094953 (+285949us) write_op.cc:301] APPLY: starting
0709 13:17:24.164406 (+ 69453us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:24.209229 (+ 44823us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:24.260355 (+ 51126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:24.543139 (+282784us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:24.543528 (+   389us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:17:24.543575 (+    47us) write_op.cc:312] APPLY: finished
0709 13:17:24.577467 (+ 33892us) log.cc:844] Serialized 113 byte log entry
0709 13:17:24.582223 (+  4756us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:24.582391 (+   168us) write_op.cc:454] Released schema lock
0709 13:17:24.582477 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:24.582884 (+   407us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:24.582911 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":42178,"reported_tablets":32,"spinlock_wait_cycles":194364800,"child_traces":[["op",{"apply.queue_time_us":169084,"apply.run_cpu_time_us":10891,"apply.run_wall_time_us":560642,"num_ops":16,"prepare.queue_time_us":125516,"prepare.run_cpu_time_us":13649,"prepare.run_wall_time_us":220825,"raft.queue_time_us":111019,"raft.run_cpu_time_us":57684,"raft.run_wall_time_us":89862,"replication_time_us":204852,"thread_start_us":286312,"threads_started":4,"wal-append.queue_time_us":28295,"wal-append.run_cpu_time_us":39559,"wal-append.run_wall_time_us":1950126}]]}
W20260709 13:17:29.813182  8179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1342) took 1569 ms (client timeout 1997 ms). Trace:
I20260709 13:17:29.795508 11481 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:29.619791 11139 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:29.802125 11594 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:29.805763 11386 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:29.820175  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.810935  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.508167 11570 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:29.831650  8174 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:29.833925 11153 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:29.833992 11502 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:29.834587 11587 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.812801  8790 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:29.835529  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:29.864709  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.835999 11348 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:29.865585  8101 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:29.870533  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:29.871276  8101 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.804927 11477 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:29.754908 11457 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.842615  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.717326 11070 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:29.840421  8179 rpcz_store.cc:269] 0709 13:17:28.243395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.287176 (+ 43781us) service_pool.cc:224] Handling call
0709 13:17:29.462908 (+1175732us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b58000d7d98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:17:29.813122 (+350214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2301696}
I20260709 13:17:29.838893  8147 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:29.849105  8183 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:17:29.849247  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.850039  8178 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:29.859925  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.863199  8175 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:29.866143  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.868646  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:29.619786  8006 catalog_manager.cc:5697] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 4 to 7, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 7 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:17:29.842861 11481 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:29.815546 11419 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.850697 11386 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.877048  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.890654 11410 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:17:29.890789  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.871274 11139 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:29.898144  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.899995  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.900995  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.899159  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.908016  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:29.905573  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2157) took 1761 ms. Trace:
I20260709 13:17:29.925768  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.864058 11608 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.872177 11348 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.915056  8102 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:29.849488 11503 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:29.917402  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.928814  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2160) took 1780 ms. Trace:
I20260709 13:17:29.843601 11601 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:17:29.938850  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.926630  8179 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:29.923642  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:29.874882 11477 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:29.935389  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.922905  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:29.857498 11533 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:29.942075  8254 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:29.926192  8108 rpcz_store.cc:276] 0709 13:17:28.081296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.082439 (+  1143us) service_pool.cc:224] Handling call
0709 13:17:28.114911 (+ 32472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.115288 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.115322 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.162066 (+ 46744us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.215500 (+ 53434us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:28.215533 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.215932 (+   399us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.443633 (+1227701us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:29.838161 (+394528us) raft_consensus.cc:1685] finished
0709 13:17:29.838182 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.842492 (+  4310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6443904,"thread_start_us":36422,"threads_started":1,"wal-append.queue_time_us":924915}
I20260709 13:17:29.941964  8252 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:29.937186  8100 rpcz_store.cc:276] 0709 13:17:28.158900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.161284 (+  2384us) service_pool.cc:224] Handling call
0709 13:17:28.178417 (+ 17133us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.218044 (+ 39627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.218074 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.259329 (+ 41255us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.388773 (+129444us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:28.388826 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.388918 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.448286 (+1059368us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:29.915985 (+467699us) raft_consensus.cc:1685] finished
0709 13:17:29.916004 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.928739 (+ 12735us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26107,"raft.queue_time_us":43253,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":159,"spinlock_wait_cycles":95956224,"thread_start_us":128990,"threads_started":1,"wal-append.queue_time_us":688234}
I20260709 13:17:29.950572  8257 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:29.951284  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:29.951905  8100 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.924854 11481 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:29.952873  8251 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:29.948335 11477 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.953526  8107 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:29.954559  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.955188  8107 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:29.956121  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.956665  8107 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:29.957674  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.929250 11139 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:29.958627 11139 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.937124 10983 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.960909 10983 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:29.961182  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 100666us
I20260709 13:17:29.962342  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.933676 11348 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.963651  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:29.964572  8108 raft_consensus.cc:2410] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:29.964908  8105 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:29.965217 11594 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.934427 11386 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.966370  8105 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:29.942001  8006 catalog_manager.cc:5697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 3 to 6, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 6 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.968382  8006 catalog_manager.cc:5697] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 6, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 6 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:17:29.950764 11497 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:29.938908 11608 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:29.970912 11502 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:29.971598 11608 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:29.972195 11608 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.972658 11608 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:29.974112  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 95691.7us
I20260709 13:17:29.975492  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:29.975643  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:29.977046 11584 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:29.977509 11584 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:29.977977 11584 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:29.977977 11497 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:29.980244 11587 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:29.969228  8181 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:29.982342  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:29.982919  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:29.983299  8251 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:29.983877  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:29.984669 11410 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:29.985385 11410 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:29.963537  8179 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:29.918872 11480 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.987504  8253 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:29.989200  8182 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:29.991405  8099 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:29.986387 11410 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.997942  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:29.998826 11570 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:29.999533  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55502.7us
I20260709 13:17:29.999642  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:30.000360  8179 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:30.001539  8107 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:30.001461  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:30.001971  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:30.002080  8107 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:30.003988  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:30.005183  8104 raft_consensus.cc:2410] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:17:30.008047  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.005795 11502 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:30.016260 11502 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:29.929786 11589 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:30.018512 11502 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:30.023432  8100 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
W20260709 13:17:30.025490  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.003669 11153 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:30.028113  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 215239us
I20260709 13:17:30.030016 11457 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:30.031258 11419 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:30.032377 11070 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:30.039089 11613 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:17:30.039970  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:30.040372 11557 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.040710 11356 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:30.046629  8074 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:30.046681 11533 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:30.070953  8147 leader_election.cc:400] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8.
I20260709 13:17:30.071339  8147 leader_election.cc:403] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:30.011534 11480 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:30.039124 11608 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:30.010175 11497 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:30.021921  8107 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.057621  8179 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:30.058156  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:30.059649  8101 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:30.080385  8108 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:30.073239  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:30.093752  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 47223.7us
I20260709 13:17:30.094784  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:30.090549  8006 catalog_manager.cc:5697] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:30.104288  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 46231.4us
I20260709 13:17:30.070866 11419 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:30.113399 11630 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:30.117902  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 44755.5us
I20260709 13:17:30.122982  8147 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:30.123961  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:30.125252  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:30.121201  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 241568us
I20260709 13:17:30.125723  8147 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:30.133117  8107 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:30.136524  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 96657.6us
W20260709 13:17:30.142921  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.145223  8006 catalog_manager.cc:5697] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 3 to 5, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 5 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.122107 11070 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:30.149403  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:30.074923 11386 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.127339 11476 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:30.138314 11613 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:17:30.122607 11533 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:30.074596 11477 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.077005 11481 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.127875 11570 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:30.153115  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 190314us
I20260709 13:17:30.139003 11277 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:30.173538  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 51572us
I20260709 13:17:30.170917  8006 catalog_manager.cc:5697] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 3 to 6, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 6 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.149727 11410 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:30.143589 11631 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:30.186161  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:30.189960  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 64303.6us
W20260709 13:17:30.176349 11623 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:17:30.187268  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:30.197530  8177 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:30.174448 11497 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:30.122936 11139 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.185024 11502 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:30.197827 11614 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:30.200591  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.201004  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.201241  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.183382  8006 catalog_manager.cc:5697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:17:30.200471  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:30.197827  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 72673.1us
I20260709 13:17:30.198758  8180 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:30.200006  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.206571  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:30.206681  8783 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:30.205754  8784 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:30.176566 11533 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:30.176954 11570 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:30.182724 11410 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:30.185969 11631 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.214854  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:30.214562  8006 catalog_manager.cc:5697] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.216543 11570 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.219949  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.222155  8782 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:30.222596  8223 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:30.223712 11139 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:30.214396 11566 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:30.224433 11566 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:30.224792 11566 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:30.224964 11477 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:30.197916 11476 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:30.226204 11476 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:30.229522 11631 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:30.232120 11348 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.233259  8250 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:30.221065  8785 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:30.220739  8006 catalog_manager.cc:5697] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 4 to 6, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 6 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:17:30.199328 11596 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:17:30.214696 11533 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.237764 11410 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.218677 11502 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.204809 11614 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.219076 11244 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:30.185354 11617 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:30.220018 11584 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.255471  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:30.265843 11477 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:30.266431 11623 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:30.284767  8149 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:30.335644  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 120891us
I20260709 13:17:30.271552 11244 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:30.271939 11614 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:30.279160 11477 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:30.341156  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 56457us
I20260709 13:17:30.338303  8006 catalog_manager.cc:5697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 3 to 6, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 6 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.271209 11139 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:30.342470  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:30.344954  8149 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:30.347265  8782 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:30.350639 11566 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.351794 11636 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:30.344408 11244 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:30.370887  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:30.373521  8100 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:30.371601  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:30.375855  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:30.343879 11633 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:30.377209 11633 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.377633 11633 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:30.377761  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:30.381549  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.347189 11139 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.383944 11139 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:30.382946  8006 catalog_manager.cc:5697] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 4 to 7, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 7 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.384326  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:30.386771  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:30.340399 11632 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:30.391108  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:30.385059  8006 catalog_manager.cc:5697] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 4, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 4 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.360708 11484 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:30.345991 11477 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:30.396906  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:30.397498  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:30.400493  8147 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:30.396790  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:30.402050  8108 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:30.402755  8784 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 10: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:17:30.403242  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.403601  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:30.404349  8787 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.409614  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:30.410955  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:30.386297 11566 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:30.391969 11070 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:30.395905 11153 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:30.362093 11630 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:17:30.419230  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:30.394804 11632 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:17:30.420747  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.420635 11070 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:30.422122  8147 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:30.455667  8006 catalog_manager.cc:5697] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.393355 11481 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:30.404594 11484 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:30.429765  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.431718  8782 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:30.410606 11497 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:30.435408  8100 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:30.461009  8788 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:30.450338 11356 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:30.405853 11299 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:30.453969  8252 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:30.460534  8787 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:30.459465  8147 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:30.418578 10983 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:30.415828 11348 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:30.465754  8107 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:30.419687 11419 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:30.478674  8006 catalog_manager.cc:5697] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 6, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 6 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:30.485224 11634 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.136s	user 0.004s	sys 0.000s
W20260709 13:17:30.485780  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.477157  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.465508 11484 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:30.462286 11070 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.423887 11558 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:17:30.466814 11497 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.424091 11338 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:17:30.496268  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:30.515440  8788 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.504864  8006 catalog_manager.cc:5697] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 6, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 6 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:30.509599  8784 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
W20260709 13:17:30.510725  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 51332.7us
I20260709 13:17:30.459527 11632 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.458918 11638 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:30.521025 11299 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:17:30.528206 11457 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:30.528640 11457 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:30.529525 11457 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.517127 11497 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.510111 11503 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:30.532935  8147 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:30.533492 11638 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:30.533968 11638 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:30.536145 11299 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:30.536734 11299 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:30.516081 11502 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:30.539300  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.539929  8791 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:30.540309  8782 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 10 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:17:30.540880  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.541477  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:30.541814  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.542426  8783 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 6.
I20260709 13:17:30.542603  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.543264  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.543953  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.543723 11410 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.544405  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.544993  8790 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:30.515090 11481 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:30.546039  8791 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:30.545843 11570 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:30.537918 11299 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:30.548022 11570 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:30.543807  8783 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:30.511507 11631 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:30.512053 11627 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.169s	user 0.003s	sys 0.001s
I20260709 13:17:30.495879 11356 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:30.515475  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 102365us
I20260709 13:17:30.494179 10983 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.551717 11386 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:30.551761 11631 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:30.541188 11596 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8.
I20260709 13:17:30.537156 11477 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.554468 11410 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:30.555215 11557 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:30.648528  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:30.555204  8006 catalog_manager.cc:5697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 3 to 5, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 5 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.496695 11419 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:30.511518  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.658692  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:30.567003 11356 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.2, Last appended by leader: 2, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.569591 11622 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:30.570353  8788 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:30.510504 11643 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:30.570796 11244 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.572496  8783 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:30.573566  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.667215  8791 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:30.574641  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:30.576799 11480 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:30.577491  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:30.668154  8790 raft_consensus.cc:2376] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9. Re-sending same reply.
I20260709 13:17:30.577703 11139 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:30.579404  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:30.670501  8252 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:30.580082  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:30.627791  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 43600.9us
I20260709 13:17:30.628710  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:30.645216  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.566234 10983 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.654455  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:30.672475  8253 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.569150 11533 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:30.564924  8108 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:30.654038  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:30.662645  8006 catalog_manager.cc:5697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 2 to 6, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 6 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.549311 11614 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:30.686192  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 343837us
I20260709 13:17:30.647195 11348 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.633644 11633 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:30.661983 11419 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:30.725564  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.723462  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:30.692258  8006 catalog_manager.cc:5697] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 4, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 4 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.709367  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:30.707878  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 79253us
I20260709 13:17:30.733755  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:30.778343  8791 raft_consensus.cc:2410] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:17:30.778359  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:30.783769  8253 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
W20260709 13:17:30.784369  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.785128 11481 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:30.787433  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:30.785368 11557 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:30.785758 11481 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:30.788899 11557 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.789919  8175 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:30.791144  8177 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:30.791571  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:30.791884  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:30.792201  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:30.789646 11481 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.792923  8179 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:30.792333 11566 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:30.788151  8006 catalog_manager.cc:5697] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 2, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.793573 11566 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.793799  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:30.793730 11638 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:30.794770  8178 raft_consensus.cc:2410] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:30.768210 11533 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:30.795682 11566 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:30.796022 11638 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:30.796257  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:30.796885  8174 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:30.797179  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:30.797822 11633 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:30.798017  8108 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:30.792650  8181 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:30.796038  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:30.668855 11643 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.667255 11617 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:30.803824  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:30.804436  8180 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:30.729087 11139 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:30.734717 11614 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:30.728327 11642 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.739502 11244 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:30.718228 11480 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:30.818955  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:30.791162 11557 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:30.818989  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:30.826795  8784 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:30.819813  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:30.827390  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:30.827628  8179 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.828733  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:30.829457  8107 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:30.747721 11070 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:30.818591 11633 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:17:30.804123 11643 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:30.718050 11570 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:30.824920  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:30.857861  8755 connection.cc:256] RPC call timeout handler was delayed by -1.614593806999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
I20260709 13:17:30.825491  8181 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:30.858342  8755 connection.cc:256] RPC call timeout handler was delayed by -1.5767938070000582s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 13:17:30.858666  8755 connection.cc:256] RPC call timeout handler was delayed by -1.3670938069999465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
I20260709 13:17:30.830309  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:30.860225 11638 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:30.718623 11348 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.861186 11299 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:30.861847 11299 consensus_queue.cc:1243] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:30.862376  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:30.863093 11348 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:30.863758 11348 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.864326 11348 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.820008  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:30.831825  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:30.865872  8178 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:30.866729  8072 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:30.813366 11596 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:30.833217  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:30.841893 11503 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:30.843307  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:30.845611  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:30.846150 11557 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.732487 11632 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:30.847575  8105 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:30.848018 11642 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.731220 11497 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.698086 11622 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:30.851013  8174 raft_consensus.cc:2393] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:30.823889  8099 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:30.843394  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.076359  8100 raft_consensus.cc:2393] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:30.851713  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:30.845023  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:30.853632  8179 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:31.077957  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.079355  8249 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:30.891485  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:31.010103 11649 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.867926 11596 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:31.080705 11649 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:31.081290 11596 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.083530 11649 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:30.882218 11601 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:31.000362  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:31.078959 11566 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.962724 11614 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:30.892373  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:31.086009 11566 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:31.086336 11651 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:31.087221 11651 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:31.087611 11651 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.065035 11338 raft_consensus.cc:3055] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:31.088446 11338 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:31.089257 11338 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.090255 11338 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.086704  8256 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.094187  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.094913  8107 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:31.095638  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.097383  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.098621  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.099612  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.100543  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.100447 11651 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:30.928289 11070 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:30.898859  8251 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:30.827826 11480 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.939450  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:30.921777  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:30.845021 11637 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.360s	user 0.003s	sys 0.000s
I20260709 13:17:31.111845 11480 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:31.101382  8249 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:31.113406  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:30.884090 11570 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:30.939790  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:31.126379  8255 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:30.857815  8103 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:30.915315 11348 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:30.915316 11484 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.049461  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:31.049722  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 249094us
W20260709 13:17:31.132854  8074 connection.cc:256] RPC call timeout handler was delayed by -1.3541970690000653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3311s for a response
I20260709 13:17:31.050815  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.050815  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:31.133396  8257 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:31.133634  8183 raft_consensus.cc:2368] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10.
I20260709 13:17:31.133615  8108 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:31.052274  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.053373  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.053565 11477 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:31.054455  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:31.055527  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:31.137297 11497 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:30.920683  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.137954  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:30.868992  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 449819us
I20260709 13:17:31.138796 11570 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:31.138898  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:31.139963 11665 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:31.140817 11665 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:31.141160 11665 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:30.919867  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:31.141741  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.134377 11584 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:31.065181  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 202892us
I20260709 13:17:31.101971  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.143986  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.144820 10983 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:31.145488  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:31.086195 11614 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:31.146304 11614 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:31.146772  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.072165  8105 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:31.103233 11557 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.148213  8105 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:31.149142  8105 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.149267 11557 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:31.149951 11594 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:31.151319 11601 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:31.151834 11594 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:31.152133 11601 raft_consensus.cc:697] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:31.104066  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:31.153577  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:31.153760 11584 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:31.154203  8102 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:31.153141 11601 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.105100 11642 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:31.105314  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.102730 11632 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:31.106094 11652 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:17:31.156911  8100 raft_consensus.cc:2393] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:31.155972 11643 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.158342  8182 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:31.158926  8100 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:30.925889 11617 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:31.108134 11419 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:31.014070  8784 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:31.116288  8249 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.136765 11484 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:30.882932  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:31.162017 11419 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:30.899006  8072 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:31.106503  8256 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:31.142287  8103 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:31.164255  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:31.168066  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.186488  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.190915  8108 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:31.196038  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:31.196671  8074 connection.cc:256] RPC call timeout handler was delayed by -1.2612832150000486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 13:17:31.196784  8180 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
W20260709 13:17:31.197073  8074 connection.cc:256] RPC call timeout handler was delayed by -1.2063832149999598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:17:31.197614  8074 connection.cc:256] RPC call timeout handler was delayed by -1.2009832150001785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260709 13:17:31.197749  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.198051  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:31.198613  8251 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.199877  8105 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:17:31.200209  8105 pending_rounds.cc:85] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 4
W20260709 13:17:31.196823  8223 connection.cc:256] RPC call timeout handler was delayed by -1.1498114230000738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
I20260709 13:17:31.200706  8105 pending_rounds.cc:107] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:17:31.200975  8105 raft_consensus.cc:2889] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:31.196827  8791 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:31.203022  8180 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:31.206688  8248 raft_consensus.cc:2368] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9.
I20260709 13:17:31.208357  8180 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:17:31.214412  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 315450us
I20260709 13:17:31.215253  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.218546  8175 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:31.189543 11632 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:31.221839 11632 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:31.222381 11570 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:31.189546 11497 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:31.223003 11570 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:31.223047 11632 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.226681  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.227924  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:31.228816  8106 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:17:31.229193  8106 pending_rounds.cc:85] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 8
I20260709 13:17:31.229472  8106 pending_rounds.cc:107] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:17:31.229694  8106 raft_consensus.cc:2889] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:31.194531 11477 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:31.228308  8072 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:31.239842 10983 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:31.231585 11503 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:31.240494  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:31.228084 11643 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:31.241350  8784 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.242489 11622 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:31.242635  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.240774 11503 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:31.252527  8784 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:31.254133  8175 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:17:31.255491  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 54410.2us
I20260709 13:17:31.258001  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.259053 11502 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:31.259549 11622 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.260207 11622 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:31.260545  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.263001 11502 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:31.263155 11622 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:31.264266  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:31.266863  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:31.271406  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.272228  8102 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:31.279743  8147 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:31.267660  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.189750 11642 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:17:31.281860  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:31.279863  8179 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:31.243011 11649 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:31.285755  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 139060us
I20260709 13:17:31.288627  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:31.292937  8250 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:31.270321 11503 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:31.296221  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.283034 10983 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:31.290659 11650 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:31.307585  8106 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:31.291234 11594 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:17:31.320633  8791 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:31.289664 11570 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:31.287362 11649 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.287485 11643 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:31.325104  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.325357  8147 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.325781  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:31.294704 11348 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:31.332160  8255 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:31.333604  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:31.314332 11617 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:31.335801  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.340401  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:31.341118  8106 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:31.334195  8250 raft_consensus.cc:2376] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8. Re-sending same reply.
I20260709 13:17:31.336100 11643 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:31.343478 11672 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:31.348941 11673 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:31.362475  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:31.379684  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.322238 11604 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:17:31.400403  8100 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.376652  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.375315  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.401170  8248 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:31.377936  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.379231  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:31.332118 11649 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:31.389030  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 107271us
W20260709 13:17:31.389369  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 121794us
I20260709 13:17:31.367892  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:31.401914  8257 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:31.341306 11596 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:31.402931  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:31.334048 11484 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:31.401327  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.403018  8255 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:17:31.417747  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 83075.1us
I20260709 13:17:31.434998  8250 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
W20260709 13:17:31.436728  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.402271 11594 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:31.444921  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:31.443703  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:31.445780  8250 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:31.398384 11672 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:31.447731 11594 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:31.448271  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.453044  8099 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:31.453061  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:31.449752  8103 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:31.450425  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.454754  8108 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.431723 10983 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:31.435700 11596 raft_consensus.cc:697] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:31.464231  8100 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:31.456231  8251 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:31.465555  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.466307  8251 raft_consensus.cc:2368] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11.
I20260709 13:17:31.466835  8108 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:31.372629 11614 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.445604  8105 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:31.469641  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:31.470374  8789 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:31.470475  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.458532  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.460919  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.448611  8249 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:31.434789 11139 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:17:31.468709  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.469004  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:31.471566  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.472268  8103 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:31.473076  8103 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:31.474289  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:31.453706 11672 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.471863 11622 raft_consensus.cc:2764] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:31.475433  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:31.475919 11139 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:31.477538 11668 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:17:31.477895 11594 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.494536  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:31.483157 11596 consensus_queue.cc:237] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.486126  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:31.486681  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.495833  8249 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:31.486855  8099 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:31.486979  8102 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:31.487860  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.499136  8251 raft_consensus.cc:2368] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8.
I20260709 13:17:31.490037  8106 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:31.491062  8250 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:31.491341  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:31.443099 11667 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:17:31.492792  8785 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:31.442814 11484 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:31.493541  8101 raft_consensus.cc:2410] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:17:31.493515  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:31.493891  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:31.506903  8791 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:31.495131  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.508042  8787 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:31.502701  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:31.489825 11663 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:17:31.503800  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:31.504878  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:31.510089  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.510397  8783 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:31.505045  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:31.510890  8249 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:31.508527  8248 raft_consensus.cc:2410] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:31.511422  8108 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:31.511987  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.513381  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.513971  8250 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:31.512781  8248 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:31.517275  8248 pending_rounds.cc:85] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 3
I20260709 13:17:31.518760  8248 pending_rounds.cc:107] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:17:31.519141  8248 raft_consensus.cc:2889] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:31.493894 11139 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:31.521380  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.522279  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.522537  8250 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:31.522814  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.525561  8100 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:17:31.510035 11681 log.cc:927] Time spent T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.093s	user 0.000s	sys 0.013s
I20260709 13:17:31.528654  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:31.519918 11678 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:31.531452 11679 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:31.532809 11566 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:31.535771  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:31.566608  8790 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:31.538465 11070 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:31.469136 11643 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.539305  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:31.508975 11503 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.551796 11665 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:31.532018  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:31.589232  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:31.559135  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.572796  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:31.590813  8179 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:31.574057  8182 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:31.580507  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.585459  8108 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:17:31.586526  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:31.589983  8176 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:31.587693  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 48501.7us
W20260709 13:17:31.588985 11682 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:17:31.595728  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:31.596515  8181 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:31.596825  8175 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:31.603529  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:31.620333  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:31.621241  8177 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:31.620347  8182 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:31.624055  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:31.624483  8106 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:31.625877  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:31.627416  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 95468.2us
I20260709 13:17:31.562093 11480 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:31.598541 11277 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:31.605077 11596 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:17:31.640432 11484 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:31.646973  8182 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:31.652702  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.653782  8175 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:31.634588 11677 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:31.657732  8180 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:31.635352 11679 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.659050  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.661623  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:31.662366 11503 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:31.663933 11480 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:31.643795 11665 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.669905 11614 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:31.670243  8181 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:31.670737 11677 raft_consensus.cc:697] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:31.671129  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.683743  8175 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:31.675989  8790 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:31.678563  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.681540 11533 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:31.677467 11679 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:31.682580  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.695981  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.697175  8174 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:31.700974 11566 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:31.701665 11649 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.702296 11566 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:31.703683 11649 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:31.703610 11566 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:31.704610  8105 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:31.704515  8177 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:31.705592 11677 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.706930 11679 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:31.707348 11631 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:31.695957 11533 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:31.710209 11533 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.711416 11533 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:31.713332  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.713815  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.714006  8175 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:31.714391 11667 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.714847 11667 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.718689  8099 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:31.720707  8176 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:31.722699 11672 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.724921  8251 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:31.727298 11672 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:31.698812  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.733322  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:31.733593 11678 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:31.734090  8099 raft_consensus.cc:2368] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10.
I20260709 13:17:31.735993  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:31.736893  8251 raft_consensus.cc:2368] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10.
I20260709 13:17:31.738140  8251 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:31.738853  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.736867  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:31.739964  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:31.741457 11678 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:31.741888  8074 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:31.742022 11678 raft_consensus.cc:697] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:31.742856 11614 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:31.743247 11614 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:31.743645 11614 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.743542 11678 consensus_queue.cc:237] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:31.751771  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:31.752403  8179 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.763746  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:31.764860 11651 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:31.765174  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:31.765528 11651 raft_consensus.cc:2764] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:17:31.765879  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.766116 11533 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:31.766753  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.767197  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:31.766712 11533 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:31.769272 11533 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:31.772859 11679 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:31.773993 11679 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:31.774349 11679 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:31.775115 11679 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:31.775789 11457 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:31.776384 11679 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.779558  8106 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 10 index: 3. (index mismatch)
I20260709 13:17:31.779871  8755 leader_election.cc:400] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10.
I20260709 13:17:31.780224  8755 leader_election.cc:403] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:31.782109  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.782927  8178 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:31.781173  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.768502  8074 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:31.787031  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:31.787629  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:31.788160  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.786576  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:31.790378  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.791718  8179 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:31.792563  8176 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:31.793708 11617 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:31.794025  8178 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:31.794189 11617 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:31.794708 11617 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:31.795049 11667 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:31.795320  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:31.796000  8178 raft_consensus.cc:2393] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 6: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:31.796275 11601 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10.
I20260709 13:17:31.796746  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.797712  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.797989  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.798537  8174 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 5: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:31.798775  8178 raft_consensus.cc:2410] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 11 because replica has last-logged OpId of term: 8 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:31.799309  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.799836  8178 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:31.786576 11651 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:31.802158  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:31.807819  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.809016  8179 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:17:31.810156  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.810521  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.810973  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:31.811062  8072 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:31.811697  8177 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 8 index: 2. Preceding OpId from leader: term: 10 index: 3. (index mismatch)
I20260709 13:17:31.813903  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:31.813921  8175 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:31.806645  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:31.820153  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:31.822432  8072 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:31.823143  8074 leader_election.cc:400] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11.
I20260709 13:17:31.827620  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:31.825213  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:31.825376  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 44274.7us
I20260709 13:17:31.831079  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:31.825930  8183 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:31.832370  8074 leader_election.cc:403] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:31.801565 11503 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:31.838145  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:31.841221  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:31.841099 11653 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:31.842154  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:31.812659 11651 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.805081 11667 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:31.813040 11672 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:31.852032  8221 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:31.852807 11701 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:31.824975 10983 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:31.853979  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:31.852972 11636 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.842731 11348 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:31.856842 11503 raft_consensus.cc:697] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:31.853415 11587 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:31.857482 11502 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:31.824760 11649 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:31.838954 11570 raft_consensus.cc:2764] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:31.826754 11665 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:31.834432 11566 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:31.844476 11557 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:31.848666 11604 consensus_queue.cc:1059] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:17:31.847234 11594 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:31.853490 11622 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:31.821964 11614 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.855695 11651 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:31.903762  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 55302.2us
I20260709 13:17:31.845578 11601 consensus_queue.cc:1059] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 13:17:31.914675  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 74120.6us
I20260709 13:17:31.924873 11339 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 13:17:31.908244 11557 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.912205 11594 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.911700 10983 raft_consensus.cc:697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:31.934769 11587 raft_consensus.cc:3055] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:31.939611 11557 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.941869 11594 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:31.950258  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 105521us
I20260709 13:17:31.952802 11683 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:31.952672 11503 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:31.958062  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:31.954871 11614 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:31.941247 11419 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:31.933771 11672 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
W20260709 13:17:31.960035  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 137054us
I20260709 13:17:31.967093 10983 consensus_queue.cc:237] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:31.968154 11683 raft_consensus.cc:697] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:31.939409 11604 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:17:31.990001  8176 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:31.970880  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:31.971560  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:31.971817  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:31.978767 11348 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:31.947104 11587 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:31.983258  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:31.983978  8181 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:31.985194  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:31.994800  8787 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:31.996369  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:31.998783  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:31.999126  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:32.000236  8074 leader_election.cc:400] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8.
I20260709 13:17:32.000499  8074 leader_election.cc:403] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:31.984696 11665 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:32.003674  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:32.006090  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 154135us
I20260709 13:17:32.006498  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:32.007599  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:32.007949  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:32.008289  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:32.008642  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:31.995035 11622 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:32.002103 11614 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:32.010257 11457 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:32.012385 11339 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:32.015460 11339 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:32.015161 11587 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.015930 11339 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.015249 11683 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.016599 11587 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.016422 11533 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.003029 11601 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:32.017531 11702 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:32.017692 11601 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:32.018036 11702 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:32.018711 11601 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.019044 11702 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.019775 11707 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:32.019955 11601 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:32.020119 11702 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.021584 11708 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8.
I20260709 13:17:32.022382 11636 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11.
I20260709 13:17:32.022812 11348 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.028236  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:32.012806 11419 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:32.032222  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:32.032480  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:32.036868  8248 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:32.046770  8253 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 13:17:32.049078 11533 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:32.049539 11708 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:32.038240 11457 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:32.050978 11457 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:32.053193 11670 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.758s	user 0.005s	sys 0.000s
I20260709 13:17:32.033742 11665 raft_consensus.cc:697] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:32.007015 11653 consensus_queue.cc:1059] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:17:32.053738 11617 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.054370 11667 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:32.054569 11704 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.027343 11614 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:32.055455 11419 consensus_queue.cc:1059] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:32.057809  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:32.121532  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2199) took 1292 ms. Trace:
I20260709 13:17:32.094166 11614 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:32.088792 11667 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:32.067603 11533 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:17:32.127990  8101 rpcz_store.cc:276] 0709 13:17:30.829188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.829351 (+   163us) service_pool.cc:224] Handling call
0709 13:17:32.121192 (+1291841us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b5400287654. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:32.121450 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972913024}
I20260709 13:17:32.097520 11704 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.143890 11717 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:32.144203 11704 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:32.144395 11713 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.144737 11717 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:32.086654 11708 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:17:32.086011 11139 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.145680  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2313) took 1295 ms. Trace:
I20260709 13:17:32.145915 11708 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:32.146430 11708 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:32.147334 11708 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.146061  8252 rpcz_store.cc:276] 0709 13:17:30.849982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.868495 (+ 18513us) service_pool.cc:224] Handling call
0709 13:17:30.898889 (+ 30394us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:30.917782 (+ 18893us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:30.918076 (+   294us) log.cc:844] Serialized 14 byte log entry
0709 13:17:31.064077 (+146001us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:31.107599 (+ 43522us) log.cc:844] Serialized 78 byte log entry
0709 13:17:31.107762 (+   163us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:31.114219 (+  6457us) log.cc:844] Serialized 14 byte log entry
0709 13:17:31.114738 (+   519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.114805 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:31.721628 (+606823us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:32.052930 (+331302us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b20001afdf8. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a09fab91 00007fa5a0a1ca19 00007fa5a09e78c3 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169 00007fa5a09f0131 00007fa5a09ef42d 000000000038f354
0709 13:17:32.145407 (+ 92477us) raft_consensus.cc:1685] finished
0709 13:17:32.145448 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.145593 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18309,"prepare.queue_time_us":6778,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":26788,"raft.run_cpu_time_us":446,"raft.run_wall_time_us":70043,"spinlock_wait_cycles":71462272,"thread_start_us":145608,"threads_started":1,"wal-append.queue_time_us":290133}
I20260709 13:17:32.148542 11708 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.145238 11533 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:17:32.154508  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 96396us
I20260709 13:17:32.156481  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:32.159404  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:32.159422  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.179778  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:32.180609  8181 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:32.180403  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:32.151405 11651 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.186314  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:32.186498  8182 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:32.146111 11139 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.188234  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:32.190080 11667 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.124785 11622 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.144934 11713 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.160355 11419 raft_consensus.cc:3055] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:17:32.194483  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 162321us
I20260709 13:17:32.153872 11533 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:32.198799  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:32.228096  8100 raft_consensus.cc:2393] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:32.228663  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:32.230005  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:32.161211 11339 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.198122 11419 raft_consensus.cc:740] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:32.257881  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:32.259294  8253 raft_consensus.cc:2410] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:32.177116 11665 consensus_queue.cc:237] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:32.261703  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 63052.4us
W20260709 13:17:32.264552  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.264408  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:32.245476 11672 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:32.278452 11713 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:32.279354 11653 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:32.282042  8248 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:17:32.283807  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:32.284896  8249 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:17:32.286619  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.287390  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:32.287751  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:32.288429  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:32.289031  8149 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:32.289739  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:32.290159  8248 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:32.290817  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:32.292323 11594 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.267555 11711 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:32.272007 11348 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:32.293483 11718 raft_consensus.cc:2764] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:32.292594  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:32.293874 11711 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:32.294273 11711 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:32.295070  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:32.295347  8784 raft_consensus.cc:2368] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7.
I20260709 13:17:32.296350 11703 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:32.297160 11651 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:32.297498 11584 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:32.297770 11651 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:32.298007 11584 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:32.265688  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:32.442165  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 153200us
I20260709 13:17:32.306581  8252 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:32.340154  8790 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:32.443682  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:32.289374  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:32.444897  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 149888us
I20260709 13:17:32.446193  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:32.447042  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 182777us
I20260709 13:17:32.341960  8787 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:32.342893  8788 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:32.341132  8791 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:32.469726  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:32.478302  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:32.484241  8149 leader_election.cc:400] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9.
I20260709 13:17:32.477293  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:32.489174  8149 leader_election.cc:403] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:32.337563 11558 raft_consensus.cc:3055] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:32.319078 11594 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:32.444430 11667 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:32.320276 11714 raft_consensus.cc:3055] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:32.399523 11716 raft_consensus.cc:3055] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:32.298448 11617 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:32.341017 11712 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:32.501256  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:32.519775  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:32.303894 11410 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.503602  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:32.398509 11719 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.209s	user 0.001s	sys 0.005s
I20260709 13:17:32.304009 11533 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.353897 11502 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:32.491117 11672 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:32.338390 11244 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.299398 11477 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:32.313305 11720 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:32.323594 11703 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:32.345877 11691 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.531172 11716 raft_consensus.cc:740] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:32.311844 11557 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.539366 11717 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:17:32.529038  8257 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:32.520634 11503 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:17:32.491307 11587 raft_consensus.cc:2764] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:17:32.489964 11708 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:32.493257 11497 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.545981  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 313022us
I20260709 13:17:32.548995 11672 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:32.312085 11614 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.519176 11651 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:32.521263 11558 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:32.535163 11339 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:32.532838 11642 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:32.531623 11714 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:32.529340  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:32.537611 11277 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9.
I20260709 13:17:32.535514 11712 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:17:32.552029 11677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.010s	sys 0.014s
W20260709 13:17:32.618484 11677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.011s	sys 0.014s
I20260709 13:17:32.301506 11419 consensus_queue.cc:260] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.299065 11584 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.566794  8223 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:32.603613 11651 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.555588 11636 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:32.547020 11410 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:32.607046  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.603132 11497 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.546118 11725 consensus_queue.cc:1059] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:17:32.553126 11244 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:32.600560 11601 consensus_meta.cc:287] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.009s
I20260709 13:17:32.592036 11672 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:32.598376  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 94833.5us
I20260709 13:17:32.597776 11477 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:32.559716 11502 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:32.642884  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 76126.1us
I20260709 13:17:32.562671 11691 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.295105 11711 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.650270  8103 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:32.654112  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:32.655736  8183 raft_consensus.cc:2393] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:32.636854 11481 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.634241 11651 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.657665 11477 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:32.661311  8179 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
W20260709 13:17:32.663463  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.670706  8103 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:32.678479  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:32.642025 11419 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.681213  8177 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:32.681152  8255 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:32.677693  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:32.685001  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:32.689716  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 188673us
I20260709 13:17:32.692896  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:32.701398 11477 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:32.704288  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 63715.7us
I20260709 13:17:32.705945  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:32.707453  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:32.710732 11244 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:32.712270 11502 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:32.713790 11497 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:32.714809 11557 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:32.630095 11716 consensus_queue.cc:260] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:32.716840 11139 consensus_meta.cc:287] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.001s
I20260709 13:17:32.717844 11728 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.718369 11614 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:32.719857 11728 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:32.670305 11481 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.721598 11709 consensus_queue.cc:1059] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:32.722339 11709 consensus_queue.cc:1243] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:32.722755 10983 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.723299 10983 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.723819 11481 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:32.669953 11503 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:32.724692 11503 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.725698 10983 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:32.727029 11503 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:32.688992 11712 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.728984 11712 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.729705  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:32.732930 11707 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:32.734943 11691 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:32.736284  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.678996 11720 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.737126 11720 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.740164 11139 consensus_queue.cc:1059] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:32.741282 11557 raft_consensus.cc:3055] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:32.684576 11653 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.741847 11557 raft_consensus.cc:740] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:32.742129 11653 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.742667 11557 consensus_queue.cc:260] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.744273 11339 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:32.747460  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 54641.9us
I20260709 13:17:32.748183  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:32.748940  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:32.749655  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:32.750546  8178 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:17:32.750607  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 216456us
W20260709 13:17:32.750859  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 43512.5us
I20260709 13:17:32.753244  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:32.754158  8181 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:32.760159  7991 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9abaa411847e4bf9907f7af5e2689c7b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:17:32.760217  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:32.762733  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:32.764213  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:32.765079  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:32.741006 11720 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:32.768180  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:32.767680  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:32.778443  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.769744  8787 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:32.768723  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:32.768430  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:32.775017  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:32.775009  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:32.780848  8789 raft_consensus.cc:2410] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:32.776060  8176 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:32.778734  8790 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:32.772723  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:32.777527  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:32.787940  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.770134 11703 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:32.781559  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:32.766269 11642 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:32.766059 11636 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:32.784130  8786 raft_consensus.cc:2376] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10. Re-sending same reply.
I20260709 13:17:32.775620 11497 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:32.812584  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:32.814363  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:32.778628 11691 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:32.815995  8101 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:32.819638  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:32.769862 11651 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.814250 11736 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:32.682456 11714 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.790298 11653 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:32.810622 11614 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:32.790211 11728 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:17:32.821077 11691 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:32.821645 11725 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:32.844359  8101 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:32.850008  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:32.845840  8149 leader_election.cc:400] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10.
I20260709 13:17:32.848384  8103 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:17:32.851050  8149 leader_election.cc:403] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:32.825233 11642 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:32.827788 11497 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:32.839284 11717 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:32.848490 11691 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.872818 11743 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:17:32.855944 11736 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.848752 11725 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.879702  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:32.868148 11277 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10.
I20260709 13:17:32.869247 11714 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.879926  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:32.852248 11244 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:17:32.846551 11614 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.902978 11497 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.904390  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 453) took 1846 ms. Trace:
I20260709 13:17:32.904839  8180 rpcz_store.cc:276] 0709 13:17:31.058301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.209404 (+151103us) service_pool.cc:224] Handling call
0709 13:17:31.645942 (+436538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:31.658716 (+ 12774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.831315 (+172599us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54002495d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:32.904141 (+1072826us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54002495d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:32.904309 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029834752}
I20260709 13:17:32.912992 11672 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.891557 11725 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.896584 11410 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:32.927321  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 57748.5us
I20260709 13:17:32.934643  8108 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:32.935123  8256 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:32.938048  8108 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:32.941188 11712 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:32.943454  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:32.944106  8108 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:32.947885  8788 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:32.948863  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:32.949739  8252 raft_consensus.cc:2410] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 9 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
W20260709 13:17:32.949973  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.950348  8790 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:32.950743  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:32.951511  8783 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:32.952603  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:32.955283  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:32.955960  8108 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:32.961670  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:32.962230  8175 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.963241  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:32.964049  8250 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:32.966296  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:32.967307  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 2 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:32.971319  8175 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:32.971762  8786 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:17:32.976526  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:32.972594  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:32.981678  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:32.983709  8248 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:32.982312  8252 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:32.990113  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:32.990988  8255 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:33.001116 11558 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:32.992071 11746 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:17:32.929785 11642 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.007143  8175 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 4. Current term is 5. Ops: []
W20260709 13:17:33.007912  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.008359  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.008666  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.009948  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:32.966995 11709 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.010957  8149 leader_election.cc:400] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10.
I20260709 13:17:32.959477 11712 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:32.989590 11678 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:32.960722 11481 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:17:32.981153 11277 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:17:32.980985 11410 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:17:33.055371 11410 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:33.055840 11410 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:33.051049  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:33.018987 11651 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:33.071890  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 103174us
I20260709 13:17:33.074512  8147 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:33.077754 11277 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:33.078301 11277 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.078783 11277 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.078431 11481 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:33.012415 11631 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.049981 11503 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:33.093083  8785 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:33.057698 11636 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:17:33.057737 11672 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:33.098102  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:33.099217 11557 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:33.070892 11678 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:17:33.104043 11730 log.cc:927] Time spent T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.430s	user 0.000s	sys 0.002s
I20260709 13:17:32.997973 11584 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:17:33.014992 11348 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:17:33.018652 11746 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:17:33.106837 11736 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:33.087580 11677 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.107928  8072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.933s (SENT) [suppressed 28 similar messages]
I20260709 13:17:33.089604 11747 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:17:33.111585 11725 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.096098 11631 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.113937 11601 raft_consensus.cc:3055] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:33.088243 11708 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:33.124424  8221 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:33.100401  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 85900.7us
I20260709 13:17:33.137763  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:33.097456 11707 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:33.056946 11410 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.136142  8257 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:33.136559  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:33.139564  8256 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.140527  8251 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:33.142889  8788 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:17:33.143919 11725 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:33.137091 11708 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:33.019387 11709 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.145107 11708 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.146546 11709 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:33.149586  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.152256 11737 raft_consensus.cc:3055] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:33.152702 11737 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:33.153752 11737 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.133073 11601 raft_consensus.cc:740] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:33.156708 11601 consensus_queue.cc:260] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.157729 11601 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:33.164886  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.185451  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.187021  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 79074.3us
W20260709 13:17:33.187913  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 63568.9us
W20260709 13:17:33.191301  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 53618us
I20260709 13:17:33.193280  8072 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:33.194878  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:33.196470  8072 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:33.199054  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:33.192068  8256 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:33.195288  8221 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:33.204873  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:33.205766  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:33.205124  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:33.207082  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:33.209088  8072 leader_election.cc:400] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7.
I20260709 13:17:33.209120  8255 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:33.209666  8072 leader_election.cc:403] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:17:33.211395  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.193672 11745 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:33.218604  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:33.220374  8256 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:33.189711 11709 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:33.218719  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:33.223971  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.230445  8251 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:33.192399 11704 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:33.233768 11757 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:17:33.233870  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.198204 11502 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:33.198369 11703 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:33.209331 11651 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:33.213557 11348 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:33.193503 11760 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:33.208881 10983 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:33.131327 11677 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.210031 11614 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:33.244793  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 47090us
W20260709 13:17:33.242127 11665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.012s	sys 0.011s
I20260709 13:17:33.229576 11636 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:33.212446 11746 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:17:33.229364 11755 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:33.190567 11707 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.243896 11762 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:33.258639  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:33.221340 11244 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:17:33.243223 11712 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:33.260908  8106 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:33.260933  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:33.242703 11704 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.266147  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:33.266191  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:33.258316 11665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.012s	sys 0.011s
I20260709 13:17:33.291848 11631 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:33.274222 11772 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:33.292984 11772 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.295193 11772 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:33.298039 11704 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:33.268636  8104 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:33.298491 11746 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:33.299089 11746 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:33.271382  8108 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:17:33.299487 11558 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:33.272431  8099 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:33.234962 11481 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:17:33.258081 11651 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 6. Current term is 7.
I20260709 13:17:33.258975 11348 raft_consensus.cc:697] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:33.282025 11758 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:17:33.259473 10983 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.267771 11762 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:33.298444  8252 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:33.300699  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:33.301553  8101 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:33.299873 11277 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.235950 11678 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.317924 11348 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.320955  8252 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
W20260709 13:17:33.321740  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.326215  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.314054 11759 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.055s	user 0.002s	sys 0.006s
I20260709 13:17:33.344980 10983 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:33.345098 11277 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:33.336390 11708 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:33.346793 11738 log.cc:927] Time spent T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.643s	user 0.003s	sys 0.000s
W20260709 13:17:33.348505  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.313695 11762 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.342862 11651 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.354650 11707 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:33.276819 11691 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.383683  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:33.384743  8100 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:33.381479  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:33.386874  8106 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:33.388056  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:33.390774  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:33.393415  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:33.365994 11651 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.402268 11709 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:33.404364 11778 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:17:33.406761 11769 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:17:33.409704  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:33.410763 11709 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:33.410874  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.411177 11709 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.411566 11709 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.299902 11746 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.414341 11746 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.419328 11709 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.422102 11533 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:33.422292 11709 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:33.423089  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:33.427443 11707 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:33.434295  8101 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:33.437790 11708 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:33.440933  8183 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:17:33.441985  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 234969us
I20260709 13:17:33.443517  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:33.445457  8179 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:33.449210  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 195770us
I20260709 13:17:33.453475  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:33.454939  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:33.455587  8248 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.460132  8101 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:33.398015 11665 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:33.462328  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 459) took 1426 ms. Trace:
I20260709 13:17:33.462589  8179 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:33.441329 11601 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.478323  8179 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:33.447634 11683 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.457255 11503 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.460304 11614 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:33.464720 11481 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.465030  8254 rpcz_store.cc:276] 0709 13:17:32.035957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.036061 (+   104us) service_pool.cc:224] Handling call
0709 13:17:32.045790 (+  9729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:32.452426 (+406636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.452464 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:32.452907 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.593536 (+140629us) spinlock_profiling.cc:243] Waited 918 us on lock 0x7b4800061158. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a5d75aa1 00007fa5a5d6cb37 00007fa5a5d6c9ca 00007fa5a5e6426f 00007fa5a5e63f37 00007fa5a5e7855c 00007fa5a5e78508 00007fa5a5e78488 00007fa5a5e78443 00007fa5a5e776ec 00007fa5a4da1a96
0709 13:17:32.689235 (+ 95699us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:32.739505 (+ 50270us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.744025 (+  4520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.744120 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.346210 (+602090us) spinlock_profiling.cc:243] Waited 46.7 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:33.462005 (+115795us) raft_consensus.cc:1685] finished
0709 13:17:33.462047 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.462252 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17598,"prepare.queue_time_us":50292,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":96518,"raft.run_cpu_time_us":8722,"raft.run_wall_time_us":454676,"spinlock_wait_cycles":109596288,"thread_start_us":507402,"threads_started":2,"wal-append.queue_time_us":198228}
I20260709 13:17:33.471800 11632 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.494910  8179 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:17:33.479503 11691 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:33.496518 11503 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.459945 11678 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:17:33.504225  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:33.506512  8179 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:33.506078  8248 raft_consensus.cc:2410] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 9 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:17:33.488158 11601 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.490087 11683 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.541195  8179 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:33.501886 11481 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.546064 11775 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:33.546752 11775 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.548915 11775 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:33.554562 11503 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:33.555945 11762 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.556636 11481 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:33.564612 11683 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:33.565901 11651 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:33.566169  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.566449 11651 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.566700 11716 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:33.501731 11632 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:33.570968  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.568693  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:33.571961  8100 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:33.598227  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:33.566959 11651 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.621398 11601 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:33.622161 11762 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:33.622789 11723 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:33.632910 11767 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.633730 11767 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.649669 11651 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:33.657202 11632 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:33.673686  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 137869us
I20260709 13:17:33.627949 11723 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:33.722359  8221 leader_election.cc:336] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.595s (SENT)
I20260709 13:17:33.723024  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:33.723031  8221 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:33.729235 11651 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:33.734266 11651 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:33.734761 11651 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:33.736017 11724 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 1.132s	user 0.002s	sys 0.000s
I20260709 13:17:33.723086 11348 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.737501 11348 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:33.745321  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.822835  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.871950  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 149616us
W20260709 13:17:33.872066  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 193564us
W20260709 13:17:33.874329  8221 leader_election.cc:336] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.644s (SENT)
I20260709 13:17:33.874470  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:33.874826  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.874929  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:33.878532  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:33.871546 11557 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.740708 11558 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:33.884831  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:33.884596  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:33.887358  8106 raft_consensus.cc:2410] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:17:33.883111  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.873531 11339 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.739471 11735 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.153s
I20260709 13:17:33.890575  8180 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:33.881309 11762 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:33.899451  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:33.899534  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:33.891593  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:33.881829 11775 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.878721 11683 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:33.898499  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:33.898856  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:33.899065  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:33.905864  8252 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:33.880909 11709 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:33.887815 11477 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:33.903832  8106 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:33.909344  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:33.912508  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:33.912731  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:33.913671  8179 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:33.916079  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:33.917665  8248 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:33.919432  8255 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:33.897043 11339 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.922958 11723 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:33.923432 11737 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:33.915411 11477 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:33.923885 11339 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:33.924223 11477 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.926594  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:33.927407  8107 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:33.899884 11762 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.928511 11762 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.886569 11557 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.890653 11786 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:17:33.930814 11557 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:33.932484  8178 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:33.908350 11775 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.938542  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:33.938980 11677 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:33.939263  8106 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:33.927503  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2265) took 1173 ms. Trace:
I20260709 13:17:33.940351  8174 rpcz_store.cc:276] 0709 13:17:32.753614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.756006 (+  2392us) service_pool.cc:224] Handling call
0709 13:17:33.250323 (+494317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.351117 (+100794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.351147 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.351625 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:17:33.441771 (+ 90146us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:33.441808 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.441869 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.551531 (+109662us) raft_consensus.cc:1685] finished
0709 13:17:33.551551 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.927243 (+375692us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54000d89d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:33.927441 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46832,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":1135723904,"thread_start_us":190075,"threads_started":2,"wal-append.queue_time_us":153366}
I20260709 13:17:33.949535  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:33.950218  8248 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:33.950768  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2269) took 1059 ms. Trace:
I20260709 13:17:33.951027  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:33.951429  8179 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:33.952003  8180 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:33.952950  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:33.951342  8183 rpcz_store.cc:276] 0709 13:17:32.891077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.891231 (+   154us) service_pool.cc:224] Handling call
0709 13:17:32.899758 (+  8527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.441342 (+541584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.950482 (+509140us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b54002f9c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:33.950703 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1244102400}
I20260709 13:17:33.953646  8254 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:33.900689 11796 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:33.958863  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:33.959213 11796 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.959620 11796 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:33.961048 11735 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.961468 11677 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.961637 11735 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.962153 11677 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.964155 11735 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:33.964515 11677 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:33.964697 11632 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.965219 11632 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.918901 11683 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.967163 11632 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:33.967514 11683 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:33.967952 11786 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:33.968330 11786 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:33.969178 11786 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.970309 11786 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.970948 11709 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.971647 11709 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:33.974990 11709 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:33.989849 11767 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:33.990731 11793 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:17:33.976018 11762 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:33.991755  8175 raft_consensus.cc:2368] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11.
I20260709 13:17:33.996901 11789 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.000133  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:33.975399 11796 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:34.013005  8149 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:33.939257 11775 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:34.020998  8180 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:34.025759  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:33.998103 11348 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:34.005545 11683 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:34.006086 11746 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:34.037281  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:34.037930  8248 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:34.039199  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:34.040663  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:34.041368  8248 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:34.042317  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:34.042915  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:34.022833 11633 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:34.056938  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:34.057735  8178 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:34.059250 11481 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.059903 11481 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:34.061889  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:34.045836  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:34.063098  8248 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
W20260709 13:17:34.046747  8221 leader_election.cc:336] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.769s (SENT)
I20260709 13:17:34.049026  8252 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:33.997752 11789 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.036393  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:34.066958  8254 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:34.068387  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:34.069072  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:34.069718  8248 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:34.070888  8248 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:17:34.064713  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:34.030810 11617 raft_consensus.cc:3055] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:34.055291  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:34.073060  8257 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:34.069042  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:34.067956 11632 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:17:34.045260 11703 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:17:34.077064  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:34.074729  8221 leader_election.cc:336] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.850s (SENT)
I20260709 13:17:34.050601 11348 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.080571  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:34.080871  8177 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:34.082856  8179 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:34.082795  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:34.083302  8183 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:34.084719  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:34.083125  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:34.072480 11775 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:34.087584  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:34.055936 11633 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:34.087067 11503 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:34.069243 11767 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.045856 11683 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:34.042192 11746 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.075589 11709 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:34.072765 11617 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:34.087990 11735 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:34.108850  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.093641 11533 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:34.092015 11775 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.130002 11533 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.130164 11775 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.130481 11533 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.132099  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 501) took 1325 ms. Trace:
I20260709 13:17:34.132472  8103 rpcz_store.cc:276] 0709 13:17:32.807263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.807438 (+   175us) service_pool.cc:224] Handling call
0709 13:17:32.807890 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:32.851162 (+ 43272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.131835 (+1280673us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b54004245d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:34.132040 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92584192}
I20260709 13:17:34.089756 11743 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:34.133628 11743 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.134090 11743 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:34.134176 11798 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:17:34.080119 11677 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:17:34.137782 11632 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:34.138216 11632 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:34.139076 11739 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 1.438s	user 0.009s	sys 0.000s
I20260709 13:17:34.139211 11632 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:34.141956  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.126930 11735 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:34.103400 11716 consensus_meta.cc:287] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.005s
I20260709 13:17:34.095204 11633 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:34.127120 11481 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:34.104269 11767 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.105684 11762 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:34.162482  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:34.163216  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:34.088444 11348 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:34.143963  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2250) took 1858 ms. Trace:
I20260709 13:17:34.153535  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:34.156320  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:34.164016  8174 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:34.167326  8250 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:17:34.134204 11796 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:34.174726  8107 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:34.143234 11632 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:34.171350  8103 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:34.144941 11735 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.150925 11711 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.178943  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:34.180886  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:34.168566  8249 rpcz_store.cc:276] 0709 13:17:32.286048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.290801 (+  4753us) service_pool.cc:224] Handling call
0709 13:17:32.451939 (+161138us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:32.461852 (+  9913us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:32.518918 (+ 57066us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.721847 (+202929us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:32.722312 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.722462 (+   150us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:32.722500 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.722569 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:32.918619 (+196050us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b18003ca600. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:17:34.138536 (+1219917us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:34.143747 (+  5211us) raft_consensus.cc:1685] finished
0709 13:17:34.143774 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.143895 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51843,"prepare.queue_time_us":56124,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":70928,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":9717,"spinlock_wait_cycles":119900928,"thread_start_us":91368,"threads_started":1,"wal-append.queue_time_us":141334}
W20260709 13:17:34.179494  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 110518us
I20260709 13:17:34.183653  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:34.184300  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:34.181624  8103 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:34.185118  8174 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:34.162604 11665 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.189143 11503 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:34.215797 11503 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.191907  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:34.183279 11800 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:17:34.188264 11707 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:34.193825 11557 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 10.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:17:34.194370 11771 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.883s	user 0.000s	sys 0.003s
W20260709 13:17:34.196810  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.193842 11683 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:34.197686 11533 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:34.189174  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 101656us
I20260709 13:17:34.227144  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:34.199820 11794 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.173s	user 0.002s	sys 0.001s
I20260709 13:17:34.166684 11716 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.178938 11703 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:34.178283 11796 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:34.166841 11722 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:17:34.247125 11796 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.221477 11707 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.230753 11533 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:34.248234 11707 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:34.235102  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45450.2us
W20260709 13:17:34.236753  8221 leader_election.cc:336] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.923s (SENT)
I20260709 13:17:34.249531  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:34.236822 11803 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:34.233193 11716 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:34.254020  8249 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:34.264325  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:34.264477  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:34.264981  8103 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
I20260709 13:17:34.265082  8249 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 5.
W20260709 13:17:34.266372  8221 leader_election.cc:336] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.997s (SENT)
I20260709 13:17:34.266803  8221 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:34.269780  8255 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:34.270131  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:34.272939  8104 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:34.226749 11789 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:34.229084 11800 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:34.272768  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:34.279675  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:34.280361  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:34.282192  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:34.214080 11665 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.261917 11803 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.290405  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:34.290966  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:34.291278  8100 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.295620  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:34.273849 11722 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:34.227751 11651 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.266386 11796 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:34.271368 11667 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:34.295506 11789 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:34.281482 11805 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:34.274451 11533 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:34.283028 11800 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:34.320417  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:34.262655 11703 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.350711 11816 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:17:34.351919 11651 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:34.352276 11800 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.3, Last appended by leader: 3, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.354031 11800 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:34.357775 11709 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.358393 11709 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:34.304769 11691 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:34.297204 11803 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:34.361984  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 71093.7us
I20260709 13:17:34.333999  8100 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:34.284461 11807 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:34.338727  8099 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:34.367321  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:34.368371  8099 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:17:34.376277  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.410807  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.327451 11809 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:34.422605  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51310.6us
I20260709 13:17:34.423432  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:34.427543  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:34.371377 11746 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:34.369686 11737 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
W20260709 13:17:34.483366  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.433331 11795 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:17:34.490350 11786 consensus_meta.cc:287] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.520s	user 0.004s	sys 0.007s
I20260709 13:17:34.492506  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1406) took 1058 ms. Trace:
I20260709 13:17:34.492908  8102 rpcz_store.cc:276] 0709 13:17:33.434598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.438619 (+  4021us) service_pool.cc:224] Handling call
0709 13:17:33.438941 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.439281 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:33.439529 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.508105 (+ 68576us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.533646 (+ 25541us) log.cc:844] Serialized 26 byte log entry
0709 13:17:33.533808 (+   162us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:33.533848 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.533916 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.947471 (+413555us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b18002839c0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f522 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:17:34.136901 (+189430us) spinlock_profiling.cc:243] Waited 9.11 ms on lock 0x7b18002839c0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:17:34.490253 (+353352us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b18002839c0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:17:34.492317 (+  2064us) raft_consensus.cc:1685] finished
0709 13:17:34.492337 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.492454 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17567,"prepare.queue_time_us":9432,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":924,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":12844,"spinlock_wait_cycles":62055040,"thread_start_us":68207,"threads_started":1,"wal-append.queue_time_us":71974}
I20260709 13:17:34.497644 11691 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:34.498106 11691 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.498450 11691 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:34.500113  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:34.504240  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.505394  8108 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:34.374626 11775 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.508525 11775 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:34.509771  8105 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:34.506850  8102 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:34.474136  8223 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:34.434607 11497 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:17:34.450350 11707 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.457577  8254 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:34.422758 11683 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.460784  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:34.463848  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:34.466912 11716 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:34.473640  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 926) took 1388 ms. Trace:
W20260709 13:17:34.524149  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 158163us
I20260709 13:17:34.474136 11348 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:34.532044  8102 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:34.476238 11477 consensus_meta.cc:287] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.002s
I20260709 13:17:34.532678 11477 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.535282 11477 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:34.535460  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:34.476586 11806 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:34.477381 11800 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:34.536314 11800 consensus_queue.cc:1243] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:17:34.477782  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:34.524001 11810 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:17:34.479172  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:34.537544 11683 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:34.538300  8257 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:34.520181  8253 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:34.520826  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:34.539772 11683 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:34.540462 11683 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.540855 11558 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.461123 11743 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.541399 11558 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:34.543121 11743 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:34.547173  8253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2247) took 2280 ms (client timeout 2018 ms). Trace:
I20260709 13:17:34.522873  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:34.548364  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:34.549333 11722 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:34.550280  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:34.551421  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:34.426100 11809 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.552142 11809 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.524048  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:34.553983  8100 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:34.554821 11729 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:34.555226 11729 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:34.555583 11729 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.556655 11803 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.522382  8107 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:34.525743  8249 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.525539  8255 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:34.465237 11767 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:34.528905  8180 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:17:34.530046  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:34.516961 11665 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:34.526320 11139 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:34.574604  8104 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:34.545140 11558 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:34.526364  8784 rpcz_store.cc:276] 0709 13:17:33.085753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.085929 (+   176us) service_pool.cc:224] Handling call
0709 13:17:33.086294 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.086712 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.086756 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.093582 (+  6826us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.056182 (+962600us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b18002c99e0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:17:34.271158 (+214976us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:34.271206 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.271281 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:34.473344 (+202063us) raft_consensus.cc:1685] finished
0709 13:17:34.473362 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.473581 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23540,"raft.queue_time_us":2243,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":2208,"spinlock_wait_cycles":13181184,"thread_start_us":214779,"threads_started":1,"wal-append.queue_time_us":1304119}
I20260709 13:17:34.561900  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:34.576035  8174 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:34.562887  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:34.563194  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:34.585095  8107 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
W20260709 13:17:34.560349  8253 rpcz_store.cc:269] 0709 13:17:32.266901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.293079 (+ 26178us) service_pool.cc:224] Handling call
0709 13:17:34.546953 (+2253874us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b5400208d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:34.547070 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4417703808}
I20260709 13:17:34.574555 11139 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.540910 11735 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:34.582085  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:34.582564  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.583679  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:34.589813  8180 raft_consensus.cc:2410] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:17:34.582823  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:34.585928  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:34.590636  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:34.594236 11830 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:34.577366 11633 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:34.574587  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 93102.1us
I20260709 13:17:34.566296 11348 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:34.572566 11711 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:34.623755  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:34.626152  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:34.627296  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:34.627463  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 359345us
I20260709 13:17:34.627833 11767 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:34.628461 11800 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:34.631520  8255 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:34.633914  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:34.634881  8099 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 10. Ops: []
I20260709 13:17:34.629063 11665 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:34.589011 11139 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:34.656226  8221 leader_election.cc:336] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.041s (SENT)
I20260709 13:17:34.540905 11683 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:34.639854  8249 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:34.660794  8223 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:34.632594 11558 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:34.627441 11807 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:34.626785 11477 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:17:34.671202 11683 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:34.635655 11677 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:17:34.664346 11716 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:34.660571 11722 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:34.679064  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:34.681672  8253 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:34.665058 11497 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:34.695284 11497 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.695719 11497 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:34.687001 11716 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.696026 11633 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:34.696326 11716 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:34.682708  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:34.665299 11339 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:34.653640 11691 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:34.686978  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.687785  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:34.705153  8102 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.706123 11691 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:34.707031 11822 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:34.708475 11803 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:34.687129  8254 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:34.588315 11773 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.709394 11773 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:34.710734  8175 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:34.712677 11773 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:34.656868  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:34.686167 11820 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.713678 11820 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.716450 11820 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:34.717350 11820 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.717870 11820 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.695461 11807 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:34.720306 11820 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:34.721475  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 65292.9us
I20260709 13:17:34.702332 11339 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.729229  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:34.730305  8254 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:17:34.725785  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 167145us
I20260709 13:17:34.708369  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:34.733994  8102 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
W20260709 13:17:34.733667  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 146376us
I20260709 13:17:34.742064  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:34.742820  8784 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:34.745824  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.756520  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:34.760223  8254 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.761209  8074 leader_election.cc:400] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11.
W20260709 13:17:34.762338  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 54065.1us
I20260709 13:17:34.764199  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:34.770301  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:34.770943  8253 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.728621 11557 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:34.781229 11707 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:34.789227  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 127017us
I20260709 13:17:34.790323  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:34.790954  8102 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:34.791038  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:34.793059  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:34.794032  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:34.799940  8102 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:34.789563  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:34.801025  8108 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:34.797621  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 52953.4us
I20260709 13:17:34.755330 11339 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.807790  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:34.699961 11683 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:17:34.808811  8104 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:34.810719  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:34.812572  8789 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:17:34.812778  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:34.813011  8789 pending_rounds.cc:85] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 9
I20260709 13:17:34.813658  8783 raft_consensus.cc:2410] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:34.813675  8789 pending_rounds.cc:107] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:17:34.814272  8789 raft_consensus.cc:2889] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:34.816509  8183 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:34.817771  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:34.817773  8786 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:34.769775 11667 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:34.829900  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:34.822283  8253 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:34.824919  8784 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:34.785032 11796 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:17:34.828444  8108 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:34.832616  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:34.839581  8183 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.834563  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:34.782845 11748 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:34.810748 11803 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:34.836591  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:34.828338 11800 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:34.825477 11830 raft_consensus.cc:697] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 7 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:34.874864  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:34.892298  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 149722us
I20260709 13:17:34.828027 11821 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:34.836181 11806 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:34.841073 11826 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:17:34.834082 11735 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:34.876631  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 47505.4us
I20260709 13:17:34.913022  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:34.917779  8253 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.870750 11803 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:34.836608 11831 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:34.834695 11667 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:34.904887 11558 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:34.874925 11614 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:34.867655 11820 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:17:34.934307  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:34.877547 11824 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:34.939332  8253 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:34.940822 11830 consensus_queue.cc:237] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:35.038455  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:35.039585  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:35.039635 11829 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:35.040119  8253 raft_consensus.cc:2376] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10. Re-sending same reply.
I20260709 13:17:35.040464 11840 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:34.935557 11803 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:35.032821  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 91030us
I20260709 13:17:35.029457  8784 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:35.041270  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:34.952942  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.830543 11828 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.185s
I20260709 13:17:34.917904  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:35.050897  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 173928us
I20260709 13:17:34.904980 11832 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:17:35.059342  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 166205us
I20260709 13:17:35.065639  8147 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:35.069106  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 151031us
I20260709 13:17:35.025255 11558 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.913751 11821 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:35.070772  8149 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:35.033457 11806 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:35.085093  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:35.108608  8253 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:35.079296  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.041415 11818 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.056891 11707 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.942082 11614 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:35.129099  8104 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:35.138000 11729 consensus_meta.cc:287] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
I20260709 13:17:35.047132 11809 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:35.111358 11840 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:35.107519 11748 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:35.149204  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.111855 11683 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.125315 11818 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:35.005354 11831 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:35.186245  8253 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:35.058130 11824 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:35.125065 11755 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:35.126845 11477 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:35.172701 11838 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:35.107718 11558 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:35.127694 11735 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:35.174252 11683 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:35.153683 11840 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:17:35.176412 11827 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:17:35.048193 11829 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:35.180272 11825 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:17:35.181495 11836 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:17:35.143703 11820 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.179380  8183 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:35.160640  8254 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:40.224511 11805 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:40.225121  8254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2279) took 5499 ms (client timeout 1638 ms). Trace:
W20260709 13:17:40.225682  8254 rpcz_store.cc:269] 0709 13:17:34.725080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.735405 (+ 10325us) service_pool.cc:224] Handling call
0709 13:17:40.224824 (+5489419us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:35.295266 11139 consensus_meta.cc:287] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.631s	user 0.002s	sys 0.011s
I20260709 13:17:35.297582 11339 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:40.227737  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2266) took 5104 ms. Trace:
I20260709 13:17:40.228572 11557 raft_consensus.cc:2764] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:17:40.228245 11139 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:40.230300 11339 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:35.275746 11477 raft_consensus.cc:697] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:35.170209  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:40.228237  8108 rpcz_store.cc:276] 0709 13:17:35.123514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.124210 (+   696us) service_pool.cc:224] Handling call
0709 13:17:35.124536 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.142700 (+ 18164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.142745 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.149298 (+  6553us) log.cc:844] Serialized 26 byte log entry
0709 13:17:40.224115 (+5074817us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:40.224176 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.224326 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.227262 (+  2936us) raft_consensus.cc:1685] finished
0709 13:17:40.227279 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.227518 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17759,"raft.queue_time_us":18410,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":13266,"thread_start_us":10585,"threads_started":1,"wal-append.queue_time_us":14684}
I20260709 13:17:40.232471 11477 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:35.928512 11497 consensus_meta.cc:287] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.232s	user 0.009s	sys 0.003s
I20260709 13:17:35.921316 11683 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:35.146039 11729 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:40.238716 11729 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:35.318950 11735 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:35.811574 11558 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:35.126047 11707 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:40.244822  8256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 5.085s	user 0.023s	sys 0.026s
W20260709 13:17:40.245410  8256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 5.085s	user 0.023s	sys 0.026s
I20260709 13:17:40.246708 11707 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:35.917757 11716 consensus_meta.cc:287] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.221s	user 0.010s	sys 0.003s
I20260709 13:17:40.248013 11716 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:37.325127 11775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.141s	user 0.000s	sys 0.031s
W20260709 13:17:40.249972 11775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 5.085s	user 0.000s	sys 0.031s
I20260709 13:17:35.194262 11748 raft_consensus.cc:697] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:40.251876 11748 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:35.301864 11806 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:35.913627 11809 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:40.254071 11497 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:35.287815 11820 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:35.914641 11821 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:40.256979  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:35.392824 11830 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.067870 11832 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:35.145277 11833 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:17:40.263401 11833 consensus_queue.cc:1243] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:40.264153 11833 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:40.264515 11833 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:40.253258 11735 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:35.218135 11834 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.292929 11840 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:35.911008 11842 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:17:35.673326 11848 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:17:38.144665 11863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.227s	user 0.009s	sys 0.006s
I20260709 13:17:35.915897 11868 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:17:38.377362 11870 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
W20260709 13:17:37.087244 11803 consensus_meta.cc:287] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 2.020s	user 0.011s	sys 0.000s
I20260709 13:17:35.912631 11818 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:35.903255 11829 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:35.699433 11614 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:35.911162 11856 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:17:39.904969 11872 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:40.526218 11872 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:40.528965 11872 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:39.907042 11873 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.530229 11873 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:40.532693 11873 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:39.908653 11874 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.909339 11875 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.533927 11874 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:40.534060 11875 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:40.536437 11874 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:40.536641 11875 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:39.950407  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2284) took 5422 ms. Trace:
I20260709 13:17:40.537276  8176 rpcz_store.cc:276] 0709 13:17:34.527349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.527489 (+   140us) service_pool.cc:224] Handling call
0709 13:17:34.533769 (+  6280us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:34.534129 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.534158 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:34.534690 (+   532us) log.cc:844] Serialized 52 byte log entry
0709 13:17:34.759872 (+225182us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:34.761337 (+  1465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.761402 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.949478 (+5188076us) raft_consensus.cc:1685] finished
0709 13:17:39.949544 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.950051 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2384,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":224734,"threads_started":1,"wal-append.queue_time_us":342798,"wal-append.run_cpu_time_us":3608,"wal-append.run_wall_time_us":1997286}
W20260709 13:17:39.970052  8183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2291) took 5177 ms (client timeout 2119 ms). Trace:
W20260709 13:17:40.005604  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.539737 11497 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:40.007157  8755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.923s	user 0.029s	sys 0.049s
W20260709 13:17:40.038894  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.541394  8755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 5.458s	user 0.029s	sys 0.050s
W20260709 13:17:40.541834  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 5.47981e+06us
I20260709 13:17:40.544257 11879 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.544962 11879 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:40.548096 11879 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:40.548334 11890 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:40.548699 11879 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.549247 11890 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:40.550593 11829 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:40.039229 11877 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.551859 11890 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:40.059749  8248 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.990s	user 0.020s	sys 0.031s
W20260709 13:17:40.552692  8248 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 5.484s	user 0.021s	sys 0.031s
I20260709 13:17:40.552234 11877 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:40.553690  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2376) took 5876 ms. Trace:
I20260709 13:17:40.554663 11877 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:40.060694  8223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 5.001s	user 0.043s	sys 0.029s
W20260709 13:17:40.555301  8223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 5.500s	user 0.043s	sys 0.030s
W20260709 13:17:40.555685  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 5.50154e+06us
I20260709 13:17:40.100459  8785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 933) took 5358 ms. Trace:
W20260709 13:17:40.539765  8183 rpcz_store.cc:269] 0709 13:17:34.792042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.829419 (+ 37377us) service_pool.cc:224] Handling call
0709 13:17:39.969779 (+5140360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:40.557689  8785 rpcz_store.cc:276] 0709 13:17:34.742212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.744640 (+  2428us) service_pool.cc:224] Handling call
0709 13:17:34.745078 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.907178 (+162100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.907231 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.918998 (+ 11767us) log.cc:844] Serialized 26 byte log entry
0709 13:17:35.068599 (+149601us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:35.068742 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.069005 (+   263us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.099892 (+5030887us) raft_consensus.cc:1685] finished
0709 13:17:40.099925 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.100234 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":337999,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":37453,"thread_start_us":286760,"threads_started":2,"wal-append.queue_time_us":286730,"wal-append.run_cpu_time_us":2250,"wal-append.run_wall_time_us":1666896}
I20260709 13:17:40.549414 11879 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:40.561762 11879 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:40.103068  8072 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 5.072s	user 0.015s	sys 0.050s
W20260709 13:17:40.565654  8072 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 5.535s	user 0.016s	sys 0.050s
W20260709 13:17:40.566082  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 5.53512e+06us
I20260709 13:17:40.105000  8100 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:40.107159  8177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2274) took 6209 ms (client timeout 1971 ms). Trace:
W20260709 13:17:40.570104  8177 rpcz_store.cc:269] 0709 13:17:33.898081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.898228 (+   147us) service_pool.cc:224] Handling call
0709 13:17:40.106585 (+6208357us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b540031f6d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:40.106910 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404087040}
W20260709 13:17:40.136343  8249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2385) took 5341 ms (client timeout 2787 ms). Trace:
W20260709 13:17:40.571424  8249 rpcz_store.cc:269] 0709 13:17:34.794882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.135868 (+5340986us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:40.136051 (+   183us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:17:40.161450  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.573467  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:17:40.574020  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.164942  8106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2248) took 5889 ms (client timeout 1938 ms). Trace:
W20260709 13:17:40.575031  8106 rpcz_store.cc:269] 0709 13:17:34.275883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.276077 (+   194us) service_pool.cc:224] Handling call
0709 13:17:40.164514 (+5888437us) spinlock_profiling.cc:243] Waited 5.65 s on lock 0x7b54003a4b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:40.164720 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12992933760}
I20260709 13:17:40.166320  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2349) took 6714 ms. Trace:
I20260709 13:17:40.576468  8250 rpcz_store.cc:276] 0709 13:17:33.451719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.452991 (+  1272us) service_pool.cc:224] Handling call
0709 13:17:33.453311 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.173098 (+719787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.165727 (+5992629us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b5400268754. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:40.166095 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611559168}
I20260709 13:17:40.577677  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:40.176808  8175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 465) took 5595 ms (client timeout 2204 ms). Trace:
W20260709 13:17:40.190395  8786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 5.063s	user 0.027s	sys 0.035s
I20260709 13:17:40.179446 11881 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.201001  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 506) took 5680 ms. Trace:
W20260709 13:17:40.579186  8786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 5.452s	user 0.027s	sys 0.036s
I20260709 13:17:40.579361  8099 rpcz_store.cc:276] 0709 13:17:34.520733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.521623 (+   890us) service_pool.cc:224] Handling call
0709 13:17:34.522952 (+  1329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.656006 (+133054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.200471 (+5544465us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400212ad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:40.200802 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257023744}
I20260709 13:17:40.579422 11881 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:40.201786  8149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 5.110s	user 0.024s	sys 0.069s
I20260709 13:17:40.580310  8786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 943) took 5750 ms. Trace:
I20260709 13:17:40.580724  8786 rpcz_store.cc:276] 0709 13:17:34.829912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.832668 (+  2756us) service_pool.cc:224] Handling call
0709 13:17:34.868815 (+ 36147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.869107 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:35.125301 (+256194us) log.cc:844] Serialized 14 byte log entry
0709 13:17:40.579814 (+5454513us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:40.579891 (+    77us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:40.580007 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.580102 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.580262 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2534318,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"thread_start_us":5707993,"threads_started":2,"wal-append.queue_time_us":788553,"wal-append.run_cpu_time_us":1365,"wal-append.run_wall_time_us":1033892}
I20260709 13:17:40.582186 11881 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:40.220283  8221 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.902s (SENT) [suppressed 5 similar messages]
W20260709 13:17:40.583189  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 363431us
W20260709 13:17:40.219662  8147 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 5.151s	user 0.034s	sys 0.055s
W20260709 13:17:40.227311  8254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2282) took 5416 ms (client timeout 3092 ms). Trace:
W20260709 13:17:40.584334  8254 rpcz_store.cc:269] 0709 13:17:34.810848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.227081 (+5416233us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:40.227251 (+   170us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:17:40.584975  8147 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 5.516s	user 0.034s	sys 0.055s
I20260709 13:17:39.957677 11617 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:40.231096 11139 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:40.164992 11348 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:40.649586 11348 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:40.654932  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:39.923848 11410 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:40.161624 11503 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:40.668606 11503 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:39.779567 11651 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:41.284142 11651 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:40.482717 11888 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.588486 11891 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:40.610438  8001 catalog_manager.cc:5697] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:41.286151 11891 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:41.286270 11888 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:40.621737  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 52863.1us
I20260709 13:17:40.646860  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2260) took 5967 ms. Trace:
I20260709 13:17:41.291956  8100 rpcz_store.cc:276] 0709 13:17:34.679229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.679468 (+   239us) service_pool.cc:224] Handling call
0709 13:17:34.679778 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.569750 (+5889972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.646496 (+ 76746us) spinlock_profiling.cc:243] Waited 5.42 s on lock 0x7b540035fa54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:40.646806 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12475935616}
I20260709 13:17:40.628733  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:41.295137  8102 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:40.629200  8104 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:40.624130  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:41.302960  8108 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
W20260709 13:17:40.284216  8074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 5.141s	user 0.032s	sys 0.064s
W20260709 13:17:41.307616  8074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 6.164s	user 0.035s	sys 0.064s
I20260709 13:17:40.590857  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:40.333884  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2238) took 6769 ms. Trace:
I20260709 13:17:41.311404  8101 rpcz_store.cc:276] 0709 13:17:33.564615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.656793 (+ 92178us) service_pool.cc:224] Handling call
0709 13:17:33.657121 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.657318 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:40.203785 (+6546467us) spinlock_profiling.cc:243] Waited 7.51 ms on lock 0x7b1800324fa0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa5a09f44bc 00007fa59dd4248b 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5c455 00007fa5a48443c7 00007fa5a0e569a7 00007fa5a0e660bf
0709 13:17:40.204048 (+   263us) log.cc:844] Serialized 14 byte log entry
0709 13:17:40.260350 (+ 56302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:40.261255 (+   905us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:40.261348 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.262025 (+   677us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.333706 (+ 71681us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":59808,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":1853,"raft.queue_time_us":2309,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":136,"spinlock_wait_cycles":17274624,"thread_start_us":112978,"threads_started":2,"wal-append.queue_time_us":32042,"wal-append.run_cpu_time_us":13263,"wal-append.run_wall_time_us":1001405}
I20260709 13:17:40.627346  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:41.314603  8103 raft_consensus.cc:2410] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 10 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:40.605043  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:40.589599  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:41.316672  8107 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
W20260709 13:17:40.603081  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 5.53718e+06us
W20260709 13:17:40.598508  8148 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 5.538s	user 0.027s	sys 0.055s
W20260709 13:17:41.323642  8148 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 6.264s	user 0.028s	sys 0.055s
W20260709 13:17:40.582180  8149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 5.490s	user 0.024s	sys 0.071s
I20260709 13:17:41.327217 11896 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:41.327939 11896 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:40.627346  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:40.335008  8174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2287) took 5803 ms (client timeout 1638 ms). Trace:
W20260709 13:17:41.331820  8174 rpcz_store.cc:269] 0709 13:17:34.531513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.535217 (+  3704us) service_pool.cc:224] Handling call
0709 13:17:40.334485 (+5799268us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b54001c2ad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:40.334794 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91448192}
I20260709 13:17:40.587643  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:40.578872  8175 rpcz_store.cc:269] 0709 13:17:34.581215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.582603 (+  1388us) service_pool.cc:224] Handling call
0709 13:17:40.176344 (+5593741us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400340654. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:40.176583 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276538240}
I20260709 13:17:40.615489  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:40.604094  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:40.633280  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:40.442610  8222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 5.332s	user 0.014s	sys 0.068s
W20260709 13:17:40.608039  8221 connection.cc:256] RPC call timeout handler was delayed by -4.6458387120001134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
I20260709 13:17:40.554039  8248 rpcz_store.cc:276] 0709 13:17:34.676802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.677890 (+  1088us) service_pool.cc:224] Handling call
0709 13:17:34.678169 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.683982 (+  5813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.684026 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.687653 (+  3627us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.847163 (+159510us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:35.068415 (+221252us) log.cc:844] Serialized 14 byte log entry
0709 13:17:40.553195 (+5484780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.553293 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.553385 (+    92us) raft_consensus.cc:1685] finished
0709 13:17:40.553398 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.553631 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":299675,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":854776,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":198,"thread_start_us":5772497,"threads_started":3,"wal-append.queue_time_us":293488,"wal-append.run_cpu_time_us":6821,"wal-append.run_wall_time_us":1921982}
W20260709 13:17:40.488057  8251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2281) took 5677 ms (client timeout 4036 ms). Trace:
W20260709 13:17:41.343474  8251 rpcz_store.cc:269] 0709 13:17:34.810570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.487701 (+5677131us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:40.487868 (+   167us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:17:40.277799  8253 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 6.
I20260709 13:17:40.624737  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2280) took 5818 ms. Trace:
I20260709 13:17:41.345981  8249 rpcz_store.cc:276] 0709 13:17:34.804790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.572231 (+5767441us) service_pool.cc:224] Handling call
0709 13:17:40.572709 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.573118 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:40.597668 (+ 24550us) log.cc:844] Serialized 14 byte log entry
0709 13:17:40.622929 (+ 25261us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:40.622977 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:40.623019 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.623062 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.623205 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1353,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":676,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":3325,"thread_start_us":24204,"threads_started":1,"wal-append.queue_time_us":33168}
W20260709 13:17:40.416779  8255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2383) took 5628 ms (client timeout 3350 ms). Trace:
I20260709 13:17:40.290475  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2381) took 5608 ms. Trace:
I20260709 13:17:40.551604  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2271) took 6509 ms. Trace:
W20260709 13:17:40.619009  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.515946  8787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 932) took 5773 ms. Trace:
I20260709 13:17:41.352054  8787 rpcz_store.cc:276] 0709 13:17:34.741948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.742059 (+   111us) service_pool.cc:224] Handling call
0709 13:17:34.742334 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.742562 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:34.933181 (+190619us) log.cc:844] Serialized 14 byte log entry
0709 13:17:40.514908 (+5581727us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b18002c98c0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa5a09f44bc 00007fa59dd4248b 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec23a
0709 13:17:40.515273 (+   365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:40.515375 (+   102us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:40.515491 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.515602 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.515774 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":346982,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":115,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":222,"spinlock_wait_cycles":24606464,"thread_start_us":311606,"threads_started":2,"wal-append.queue_time_us":2466457,"wal-append.run_cpu_time_us":1134,"wal-append.run_wall_time_us":1001169}
I20260709 13:17:40.641701 11139 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.608650 11339 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:41.355122 11139 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.355652 11339 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.356527 11899 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.678679 11503 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:40.296947 11642 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:41.360631 11642 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.362329 11903 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:41.363041 11642 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.363734 11642 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:41.364459 11904 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.364316 11642 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.365047 11904 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.367273 11904 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:41.367905 11904 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.368100 11533 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.165812 11665 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:41.370486 11665 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:40.044229 11667 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:40.148303 11677 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.375627 11677 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:41.376701  8221 connection.cc:256] RPC call timeout handler was delayed by -4.2543387120001626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
W20260709 13:17:41.377095  8221 connection.cc:256] RPC call timeout handler was delayed by -4.0285976449999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
I20260709 13:17:40.300887 11678 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:40.551880 11683 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:41.381413 11683 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:41.382599 11683 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:40.298411 11691 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.383268 11642 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.385609 11691 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:39.993618 11703 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.414227 11703 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.414752 11703 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:39.974460 11709 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:40.166469 11722 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:40.722796 11743 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.420565 11722 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.421123 11743 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:40.446902 11746 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.424506 11746 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.426587 11746 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:40.163225 11767 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.427958 11767 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.430055  8182 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:40.481849 11773 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:40.480901 11776 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.450821 11803 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.447561 11773 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:40.642554 11800 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:41.449640 11800 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.451447 11743 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:41.452808  8181 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
W20260709 13:17:41.454356  8181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2290) took 6662 ms (client timeout 3092 ms). Trace:
W20260709 13:17:41.454839  8181 rpcz_store.cc:269] 0709 13:17:34.791750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.793647 (+  1897us) service_pool.cc:224] Handling call
0709 13:17:41.454075 (+6660428us) spinlock_profiling.cc:243] Waited 6.65 s on lock 0x7b54002f8d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:41.454249 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15298292608}
I20260709 13:17:40.225265 11805 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:40.483942 11806 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.462507 11806 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:40.325341 11716 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:40.168104 11816 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:40.462440 11820 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:35.918949 11824 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:40.278174 11830 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.480036 11767 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:41.480962  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:37.379273 11831 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:40.274818 11834 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.488348 11824 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:41.489801 11803 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.490121 11824 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.491108 11834 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:40.618548 11840 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:40.264860 11832 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:40.605978 11833 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.493513 11800 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:35.243876 11845 consensus_queue.cc:1059] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.531s
I20260709 13:17:35.199352 11847 raft_consensus.cc:3055] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:41.502095 11847 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:41.503656 11847 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:40.278446 11863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.361s	user 0.010s	sys 0.007s
I20260709 13:17:40.279429 11868 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:40.618963 11879 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:41.512894 11879 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:41.138162  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:41.169546  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:41.173672  8006 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39814 (request call id 279) took 28971 ms (client timeout 15000 ms). Trace:
I20260709 13:17:41.255661 11617 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:41.259374 11557 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:41.263687  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.286695 11891 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:41.287313  8001 catalog_manager.cc:5697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:40.583214 11890 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:17:41.288545 11888 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:41.289044  8820 debug-util.cc:398] Leaking SignalData structure 0x7b0800304f60 after lost signal to thread 7005
I20260709 13:17:41.290036 11822 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:41.290477 11735 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:41.290781 11651 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.291101 11809 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.320233 11780 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:41.321252 11410 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:41.322558  8147 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:41.330467 11896 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.339509  8179 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
W20260709 13:17:41.340749  8222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 6.231s	user 0.014s	sys 0.068s
W20260709 13:17:41.348203  8255 rpcz_store.cc:269] 0709 13:17:34.788563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.416441 (+5627878us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:40.416598 (+   157us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:17:41.348577  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:41.349140  8253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60806 (request call id 468) took 6605 ms (client timeout 2204 ms). Trace:
I20260709 13:17:41.349407  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:41.349941 11898 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.348786  8256 rpcz_store.cc:276] 0709 13:17:34.682160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.699273 (+ 17113us) service_pool.cc:224] Handling call
0709 13:17:34.756176 (+ 56903us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:34.802235 (+ 46059us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:35.026287 (+224052us) log.cc:844] Serialized 14 byte log entry
0709 13:17:40.245903 (+5219616us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:40.247046 (+  1143us) log.cc:844] Serialized 52 byte log entry
0709 13:17:40.262271 (+ 15225us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:40.278148 (+ 15877us) log.cc:844] Serialized 14 byte log entry
0709 13:17:40.278432 (+   284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.278555 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.289022 (+ 10467us) raft_consensus.cc:1685] finished
0709 13:17:40.289050 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.290386 (+  1336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30352,"prepare.queue_time_us":297894,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":91,"raft.queue_time_us":1088750,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":16157,"spinlock_wait_cycles":1051904,"thread_start_us":5367153,"threads_started":4,"wal-append.queue_time_us":674601,"wal-append.run_cpu_time_us":4267,"wal-append.run_wall_time_us":2098581}
I20260709 13:17:41.354375 11900 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.355530 11901 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.682097 11348 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:41.357120 11899 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.374150 11905 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:41.377386  8221 connection.cc:256] RPC call timeout handler was delayed by -3.806297645000086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
I20260709 13:17:41.368711 11904 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.380579 11139 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:41.368896 11533 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.384022 11683 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:41.379554  8149 connection.cc:256] RPC call timeout handler was delayed by -5.3317442739999024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
I20260709 13:17:41.379792  8252 rpcz_store.cc:276] 0709 13:17:34.042582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.067901 (+ 25319us) service_pool.cc:224] Handling call
0709 13:17:34.068306 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.194902 (+126596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.194929 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.195335 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.280971 (+ 85636us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:34.281012 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.048709 (+5767697us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b2400395708. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dbe59c4 00007fa59dbe3acb 00007fa59dd9edc9 00007fa59dd9ea55 00007fa59dd9dfb0 00007fa5a0a14488 00007fa5a0a14be8 00007fa5a09ec398 00007fa5a09e776a 00007fa5a09e6bb6
0709 13:17:40.551062 (+502353us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400387f54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:40.551124 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.551208 (+    84us) raft_consensus.cc:1685] finished
0709 13:17:40.551221 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.551438 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3639,"raft.queue_time_us":4630,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":284999168,"thread_start_us":85278,"threads_started":1,"wal-append.queue_time_us":418046,"wal-append.run_cpu_time_us":302542,"wal-append.run_wall_time_us":6425261}
I20260709 13:17:41.390756 11906 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.395709 11503 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:41.410758  8074 connection.cc:256] RPC call timeout handler was delayed by -6.09192537700028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
I20260709 13:17:41.394076 11665 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:41.392580 11691 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:41.411528 11678 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.398447 11642 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:41.394435 11677 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.363082 11903 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.417284 11339 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:41.418635  8072 connection.cc:256] RPC call timeout handler was delayed by -4.6797048200000972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
I20260709 13:17:41.419720 11703 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.435220  8257 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:41.435365  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.423235 11722 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:41.445782  8182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 456) took 8002 ms (client timeout 1566 ms). Trace:
I20260709 13:17:41.446157 11776 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.478907 11773 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.481959  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.482928  8181 raft_consensus.cc:2410] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:41.466248 11816 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.486471  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.487586 11830 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:41.488336 11910 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:41.495028 11824 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.489332 11831 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:41.505904 11847 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:41.506256 11806 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:41.508562 11805 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:41.626430  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.509281  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2386) took 6413 ms. Trace:
W20260709 13:17:41.627727  8820 debug-util.cc:398] Leaking SignalData structure 0x7b08003053c0 after lost signal to thread 8040
W20260709 13:17:41.628974  8221 connection.cc:256] RPC call timeout handler was delayed by -3.3895976450000944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23290000000000002s for a response
I20260709 13:17:41.629678  8101 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:41.630419  8149 connection.cc:256] RPC call timeout handler was delayed by -5.3317442739999024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 13:17:41.631413  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.515380  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:41.632882  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.620096 11840 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:41.635560  8001 catalog_manager.cc:5697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 7 to 11, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 11 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:41.513710 11868 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:41.652069  8820 debug-util.cc:398] Leaking SignalData structure 0x7b0800305b20 after lost signal to thread 8132
I20260709 13:17:41.640450 11910 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:41.630043  8072 connection.cc:256] RPC call timeout handler was delayed by -4.5200053690000459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 13:17:41.630704  8253 rpcz_store.cc:269] 0709 13:17:34.743764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.187351 (+443587us) service_pool.cc:224] Handling call
0709 13:17:41.349052 (+6161701us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:41.648777  8149 connection.cc:256] RPC call timeout handler was delayed by -4.8718442740000683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2449s for a response
W20260709 13:17:41.649147  8221 connection.cc:256] RPC call timeout handler was delayed by -2.7372027100000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.49610000000000004s for a response
I20260709 13:17:41.634146  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.649772  8180 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
W20260709 13:17:41.654079  8072 connection.cc:256] RPC call timeout handler was delayed by -4.4678053690001889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
I20260709 13:17:41.655280  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.637701  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:41.655723  8072 connection.cc:256] RPC call timeout handler was delayed by -4.4273053690001234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
I20260709 13:17:41.656190  8177 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:41.656536 11824 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:41.657295  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.658425  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:41.659271 11910 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:41.659476  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.660133  8177 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:41.657063 11824 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.660871  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.699286 11824 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:41.661958  8820 debug-util.cc:398] Leaking SignalData structure 0x7b08002561e0 after lost signal to thread 8207
I20260709 13:17:41.661598 11900 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.662117 11642 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:41.709200  8820 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4e40 after lost signal to thread 8281
W20260709 13:17:41.710353  8820 debug-util.cc:398] Leaking SignalData structure 0x7b0800346d20 after lost signal to thread 8823
W20260709 13:17:41.710772  8820 debug-util.cc:398] Leaking SignalData structure 0x7b08003ed760 after lost signal to thread 8824
I20260709 13:17:41.712083 11642 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:41.654924  8149 connection.cc:256] RPC call timeout handler was delayed by -4.7916052359998957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
I20260709 13:17:41.655539  8183 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
W20260709 13:17:41.713686  8149 connection.cc:256] RPC call timeout handler was delayed by -4.6634748529997978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
W20260709 13:17:41.714099  8149 connection.cc:256] RPC call timeout handler was delayed by -4.0320052360000318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2787s for a response
I20260709 13:17:41.665537 11905 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.714399  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.715634  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.716187 11905 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:41.653473  8257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60806 (request call id 467) took 6909 ms (client timeout 2194 ms). Trace:
I20260709 13:17:41.716614  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.669834 11904 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:41.714397  8149 connection.cc:256] RPC call timeout handler was delayed by -3.5253052359998946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.335s for a response
I20260709 13:17:41.669983  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:41.717558  8149 connection.cc:256] RPC call timeout handler was delayed by -3.0893748529997538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.39580000000000004s for a response
I20260709 13:17:41.667558 11903 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.650103 11901 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.652662 11557 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.677023 11896 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:41.677076  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:41.673857  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:41.674027  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:41.677007  8074 connection.cc:256] RPC call timeout handler was delayed by -5.3074285349998718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 13:17:41.733516  8074 connection.cc:256] RPC call timeout handler was delayed by -5.3074285349998718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 13:17:41.733989  8074 connection.cc:256] RPC call timeout handler was delayed by -5.0266285349998725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 13:17:41.734354  8074 connection.cc:256] RPC call timeout handler was delayed by -4.9654285350000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
W20260709 13:17:41.734726  8074 connection.cc:256] RPC call timeout handler was delayed by -4.9393285349999587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
W20260709 13:17:41.734965  8074 connection.cc:256] RPC call timeout handler was delayed by -4.6166421750001518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 13:17:41.735206  8074 connection.cc:256] RPC call timeout handler was delayed by -3.7409421750001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30920000000000003s for a response
W20260709 13:17:41.735499  8074 connection.cc:256] RPC call timeout handler was delayed by -3.7409421750001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30920000000000003s for a response
W20260709 13:17:41.735842  8074 connection.cc:256] RPC call timeout handler was delayed by -2.8913421750000907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.40359999999999996s for a response
I20260709 13:17:41.673628 11809 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.678009  8001 catalog_manager.cc:5697] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 7 to 8, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 8 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:41.673736 11651 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.729966  8175 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:41.677146 11703 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.675428  8253 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:41.675225 11533 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.681349  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:41.643936 11906 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.739200  8255 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:41.674487  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:41.675488  8072 connection.cc:256] RPC call timeout handler was delayed by -4.35710536900001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
I20260709 13:17:41.739692  8249 raft_consensus.cc:2368] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9.
W20260709 13:17:41.739813  8072 connection.cc:256] RPC call timeout handler was delayed by -4.3418053689999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 13:17:41.740207  8072 connection.cc:256] RPC call timeout handler was delayed by -4.0866048200000478s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
W20260709 13:17:41.740515  8072 connection.cc:256] RPC call timeout handler was delayed by -3.8280539610000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 13:17:41.740775  8072 connection.cc:256] RPC call timeout handler was delayed by -3.4085053690000677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2987s for a response
I20260709 13:17:41.683190 11805 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.737124  8001 catalog_manager.cc:5697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 6 to 9, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 9 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:41.743290  8001 catalog_manager.cc:5697] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:41.683542 11816 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.684234 11879 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.684659  8101 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:41.684839  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.685694  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:41.650512 11840 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:41.687227  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:41.631608  8006 rpcz_store.cc:269] 0709 13:17:12.274731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.377898 (+103167us) service_pool.cc:224] Handling call
0709 13:17:41.173488 (+28795590us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:31.033987 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:31.034743 (+   756us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:31.034810 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:17:31.034830 (+    20us) tablet.cc:662] Decoding operations
0709 13:17:31.221885 (+187055us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:31.221979 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:31.222005 (+    26us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:17:31.400280 (+178275us) tablet.cc:701] Row locks acquired
0709 13:17:31.434465 (+ 34185us) write_op.cc:260] PREPARE: finished
0709 13:17:31.455388 (+ 20923us) write_op.cc:270] Start()
0709 13:17:31.481502 (+ 26114us) write_op.cc:276] Timestamp: P: 1783603051450928 usec, L: 0
0709 13:17:31.481534 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:17:31.482326 (+   792us) log.cc:844] Serialized 7511 byte log entry
0709 13:17:31.743791 (+261465us) op_driver.cc:464] REPLICATION: finished
0709 13:17:31.745227 (+  1436us) write_op.cc:301] APPLY: starting
0709 13:17:31.745331 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:31.749461 (+  4130us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:31.749613 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:31.857674 (+108061us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:31.858059 (+   385us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:17:31.858105 (+    46us) write_op.cc:312] APPLY: finished
0709 13:17:31.858596 (+   491us) log.cc:844] Serialized 132 byte log entry
0709 13:17:31.858873 (+   277us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:31.859114 (+   241us) write_op.cc:454] Released schema lock
0709 13:17:31.859206 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:31.859703 (+   497us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:31.859731 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":921767,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":1178,"apply.run_cpu_time_us":5712,"apply.run_wall_time_us":114423,"num_ops":19,"prepare.queue_time_us":190963,"prepare.run_cpu_time_us":61093,"prepare.run_wall_time_us":553012,"raft.queue_time_us":60591,"raft.run_cpu_time_us":924,"raft.run_wall_time_us":2088,"replication_time_us":262087,"thread_start_us":296720,"threads_started":4,"wal-append.queue_time_us":119822,"wal-append.run_cpu_time_us":13346,"wal-append.run_wall_time_us":1268550}]]}
W20260709 13:17:41.690207  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 367811us
I20260709 13:17:41.645506  8250 rpcz_store.cc:276] 0709 13:17:35.092490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.577891 (+5485401us) service_pool.cc:224] Handling call
0709 13:17:40.578284 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.433839 (+855555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.433882 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:41.436098 (+  2216us) log.cc:844] Serialized 26 byte log entry
0709 13:17:41.477376 (+ 41278us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:41.477446 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.484253 (+  6807us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b54002e8954. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:41.484304 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.505132 (+ 20828us) raft_consensus.cc:1685] finished
0709 13:17:41.505151 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.505347 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":406,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":801,"spinlock_wait_cycles":1961979264,"thread_start_us":40769,"threads_started":1,"wal-append.queue_time_us":50656}
W20260709 13:17:41.774484  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 72437.5us
I20260709 13:17:41.642339 11822 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.691977 11833 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:41.626857  8182 rpcz_store.cc:269] 0709 13:17:33.442992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.443235 (+   243us) service_pool.cc:224] Handling call
0709 13:17:41.438792 (+7995557us) spinlock_profiling.cc:243] Waited 7.98 s on lock 0x7b54002f9254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:41.445694 (+  6902us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18348062592}
I20260709 13:17:41.694155 11847 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.695726 11868 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:41.661417 11678 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.699702 11806 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:41.700606 11897 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.703161  8177 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:17:41.655038  8755 connection.cc:256] RPC call timeout handler was delayed by -6.4092129030000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
I20260709 13:17:41.641651 11831 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.710399 11900 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.713333  8223 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:41.790380  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:41.790982  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 77756.9us
I20260709 13:17:41.791601  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.792160 11139 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:41.792477  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:41.792677 11139 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.793120 11139 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:41.653957 11898 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.793557 11348 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.793674 11722 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.794121 11348 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.794276 11722 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.733001  8256 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:41.807542  8223 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:41.808235  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:41.808815 11722 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:41.808893  8256 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 5.
I20260709 13:17:41.809366 11863 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:41.809816 11863 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.809888  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:41.810264 11863 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:41.810770  8256 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:41.811551  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:41.812822  8256 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:41.681921 11776 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.744535  8001 catalog_manager.cc:5697] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 8, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 8 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:41.788890 11868 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.814455  8001 catalog_manager.cc:5697] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:41.815543 11868 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:41.815743  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:41.815900  8001 catalog_manager.cc:5697] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 4 to 5, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 5 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:41.817024  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:41.817679  8252 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:41.818434  8255 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:17:41.751266  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.826320  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:41.827479  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.810009  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.750957  8248 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:41.828730  8182 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:41.745467 11651 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.642824 11735 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.829643  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.830266  8106 raft_consensus.cc:2410] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:41.776012  8183 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 8: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:41.775396 11703 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.776610  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:41.777494  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.778424  8147 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:41.778610 11642 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:41.785045  8072 leader_election.cc:336] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.567s (SENT)
I20260709 13:17:41.837332  8072 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:41.837590 11905 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:41.838002 11905 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:41.838419  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 56493.5us
I20260709 13:17:41.838804 11651 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:41.741201 11896 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:41.787461  8755 connection.cc:256] RPC call timeout handler was delayed by -6.4092129030000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
I20260709 13:17:41.792273 11897 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.795089 11898 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.795562 11904 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.796033 11665 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:41.796535 11339 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:41.716905  8257 rpcz_store.cc:269] 0709 13:17:34.743432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.169883 (+426451us) service_pool.cc:224] Handling call
0709 13:17:41.648383 (+6478500us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400208854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:41.652485 (+  4102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2737523584}
I20260709 13:17:41.672638 11899 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:41.798816 11831 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.788470 11410 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:17:41.801337  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:41.795090 11822 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.802279 11901 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.802788  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:41.803128 11809 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.803277 11806 raft_consensus.cc:697] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:41.803561 11678 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:41.804473 11557 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:41.804327 11840 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.806623 11348 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:41.745893  8174 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:41.817940  8001 catalog_manager.cc:5697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 5 to 7, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 7 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:41.818977 11767 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.819430 11868 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:41.820713  8252 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:41.746841  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.820892  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:41.785915 11847 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.823702 11891 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.824543 11863 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.828061  8175 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:41.764436  8251 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:41.830195  8182 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:41.777468 11906 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:41.792173  8177 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 7.
I20260709 13:17:41.836676 11735 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:41.839493  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 61182.2us
W20260709 13:17:41.840613  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 58365.6us
I20260709 13:17:41.875744  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:41.981513  8001 catalog_manager.cc:5697] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 5 to 7, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 7 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:41.841809  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 511) took 1263 ms. Trace:
I20260709 13:17:41.983251  8001 catalog_manager.cc:5697] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:41.997521  8103 raft_consensus.cc:2410] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:41.983644 11891 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:41.839375 11651 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:41.880674 11879 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.983876  8106 rpcz_store.cc:276] 0709 13:17:40.576811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.604658 (+ 27847us) service_pool.cc:224] Handling call
0709 13:17:41.831823 (+1227165us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b540036ecd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:41.840053 (+  8230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1182496640}
I20260709 13:17:41.984588 11868 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.999850 11868 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:41.999679 11879 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.985179  8179 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:41.847088  8183 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:41.845633 11776 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:41.986563 11557 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:41.847052 11896 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:41.986948  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 166277us
I20260709 13:17:41.838883 11905 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.988265 11767 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:41.988889  8176 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:41.989754  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 187054us
I20260709 13:17:42.010092 11557 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.018682 11557 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:42.021698  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.022154  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.022415  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.023454  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.023944 11840 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:42.024366  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.024869 11767 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:42.025559  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.025893  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.026180  8254 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:42.026979  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:42.027062  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.027241 11897 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:42.027535  8256 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:42.028924  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.029609  8255 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:42.030589  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.031209  8103 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:42.032320  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.032667 11557 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:42.033695  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.034323  8101 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:42.035295  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:42.035421  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.035816 11847 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:41.990700 11903 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:41.991062 11410 consensus_queue.cc:1243] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:42.036803  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.037406  8100 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:42.011922 11899 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:42.038085 11899 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:42.038560  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.039204  8104 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:42.040119  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:41.841245  8755 connection.cc:256] RPC call timeout handler was delayed by -6.2890840590000607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
I20260709 13:17:42.040730  8102 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
W20260709 13:17:42.040820  8755 connection.cc:256] RPC call timeout handler was delayed by -6.2296840589999647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
I20260709 13:17:41.991460 11339 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.010325 11776 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.041651 11339 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:42.041833 11776 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:42.042172  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.042759  8105 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:41.992523 11806 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:42.045414  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.046341  8106 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:41.993889  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.047037 11722 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:42.047358  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:41.993466 11904 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:42.040036 11899 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:41.841415 11139 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:41.998040  8001 catalog_manager.cc:5697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:17:42.041231  8755 connection.cc:256] RPC call timeout handler was delayed by -6.1990840590001426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
I20260709 13:17:41.980646  8180 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:42.050299  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.035953  8107 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:42.021762  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.045529  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:41.996106 11665 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:42.049899  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:42.051035  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.067435  8257 raft_consensus.cc:2410] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:41.848511 11703 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:42.058928  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.051667  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.056157  8001 catalog_manager.cc:5697] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 5 to 8, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 8 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:41.841414  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:41.998594 11863 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:42.055136  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:42.057813  8755 connection.cc:256] RPC call timeout handler was delayed by -6.1990840590001426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
I20260709 13:17:42.054039  8174 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:17:42.053751  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:42.069689  8755 connection.cc:256] RPC call timeout handler was delayed by -5.9898129030000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
I20260709 13:17:42.070242  8251 raft_consensus.cc:2410] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:17:42.070274  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 231211us
I20260709 13:17:42.052301  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.036227  8108 raft_consensus.cc:2410] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:17:42.071357  8254 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:42.064248  8249 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:42.054147  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.066017  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.073167  8100 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:42.066439  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.066570  8101 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:42.066936  8104 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:17:42.070169  8755 connection.cc:256] RPC call timeout handler was delayed by -5.9146840590001375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
I20260709 13:17:42.054466  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:42.075474  8755 connection.cc:256] RPC call timeout handler was delayed by -5.75718405900011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260709 13:17:42.076038  8755 connection.cc:256] RPC call timeout handler was delayed by -5.75718405900011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260709 13:17:42.076386  8755 connection.cc:256] RPC call timeout handler was delayed by -5.7094840590000331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 13:17:42.076746  8755 connection.cc:256] RPC call timeout handler was delayed by -5.7094840590000331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 13:17:42.077121  8755 connection.cc:256] RPC call timeout handler was delayed by -5.7004840590000185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
W20260709 13:17:42.079732  8755 connection.cc:256] RPC call timeout handler was delayed by -5.7004840590000185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
I20260709 13:17:42.078715  8250 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:42.051234 11901 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:42.082667  8037 debug-util.cc:398] Leaking SignalData structure 0x7b0800064520 after lost signal to thread 7005
I20260709 13:17:42.079172  8256 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:42.082041  8255 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 8: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:42.083174  8105 raft_consensus.cc:2410] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:42.053509 11905 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:42.083686  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08002713a0 after lost signal to thread 8040
I20260709 13:17:42.080914  8106 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
W20260709 13:17:42.084908  8037 debug-util.cc:398] Leaking SignalData structure 0x7b0800310a80 after lost signal to thread 8132
W20260709 13:17:42.084820  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 315882us
I20260709 13:17:42.049624 11348 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:42.049391 11904 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:42.087811  8037 debug-util.cc:398] Leaking SignalData structure 0x7b0800310500 after lost signal to thread 8207
W20260709 13:17:42.089043  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08001d7720 after lost signal to thread 8281
W20260709 13:17:42.090408  8037 debug-util.cc:398] Leaking SignalData structure 0x7b0800297e40 after lost signal to thread 8823
I20260709 13:17:42.091698  8786 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:42.093750  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.094426  8257 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
W20260709 13:17:42.090703  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08003b2c60 after lost signal to thread 8824
W20260709 13:17:42.098050  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08001ded40 after lost signal to thread 11665
W20260709 13:17:42.100301  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7a40 after lost signal to thread 11667
I20260709 13:17:42.101140  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:42.101317  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08002489a0 after lost signal to thread 11677
I20260709 13:17:42.103947  8251 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:17:42.106361  8037 debug-util.cc:398] Leaking SignalData structure 0x7b0800393300 after lost signal to thread 11703
W20260709 13:17:42.106707  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08003b7e20 after lost signal to thread 11709
W20260709 13:17:42.106935  8037 debug-util.cc:398] Leaking SignalData structure 0x7b0800385a40 after lost signal to thread 11722
W20260709 13:17:42.107215  8037 debug-util.cc:398] Leaking SignalData structure 0x7b0800364ac0 after lost signal to thread 11767
W20260709 13:17:42.107506  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08003fa920 after lost signal to thread 11805
W20260709 13:17:42.107745  8037 debug-util.cc:398] Leaking SignalData structure 0x7b0800396860 after lost signal to thread 11816
I20260709 13:17:42.082715 11901 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:42.110798  8072 leader_election.cc:336] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.933s (SENT)
I20260709 13:17:42.112727  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.113581  8249 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:17:42.112771  8072 leader_election.cc:336] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.226s (SENT)
W20260709 13:17:42.116672  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.117846  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.118651  8102 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 6: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:42.121111  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:42.121934  8250 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:17:42.122272  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08003fa900 after lost signal to thread 11824
W20260709 13:17:42.122622  8037 debug-util.cc:398] Leaking SignalData structure 0x7b080031ea00 after lost signal to thread 11830
W20260709 13:17:42.122848  8037 debug-util.cc:398] Leaking SignalData structure 0x7b0800226e00 after lost signal to thread 11831
W20260709 13:17:42.123080  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba560 after lost signal to thread 11832
W20260709 13:17:42.123311  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed780 after lost signal to thread 11834
W20260709 13:17:42.123548  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08002c8960 after lost signal to thread 11845
W20260709 13:17:42.123739  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08003eea00 after lost signal to thread 11847
I20260709 13:17:42.124280  8104 raft_consensus.cc:1217] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[5.3-10.6]   Dedup: 5.3->[6.4-10.6]
I20260709 13:17:42.124761  8104 pending_rounds.cc:85] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 3
I20260709 13:17:42.125038  8104 pending_rounds.cc:107] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:17:42.125357  8104 raft_consensus.cc:2889] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:42.126637 11691 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:42.127204 11691 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:42.127933  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.128538  8102 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:42.055150 11868 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:42.086813 11348 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.092242 11703 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:42.100618  8001 catalog_manager.cc:5697] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 8, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 8 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.136492 11773 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.085660 11903 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:42.147013  8257 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:42.147933  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:42.155797  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.156494  8105 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 6.
I20260709 13:17:42.129410 11691 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:42.158291 11903 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:42.161239 11703 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:17:42.162547  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 68994.6us
W20260709 13:17:42.165990  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 118350us
I20260709 13:17:42.167047  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:42.145450 11348 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:42.172459  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:42.175385  8001 catalog_manager.cc:5697] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:17:42.177878  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 125276us
I20260709 13:17:42.180548  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:42.183588  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.192567  8786 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:42.195078  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:42.197763 11722 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:42.198158 11722 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.193591  8785 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:42.200604  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:42.200436 11703 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:42.201292  8107 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:42.201623 11691 consensus_queue.cc:1059] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:42.203151 11691 raft_consensus.cc:3055] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:42.203518 11691 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:42.203855  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:42.205183  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:42.192602  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:42.206053  8788 raft_consensus.cc:2410] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:17:42.206373  8174 raft_consensus.cc:606] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:42.206773  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:42.200930  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:42.208201  8181 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:42.200448 11924 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:42.209731 11924 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:42.210701 11924 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:42.211475  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:42.204576 11691 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:42.216054  8101 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:42.215435 11722 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:42.217257  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.218097  8101 raft_consensus.cc:2410] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:42.218788  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:42.219385  8101 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:42.190546 11339 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:42.164945 11773 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:42.223743 11557 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:42.184448 11677 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:42.224587 11677 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:42.225320  8252 raft_consensus.cc:2368] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9.
I20260709 13:17:42.225586 11677 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:42.230301  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:42.231124 11665 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:42.231588  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:42.232019  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.232199  8183 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:42.233281 11879 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:42.234004  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:42.218812  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:42.235380  8102 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:42.235955  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.236522  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:42.237085  8786 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:42.224049  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:42.200917 11868 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:42.224567  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.238404  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:42.237277  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.237990  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:42.216923 11776 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:42.241336 11891 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:42.305713  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:42.309769  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:42.239331  8176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:42.311571  8175 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:42.246785  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 109059us
I20260709 13:17:42.252933  8181 raft_consensus.cc:2410] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:42.234725  8179 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
W20260709 13:17:42.307229  8221 leader_election.cc:336] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.040s (SENT)
I20260709 13:17:42.311858  8176 raft_consensus.cc:606] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:42.283557  8107 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:17:42.313473  8176 raft_consensus.cc:614] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:42.239693  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:42.307336  8105 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:42.314211  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:42.316514  8108 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
W20260709 13:17:42.318147  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 78516.4us
I20260709 13:17:42.319697  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:42.320292  8221 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:42.326356  8147 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:42.240110 11139 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:42.251931  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:42.331766  8178 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:42.331799  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:42.332674  8182 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:42.333777  8180 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:42.328331  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:42.249119 11691 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:42.337132  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:42.224567 11773 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:42.340051  8101 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:42.341928 11904 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:42.350733 11904 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.351125 11904 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:42.342222  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:42.354130 11921 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:17:42.354352  8105 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:42.355479  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.356190  8105 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:42.359469  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:42.350214 11847 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:42.324522 11780 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:42.361603  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.357250  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:42.362102  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:42.374147  8101 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:17:42.387432  8108 raft_consensus.cc:2410] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:42.387555  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:42.336970 11557 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:42.366289  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.348850  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:42.329708 11868 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:42.403115  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 95940.9us
I20260709 13:17:42.407131  8182 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:42.374142 11847 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:42.413836  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 83995.4us
I20260709 13:17:42.414248 11722 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:42.416667 11722 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:42.328985 11905 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:17:42.414773  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:42.419968  8175 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:42.426069  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:42.426641  8102 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:42.372943 11780 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:42.431273  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.414300 11847 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:42.395068 11868 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.394884 11897 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:42.440270  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 91534us
I20260709 13:17:42.443034  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.443900  8105 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
W20260709 13:17:42.449362 11928 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:17:42.377935 11906 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:17:42.417608 11891 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:42.463811  8101 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:42.462873  8223 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:42.433478 11339 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:42.434381 11780 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:42.432652 11924 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:42.479816  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:42.483316  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.491178  8107 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:42.492161  8101 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:17:42.492336  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 166068us
I20260709 13:17:42.446393 11868 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:42.439765 11896 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:42.464783 11879 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:42.477113 11898 raft_consensus.cc:2764] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:17:42.466082 11891 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:42.560405  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 78331.7us
I20260709 13:17:42.496539  8147 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:42.555352  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:42.563133  8072 leader_election.cc:336] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.923s (SENT)
I20260709 13:17:42.567790  8786 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:42.572177  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:42.573065  8784 raft_consensus.cc:2410] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:42.573292  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.489887 11339 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:42.581758 11339 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.582149 11339 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:42.437310 11348 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:42.592586  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 96128.5us
W20260709 13:17:42.595881  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.599818  8223 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:42.610540  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:42.567262 11891 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:42.611971  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:42.620896  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:42.611400  8099 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:42.630430  8101 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:17:42.632427  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:42.635962  8180 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:42.633186  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:42.636828  8179 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:42.600486 11879 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:42.658507  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.659355  8101 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:17:42.659287  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 299846us
I20260709 13:17:42.661253  8784 raft_consensus.cc:3055] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:42.661758  8784 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:42.666858  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:42.667448  8101 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:42.610837 11896 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:42.600668 11863 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:17:42.635876 11139 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:42.673674  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:42.625952 11925 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:42.704023  8101 raft_consensus.cc:2410] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:42.673287  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.640892 11905 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:42.697319  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:42.692916  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:42.708287  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.710770  8101 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:42.711823  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.710228  8788 raft_consensus.cc:2410] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:17:42.671185 11800 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:17:42.721714  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.725382  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:42.740804  8174 raft_consensus.cc:606] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:42.713418  8786 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:42.730404  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:42.742612  8101 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:17:42.740955  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 120142us
I20260709 13:17:42.706300  8784 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:42.705642  8108 raft_consensus.cc:2376] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12. Re-sending same reply.
I20260709 13:17:42.731926  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:42.635447 11901 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:42.709414 11905 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.780164  8179 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:42.786116  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:42.673599 11557 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:42.727029 11925 raft_consensus.cc:697] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:42.711346  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:42.797945  8784 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:42.793135  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:42.673454 11776 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:42.809643  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:42.808645  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:42.810917  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 99674.3us
I20260709 13:17:42.740126 11800 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:42.773710 11642 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:42.788230 11905 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:42.854620  8101 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
W20260709 13:17:42.833417  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.814147  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:42.857889 11925 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:42.873500  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 317971us
W20260709 13:17:42.874616  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 60558.3us
I20260709 13:17:42.859063  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:42.875780  8786 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:42.759415 11948 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:17:42.860479  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:42.862211 11935 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:17:42.862995 11931 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:17:42.863696 11938 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:17:42.864140  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:42.864589 11941 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:42.854200 11879 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:42.866900 11665 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:42.812299 11899 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:42.868984 11642 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.747335 11904 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:42.925765  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:42.923503  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:42.874087 11840 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.869012 11863 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.930204 11863 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:42.802924 11557 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:42.926291  8786 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:42.880198 11924 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:42.941267  8784 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:17:42.926985  8149 leader_election.cc:400] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9.
I20260709 13:17:42.878998 11901 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:42.929620  8785 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:17:42.947190  8785 pending_rounds.cc:85] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 8
I20260709 13:17:42.947546  8785 pending_rounds.cc:107] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:17:42.947872  8785 raft_consensus.cc:2889] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:42.880247 11691 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:42.926674  8787 raft_consensus.cc:2410] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:17:42.943423  8784 pending_rounds.cc:85] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 8
I20260709 13:17:42.943737  8149 leader_election.cc:403] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:42.944514  8099 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:42.922475 11665 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.925225 11348 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:42.928267 11642 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:42.949918  8784 pending_rounds.cc:107] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:17:42.982371  8784 raft_consensus.cc:2889] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:42.942514 11557 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:42.876762 11896 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:42.998348 11410 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9.
I20260709 13:17:42.943331 11840 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:43.005640  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.006434  8789 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:42.951022 11691 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:43.009231 11944 log.cc:927] Time spent T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:17:43.010671 11953 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.011196 11953 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:42.956259 11665 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:43.012567  8178 consensus_meta.cc:287] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.675s	user 0.005s	sys 0.006s
I20260709 13:17:43.016404  8786 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:43.017771  8178 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:43.009011 11840 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:43.020540  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.021916  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 213347us
I20260709 13:17:43.023958  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:42.944599 11903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.006s	sys 0.008s
I20260709 13:17:43.028482  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:43.025262  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 145529us
W20260709 13:17:43.039338  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.040221  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 159208us
I20260709 13:17:43.009331 11691 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:43.044675  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.045657  8786 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
W20260709 13:17:43.029831 11903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.008s	sys 0.014s
I20260709 13:17:43.020004 11773 raft_consensus.cc:2764] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:17:43.030490 11703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.015s	sys 0.005s
I20260709 13:17:42.949532 11942 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:17:43.054996  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:42.950338 11800 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:43.069519 11703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.015s	sys 0.010s
I20260709 13:17:43.069557 11348 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:43.077625 11348 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:43.078938 11348 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.089155 11939 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:43.089809 11939 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:43.091385 11800 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:43.093835  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.094769  8786 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:43.098151  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.099647 11904 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:43.105926 11957 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:43.106860 11953 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:43.107942  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.113225  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 58303.4us
I20260709 13:17:43.114291  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:43.118396  8074 leader_election.cc:400] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9.
I20260709 13:17:43.119108  8074 leader_election.cc:403] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:43.120800  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:43.125350  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:43.074501 11934 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
I20260709 13:17:43.135519  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:43.144830  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.130286  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:43.145015  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:43.145941  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.146569  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:43.146772  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:43.147611  8182 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.136327  8100 raft_consensus.cc:2376] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10. Re-sending same reply.
W20260709 13:17:43.148512  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 73663.5us
I20260709 13:17:43.150266  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:43.148227  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:43.128719  8784 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:43.153831  8175 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 13 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:17:43.149338  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:43.162019  8183 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:43.165817  8178 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:43.165973  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:43.166102  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:43.166772  8107 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 13 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:17:43.166859  8177 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:43.169046  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:43.170265  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:43.172573  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.123886 11942 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:43.174140  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:43.180753  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:43.176826  8106 raft_consensus.cc:2410] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:43.126070 11966 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:43.152351 11903 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:43.152133 11924 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:43.185009  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:43.161065  8180 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:17:43.155727 11410 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:43.166728 11957 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9.
I20260709 13:17:43.199352  8788 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
W20260709 13:17:43.202142  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 51935.8us
I20260709 13:17:43.202850  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:43.166570 11951 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:43.182731 11703 raft_consensus.cc:2764] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:17:43.205552  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.205626  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:43.205860  8182 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:43.194419 11897 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:43.201493 11896 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:43.213029  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.215472  8790 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:43.215632 11642 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.186517 11966 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:43.217800 11966 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.213174 11896 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:43.213697  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:43.214771  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:43.222997  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:43.223912  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.195602 11903 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:43.196373 11776 raft_consensus.cc:2764] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:43.229612  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.230700 11948 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:43.230995  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:43.250056  8790 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:43.231650  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.231987  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.232300  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:43.230743  8783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 955) took 1059 ms. Trace:
I20260709 13:17:43.232726  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.257326  8786 raft_consensus.cc:2376] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10. Re-sending same reply.
I20260709 13:17:43.233100  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.258845  8787 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:43.233485  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.259476  8784 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 7: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:43.234087  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:43.234589  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:43.208396 11897 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:43.231673 11847 consensus_meta.cc:287] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.756s	user 0.001s	sys 0.009s
I20260709 13:17:43.235591  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.273420  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:43.274029  8257 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:17:43.218623 11879 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.272603  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:43.275646  8785 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:43.237627 11976 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:43.198989 11410 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:43.241575 11903 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:43.245683  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.256814  8783 rpcz_store.cc:276] 0709 13:17:42.159908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.160059 (+   151us) service_pool.cc:224] Handling call
0709 13:17:42.160415 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:42.160895 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:42.160923 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:42.161461 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:17:42.489734 (+328273us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:42.489789 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.489870 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:43.218528 (+728658us) raft_consensus.cc:1685] finished
0709 13:17:43.218547 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.218678 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4113,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":2532,"thread_start_us":327837,"threads_started":1,"wal-append.queue_time_us":479923}
I20260709 13:17:43.284164  8789 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:43.248437  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:43.287191  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:43.287402  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.287191  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.287592  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.287415  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:43.250990  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1421) took 1093 ms. Trace:
I20260709 13:17:43.289124  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.291142  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.164950 11939 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.293911  8249 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:43.294255  8251 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:43.198369 11953 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:17:43.255651  8255 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:43.294515  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.264777  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.265410  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:43.306640  8783 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:43.265760  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.256260  8791 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:43.260252  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:43.271342  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.271556  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:43.260200  8248 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:43.272063 11897 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:43.271879 11557 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.272581  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.315783  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.272818  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.316653  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.317127  8786 raft_consensus.cc:2410] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:17:43.227227 11722 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:43.322837  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.253278  8177 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:17:43.229096 11925 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:43.282267 11410 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:43.271556 11339 consensus_meta.cc:287] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.001s
I20260709 13:17:43.325258  8787 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:43.282024 11976 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:43.283062 11847 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:43.296415  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.296865  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:43.293944 11879 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:43.300390 11967 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.104s	user 0.000s	sys 0.003s
I20260709 13:17:43.307510  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.309125  8182 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:43.313067  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.341848  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.318245  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.342579  8174 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:43.325730  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.343102  8183 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:17:43.285635 11642 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:43.328657 11339 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:43.333673 11780 consensus_meta.cc:287] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.832s	user 0.006s	sys 0.005s
I20260709 13:17:43.328819 11863 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:43.333982 11557 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:43.319605 11888 raft_consensus.cc:993] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
W20260709 13:17:43.334372 11891 consensus_meta.cc:287] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.001s
I20260709 13:17:43.337747  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:43.288885  8103 rpcz_store.cc:276] 0709 13:17:42.128290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.128404 (+   114us) service_pool.cc:224] Handling call
0709 13:17:42.128732 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:42.129092 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:42.129131 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:42.136506 (+  7375us) log.cc:844] Serialized 52 byte log entry
0709 13:17:42.304818 (+168312us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:42.553520 (+248702us) log.cc:844] Serialized 14 byte log entry
0709 13:17:42.923355 (+369835us) log.cc:844] Serialized 14 byte log entry
0709 13:17:43.110830 (+187475us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b1800468520. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5c455 00007fa5a0e44060 00007fa5a0e56716 00007fa5a0e67287 00007fa5a0e67208
0709 13:17:43.206284 (+ 95454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.212543 (+  6259us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:43.220948 (+  8405us) raft_consensus.cc:1685] finished
0709 13:17:43.221013 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.221396 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63704,"prepare.queue_time_us":201690,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":199781,"raft.run_cpu_time_us":450,"raft.run_wall_time_us":22483,"spinlock_wait_cycles":7869696,"thread_start_us":744900,"threads_started":4,"wal-append.queue_time_us":418231}
I20260709 13:17:43.329459  8176 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:43.338371  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.338769  8789 raft_consensus.cc:2410] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:17:43.319440  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:43.338356  8790 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
W20260709 13:17:43.343788  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 158883us
W20260709 13:17:43.344995  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 142224us
W20260709 13:17:43.345633  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.357838  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.358722  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:43.337827 11976 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:43.346707  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.320307 11722 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:43.361677 11722 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:43.363032 11966 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.364997 11966 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:43.348220  8785 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:43.368716  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.369133  8785 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:43.350241  8788 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:17:43.346398  8782 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 7: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:43.356767  8249 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:43.331008 11939 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:43.366828  8257 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:43.367452  8787 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:43.369818  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.373027  8783 raft_consensus.cc:2376] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10. Re-sending same reply.
I20260709 13:17:43.373355  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.373456  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:43.374446  8791 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:17:43.374540  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.371578  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.317708 11924 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:43.374799  8787 raft_consensus.cc:2376] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10. Re-sending same reply.
I20260709 13:17:43.379307  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.382812  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.385370  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.385563  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:43.385684  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.385878  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.386463  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.386704  8789 raft_consensus.cc:2410] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:17:43.387002  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:43.387472  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.387558  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.388346  8785 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:43.388505  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:43.389148 11906 raft_consensus.cc:2764] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:43.389601 11942 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:43.389974 11906 raft_consensus.cc:2764] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:17:43.390760 11906 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:43.391170 11970 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:43.392035 11906 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:43.392427 11947 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:43.392797 11947 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:43.392932 11139 consensus_meta.cc:287] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.682s	user 0.007s	sys 0.002s
I20260709 13:17:43.393671 11947 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.394120  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.388557  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.389072  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.402768 11947 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:43.403290  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.404139  8786 raft_consensus.cc:2410] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:17:43.404971  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.407344  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:43.407474 11722 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.408484  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.409968  8788 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:17:43.412889  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.355350 11977 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:43.417985  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.410807  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:43.394078 11952 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:43.374512 11773 raft_consensus.cc:1081] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:17:43.424952  8790 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:43.425653  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:43.426287  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 94836.6us
I20260709 13:17:43.424958 11952 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:43.427873 11924 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.3, Last appended by leader: 3, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.428059 11952 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.429277 11952 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.352187 11780 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:43.411922 11139 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:43.352059 11896 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.431490 11410 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.432456 11780 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:43.433542 11410 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:43.434340  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.416291 11557 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:43.435576 11557 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:43.435999 11868 consensus_meta.cc:287] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.000s
I20260709 13:17:43.436388 11868 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:43.440689 11973 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:17:43.442644 11722 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:43.421626  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 64028.7us
I20260709 13:17:43.449992  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:43.451082  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:43.366712 11891 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:43.455018  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.455946  8256 raft_consensus.cc:2368] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12.
I20260709 13:17:43.448926  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:43.456734  8784 raft_consensus.cc:2410] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:43.457340  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:43.410836 11847 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:43.463284  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:43.466218  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 287948us
W20260709 13:17:43.466735  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.467204  8789 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:43.469254  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:43.471241  8223 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:43.470043  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:43.471567  8257 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:43.472043  8254 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
W20260709 13:17:43.475973  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.477592  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.478190  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.478353  8249 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:43.470065  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:43.421298 11977 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:43.482805  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:43.480316  8251 raft_consensus.cc:2376] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12. Re-sending same reply.
I20260709 13:17:43.483516  8255 raft_consensus.cc:2368] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11.
W20260709 13:17:43.487345  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 103880us
I20260709 13:17:43.489313  8791 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:17:43.492717  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.498907  8256 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:43.506625  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:43.506845  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:43.527834  8174 raft_consensus.cc:606] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:43.509740  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:43.486668 11977 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:43.521548  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:43.471587 11139 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:43.476483 11953 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:43.488881 11979 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:43.499766 11942 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.536361  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:43.528110  8790 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.466995 11557 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:43.528712  8174 raft_consensus.cc:614] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:43.532398  8250 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:43.487170 11863 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:43.536361  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:43.542212  8102 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:43.462028 11691 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.539008  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:43.550165  8249 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:43.540745  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:43.497905 11410 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:43.538327  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.542984  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:43.552711 11665 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 13:17:43.553036 11339 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:43.554277 11891 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:43.534385 11903 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.549055 11942 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:43.556998  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.557246  8179 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:43.558339  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:43.566201  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 77862.7us
I20260709 13:17:43.579368  8103 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:43.581851  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:43.583899  8074 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:43.586444  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:43.588083  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:43.536010 11978 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:43.592609  8149 leader_election.cc:400] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12.
I20260709 13:17:43.598385  8149 leader_election.cc:403] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:43.605822  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.606104  8255 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:43.556906 11903 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:43.543372 11139 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:43.610231  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:43.611464  8257 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:43.612283  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.612403  8783 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:43.652385  8102 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:43.654449  8100 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.553195 11665 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.657207  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:43.657706  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:43.658021  8099 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.658311  8104 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:43.615502  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 74869.6us
I20260709 13:17:43.578966 11979 raft_consensus.cc:697] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:43.618050  8221 leader_election.cc:336] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.902s (SENT)
I20260709 13:17:43.661134  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:43.588976 11840 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:43.664534  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:43.664752  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:43.667375  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 74888.5us
I20260709 13:17:43.668105  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:43.589161 11773 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:43.595875 11348 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:43.557135 11557 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:17:43.614286  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:43.670498  8107 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:43.612926 11899 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:43.612890 11975 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:43.682552  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 64547.1us
I20260709 13:17:43.652704 11947 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12.
I20260709 13:17:43.690872  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:43.690801  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 76606.6us
I20260709 13:17:43.691948  8250 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:43.694972  8176 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:43.613150 11952 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:43.613653 11896 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:43.595240 11868 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:43.613056 11879 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:43.675889  8252 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:43.675418 11773 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:43.704293  8099 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:43.676761 11665 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:43.677675  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:43.657220 11863 raft_consensus.cc:697] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:43.681867 11942 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:43.682631  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:43.673655 11891 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:43.697788  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:43.669217 11978 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:43.580075 11410 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.716749  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:43.717583  8182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:43.721714  8103 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:43.725244  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:43.729159  8072 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.980s (SENT)
I20260709 13:17:43.693631 11899 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:43.725497 11976 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.733987  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:43.695014 11348 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:43.739079  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 55098.6us
I20260709 13:17:43.700652 11952 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.740074  8182 raft_consensus.cc:606] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:43.737860  8791 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:43.705840 11953 raft_consensus.cc:2764] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:17:43.742465  8107 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:43.744509  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:43.751972  8182 raft_consensus.cc:614] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:43.753990  8223 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:43.751932  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:43.761083  8255 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
W20260709 13:17:43.757328  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.765902  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:43.766608  8176 raft_consensus.cc:2368] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11.
I20260709 13:17:43.766438  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:43.766551  8257 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:43.774379  8175 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 8: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:43.747571 11964 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:43.776491  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:43.779498  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 111442us
I20260709 13:17:43.783975  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:43.784729  8179 raft_consensus.cc:2368] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8.
I20260709 13:17:43.689978 11975 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.796576  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:43.737732 11677 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:17:43.798569  8252 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:43.770269 11896 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:43.760278 11952 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:43.790977  8221 leader_election.cc:336] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.619s (SENT)
I20260709 13:17:43.776355 11925 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:43.810976  8099 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:43.809507  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:43.812570  8221 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:43.811913  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:43.814365  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 85235.5us
I20260709 13:17:43.730793 11139 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.779325 11951 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:43.783452 11703 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:43.836035  8149 leader_election.cc:400] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11.
I20260709 13:17:43.843457  8149 leader_election.cc:403] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:17:43.830969  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:43.834568  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:43.812014 11896 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:43.817689 11986 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:17:43.810632 11868 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:43.885298  8106 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:43.881884  8100 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:43.848515  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:43.883701  8108 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:43.887209  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:43.834946 11989 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:17:43.893317  8252 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.894479  8107 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:43.918747  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 87898.2us
I20260709 13:17:43.921670  8790 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
W20260709 13:17:43.885329  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 94401.5us
W20260709 13:17:43.912204  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.827937 11905 consensus_meta.cc:287] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.941s	user 0.008s	sys 0.004s
I20260709 13:17:43.825949 11665 consensus_queue.cc:1059] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:17:43.838969 11976 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:43.825876 11691 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:43.814868 11899 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:43.929307 11800 consensus_meta.cc:287] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.826s	user 0.012s	sys 0.000s
I20260709 13:17:43.913558 11896 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:43.836328 11942 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:43.918025 11925 raft_consensus.cc:697] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:43.965150  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.758569 11979 consensus_queue.cc:237] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.928447 11840 raft_consensus.cc:2764] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
W20260709 13:17:43.958748  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 122835us
I20260709 13:17:43.982417  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:43.935844 11964 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11.
W20260709 13:17:43.973788  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 146040us
I20260709 13:17:43.813774 11863 consensus_queue.cc:237] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:43.928334 11993 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:43.988179  8108 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:43.950215 11879 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:43.944980 11951 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:43.983992  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.995131  8248 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 6.
I20260709 13:17:44.004786  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:43.996181  8249 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:43.996923  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:44.011826  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:43.995724 11868 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:17:44.015836  8253 raft_consensus.cc:2410] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:43.942548 11905 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:44.017024  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:44.021975  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.837930 11348 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:44.025661  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:44.006286 11879 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:44.005240 11942 raft_consensus.cc:697] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:44.043443  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:44.060978 11991 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:17:44.064262 11773 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:44.064397  8248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57566
I20260709 13:17:44.065739  8174 raft_consensus.cc:1240] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:44.064968 11984 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:17:44.023312 11903 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:44.028326  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:44.072465  8248 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:17:44.047549 11897 consensus_meta.cc:287] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.000s
W20260709 13:17:44.079660  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 54146.6us
I20260709 13:17:44.083880  8248 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:44.075488  8072 leader_election.cc:336] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.752s (SENT)
I20260709 13:17:44.015722 11993 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:44.084497  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:44.079432 11847 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:44.068719 11879 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:44.084684  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 56443.6us
I20260709 13:17:44.095100  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:44.094915  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:44.089407 11948 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:44.070786 11665 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:17:44.127815  8248 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:44.130101  8105 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:17:44.113780  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 67299us
I20260709 13:17:44.123167  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:44.066363 11976 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:17:44.096621 11891 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:44.140237  8175 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:44.142525  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:44.089354 11897 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:44.121275 11901 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:44.237313  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 161875us
I20260709 13:17:44.241873  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:44.243669  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:44.090932 11925 consensus_queue.cc:237] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:44.129302 11975 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:44.248006  8179 raft_consensus.cc:2368] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11.
W20260709 13:17:44.250910  8104 consensus_meta.cc:287] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.002s
I20260709 13:17:45.019524  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2418) took 1521 ms. Trace:
I20260709 13:17:45.019557  8104 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
W20260709 13:17:45.019551  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 775640us
I20260709 13:17:45.020542  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2309) took 1413 ms. Trace:
I20260709 13:17:45.021685  8103 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:44.245484  8248 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:44.246490  8072 leader_election.cc:336] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.810s (SENT)
I20260709 13:17:44.142522 11948 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:44.261312 11906 consensus_meta.cc:287] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.869s	user 0.010s	sys 0.002s
I20260709 13:17:43.934909 11978 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:45.011710 11897 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:45.028306  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2314) took 1102 ms. Trace:
W20260709 13:17:45.008104 11952 consensus_meta.cc:287] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.160s	user 0.002s	sys 0.016s
W20260709 13:17:45.009473  8252 consensus_meta.cc:287] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.078s	user 0.008s	sys 0.010s
I20260709 13:17:45.010345  8101 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:17:44.766817  8254 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.028s	user 0.005s	sys 0.031s
W20260709 13:17:45.041436  8254 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.303s	user 0.012s	sys 0.041s
I20260709 13:17:45.032418  8252 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
W20260709 13:17:45.014807  8106 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.086s	user 0.007s	sys 0.012s
I20260709 13:17:44.142783 11847 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:44.236835 12007 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.296s
I20260709 13:17:44.321791 11942 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:44.142130 11940 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.261s
I20260709 13:17:44.446414 11993 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.021099  8104 rpcz_store.cc:276] 0709 13:17:43.607152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.611220 (+  4068us) service_pool.cc:224] Handling call
0709 13:17:45.020473 (+1409253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.043546  8106 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:17:45.028846  8257 rpcz_store.cc:276] 0709 13:17:43.926224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.946911 (+ 20687us) service_pool.cc:224] Handling call
0709 13:17:43.961151 (+ 14240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.986001 (+ 24850us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:44.021367 (+ 35366us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.027872 (+1006505us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.027943 (+    71us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:45.028015 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.028097 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.028238 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":765309,"prepare.queue_time_us":38029,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":14405,"thread_start_us":186978,"threads_started":1}
I20260709 13:17:45.020115  8251 rpcz_store.cc:276] 0709 13:17:43.491595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.499786 (+  8191us) service_pool.cc:224] Handling call
0709 13:17:43.527448 (+ 27662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.533335 (+  5887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.533369 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:43.537582 (+  4213us) log.cc:844] Serialized 26 byte log entry
0709 13:17:43.697303 (+159721us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:43.998246 (+300943us) log.cc:844] Serialized 14 byte log entry
0709 13:17:44.024485 (+ 26239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.024554 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.012414 (+987860us) raft_consensus.cc:1685] finished
0709 13:17:45.012442 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.012596 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105855,"prepare.queue_time_us":143005,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":48801,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":16570,"thread_start_us":341680,"threads_started":2,"wal-append.queue_time_us":179780}
I20260709 13:17:45.048821  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:57566 (request call id 2437) took 1039 ms. Trace:
I20260709 13:17:45.066208  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2419) took 1574 ms. Trace:
W20260709 13:17:45.050602  8252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2435) took 1155 ms (client timeout 1510 ms). Trace:
I20260709 13:17:45.053610 11557 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:45.054394  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 807900us
W20260709 13:17:45.056056  8221 leader_election.cc:336] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.687s (SENT)
W20260709 13:17:45.069443  8072 leader_election.cc:336] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.855s (SENT)
I20260709 13:17:45.069989  8072 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:45.055405 11948 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.032990 11906 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:45.065974  8248 rpcz_store.cc:276] 0709 13:17:44.000475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.014674 (+ 14199us) service_pool.cc:224] Handling call
0709 13:17:45.023675 (+1009001us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":215}
W20260709 13:17:45.061854  8755 connection.cc:256] RPC call timeout handler was delayed by -2.0558033269999214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
I20260709 13:17:45.058060 11924 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.064788  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1467) took 1244 ms. Trace:
W20260709 13:17:45.067819  8252 rpcz_store.cc:269] 0709 13:17:43.886848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.886961 (+   113us) service_pool.cc:224] Handling call
0709 13:17:45.042507 (+1155546us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.058591  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1464) took 1402 ms. Trace:
W20260709 13:17:45.074508  8755 connection.cc:256] RPC call timeout handler was delayed by -1.9658033269997759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 13:17:45.080551  8755 connection.cc:256] RPC call timeout handler was delayed by -1.7660033269999076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
W20260709 13:17:45.081099  8755 connection.cc:256] RPC call timeout handler was delayed by -1.5797033269998337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
I20260709 13:17:45.080473  8099 rpcz_store.cc:276] 0709 13:17:43.656006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.722112 (+ 66106us) service_pool.cc:224] Handling call
0709 13:17:45.058316 (+1336204us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b540001b8d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:45.058509 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165327104}
W20260709 13:17:45.081549  8755 connection.cc:256] RPC call timeout handler was delayed by -1.554503326999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
I20260709 13:17:45.046033 11847 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:45.085650  8106 rpcz_store.cc:276] 0709 13:17:43.820772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.821261 (+   489us) service_pool.cc:224] Handling call
0709 13:17:45.064663 (+1243402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.090051 11780 consensus_queue.cc:1059] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:45.062243 11901 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:45.032392 11952 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:45.155391  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 99368.3us
W20260709 13:17:45.157383  8221 connection.cc:256] RPC call timeout handler was delayed by -1.1910950259998572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2529s for a response
W20260709 13:17:45.158094  8221 leader_election.cc:336] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.866s (SENT)
W20260709 13:17:45.158881  8221 connection.cc:256] RPC call timeout handler was delayed by -1.1445749510000951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
I20260709 13:17:45.161696  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51044 (request call id 33) took 1413 ms. Trace:
I20260709 13:17:45.162392  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:45.162842  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1471) took 1524 ms. Trace:
I20260709 13:17:45.162220  8182 rpcz_store.cc:276] 0709 13:17:43.693473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.693817 (+   344us) service_pool.cc:224] Handling call
0709 13:17:45.106314 (+1412497us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b5400329e54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e46853 00007fa5a5e1460a 00007fa59f39a7d4 00007fa59f39a762 00007fa59f39a691 00007fa59f39a60c 00007fa59f3998c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:45.106441 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3873664}
I20260709 13:17:45.165782  8174 rpcz_store.cc:276] 0709 13:17:43.584283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.585586 (+  1303us) service_pool.cc:224] Handling call
0709 13:17:44.065546 (+479960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:44.080249 (+ 14703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.108189 (+1027940us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b540031e7d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:45.108381 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102811392}
W20260709 13:17:45.163838  8221 connection.cc:256] RPC call timeout handler was delayed by -1.0065950259997862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27340000000000003s for a response
I20260709 13:17:45.088356 11847 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.170274  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:45.088771 11962 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:45.102794 11780 consensus_queue.cc:1243] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 6.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:17:45.179039  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 109658us
W20260709 13:17:45.165091 11977 consensus_meta.cc:287] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.629s	user 0.022s	sys 0.009s
I20260709 13:17:45.188429  8105 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 3. Preceding OpId from leader: term: 12 index: 4. (index mismatch)
I20260709 13:17:45.107733 11905 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:45.193828  8147 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:45.198498  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:45.196285  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.165630 11899 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.086270 11924 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.203415  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:45.204695  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:45.205900  8108 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.161408 11903 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:17:45.188849 12007 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:45.209210  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:45.228199  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:45.211884  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:17:45.230908  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 60748.6us
I20260709 13:17:45.231824  8221 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:45.208521 11677 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:45.239832  8221 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:45.243530  8221 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:45.200717 11977 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.229380 11897 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:45.257462  8221 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:45.237185 11677 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.241108 11905 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:45.280306  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:45.207231 11899 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:45.278240 11879 consensus_meta.cc:287] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 1.165s	user 0.013s	sys 0.005s
I20260709 13:17:45.287381  8108 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:17:45.254848 12009 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:45.263350 11896 consensus_meta.cc:287] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.281s	user 0.008s	sys 0.021s
I20260709 13:17:45.313666  8108 pending_rounds.cc:85] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 6
I20260709 13:17:45.332796  8108 pending_rounds.cc:107] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:17:45.333233  8108 raft_consensus.cc:2889] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:45.333585  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:45.334436  8785 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
W20260709 13:17:45.273905 12014 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:17:45.263463 12007 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:45.287297 11905 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.262251 12010 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:45.273397 12016 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:17:45.272871 11984 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:45.354990  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 74777.2us
I20260709 13:17:45.331513 11897 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:45.357302  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:45.285595 11722 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:45.337464 11139 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:45.339956 12017 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.384842  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:45.386283  8785 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.390964 11994 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:45.387441 11984 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:45.393157 11984 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:45.395669  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2297) took 2189 ms. Trace:
I20260709 13:17:45.396077  8253 rpcz_store.cc:276] 0709 13:17:43.206389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.206669 (+   280us) service_pool.cc:224] Handling call
0709 13:17:45.395425 (+2188756us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54002e9354. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:45.395586 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814046080}
W20260709 13:17:45.397517 12015 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:17:45.397567  8250 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:17:45.398283  8250 pending_rounds.cc:85] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 3
I20260709 13:17:45.398195 11677 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:45.398597 11952 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:45.398638  8250 pending_rounds.cc:107] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:17:45.399359  8250 raft_consensus.cc:2889] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:45.262609 11901 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.419798  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:45.348428 11905 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:45.338771 11879 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:45.339906 11896 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.409330 11976 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:45.439312 12016 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:45.461890  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:45.464315  8784 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:45.464421  8108 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:17:45.489884  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 291471us
I20260709 13:17:45.491051  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:45.491940  8105 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:45.496265  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:45.496876  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:45.497648  8105 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
W20260709 13:17:45.500456  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 397481us
W20260709 13:17:45.501936  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 339656us
I20260709 13:17:45.502545  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2308) took 1895 ms. Trace:
I20260709 13:17:45.503098  8101 rpcz_store.cc:276] 0709 13:17:43.606804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.610769 (+  3965us) service_pool.cc:224] Handling call
0709 13:17:43.611051 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.042737 (+1431686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.502262 (+459525us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b540036f6d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:45.502474 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654280960}
I20260709 13:17:45.517525 11847 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:45.520668 11847 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:45.522903  8108 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:17:45.541850  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 313744us
I20260709 13:17:45.542915  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:45.544399  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:45.541903  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:45.547091  8104 raft_consensus.cc:2393] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:17:45.569487  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.463774 11677 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.432542 12017 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:45.492712 11897 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.591964  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:45.592000  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 90610.7us
I20260709 13:17:45.592799  8108 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:45.593330  8149 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:45.593729  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:45.596547  8785 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
W20260709 13:17:45.613226  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 227994us
I20260709 13:17:45.615578  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:45.460697 11976 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.510396 11962 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:45.620975  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2320) took 1851 ms. Trace:
I20260709 13:17:45.565811 11847 raft_consensus.cc:2764] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:17:45.641628  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 138224us
I20260709 13:17:45.650780  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:45.600591 11840 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:45.648785  8108 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
W20260709 13:17:45.641664  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 149645us
W20260709 13:17:45.653530  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 109223us
I20260709 13:17:45.601594 11897 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.621835  8176 rpcz_store.cc:276] 0709 13:17:43.769179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.770842 (+  1663us) service_pool.cc:224] Handling call
0709 13:17:43.771183 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.771430 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:43.925604 (+154174us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.312383 (+1386779us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.407827 (+ 95444us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b48001e0258. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a5d75aa1 00007fa5a5d6cb37 00007fa5a5d6c9ca 00007fa5a5e6426f 00007fa5a5e63f37 00007fa5a5e7855c 00007fa5a5e78508 00007fa5a5e78488 00007fa5a5e78443 00007fa5a5e776ec 00007fa5a4da1a96
0709 13:17:45.620540 (+212713us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.620601 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:45.620665 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.620752 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.620907 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":826875,"prepare.queue_time_us":680261,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":2621,"raft.queue_time_us":1019861,"raft.run_cpu_time_us":3157,"raft.run_wall_time_us":398898,"spinlock_wait_cycles":7926016,"thread_start_us":985828,"threads_started":4,"wal-append.queue_time_us":1097021}
I20260709 13:17:45.656641  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:45.671828  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:45.681319  8072 leader_election.cc:336] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.950s (SENT)
I20260709 13:17:45.640540 11924 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:45.683620  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:45.630568 11977 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:45.688985  8072 leader_election.cc:336] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.119s (SENT)
I20260709 13:17:45.682790  8256 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:45.689880  8147 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:45.689651  8072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.123s (SENT) [suppressed 44 similar messages]
I20260709 13:17:45.651690 11899 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:45.671705 11557 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:45.696435  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:45.697104  8252 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:45.654148 12029 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:17:45.692799  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:45.698024  8099 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:17:45.681056 12023 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.693819  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:45.698596  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:45.632251 11677 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.701483  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:45.702153  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:45.702207  8257 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:17:45.704238  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:45.704758  8108 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:17:45.672478 12027 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:45.699409 11960 raft_consensus.cc:3055] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:45.706653  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:45.707195 11960 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:45.707588 11677 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:45.708340  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:45.708053 11960 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.709508  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:45.710189  8249 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 7: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:45.711823 12033 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:45.712409 12033 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:45.712961 11984 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.680915 11903 consensus_queue.cc:1059] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:17:45.713217  8251 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:45.713469 11984 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.713994  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:45.714824  8255 raft_consensus.cc:2410] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:45.715966 11984 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:45.717099 11977 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:45.717053 12023 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:45.717792 11977 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:45.718305 11977 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:45.719511 12023 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:45.720621  8253 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:45.687140 11840 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:45.723454 11840 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:45.727322 12021 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:17:45.727591 12039 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:45.728953  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:45.730378 11977 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:45.730424 11840 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:45.731705  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:45.734072 12023 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:45.734448 12023 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:45.734834 12023 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:45.737936 11677 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.738456 11677 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.733026 11977 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:45.740777 12027 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:45.741858 11677 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:45.742285 12017 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:45.742934 11677 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:45.743211 11896 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:45.743558 11677 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:45.744647 11677 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:45.747614 12009 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:45.748593  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:45.689477 11847 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:45.754437  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 70930.4us
I20260709 13:17:45.755494  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:45.759629  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:45.790701  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:17:45.792275  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 102639us
W20260709 13:17:45.794066  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 200801us
I20260709 13:17:45.794798  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:45.798050  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:45.800559  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 110760us
I20260709 13:17:45.803092  8175 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:45.803706  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1468) took 1982 ms. Trace:
I20260709 13:17:45.805819  8180 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:45.752414 11847 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:45.808578  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:45.787071 11896 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:45.808571  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:45.804095  8107 rpcz_store.cc:276] 0709 13:17:43.821093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.821215 (+   122us) service_pool.cc:224] Handling call
0709 13:17:43.894317 (+ 73102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.918865 (+ 24548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.803499 (+1884634us) spinlock_profiling.cc:243] Waited 72.8 ms on lock 0x7b540036e7d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:45.803648 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167341952}
I20260709 13:17:45.737954 12042 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:45.809688  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:45.795022 11901 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.787979 12017 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:45.807866  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.810344  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:45.810578  8147 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:45.810873  8180 raft_consensus.cc:2410] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:17:45.809764  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:45.811904  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:45.812013  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:45.821907  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:45.822611  8181 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:45.822047  8179 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:45.822957  8181 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:45.823242  8180 raft_consensus.cc:1217] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Deduplicated request from leader. Original: 6.8->[8.9-8.9]   Dedup: 8.9->[]
I20260709 13:17:45.813163  8253 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:17:45.813642  8221 leader_election.cc:336] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.581s (SENT)
I20260709 13:17:45.812454  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:45.815893  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 60507.4us
I20260709 13:17:45.824303  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:45.824743  8074 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:45.825626  8221 leader_election.cc:336] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.742s (SENT)
I20260709 13:17:45.694482 11925 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 13:17:45.816298  8174 raft_consensus.cc:2368] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11.
I20260709 13:17:45.831328  8783 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:45.801551 11977 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.835516  8182 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 3. Preceding OpId from leader: term: 12 index: 4. (index mismatch)
I20260709 13:17:45.835603 11977 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.836678 12022 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:45.837843 11977 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:45.819831  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:45.826757 11978 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:45.842500 12035 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:17:45.713275 12033 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:45.845470 11897 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:45.815968 12042 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:45.826452  8221 leader_election.cc:336] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.749s (SENT)
I20260709 13:17:45.807385 11879 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:45.812882 11847 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.865208  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:45.866196  8177 raft_consensus.cc:2410] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:45.867211  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:45.867954 12030 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.868516 12030 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.827353  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:45.834837 12029 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:45.822149 11901 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:45.870023 12029 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:45.870432 12029 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:45.870837 12030 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:45.871452 11901 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:45.835090 12034 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.830355 11896 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:17:45.857496 12042 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.878173 12034 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.880069  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:45.880542 12034 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:45.880729  8784 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:45.881671 12010 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:45.823807  8180 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:17:45.884047  8255 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:17:45.823905  8181 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:45.847728 12046 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:45.847782  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:45.849782 12024 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:45.850569 12043 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:45.852140 12000 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 1.593s	user 0.008s	sys 0.018s
I20260709 13:17:45.853534 11970 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:45.856376  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:45.895992  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 69555.9us
I20260709 13:17:45.859746 12025 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:17:45.860615 11976 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:45.888783  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:45.889906  8790 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:17:45.899377  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 72144.2us
I20260709 13:17:45.900141  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:45.890368  8784 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:45.905678  8179 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:45.909368  8107 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
W20260709 13:17:45.913774  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 123146us
I20260709 13:17:45.915439  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:45.916157  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:45.917080  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:45.919189  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:45.891289 11977 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:45.921132  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:45.920051  8105 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:45.925613  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:45.925788  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:45.926483  8101 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:45.891364 12026 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.926492  8105 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:45.895851 12043 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.932142  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:45.932804  8108 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.932564  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:45.934255  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 75398.2us
I20260709 13:17:45.931008  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:45.934950  8072 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:45.896551 11901 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.936226  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:45.900255 11868 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:45.897027 11970 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:45.941555 12055 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:45.949332 12054 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:45.949874 12049 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:45.938377 12043 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.954352  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:45.929776 11942 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:45.956586 12046 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:45.969003  8099 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
W20260709 13:17:45.969575  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 143241us
I20260709 13:17:45.953176 12039 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:45.974308  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:45.970139  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 82883.2us
I20260709 13:17:45.942416 11879 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:45.976465 11879 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 7 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:45.977748 11879 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:45.915457 12020 consensus_queue.cc:1059] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:17:45.959508 12055 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:45.983467 12055 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:45.966245 12054 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:45.974809 12039 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.986104 12054 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.986318 12039 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:45.989753  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.985137 12055 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.939105 12026 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:45.992344  8221 leader_election.cc:336] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.830s (SENT)
I20260709 13:17:45.992987  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:45.947180 11977 raft_consensus.cc:697] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:45.974028 11905 consensus_meta.cc:287] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
I20260709 13:17:45.998137  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:46.003706  8221 leader_election.cc:336] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.938s (SENT)
I20260709 13:17:46.005465  8221 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:46.006243  8108 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
W20260709 13:17:46.008360  8221 leader_election.cc:336] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.990s (SENT)
I20260709 13:17:45.942302 11901 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:45.973862 12046 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:45.997516 11868 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:46.010433 11840 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.014170 12046 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.027343 12045 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:46.012568 11970 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.030123 12057 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:46.007368 11905 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.030980 11901 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:46.044153  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 109273us
I20260709 13:17:46.045472  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.046123  8072 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:46.002086 12023 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.049993  8176 raft_consensus.cc:2368] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8.
W20260709 13:17:46.061457 12058 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:46.062093 12065 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:46.066129 12065 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:46.071120 11863 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:46.071501  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1460) took 2416 ms. Trace:
I20260709 13:17:46.078374  8103 rpcz_store.cc:276] 0709 13:17:43.654976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.750032 (+ 95056us) service_pool.cc:224] Handling call
0709 13:17:45.021524 (+1271492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.024610 (+  3086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.071270 (+1046660us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540040b5d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:46.071414 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2882020224}
I20260709 13:17:46.082885  8248 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:46.083636 12023 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:46.084000 11410 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:46.077461 12045 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:46.085506 12045 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.087826 12045 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:46.090349  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:46.090855  8179 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:46.091269  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:46.091868  8257 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:46.092622  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:46.093608  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 47552.9us
I20260709 13:17:46.095523  8072 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:46.101121  8180 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:46.101197  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:46.077230 12065 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:46.117519  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:46.117947 12065 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:46.117769 12054 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.118887  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:46.120080  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:46.123152 11677 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:46.126766  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 190567us
I20260709 13:17:46.127396  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:46.120114 12054 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:46.132943  8175 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:46.129499  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:46.135223  8252 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:46.135231  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:46.137174  8179 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:46.138770  8785 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:46.138722  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:46.058647 12043 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.136792  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:46.142331  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:46.071511 11847 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.140899  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:46.141319  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 45881.1us
I20260709 13:17:46.140857  8104 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:46.142864  8180 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
W20260709 13:17:46.148792  8072 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.940s (SENT)
I20260709 13:17:46.150084  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:46.150195  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:46.150863  8252 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 11: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:46.154313  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:46.154898  8787 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.155616  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:46.156286  8072 leader_election.cc:336] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.065s (SENT)
I20260709 13:17:46.156736  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:46.157503  8785 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 7: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:46.158442  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:46.158711 11677 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:46.159039  8788 raft_consensus.cc:2376] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10. Re-sending same reply.
I20260709 13:17:46.160184  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:46.159917 12065 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.160907  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:46.161841  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2429) took 2494 ms. Trace:
I20260709 13:17:46.162038  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:46.162775  8789 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:46.162395  8250 rpcz_store.cc:276] 0709 13:17:43.667120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.692648 (+ 25528us) service_pool.cc:224] Handling call
0709 13:17:45.397124 (+1704476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.399966 (+  2842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.161619 (+761653us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54002e9350. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:46.161751 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3901571968}
I20260709 13:17:46.163793  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:46.059489 11977 consensus_queue.cc:237] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.080824 11863 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.164849  8107 raft_consensus.cc:2410] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:17:46.164722  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 119363us
I20260709 13:17:46.159951  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:46.164801  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:46.172683  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:46.166944  8790 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:17:46.160301  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:46.175043  8248 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 11: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:46.167744  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:46.175361  8755 leader_election.cc:400] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11.
I20260709 13:17:46.175658  8755 leader_election.cc:403] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:46.168038  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:46.143476 11993 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:46.179102  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:46.168761  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:46.179891  8791 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:46.169399  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:46.180487  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:46.139477 12009 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:46.139550 12057 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:17:46.177848  8072 leader_election.cc:336] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.081s (SENT)
I20260709 13:17:46.132025 11868 consensus_queue.cc:1059] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:17:46.168695  8108 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:17:46.180742  8786 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 8: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:46.180769  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:46.181265  8250 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:46.187191  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:46.181480  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:46.187544  8072 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.182060  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:46.174444  8790 pending_rounds.cc:85] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 8
I20260709 13:17:46.158756 12062 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:46.134282 11925 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:17:46.184096  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:46.177603  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:46.137399 12029 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.185331  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:46.132179 11978 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:17:46.183244  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:46.152376 11348 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:46.165233 11339 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:17:46.170087 11953 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:46.226827  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:46.220736  8786 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:46.190836  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:46.246007  8790 pending_rounds.cc:107] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:17:46.189046  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:46.261111  8175 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:46.261929  8790 raft_consensus.cc:2889] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:46.187964  8788 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:46.247478  8103 raft_consensus.cc:2410] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:46.187347  8791 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:46.171308 12066 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:46.202167  8074 connection.cc:256] RPC call timeout handler was delayed by -1.4056650019999779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 13:17:46.246219  8099 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:46.274346  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 89069.5us
I20260709 13:17:46.228910  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:46.283130  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:46.284497  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:46.286325  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:46.287070  8248 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:46.260344  8782 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:46.288403  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:46.179234 12026 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:46.218266 12069 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:46.298897  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 121065us
I20260709 13:17:46.291893  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:46.292594  8249 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:46.303305  8074 leader_election.cc:400] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11.
I20260709 13:17:46.305461  8783 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:46.225131 12057 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.311396 12029 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:46.312667  8175 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:46.215317 12054 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11.
I20260709 13:17:46.309537  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:46.315922  8099 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:46.318496  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:46.320431  8248 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:46.320574  8180 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:17:46.326609  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:46.329115  8175 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:46.278769 11905 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:46.179834 11879 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 13:17:46.312367 11940 raft_consensus.cc:3055] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:46.313935 12072 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:17:46.393277  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 240757us
I20260709 13:17:46.343371  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:46.344808  8074 leader_election.cc:400] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8.
I20260709 13:17:46.394236  8074 leader_election.cc:403] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:46.291590 12068 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:46.313350 12062 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.395735  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:46.342132  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:46.316814 11840 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:46.398315 12029 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.314287 12071 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:46.410415  8252 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:46.416693 12062 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.411875 12029 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.413628 12024 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 7. Current term is 8.
I20260709 13:17:46.415259 12046 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.302896 12023 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:17:46.326254 11993 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:46.340556 12065 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:46.434844  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:46.378311 11940 raft_consensus.cc:740] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:46.420308 12062 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:46.443521  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:46.444226  8180 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:46.421123 12054 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:46.424795 12073 raft_consensus.cc:3055] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:46.404474 11840 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:46.451727  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 107132us
I20260709 13:17:46.448072  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:46.455689  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.459808  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:46.460572  8174 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
W20260709 13:17:46.460902  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 151522us
I20260709 13:17:46.461781  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.472340  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.461886 12081 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:46.318821 12069 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.500031  8249 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:46.454213 12054 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.502434  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:46.458642 11840 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.543208  8180 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:46.454514 12073 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:46.500074  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:46.539934  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 84360.3us
I20260709 13:17:46.496817 11847 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:46.562438  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 62442.6us
I20260709 13:17:46.562683  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.563232  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.551654 11978 consensus_queue.cc:1243] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:46.564566  8100 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:46.503834 12081 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:46.510349 12043 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:46.550519 12054 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.540854 12065 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:46.459928 12078 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:17:46.579759  8787 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:46.576485  8180 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:46.563802 12046 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:46.595942  8789 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:46.598515  8074 leader_election.cc:400] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11.
I20260709 13:17:46.601703  8074 leader_election.cc:403] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:17:46.588780 12062 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.602723  8785 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:46.602826 12062 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:46.605744 12070 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.383s	user 0.001s	sys 0.000s
I20260709 13:17:46.588794 12071 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:46.607988 12079 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:46.608539 12079 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.608935 12079 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.066653  8254 rpcz_store.cc:276] 0709 13:17:43.491904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.494850 (+  2946us) service_pool.cc:224] Handling call
0709 13:17:43.528396 (+ 33546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.533895 (+  5499us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:43.693654 (+159759us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.058784 (+1365130us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.058835 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:45.065969 (+  7134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.066039 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.066150 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16866,"prepare.queue_time_us":239223,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":23666,"thread_start_us":1439811,"threads_started":2}
I20260709 13:17:46.613533 12080 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:46.576087 12068 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:46.578238 11847 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.577498 11863 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:46.628196  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 65029.1us
I20260709 13:17:46.566447 12067 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:17:46.630080  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.632292  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.619855 11879 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:46.539256 11940 consensus_queue.cc:260] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.624089 12046 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11.
I20260709 13:17:46.625919 12062 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:46.641201  8180 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:46.653820 12087 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:46.654372 12075 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:17:46.656169 12080 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:46.566210 11993 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.623044 12073 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.646878 12074 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.191s
I20260709 13:17:46.647146  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.643321 12029 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:46.660277 11940 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:46.676395  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 280736us
W20260709 13:17:46.668352 12042 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.789s	user 0.006s	sys 0.006s
I20260709 13:17:46.666996 12079 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.633138 12068 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:17:46.684973 12068 consensus_queue.cc:1243] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:46.686996 12079 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:46.688491 12065 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:46.679958 12084 log.cc:927] Time spent T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:17:46.682179 12029 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:46.682858 12069 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:46.683938 12042 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.693217  8788 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:46.693547 12042 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:46.694456 12079 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:46.695015 12079 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.695262 12054 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.697026 12079 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:46.659682 12039 consensus_meta.cc:287] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.001s
I20260709 13:17:46.698949 11840 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.702888 12029 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:46.706954 12081 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.708678 12030 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:46.720237 12030 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:46.721143 12030 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.722394 12030 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:46.710878  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 63812.7us
I20260709 13:17:46.681624 12073 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:46.725116  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:46.725903 12068 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:46.726284 12068 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.726601 12068 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.713608 11800 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:46.729671  8787 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:17:46.730692  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:46.731305  8100 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:46.732280  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:46.734102  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:46.738005  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:46.744004 12081 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:46.748287 11925 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:46.748793 11925 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:46.749693 11925 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.751468  8101 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:46.752293  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:46.754509  8108 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:46.752833  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:46.753237  8106 raft_consensus.cc:1240] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:46.753163  8107 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:46.755524  8099 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:46.755542  8107 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:17:46.756484  8072 leader_election.cc:336] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.832s (SENT)
I20260709 13:17:46.756929  8072 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.758169  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:46.760692  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.758237  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:46.761760  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2315) took 2835 ms. Trace:
I20260709 13:17:46.762145  8256 rpcz_store.cc:276] 0709 13:17:43.926696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.957408 (+ 30712us) service_pool.cc:224] Handling call
0709 13:17:43.969213 (+ 11805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.689928 (+1720715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.761494 (+1071566us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54001e5854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:46.761705 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3940401536}
I20260709 13:17:46.729031 12029 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.765161 12029 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:46.737006 11800 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.757287  8107 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.770044  8107 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.770219  8099 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:46.770846  8221 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:46.770936 11800 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:46.771286  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:46.771862 11800 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:46.772123  8221 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:46.772486  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:46.773072  8252 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:46.773597 12079 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:46.774418  8221 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:46.775574 11997 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:46.775705  8101 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:46.774293 12079 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:46.776008 11997 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:46.776451 11997 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:46.776880  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:46.718000 12039 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.779549 12039 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:46.782342 11339 raft_consensus.cc:3055] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:46.782869 11339 raft_consensus.cc:740] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:46.783867 11339 consensus_queue.cc:260] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.786818  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:46.787420  8257 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.787850  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:46.785336 11339 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:46.790024 11970 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:46.792172 11925 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.797490  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:46.798331  8252 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:46.804051 11997 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.805203 12054 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:46.796756 12065 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:46.816511  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 840973us
I20260709 13:17:46.817044  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:46.817546 12065 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:46.818245  8147 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:46.805596  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 481) took 1004 ms. Trace:
I20260709 13:17:46.820350 11896 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:46.820545  8176 rpcz_store.cc:276] 0709 13:17:45.801127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.802716 (+  1589us) service_pool.cc:224] Handling call
0709 13:17:46.805369 (+1002653us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54001c34d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:46.805532 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524384640}
I20260709 13:17:46.821015 11896 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:46.821632 12069 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:46.822331 12042 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:46.823215 12069 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:46.823293 12020 consensus_queue.cc:1059] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:46.824061  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:46.823853 12069 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.824880 12020 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:46.502307  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:46.825680 12053 raft_consensus.cc:3055] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:46.826074 12053 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:46.827226  8786 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:46.826864 12053 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.828188 12053 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:46.816569  8149 connection.cc:256] RPC call timeout handler was delayed by -1.1465842210002393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260709 13:17:46.830655  8181 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.825363 12020 raft_consensus.cc:697] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:46.831130 11901 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:17:46.833684  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.834136  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.807355 11952 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.837170 12042 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:46.837620 12042 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.837973 12042 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:46.838204 11948 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:46.838830 11948 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.832233 12020 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.812179  8003 catalog_manager.cc:5697] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 6 to 7, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 7 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.808336 11840 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:46.848703  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 138815us
I20260709 13:17:46.822103 11896 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.854117  8257 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:17:46.830521  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.843308  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.787375 12068 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.857131  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.858227  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:46.813953  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1477) took 1009 ms. Trace:
I20260709 13:17:46.847366  8100 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
W20260709 13:17:46.855763  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.861531  8108 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:46.867162  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:46.871985  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.859043  8178 rpcz_store.cc:276] 0709 13:17:45.804961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.805113 (+   152us) service_pool.cc:224] Handling call
0709 13:17:45.817157 (+ 12044us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.827418 (+ 10261us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:45.872124 (+ 44706us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.958713 (+ 86589us) log.cc:844] Serialized 14 byte log entry
0709 13:17:46.726518 (+767805us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b1800209440. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:17:46.807237 (+ 80719us) spinlock_profiling.cc:243] Waited 9.9 ms on lock 0x7b1800209440. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dcd9c0a 00007fa5a7419219 00007fa59dd61a40 00007fa59dd5c4e4 00007fa59dd5c455 00007fa5a0e44060 00007fa5a0e56716 00007fa5a0e67287 00007fa5a0e67208
0709 13:17:46.807399 (+   162us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:46.807874 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:17:46.808029 (+   155us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:46.808059 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.808123 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:46.813706 (+  5583us) raft_consensus.cc:1685] finished
0709 13:17:46.813725 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.813867 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":198474,"prepare.queue_time_us":51819,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":922388,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":297,"spinlock_wait_cycles":28052096,"thread_start_us":66723,"threads_started":1,"wal-append.queue_time_us":71805}
I20260709 13:17:46.879510  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:46.880321  8176 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:46.881181  8174 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:46.881181  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.885315  8175 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:46.885057  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:46.886988  8074 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:46.884407 12069 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:46.890812  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.853931 11897 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:46.856724 11339 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.873322 11965 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:46.873517 12046 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:46.891729 12071 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:17:46.884557 12066 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:46.885052 11952 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.900074 11994 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:17:46.918169  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:46.918883 12043 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:46.919312  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:46.919752  8074 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:46.900621 11410 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.911157  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:46.920620 12069 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:46.921279 12069 consensus_queue.cc:1243] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:46.921409 12024 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:46.922024 12024 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:46.911574  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:46.892714 12062 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:46.913166  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.914698  8003 catalog_manager.cc:5697] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.925674  8257 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:46.919582 12043 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:46.909610  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:46.926879  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:46.934211  8181 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:46.894244 11979 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:46.873075 11942 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:17:46.882609 12073 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:17:46.903631 11897 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.925949 12066 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.912531 11965 raft_consensus.cc:697] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:46.898926 12065 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:46.945463  8252 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.953697  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.945904  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:46.957609  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 99440.5us
I20260709 13:17:46.946305  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:46.965366  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:46.947178  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:46.966288 11962 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:46.966792 11962 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:46.966967 12057 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:46.967545 11962 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:46.949733  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1480) took 1135 ms. Trace:
I20260709 13:17:46.969548  8181 rpcz_store.cc:276] 0709 13:17:45.814220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.814372 (+   152us) service_pool.cc:224] Handling call
0709 13:17:46.741271 (+926899us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b58002d2fd0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0da80aa 00007fa5a0e2a447 00007fa5a0e42fe7 00007fa5a0e447de 00007fa5a0e5027c 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c
0709 13:17:46.830289 (+ 89018us) spinlock_profiling.cc:243] Waited 88 ms on lock 0x7b54002cca20. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0dc1a1d 00007fa5a0da81a4 00007fa5a0e2a447 00007fa5a0e42fe7 00007fa5a0e447de 00007fa5a0e5027c 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591
0709 13:17:46.949614 (+119325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392164480}
I20260709 13:17:46.960489  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:46.961102  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:46.903842 12046 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.972183  8107 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.966777  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:46.975862  8175 raft_consensus.cc:2393] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:46.976404  8788 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:46.978212  8786 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:46.980815  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:46.981451  8106 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:46.981594  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:46.952508 12066 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.952091 11897 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:46.955945 12079 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:46.940976 12062 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:46.989892  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:46.906853 11339 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:46.985935  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 249993us
I20260709 13:17:46.988756  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:46.998842  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:46.998759 11840 consensus_queue.cc:1059] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:46.999884 12023 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:46.999943 11840 raft_consensus.cc:3055] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:47.000831 11840 raft_consensus.cc:740] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:47.000998  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:47.001807 12023 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:46.975497 12040 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:47.003103  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:47.004669  8252 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:17:46.978317 12046 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:47.013520  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:46.970291 11952 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:47.006392  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:46.923048 11410 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:46.951261 11800 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:17:46.984181 12051 raft_consensus.cc:3055] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:47.010555  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:47.016659  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:47.016852  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:46.951103 11993 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:17:47.024281  8178 raft_consensus.cc:2376] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11. Re-sending same reply.
I20260709 13:17:46.977407 12065 raft_consensus.cc:697] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:46.969280 11970 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:17:47.022135  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:47.012166  8107 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:17:47.033987 11970 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:47.034876 11780 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:47.035001  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:47.035274 11780 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:47.036391 11780 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:46.962097 12009 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:17:47.035190 11970 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:47.038496 11970 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:47.039345 11970 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:47.040511 11970 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:47.041417  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:47.042670  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:47.043198  8106 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:47.043661  8250 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:17:47.044797  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:47.046022  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:47.047175  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:47.047863  8255 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:46.996659 11997 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:47.023437  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:47.050055 12023 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:47.050253  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:47.050612 12023 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:47.051730  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:47.051453 12023 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:47.048419  8177 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:47.052466 12029 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:47.053987 12043 consensus_queue.cc:1059] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:47.055377  8072 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:47.083149  8789 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:47.057474  8179 pending_rounds.cc:85] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 5
I20260709 13:17:47.083747  8179 pending_rounds.cc:107] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:17:47.084035  8179 raft_consensus.cc:2889] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:47.058369  8252 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:47.062212  8255 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:47.062426  8254 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:47.063392  8248 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:47.003345 12079 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.003098 12062 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:47.070966  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:47.008116 12040 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.941053 12090 consensus_queue.cc:1059] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:17:47.113840 12055 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:47.028276 12054 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:47.075486  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:47.123060  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:47.023702 12051 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:47.023306 11691 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:47.066955 11984 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:47.096266  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:47.097220  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.139612  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:47.022627 12074 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
W20260709 13:17:47.102110  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 67183.9us
W20260709 13:17:47.102736 12096 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:17:47.104152  8784 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:17:47.147861  8784 pending_rounds.cc:85] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 9
I20260709 13:17:47.148120  8784 pending_rounds.cc:107] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:17:47.108789 12040 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:47.109193 12079 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:47.026432 11975 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:47.053349  8106 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:47.124552  8257 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:17:47.133284  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 57867.2us
I20260709 13:17:47.066208 11665 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:47.096396  8181 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:17:46.954615 11965 consensus_queue.cc:237] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:47.140564  8177 raft_consensus.cc:2368] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8.
I20260709 13:17:47.132576 11691 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.098480 11410 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:47.174149  8223 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:47.148469  8784 raft_consensus.cc:2889] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:47.149837  8178 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:47.151453  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:47.131404 11780 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:47.089164 12045 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:17:47.157941  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:47.167407  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:47.167289  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:47.214452  8787 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:47.084540 11847 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:47.216079  8791 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:47.138728 11984 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.139474 12039 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:47.225756 12039 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.226244 12039 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:47.022275 11952 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:47.140100 12054 raft_consensus.cc:697] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:47.232182 12054 consensus_queue.cc:237] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:47.234966  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:47.027534 12024 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:47.148131 12068 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:47.239351  8183 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:17:47.239773  8183 pending_rounds.cc:85] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 5
I20260709 13:17:47.240000  8183 pending_rounds.cc:107] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:17:47.240242  8183 raft_consensus.cc:2889] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:47.184684  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:47.071947 11840 consensus_queue.cc:260] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:47.248090  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.204422  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:47.209527  8178 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:47.249343  8788 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:17:47.250520  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 185147us
I20260709 13:17:47.168701 12029 consensus_queue.cc:1059] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:17:47.212610  8181 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:47.166165 11665 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:47.183178 12020 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:47.222918  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:47.258826  8106 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 13: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:47.224828  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:47.259867  8100 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:47.236123  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:47.185647 11691 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:47.257053  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:47.244230 11984 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:47.260702  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:47.261565  8104 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:47.264603  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:47.269632  8178 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 8: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:47.269960  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:47.298543  8149 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:47.301915  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:47.258041 11665 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:47.188836 12065 consensus_queue.cc:237] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:47.189105 12051 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:47.357590  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.305063 12068 raft_consensus.cc:3055] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:47.306596 12071 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.298159 11964 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:47.250787 12017 consensus_queue.cc:1059] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:17:47.373663  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:47.311614 11339 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:47.306720 11901 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:47.416107  8072 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:47.437832 12107 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:17:47.379213 12068 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:47.525651 11722 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:47.526546 11960 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:47.324487 12049 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:17:47.526392 11722 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:47.414638  8787 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:47.434219 12066 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:47.397996  8104 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:47.528592 11722 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:47.529245  8104 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:47.529551 12066 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:47.385937 12071 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:47.462864 12069 raft_consensus.cc:3055] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:47.454308 12044 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:47.467803  8101 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:47.469473 11948 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:47.473006  8175 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:17:47.476554 11840 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:47.489043 12020 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:47.399147 12033 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:17:47.492450 12042 consensus_meta.cc:287] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.000s
I20260709 13:17:47.495509  8177 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:47.572263  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:47.500663 12078 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:47.504503 12090 raft_consensus.cc:3055] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:47.506196  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:47.516883 12074 raft_consensus.cc:3055] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:17:47.518585  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 344519us
I20260709 13:17:47.582316  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:47.519311 11993 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:47.522446  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.413664 12104 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:17:47.526136 12068 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:47.454926  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51880.1us
I20260709 13:17:47.531332  8103 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:47.531469  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:47.534055  8252 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:47.534565  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:47.601284  8178 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:47.583084  8255 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:47.534791  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:47.412796 12110 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:17:47.539930  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 123865us
I20260709 13:17:47.604377  8072 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:47.568405 11897 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:47.567902  8254 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:47.532981 12049 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:47.587427  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 81374.5us
I20260709 13:17:47.521173 12040 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:47.476797 12062 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:47.609864  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:47.563354 12069 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:47.611424  8755 leader_election.cc:400] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 7 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 7. Current term is 8.
I20260709 13:17:47.611573 12069 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:47.612906 12069 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:47.587204 12020 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:47.614400 12046 consensus_meta.cc:287] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.001s
I20260709 13:17:47.516938 12039 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:47.587677 12042 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:47.587777 12033 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:47.607920  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 73432.8us
I20260709 13:17:47.627907  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:47.628563  8251 raft_consensus.cc:2376] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11. Re-sending same reply.
I20260709 13:17:47.595679 11847 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:47.587108 12090 raft_consensus.cc:740] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:47.634413  8174 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 13: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:17:47.626896  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.636577  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:47.582597 12074 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:47.632138  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:47.607570 11339 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:17:47.621663 12081 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:47.640290  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:47.638134  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:47.623974 12049 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:47.709673  8177 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:47.636080 12039 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:47.685114  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:47.625945 11942 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:17:47.686661  8107 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:47.601284 11348 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:17:47.625398 11780 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:17:47.626156 12066 raft_consensus.cc:2764] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:47.626514 11410 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:17:47.630349 11897 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:47.626271 11993 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:47.698092  8180 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:47.637205 12053 consensus_meta.cc:287] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.809s	user 0.006s	sys 0.006s
I20260709 13:17:47.642602 12068 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:47.705680  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:47.616117 12009 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.626121 11901 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.071s
W20260709 13:17:47.697496 11975 consensus_meta.cc:287] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.533s	user 0.004s	sys 0.006s
I20260709 13:17:47.741837 11975 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:47.711694  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 71478.1us
W20260709 13:17:47.749198  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 123336us
I20260709 13:17:47.754472  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:47.763352  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.775933  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:47.777024  8251 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 13: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:47.779450  8176 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:47.746410 11965 raft_consensus.cc:3055] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:47.628290 11863 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:17:47.629803 12034 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:17:47.627540 12046 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:47.632756 11925 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:17:47.734036  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:47.707736 11962 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.740s	user 0.012s	sys 0.000s
I20260709 13:17:47.732118 12081 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:47.784595  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:47.789556  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:47.743953 12040 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:47.792979  8108 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:47.806288  8251 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 13: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:47.794425  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:47.734923 11557 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:17:47.807646  8255 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 13: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:47.743393  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:17:47.808773  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 65492.6us
I20260709 13:17:47.809749  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:47.712325  8178 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:47.799739  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:47.811084  8257 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:47.794427  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:47.807394  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:47.812642  8251 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:47.742854 12009 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:47.826517  8102 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: [12.4-12.4]
I20260709 13:17:47.791193 11965 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:47.823873  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:47.822324  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:47.837504  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:47.839689  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:47.840919  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 236782us
I20260709 13:17:47.841747  8072 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:47.840344 12039 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:17:47.843178 12119 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:17:47.833305 11964 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:47.845477 12067 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:47.845938 12067 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:47.846472 12040 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:47.846753 11348 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:47.813921 11948 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:47.846499 12049 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:47.852753 11557 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:47.853298 11557 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:47.854457 12039 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:47.855345 11557 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:47.845583 11665 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.520s	user 0.005s	sys 0.005s
I20260709 13:17:47.857328 11665 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:47.858601  8250 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:47.863833  8100 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:47.865695  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:47.814863 11906 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:47.882860  8785 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:17:47.888090  8100 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:47.891291  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:47.891835  8786 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:47.940207  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 72382.2us
W20260709 13:17:47.940430  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 74860.3us
I20260709 13:17:47.941195  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1496) took 1095 ms. Trace:
I20260709 13:17:47.941115  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:47.941817  8180 rpcz_store.cc:276] 0709 13:17:46.845883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.846022 (+   139us) service_pool.cc:224] Handling call
0709 13:17:46.868211 (+ 22189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.734519 (+866308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.870961 (+136442us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b540031ecd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:47.941109 (+ 70148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1907962752}
I20260709 13:17:47.805806 11691 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:47.973011  8782 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:47.978086  8257 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:47.979743  8102 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:47.980259  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:47.982295  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:47.983032  8253 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:47.840276 12071 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:47.940313 12079 consensus_meta.cc:287] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.771s	user 0.009s	sys 0.003s
I20260709 13:17:47.980289  8790 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:47.808723 11962 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:47.986064  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:47.867493 12055 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:47.997493  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 159217us
I20260709 13:17:47.867687 12024 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:48.007221 12024 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:48.010042 12024 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:48.010723 12024 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.011253 12024 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:47.977633 11896 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:48.016003  8181 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:47.981570 11906 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:48.036504  8105 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:47.992913 12042 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:47.991688 12033 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:48.100131  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 82102.4us
I20260709 13:17:48.101209  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:47.980360 11964 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:17:48.017791 12054 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:47.839421 11993 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:47.971316 12030 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:17:48.112598  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:48.119618  8102 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:48.115185  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:48.121522  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 180464us
I20260709 13:17:48.006048 12079 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.133113  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:48.108943 12066 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.993204 12081 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:48.109417 12127 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:48.047859 12053 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
W20260709 13:17:48.150449  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.116464 12024 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:48.113845 12128 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:48.133127 12135 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.099984 12044 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:17:48.155097  8252 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:17:48.004350 12067 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.003962 11965 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:48.150449  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 112076us
W20260709 13:17:48.132544 11840 consensus_meta.cc:287] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.001s
I20260709 13:17:48.120301 12025 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:17:48.114015 12033 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:17:48.178572  8102 pending_rounds.cc:85] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 5
I20260709 13:17:48.184621  8102 pending_rounds.cc:107] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:17:48.179404  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:48.184855  8102 raft_consensus.cc:2889] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:48.179175  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:48.179853  8254 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:17:48.156406 12127 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:48.186025  8248 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:48.165542 12078 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:48.189850 11970 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:48.180060 12057 consensus_queue.cc:1059] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:17:48.175343 12129 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 10.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 13:17:48.191123 12124 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 13:17:48.191427 11780 consensus_queue.cc:1059] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:48.192219 11780 consensus_queue.cc:1243] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer 5033fc7e66374940a203908ea8b0078f log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:48.192629 11780 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.193029 11780 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:48.195102 11780 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:48.195564 11780 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.174342 12135 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.195952 11780 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.196414  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:48.197121  8257 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:48.197578 11964 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.198046 12135 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:48.198211 12040 raft_consensus.cc:3055] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:48.198623 12040 raft_consensus.cc:740] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:48.198873 12123 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:17:48.199391 12040 consensus_queue.cc:260] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:48.200618 12040 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:48.024842 12090 consensus_queue.cc:260] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.178583 12044 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:48.207472  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2341) took 1254 ms. Trace:
I20260709 13:17:48.152406 12055 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 13:17:48.187511 12122 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
I20260709 13:17:48.207877  8179 rpcz_store.cc:276] 0709 13:17:46.953207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.056945 (+103738us) service_pool.cc:224] Handling call
0709 13:17:47.057261 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:47.084677 (+ 27416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.084708 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:47.085228 (+   520us) log.cc:844] Serialized 52 byte log entry
0709 13:17:47.479293 (+394065us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b18002956c0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:17:47.703179 (+223886us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:47.703219 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.703286 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.202230 (+498944us) raft_consensus.cc:1685] finished
0709 13:17:48.202250 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.207406 (+  5156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3952,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":47041280,"thread_start_us":223667,"threads_started":1,"wal-append.queue_time_us":719286}
I20260709 13:17:48.152729 12066 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:48.232363  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:48.186833 12120 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.166563 12010 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:17:48.234627  8789 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:48.206561 11665 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:48.238608 12029 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:48.249577  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 833) took 1092 ms. Trace:
I20260709 13:17:48.250038  8784 rpcz_store.cc:276] 0709 13:17:47.158606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.219656 (+ 61050us) service_pool.cc:224] Handling call
0709 13:17:47.254876 (+ 35220us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:47.715665 (+460789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.715699 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:47.717491 (+  1792us) log.cc:844] Serialized 52 byte log entry
0709 13:17:48.014228 (+296737us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:48.014264 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.014417 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.249325 (+234908us) raft_consensus.cc:1685] finished
0709 13:17:48.249347 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.249514 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7080,"raft.queue_time_us":67635,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":45061,"thread_start_us":670480,"threads_started":2,"wal-append.queue_time_us":504714}
I20260709 13:17:48.186905 12034 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:17:48.253458 12034 consensus_queue.cc:1243] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Peer 5033fc7e66374940a203908ea8b0078f log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:48.203025 12127 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:48.221235 12044 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:48.251113 11952 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:48.210237 12046 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:48.198058 11964 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.232949 12090 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:48.234480 11984 consensus_meta.cc:287] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.929s	user 0.008s	sys 0.004s
I20260709 13:17:48.265259  8789 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260709 13:17:48.238536 12030 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.167795 11906 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:48.275784  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.275779  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:48.269758 12010 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:48.279609 12010 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:48.260403 11780 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:48.285048  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:48.277769 12020 consensus_meta.cc:287] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.001s
I20260709 13:17:48.303081  8257 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:17:48.270987 11691 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:48.315810  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:48.271808 11897 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:48.307471  8253 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:17:48.312438  8251 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:48.258283 12029 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:48.313745  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:48.324342  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:48.328071  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 321293us
I20260709 13:17:48.329833  8180 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:48.330400  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:48.273219 11984 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.334126  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:48.258876 12120 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:48.306975 11962 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:48.298949 12143 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:48.338209  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:48.321357 12022 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.276474 12030 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:48.284191 12046 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:17:48.338868 11960 consensus_meta.cc:287] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.812s	user 0.010s	sys 0.002s
I20260709 13:17:48.353964  8175 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:48.330790 12017 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:48.341869 11901 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:17:48.319362 12020 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.358193  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:48.340961 12079 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:48.363235  8178 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:48.364396 12046 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:48.366870  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:48.368429  8101 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:48.286530 12010 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.329484 11897 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:48.353957 12068 consensus_meta.cc:287] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.000s
W20260709 13:17:48.378505  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.379323  8179 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:48.380702 11964 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:48.352392 12143 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:17:48.362695 12142 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:17:48.383659  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:48.396374  8102 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:17:48.359998 11800 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.305790 12078 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.404807 12066 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:48.405635 11410 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:48.406396 11897 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:48.406292 11410 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.383031 11952 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:48.362497 11691 consensus_queue.cc:1059] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:17:48.362133 12017 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:48.352630 12022 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.382859 12150 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:17:48.425374  8102 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:48.418592 11410 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:48.313211 12044 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:48.403008 12010 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:48.408480 12046 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:48.435194  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:48.442690  8102 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:48.435868 12146 raft_consensus.cc:3055] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:48.397202 12143 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.443584  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:48.436580  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.446328  8102 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
W20260709 13:17:48.446599  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.403524 11800 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.425282 12034 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:48.429308 12053 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.449177  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:48.449505  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:48.449525  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:48.454069  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:48.459499 12044 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:48.459646 12034 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.459153  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:48.470598 11962 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:48.459479  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:48.444103 12146 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:48.443475 12074 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:48.478065  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:48.478199  8253 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:48.482198  8254 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:48.460217 12066 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:48.483659 12066 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.484010 12066 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:48.460373 11897 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:48.487185 11897 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:48.488040 11897 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.494580 12071 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:48.495430 12071 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.498220  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2332) took 1457 ms. Trace:
I20260709 13:17:48.498944 12022 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:48.510385 12071 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:48.501761 12029 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:48.513221 12017 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:48.498612  8107 rpcz_store.cc:276] 0709 13:17:47.040680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.071547 (+ 30867us) service_pool.cc:224] Handling call
0709 13:17:47.071839 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.711834 (+639995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.497975 (+786141us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b540001b8d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:48.498142 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1413542272}
I20260709 13:17:48.516264  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:48.517203  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:48.517726  8107 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:48.518405  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:48.519009  8107 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:48.474035 12034 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:48.446868 12046 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:48.450831 11952 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:17:48.458850 12053 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:48.537905  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:48.526746 11965 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:48.538436 12127 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.547026 12046 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:48.557132 12020 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:48.564990  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.539989 12146 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:48.594981 12053 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:48.557315 12128 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:48.634413  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2334) took 1593 ms. Trace:
I20260709 13:17:48.654274  8105 rpcz_store.cc:276] 0709 13:17:47.041294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.041412 (+   118us) service_pool.cc:224] Handling call
0709 13:17:47.041724 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.038076 (+996352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.634113 (+596037us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b5400226ad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:48.634340 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2278660992}
W20260709 13:17:48.649360 12121 log.cc:927] Time spent T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.094s	user 0.006s	sys 0.006s
W20260709 13:17:48.711604 12167 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:17:48.653633 12146 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:48.745183 12020 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:48.608547 12127 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:48.640023 12054 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:48.745913 12020 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.746609 12054 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:48.748950 12020 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:48.718291 12069 consensus_meta.cc:287] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.097s	user 0.016s	sys 0.007s
I20260709 13:17:48.720042 12081 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.720593 12017 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:48.630967 12009 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:48.729301 12057 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.734500 11339 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:49.018826 11339 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:48.990846 12081 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.019840 11339 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.4, Last appended by leader: 4, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.859413  8105 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:49.022069 12081 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:49.022176  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:49.023505  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:48.983821  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.983999  8100 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:17:48.985193  8107 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:48.601130 12066 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:48.748989 12054 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:49.001726  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:49.038466  8103 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:49.030328  8790 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:49.000725  8101 pending_rounds.cc:85] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 4
I20260709 13:17:49.040894  8101 pending_rounds.cc:107] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:17:49.041267  8101 raft_consensus.cc:2889] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:48.981335 11691 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.979970 11847 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:17:49.061923  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.063030  8107 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:48.988937 12023 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.024434 11339 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:49.062552 11975 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:49.002978 12017 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.030428 12057 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:49.062429 12010 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:49.171890 12047 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:49.071240 11847 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.067142 11691 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.071779 12044 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.078039 12023 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.190330  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:49.191196  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:49.196249  8790 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:49.137951 12065 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:49.198366  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:49.125109 11975 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:49.205699  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.208184 12057 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:49.183791 12010 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.209842 12023 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:49.211652 12010 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:49.192525 12068 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:49.218204 12044 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:49.219436  8782 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:49.220909 12044 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:49.172746 12047 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:49.242715 12047 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:49.242851 11691 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:49.243487 12171 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.262262 12171 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.246482 12066 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:49.203029 12065 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.264966 12171 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:49.265954 12065 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:49.204612 12069 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:49.219084 12068 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.266834 12069 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:49.267760 12069 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:49.268343 12068 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:49.268356  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2349) took 1215 ms. Trace:
I20260709 13:17:49.245241 12017 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:49.262789 12030 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:49.269588  8100 rpcz_store.cc:276] 0709 13:17:48.053293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.054038 (+   745us) service_pool.cc:224] Handling call
0709 13:17:48.054338 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.024927 (+970589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.268120 (+243193us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b540043cbd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:49.268296 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2137223424}
I20260709 13:17:49.254729  8103 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:49.276726 11993 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.290237 11993 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:49.292397 11993 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:49.265945 11863 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:49.293193 11863 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:49.294028 11847 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:49.294539 11847 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.294962 11847 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.295739 11863 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:49.296936 11847 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:49.298631  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:49.292718 12146 consensus_meta.cc:287] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.550s	user 0.003s	sys 0.003s
I20260709 13:17:49.305778  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.306957  8174 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:17:49.302162  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.302906  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2461) took 2241 ms. Trace:
I20260709 13:17:49.309037  8250 rpcz_store.cc:276] 0709 13:17:47.061487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.062804 (+  1317us) service_pool.cc:224] Handling call
0709 13:17:47.063238 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.859084 (+795846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.302651 (+1443567us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b5400412dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:49.302840 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1828612992}
I20260709 13:17:49.312327  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.316849  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.317838  8179 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:49.282326 12065 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.307698  8147 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:49.324272  8147 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:49.327732  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:49.327246  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:49.328513  8789 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:49.329335  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:49.330823  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.330773  8784 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:17:49.331645  8784 pending_rounds.cc:85] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 7
I20260709 13:17:49.331897  8784 pending_rounds.cc:107] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:17:49.332182  8784 raft_consensus.cc:2889] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:49.327438  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:49.334405  8783 raft_consensus.cc:2410] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:17:49.321570 11847 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.338557  8786 raft_consensus.cc:1217] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Deduplicated request from leader. Original: 8.9->[9.10-9.10]   Dedup: 9.10->[]
I20260709 13:17:49.339929  8786 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:17:49.325330 12030 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:49.337736 12044 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 13:17:49.344079 12132 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.188s	user 0.003s	sys 0.029s
I20260709 13:17:49.330687 11691 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:49.345017 11691 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.345371 11691 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.325214 12017 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.349558  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:49.359472 12025 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:49.359918 12025 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:49.360080  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:49.362521 11691 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.363309 12051 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:49.364787 11691 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:49.368949 11942 raft_consensus.cc:3055] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:49.333217 12023 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:49.370468 12125 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.480s	user 0.007s	sys 0.021s
I20260709 13:17:49.370818 11975 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:49.371798 12148 raft_consensus.cc:3055] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:49.375571 12126 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.220s	user 0.000s	sys 0.013s
I20260709 13:17:49.376502  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2354) took 1061 ms. Trace:
I20260709 13:17:49.390944  8178 rpcz_store.cc:276] 0709 13:17:48.314663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.315489 (+   826us) service_pool.cc:224] Handling call
0709 13:17:49.376292 (+1060803us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b54002490d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:49.376431 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107258112}
I20260709 13:17:49.332867 12039 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:49.326495 12068 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:49.360721 12025 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:49.386474  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.382082  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:49.325198 12065 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.382541 11942 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:49.399351  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.402115  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:49.404079  8786 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:49.406296  8100 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:49.409742  8100 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:49.389796 12023 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:49.408095  8178 raft_consensus.cc:2410] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:17:49.396975  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:49.389621 12148 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:49.413318  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:49.421238  8791 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:49.422241  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:49.347607 11847 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.430121  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:49.393076 12062 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:49.445374  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.409185 12143 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.385340 12017 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.408437 12042 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.448137  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:49.455768  8788 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:49.418365 12146 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.418526 12039 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:49.459599  8790 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:49.423738 12081 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.472376  8785 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:49.410859 12054 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:17:49.449103 12025 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.403740 12068 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.462625  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1499) took 2313 ms. Trace:
W20260709 13:17:49.480700  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.492180  8104 rpcz_store.cc:276] 0709 13:17:47.149006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.530096 (+381090us) service_pool.cc:224] Handling call
0709 13:17:47.530391 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.530730 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.530756 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.564363 (+ 33607us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.830144 (+265781us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:47.830209 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.830301 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:49.374795 (+1544494us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:49.453921 (+ 79126us) raft_consensus.cc:1685] finished
0709 13:17:49.453950 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.462535 (+  8585us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1013,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":28358,"spinlock_wait_cycles":8040192,"thread_start_us":207166,"threads_started":1,"wal-append.queue_time_us":522982}
I20260709 13:17:49.482986  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:49.473651 12029 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:49.486532 12120 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:49.496934  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:49.499403  8107 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:49.498236  8108 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 11: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:49.502532  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1510) took 1878 ms. Trace:
I20260709 13:17:49.495760 12029 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.449293 12143 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.512751  8183 rpcz_store.cc:276] 0709 13:17:47.624197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.624351 (+   154us) service_pool.cc:224] Handling call
0709 13:17:47.624716 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.695030 (+ 70314us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:47.791078 (+ 96048us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.795465 (+  4387us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.795536 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:47.795633 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.429388 (+633755us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b18002c8fc0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd2d2a6 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419
0709 13:17:49.502301 (+1072913us) spinlock_profiling.cc:243] Waited 70.1 ms on lock 0x7b54000d75d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:49.502351 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.502475 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3871,"prepare.queue_time_us":342085,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":4030,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":6274,"spinlock_wait_cycles":170868352,"thread_start_us":95638,"threads_started":1}
I20260709 13:17:49.472887 12146 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.463037 12042 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.544396 12065 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:49.476274 12081 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.535326 12118 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.551811  8103 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:49.554266 12146 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:49.547173  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 216434us
I20260709 13:17:49.539104 12029 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:49.544860 11847 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:49.576656  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.491117 11942 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.581871 11942 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:49.584367  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:49.584816  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:49.585084  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.581400  8147 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:49.594010  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:49.596016  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:49.474081 12148 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.603713 12024 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:49.605597  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2344) took 2344 ms. Trace:
I20260709 13:17:49.577023 12143 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:49.611389 11800 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:49.607117 12156 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.169s	user 0.000s	sys 0.015s
I20260709 13:17:49.600724 12173 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:49.612112  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:49.611956  8181 rpcz_store.cc:276] 0709 13:17:47.256343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.257539 (+  1196us) service_pool.cc:224] Handling call
0709 13:17:47.298450 (+ 40911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.023037 (+724587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.600010 (+1576973us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54002f8854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:49.600203 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1649635584}
I20260709 13:17:49.645392  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.645702  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:49.646149  8182 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:49.633186 12055 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.646916  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:49.647472  8182 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:49.617023  8147 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:49.596318 12065 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.648622 12065 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:49.647500  8255 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:49.650744 12065 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:49.650969  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:49.651674  8254 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:49.653599 12007 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:49.653651  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.653927  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:49.654188 12007 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.654469  8182 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:49.633699 11977 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:49.655215 11977 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.655372  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.655597 11977 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.655939  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:49.606427 12009 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:49.657387 12009 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.658169  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:49.658396 12053 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:49.658849 12053 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.659224 12053 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:49.659996 12009 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:49.637414  8248 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:49.637547  8183 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:17:49.640583  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.635932  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:49.647076 12055 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.516538 12023 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.655748 12128 consensus_queue.cc:1059] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:49.662014  8251 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:49.663784  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:49.611774 12024 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:49.666857  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2467) took 2039 ms. Trace:
I20260709 13:17:49.679589  8252 rpcz_store.cc:276] 0709 13:17:47.627439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.627734 (+   295us) service_pool.cc:224] Handling call
0709 13:17:47.891052 (+263318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:48.170184 (+279132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.666536 (+1496352us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54002e9354. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:49.666785 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606685056}
W20260709 13:17:49.670743  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.640511 11975 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.654578 12007 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.663453  8074 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:49.674113  8257 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: [8.9-11.11]
W20260709 13:17:49.685724  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 320315us
I20260709 13:17:49.556526 12039 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.673538  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.677817  8782 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.664623  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:49.697801  8248 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:49.667928  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:49.640273 11863 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.671229  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.701676  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.702430  8176 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:49.703461  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.660909 12173 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.577235 12118 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.634847 12047 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:17:49.699339  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:49.684595 11800 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:17:49.715754  8254 raft_consensus.cc:2410] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:49.701243  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2333) took 2790 ms. Trace:
I20260709 13:17:49.702000  8183 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
W20260709 13:17:49.716380  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 48542us
I20260709 13:17:49.717015  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:49.718115  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:49.718261  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 316223us
I20260709 13:17:49.710059  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:49.723541  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:49.682132 12024 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:49.713666  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:49.716199  8256 rpcz_store.cc:276] 0709 13:17:46.910610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.910739 (+   129us) service_pool.cc:224] Handling call
0709 13:17:46.911084 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:47.850455 (+939371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.850490 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:47.851118 (+   628us) log.cc:844] Serialized 52 byte log entry
0709 13:17:48.142269 (+291151us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:48.142313 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.688286 (+1545973us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b5400089dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:49.688333 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:49.688377 (+    44us) raft_consensus.cc:1685] finished
0709 13:17:49.688387 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.701182 (+ 12795us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4865,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":2159489280,"thread_start_us":290165,"threads_started":1,"wal-append.queue_time_us":349671,"wal-append.run_cpu_time_us":2115,"wal-append.run_wall_time_us":1062739}
I20260709 13:17:49.730077  8175 raft_consensus.cc:2393] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:17:49.690761  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.730473  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:49.731351  8100 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:49.733251  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:49.733610  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.726435  8072 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:49.725314  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:49.685124 12069 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.728430  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:49.687767 12017 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:49.734905  8257 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:17:49.719102  8252 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:49.735313  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:49.737514  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:49.744611  8100 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:49.745739  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:49.746584  8106 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:49.750234  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:49.752008  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:49.737946  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:49.740983  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:49.679065 11994 consensus_queue.cc:1059] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:17:49.766952  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:49.767381  8101 raft_consensus.cc:2410] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:49.765959  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:49.773355  8100 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:49.713775 12143 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:49.774931  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:49.687613 12009 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:17:49.778044  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:49.807874  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:49.696393 11904 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:17:49.732868 12010 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.715049 12173 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.715939 12146 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:17:49.791220  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.816478  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.836519  8183 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:49.837682  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.838972  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.802536  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:49.840070  8107 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 7: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:49.819756  8248 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:49.696566 11975 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.815146  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:49.765074 12145 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:49.741796 11960 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:49.841976  8175 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 8.
I20260709 13:17:49.730661 12065 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:17:49.778250 12120 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:49.715862 11863 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.776636 12066 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:49.802851 12017 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:49.853945  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:49.772495 12054 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:17:49.778980 12143 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:49.878973  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1504) took 1714 ms. Trace:
I20260709 13:17:49.908936  8099 rpcz_store.cc:276] 0709 13:17:48.164450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.210566 (+ 46116us) service_pool.cc:224] Handling call
0709 13:17:48.210885 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:48.256836 (+ 45951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.256884 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:48.261367 (+  4483us) log.cc:844] Serialized 26 byte log entry
0709 13:17:48.327264 (+ 65897us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:48.327302 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.327370 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:49.606535 (+1279165us) spinlock_profiling.cc:243] Waited 995 us on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:49.864793 (+258258us) raft_consensus.cc:1685] finished
0709 13:17:49.864822 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.878880 (+ 14058us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46574,"raft.queue_time_us":46628,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3686,"spinlock_wait_cycles":2287488,"thread_start_us":32622,"threads_started":1,"wal-append.queue_time_us":125396}
I20260709 13:17:49.743306 11847 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:17:49.882968  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:49.834237 12181 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.914929 12081 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:49.915747 12081 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:49.915442 12181 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:49.916498 12081 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:49.918601 12181 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:49.919384 12181 consensus_queue.cc:1059] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:49.772701 12069 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:49.857532 12145 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:49.921766 12020 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:17:49.922045 12177 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:17:49.922401 12020 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:49.922896 12069 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:49.924515 11847 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:49.924691 12020 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:49.924801 12069 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:49.925385 12069 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:49.927531 12069 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:49.921767 12145 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.865948 12175 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.865775 12120 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:49.877920 11960 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:49.929112 12069 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:49.913370 12143 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.978595 11863 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:49.925280 12020 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:49.589286 12049 consensus_queue.cc:1175] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5033fc7e66374940a203908ea8b0078f" responder_term: 11 status { last_received { term: 10 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:49.881649 12066 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.974975  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:50.000821  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.002163  8790 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:17:49.853695 12146 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:49.856163 12010 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:49.995617 12179 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:17:49.917132 12081 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:50.037323  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.867301 11800 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:49.907938 12042 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:49.971730 12079 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:50.059706  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 472783us
I20260709 13:17:50.155015  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:50.015708 12120 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:50.050105 12055 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:50.129328  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:50.124670  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 444246us
W20260709 13:17:50.141446  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 451713us
I20260709 13:17:50.141659  8790 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:50.057793 12066 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:50.169833  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:50.170491  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:50.170982  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:49.993358 12053 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.157699  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:50.179153  8175 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:17:50.026872 12020 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:49.887362 12017 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.925136 11847 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.028143 12131 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:50.150554  8782 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
W20260709 13:17:50.172644  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.172748  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:50.182322  8253 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:50.173713  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:50.174960  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.175410  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:50.186761  8256 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:50.156736  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:50.194741  8177 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.016s	sys 0.043s
I20260709 13:17:50.219391  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:50.207777  8183 raft_consensus.cc:2368] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9.
I20260709 13:17:50.298800  8221 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:50.300133  8223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.011s	sys 0.003s
I20260709 13:17:50.223078  8254 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:50.209779  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:50.201421  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:50.216589  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:50.213002  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:50.197461  8789 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.013s	sys 0.050s
W20260709 13:17:50.322528  8786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.004s	sys 0.008s
W20260709 13:17:50.511842  8786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.005s	sys 0.009s
W20260709 13:17:50.513388  8788 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.003s	sys 0.009s
W20260709 13:17:50.516386  8788 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.004s	sys 0.009s
W20260709 13:17:50.440315  8074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.003s	sys 0.017s
W20260709 13:17:50.517814  8074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.003s	sys 0.017s
I20260709 13:17:50.171113 11780 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.521358 12010 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:50.455138  8177 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.017s	sys 0.044s
I20260709 13:17:50.170169 11863 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:50.233705 11847 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:50.224123 11901 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:50.213477 11960 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:50.238018 11975 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:50.540557 11901 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:50.440347  8073 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.000s	sys 0.017s
I20260709 13:17:50.541275 11901 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:50.541603  8073 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.000s	sys 0.018s
W20260709 13:17:50.454175  8174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.001s	sys 0.001s
I20260709 13:17:50.521093 11339 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:50.545951  8174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.002s	sys 0.001s
I20260709 13:17:50.546471 11339 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:50.521907 11904 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:50.341559 12146 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:50.140825 11800 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:50.505604  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 292421us
W20260709 13:17:50.356743 12051 consensus_meta.cc:287] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.993s	user 0.014s	sys 0.000s
I20260709 13:17:50.521394  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:50.244980 12020 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:50.555738 12020 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:50.556370  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:50.188349 12017 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:50.212244 12025 consensus_meta.cc:287] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.716s	user 0.011s	sys 0.000s
I20260709 13:17:50.356945 12173 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.183584 12047 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:17:50.560187 12047 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:50.560396 11984 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:50.560698 12047 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:50.297147 12054 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.553530 11800 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:50.252481 12143 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.197577 12131 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.210625 12118 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:50.019014 12175 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.566833 11800 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:50.566484 12207 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:50.248243 12176 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.432s	user 0.001s	sys 0.000s
I20260709 13:17:50.569950 12185 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:50.478709  8223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.011s	sys 0.003s
W20260709 13:17:50.571930  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 850771us
I20260709 13:17:50.565155 12143 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:50.574011 12184 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:50.475575  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:50.508498  8789 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.013s	sys 0.050s
W20260709 13:17:50.462461  8179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.010s	sys 0.009s
I20260709 13:17:50.574261 11904 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:50.575866  8787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1019) took 1598 ms. Trace:
I20260709 13:17:50.561298 12173 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:50.576223 11904 raft_consensus.cc:3055] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:50.327870 12081 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:50.462718  8181 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.004s	sys 0.007s
W20260709 13:17:50.577670  8181 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.005s	sys 0.007s
I20260709 13:17:50.578020 11863 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:50.483597  8253 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:50.562285 12054 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.580470  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:50.580782 11863 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:50.581367  8253 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
W20260709 13:17:50.582103  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.482750  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:50.583074  8254 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:50.582581 12047 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:50.584501  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:50.584794 12047 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:50.506129  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:50.374356 12145 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.433054  7995 maintenance_manager.cc:419] P e5e50b3438e24144a9523cb9ae40543f: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033435
I20260709 13:17:50.485765  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:50.478152  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 179379us
I20260709 13:17:50.515681  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 676) took 1118 ms. Trace:
I20260709 13:17:50.482417  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:50.476836  8147 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:50.369626 12053 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:50.329707 12149 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.211s
I20260709 13:17:50.556386 11965 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.168618 12079 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:50.522655 11780 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:50.575496  8179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.011s	sys 0.010s
W20260709 13:17:50.462208  8178 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.001s	sys 0.010s
I20260709 13:17:50.576812 11904 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:50.582594  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:50.528676  8071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.013s	sys 0.015s
I20260709 13:17:50.574630  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:50.574609  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:50.606711 12146 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:50.607044  8221 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:50.608084 12079 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:50.608328  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:50.609911 11975 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:50.610515 11975 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.611050 11975 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:50.612210  8256 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:50.613574  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:50.576383  8787 rpcz_store.cc:276] 0709 13:17:48.977146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.977423 (+   277us) service_pool.cc:224] Handling call
0709 13:17:49.021763 (+ 44340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:49.022113 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.022140 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:49.038780 (+ 16640us) log.cc:844] Serialized 26 byte log entry
0709 13:17:49.496346 (+457566us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:49.496386 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.496453 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.575407 (+1078954us) raft_consensus.cc:1685] finished
0709 13:17:50.575458 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.575662 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":707,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":414225,"threads_started":1,"wal-append.queue_time_us":642958}
W20260709 13:17:50.616039  8071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.013s	sys 0.016s
I20260709 13:17:50.621201 12030 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:50.621580 12208 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.622169 12030 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:50.622479 12208 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.623340  8176 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:50.624773  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:50.625737 12030 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:50.626947 11339 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:50.627527  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:50.629092  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:50.629647  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:50.630815  8256 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:50.631799  8253 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:17:50.632520  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:50.630980  8176 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
W20260709 13:17:50.633337  8178 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.001s	sys 0.011s
I20260709 13:17:50.616639 12143 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:50.615388 11780 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:50.633510  8256 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:50.613595 12131 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:50.653893  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 193011us
I20260709 13:17:50.595038  8791 rpcz_store.cc:276] 0709 13:17:49.396909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.424751 (+ 27842us) service_pool.cc:224] Handling call
0709 13:17:49.425056 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:49.729579 (+304523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.729610 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:49.730092 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:17:50.027596 (+297504us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:50.027638 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.027731 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.515147 (+487416us) raft_consensus.cc:1685] finished
0709 13:17:50.515196 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.515473 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21182,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":4430,"thread_start_us":601339,"threads_started":2,"wal-append.queue_time_us":632683}
I20260709 13:17:50.663009 12030 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:50.664644 12030 raft_consensus.cc:697] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:50.648296 12143 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:50.665896  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:50.666177 12143 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:50.647356 12146 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.666234 12030 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.667722 12146 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:50.670599  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.625339 12208 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:50.698386  8174 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:17:50.705969  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:50.706336 11339 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:50.706910  8782 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:50.708837  8248 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:50.706123 11904 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:50.644562 11965 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:50.709635 12079 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:50.710789  8175 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
W20260709 13:17:50.713053  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 77854.2us
I20260709 13:17:50.720260 11339 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.720455  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:50.720988 11339 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:50.723853  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:50.724071 11924 raft_consensus.cc:3055] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:50.724324 12090 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.724519 11924 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:50.725152 12090 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:50.723502 11339 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:50.783838  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 209452us
I20260709 13:17:50.721370  8787 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
W20260709 13:17:50.804397  8182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.005s	sys 0.009s
I20260709 13:17:50.720613  8786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 677) took 1323 ms. Trace:
I20260709 13:17:50.782824  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1514) took 1144 ms. Trace:
W20260709 13:17:50.820040  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 264001us
I20260709 13:17:50.727102  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:50.818837  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1030) took 1157 ms. Trace:
W20260709 13:17:50.825956  8182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.008s	sys 0.009s
W20260709 13:17:50.787796 12066 consensus_meta.cc:287] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.007s
W20260709 13:17:50.828295  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.727847 12090 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:50.830952  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:50.787418 11410 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:50.837569 12148 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:50.783210 12067 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:50.840056 12024 consensus_meta.cc:287] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.073s	user 0.008s	sys 0.011s
W20260709 13:17:50.841069 12120 consensus_meta.cc:287] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.656s	user 0.007s	sys 0.009s
I20260709 13:17:50.840390 11924 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.823686  8789 rpcz_store.cc:276] 0709 13:17:49.661333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.661763 (+   430us) service_pool.cc:224] Handling call
0709 13:17:49.682421 (+ 20658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.682661 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:50.577813 (+895152us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.635702 (+ 57889us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:50.649569 (+ 13867us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:50.692921 (+ 43352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.699928 (+  7007us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.818772 (+118844us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":311450,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":3021,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":35552,"thread_start_us":920165,"threads_started":2,"wal-append.queue_time_us":151003}
I20260709 13:17:50.846493 12185 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:50.847070 12017 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.868587  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:50.786911 11975 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:50.849480  8180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.008s	sys 0.008s
I20260709 13:17:50.808116 12074 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:50.873260  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:50.849570 11977 consensus_meta.cc:287] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.193s	user 0.018s	sys 0.000s
I20260709 13:17:50.806166 12068 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:50.850171  8251 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
W20260709 13:17:50.850193  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:50.852113  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.834964  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1523) took 1175 ms. Trace:
W20260709 13:17:50.878669  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.804021 12175 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:50.855358  8782 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:50.726775 12054 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:50.825008 11904 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:50.860970 12204 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:50.862162  8223 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:50.888641  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.818045  8786 rpcz_store.cc:276] 0709 13:17:49.397184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.447354 (+ 50170us) service_pool.cc:224] Handling call
0709 13:17:49.448441 (+  1087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.511734 (+ 63293us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:49.714958 (+203224us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.512630 (+797672us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:50.512751 (+   121us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:50.512868 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.720312 (+207444us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b5400520154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:50.720356 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.720556 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25275,"prepare.queue_time_us":482097,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":26096,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":322,"spinlock_wait_cycles":144859520,"thread_start_us":974046,"threads_started":2,"wal-append.queue_time_us":666702}
I20260709 13:17:50.818909  8178 rpcz_store.cc:276] 0709 13:17:49.638066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.638769 (+   703us) service_pool.cc:224] Handling call
0709 13:17:49.639074 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.639293 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:50.633944 (+994651us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.782239 (+148295us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:50.782320 (+    81us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:50.782410 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.782503 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.782719 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29818,"prepare.queue_time_us":459649,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":12441,"raft.queue_time_us":165478,"thread_start_us":1003486,"threads_started":2}
I20260709 13:17:50.890435  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:50.871053 12185 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:50.881963  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:50.871146  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 450660us
I20260709 13:17:50.877812 12146 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:50.878703  8182 rpcz_store.cc:276] 0709 13:17:49.659212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.659920 (+   708us) service_pool.cc:224] Handling call
0709 13:17:49.660187 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.660381 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:50.014504 (+354123us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.834385 (+819881us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:50.834501 (+   116us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:50.834613 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.834715 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.834894 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10974,"prepare.queue_time_us":500366,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":8339,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"thread_start_us":1165332,"threads_started":2,"wal-append.queue_time_us":696786}
I20260709 13:17:50.860102 12066 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:50.897926 12204 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.901854 12145 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:50.872422 12024 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:50.876559 12120 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.907840  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1517) took 1263 ms. Trace:
I20260709 13:17:50.884891 11977 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.929602 11952 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.930552 11952 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:50.933187 12029 consensus_meta.cc:287] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 1.338s	user 0.012s	sys 0.008s
I20260709 13:17:50.899372 12030 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.905869 12090 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:50.938001  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 75936.3us
I20260709 13:17:50.936441  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:50.937175  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2360) took 1274 ms. Trace:
I20260709 13:17:50.939388  8106 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:50.944438  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:50.935488 12146 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:50.922587  8181 rpcz_store.cc:276] 0709 13:17:49.644774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.661954 (+ 17180us) service_pool.cc:224] Handling call
0709 13:17:49.681616 (+ 19662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:50.578340 (+896724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:50.578402 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:50.579052 (+   650us) log.cc:844] Serialized 26 byte log entry
0709 13:17:50.594060 (+ 15008us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:50.594105 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.601514 (+  7409us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.905771 (+304257us) raft_consensus.cc:1685] finished
0709 13:17:50.905802 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.907749 (+  1947us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":204636,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":27478,"thread_start_us":910567,"threads_started":2,"wal-append.queue_time_us":237988}
I20260709 13:17:50.939783  8180 rpcz_store.cc:276] 0709 13:17:49.663062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.668618 (+  5556us) service_pool.cc:224] Handling call
0709 13:17:49.669013 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:50.110618 (+441605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:50.110673 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:50.118805 (+  8132us) log.cc:844] Serialized 26 byte log entry
0709 13:17:50.896314 (+777509us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:50.907481 (+ 11167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.921701 (+ 14220us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.921760 (+    59us) raft_consensus.cc:1685] finished
0709 13:17:50.921776 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.937104 (+ 15328us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":202677,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":148,"thread_start_us":1196503,"threads_started":2,"wal-append.queue_time_us":531285}
W20260709 13:17:50.954615  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.955500  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:50.958422  8175 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:50.924310 12208 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:50.943313 12145 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.964150 12030 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:50.965025  8783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 841) took 1163 ms. Trace:
I20260709 13:17:50.965751  8100 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
W20260709 13:17:50.965945 12227 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:17:50.948433 11924 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:50.968120  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.960510  8147 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:50.975183  8182 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:17:50.967201  8003 catalog_manager.cc:5697] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:50.933835 12029 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:50.954766 12146 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.969614  8783 rpcz_store.cc:276] 0709 13:17:49.724618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.724771 (+   153us) service_pool.cc:224] Handling call
0709 13:17:49.772460 (+ 47689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.772749 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:50.507565 (+734816us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.829656 (+322091us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.854948 (+ 25292us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:50.858953 (+  4005us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:50.870834 (+ 11881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.877606 (+  6772us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.888077 (+ 10471us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":359409,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":86,"raft.queue_time_us":6593,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":30151,"thread_start_us":567508,"threads_started":2,"wal-append.queue_time_us":227792}
I20260709 13:17:51.003855  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:51.004004 12208 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.006493  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1512) took 1372 ms. Trace:
I20260709 13:17:51.009780  8786 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:50.968423 12054 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:50.990840 12146 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:51.013556  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 149451us
I20260709 13:17:51.013391  8177 rpcz_store.cc:276] 0709 13:17:49.633897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.635493 (+  1596us) service_pool.cc:224] Handling call
0709 13:17:49.635814 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:49.636150 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:50.522949 (+886799us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.618455 (+ 95506us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:50.775506 (+157051us) log.cc:844] Serialized 26 byte log entry
0709 13:17:50.775763 (+   257us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:50.775812 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.775963 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:51.006206 (+230243us) raft_consensus.cc:1685] finished
0709 13:17:51.006231 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.006412 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":247,"prepare.queue_time_us":511699,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":22556,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":292,"thread_start_us":918756,"threads_started":2,"wal-append.queue_time_us":211247}
I20260709 13:17:51.015056 12145 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.033511  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:51.017942  8785 raft_consensus.cc:2368] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9.
I20260709 13:17:51.019116  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:51.025000 11901 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:51.028575  8755 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.131:45561 timed out after 1.725s (SENT) [suppressed 8 similar messages]
I20260709 13:17:51.040171 12145 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.039994 11901 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.041678  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:51.043087  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:51.044905  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:51.045564  8001 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36106 (request call id 200) took 20868 ms (client timeout 15000 ms). Trace:
I20260709 13:17:51.046060  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:51.046864  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:51.047091  8107 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:51.047646  8103 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:17:51.048564  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:51.049691 11975 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:51.046006  8001 rpcz_store.cc:269] 0709 13:17:30.120201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.120380 (+   179us) service_pool.cc:224] Handling call
0709 13:17:50.984852 (+20864472us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:42.867155 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:42.867846 (+   691us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:42.867902 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:17:42.867920 (+    18us) tablet.cc:662] Decoding operations
0709 13:17:42.934095 (+ 66175us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:42.934183 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:42.934216 (+    33us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:17:42.935517 (+  1301us) tablet.cc:701] Row locks acquired
0709 13:17:42.935595 (+    78us) write_op.cc:260] PREPARE: finished
0709 13:17:42.935755 (+   160us) write_op.cc:270] Start()
0709 13:17:42.935906 (+   151us) write_op.cc:276] Timestamp: P: 1783603062935694 usec, L: 0
0709 13:17:42.935927 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:17:42.936645 (+   718us) log.cc:844] Serialized 6278 byte log entry
0709 13:17:43.355089 (+418444us) op_driver.cc:464] REPLICATION: finished
0709 13:17:43.485965 (+130876us) write_op.cc:301] APPLY: starting
0709 13:17:43.486063 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:43.507071 (+ 21008us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:43.535779 (+ 28708us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:43.682076 (+146297us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:43.682489 (+   413us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:17:43.682534 (+    45us) write_op.cc:312] APPLY: finished
0709 13:17:43.682972 (+   438us) log.cc:844] Serialized 113 byte log entry
0709 13:17:43.683159 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:43.683325 (+   166us) write_op.cc:454] Released schema lock
0709 13:17:43.683390 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:43.683824 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:43.683851 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":123736,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":117714,"apply.run_cpu_time_us":6269,"apply.run_wall_time_us":197824,"num_ops":16,"prepare.queue_time_us":418261,"prepare.run_cpu_time_us":20366,"prepare.run_wall_time_us":334402,"raft.queue_time_us":50316,"raft.run_cpu_time_us":13687,"raft.run_wall_time_us":111151,"replication_time_us":418891,"thread_start_us":522979,"threads_started":4,"wal-append.queue_time_us":364326,"wal-append.run_cpu_time_us":73606,"wal-append.run_wall_time_us":1709265}]]}
I20260709 13:17:51.049394  8104 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.013072  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1532) took 1218 ms. Trace:
I20260709 13:17:51.016407 12150 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:51.035981 12234 log.cc:927] Time spent T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:17:51.066781  8182 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:51.029937  8788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 680) took 1631 ms. Trace:
I20260709 13:17:51.078507 12150 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:51.079901 12150 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:51.081800  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.082625  8248 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:51.067524  8257 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:51.057415  8181 rpcz_store.cc:276] 0709 13:17:49.778671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.961340 (+1182669us) service_pool.cc:224] Handling call
0709 13:17:50.961796 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.962062 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:50.964010 (+  1948us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.995987 (+ 31977us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:50.996057 (+    70us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:50.996115 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.996201 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.997291 (+  1090us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1502,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":3452,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":5397,"thread_start_us":28147,"threads_started":1}
I20260709 13:17:51.024902 12143 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:51.102430  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.117645  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 89064.5us
I20260709 13:17:51.068089  8788 rpcz_store.cc:276] 0709 13:17:49.398093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.456634 (+ 58541us) service_pool.cc:224] Handling call
0709 13:17:49.457086 (+   452us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:49.470963 (+ 13877us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:49.769214 (+298251us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.595262 (+826048us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:50.817893 (+222631us) log.cc:844] Serialized 78 byte log entry
0709 13:17:50.842282 (+ 24389us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:50.842837 (+   555us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.845153 (+  2316us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.845895 (+   742us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.846233 (+   338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.846356 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:51.029332 (+182976us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b5400730b20. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0dc1dbe 00007fa5a0dcc930 00007fa5a0dcc8d8 00007fa5a0dcc858 00007fa5a0dcc813 00007fa5a0dcba9c 00007fa5a6cb7626 00007fa5a6cb1dd8 00007fa5a0e087cb 00007fa5a0e0b2c0
0709 13:17:51.029687 (+   355us) raft_consensus.cc:1685] finished
0709 13:17:51.029705 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.029885 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":521666,"prepare.run_cpu_time_us":195,"prepare.run_wall_time_us":199,"raft.queue_time_us":84905,"raft.run_cpu_time_us":623,"raft.run_wall_time_us":13683,"spinlock_wait_cycles":27183488,"thread_start_us":956583,"threads_started":3,"wal-append.queue_time_us":576821}
I20260709 13:17:51.130909  8107 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:51.132740  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:51.133780  8106 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:51.134078  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1531) took 1386 ms. Trace:
I20260709 13:17:51.134510  8178 rpcz_store.cc:276] 0709 13:17:49.748327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.952410 (+1204083us) service_pool.cc:224] Handling call
0709 13:17:51.014409 (+ 61999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.133705 (+119296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:51.133743 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:51.133801 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:51.133828 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.133884 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.134002 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:51.136107  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 166523us
I20260709 13:17:51.137542  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:51.135004  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:51.144907  8257 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:51.146381  8107 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:51.146669  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.086884 12145 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:17:51.154206  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.084584 11952 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:51.090435 12054 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:51.181559  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.181747  8106 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:51.182379  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:51.185227  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:51.186475  8178 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.186513  8107 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:51.186347  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:51.180827 11904 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.197687  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:51.198925  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:51.201987  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.185793 12066 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:51.211360 12232 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:17:51.212190  8785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48096 (request call id 683) took 1485 ms. Trace:
I20260709 13:17:51.212596  8785 rpcz_store.cc:276] 0709 13:17:49.726984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.807539 (+ 80555us) service_pool.cc:224] Handling call
0709 13:17:51.211929 (+1404390us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54005591d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:51.212100 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2766108928}
W20260709 13:17:51.200941 12020 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.644s	user 0.016s	sys 0.000s
W20260709 13:17:51.202157 12047 consensus_meta.cc:287] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.617s	user 0.006s	sys 0.007s
W20260709 13:17:51.224610 12007 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.466s	user 0.015s	sys 0.008s
I20260709 13:17:51.225190 12007 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.227533 12007 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:51.228180 12230 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 13:17:51.230238 12235 log.cc:927] Time spent T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:17:51.231521  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 511) took 1500 ms. Trace:
I20260709 13:17:51.195335 12120 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.206580 12049 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:51.237795  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:51.271744  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:51.287352  8074 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:17:51.289089  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.189251 12145 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.287256  8107 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:17:51.241456  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.231989  8176 rpcz_store.cc:276] 0709 13:17:49.731467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.635200 (+903733us) service_pool.cc:224] Handling call
0709 13:17:50.782649 (+147449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:50.825980 (+ 43331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:50.826023 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:50.843385 (+ 17362us) log.cc:844] Serialized 26 byte log entry
0709 13:17:50.939514 (+ 96129us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:50.939550 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.939613 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:51.231208 (+291595us) raft_consensus.cc:1685] finished
0709 13:17:51.231237 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.231449 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39042,"raft.queue_time_us":45412,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":30479,"thread_start_us":95674,"threads_started":1,"wal-append.queue_time_us":190172}
I20260709 13:17:51.214509 11977 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:51.293937  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 126654us
I20260709 13:17:51.205662  8003 catalog_manager.cc:5697] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 6 to 8, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 8 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.286868  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2366) took 1601 ms. Trace:
I20260709 13:17:51.296906  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:51.261904 12030 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.303236  8255 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:51.309249  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:51.347786  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.330271  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.332337  8107 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:51.327109  8256 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:51.337738  8788 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:51.323985  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.311743  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.238412 11800 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:51.309962  8783 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:51.272609 12066 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.360530  8257 raft_consensus.cc:2410] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:51.324744  8102 raft_consensus.cc:2410] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:51.206604 11904 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:51.357585 12079 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:51.363034 12148 consensus_meta.cc:287] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.004s
W20260709 13:17:51.365484  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 68756.4us
I20260709 13:17:51.370069  8256 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:51.358461  8104 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:17:51.325317  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.302887 12145 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.294977 12143 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.333619  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:51.310635  8183 rpcz_store.cc:276] 0709 13:17:49.685001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.630685 (+945684us) service_pool.cc:224] Handling call
0709 13:17:50.631643 (+   958us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:50.632040 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:50.632071 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:50.632659 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:17:50.815865 (+183206us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:50.815904 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.815978 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:51.286561 (+470583us) raft_consensus.cc:1685] finished
0709 13:17:51.286588 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.286778 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":182788,"threads_started":1,"wal-append.queue_time_us":242382}
I20260709 13:17:51.334604  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:51.375098  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.364675 12120 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:51.334585 12054 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.327024 12049 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.336270 12208 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.331497 11952 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:51.393075  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:51.414573  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.403458  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:51.430688  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 53383.8us
I20260709 13:17:51.421232  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:51.418708  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 48547.4us
W20260709 13:17:51.429246  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.432148  8104 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:51.373315  8179 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:51.435930  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.372519  8252 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
W20260709 13:17:51.439958  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.440161  8106 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:51.428876  8249 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:17:51.433182 11952 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.434561  8257 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:51.441907  8107 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.410068 12204 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:51.375559 12074 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.443701 12065 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.444020 12081 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:51.418493 12067 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.411392 12029 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:51.430480 12120 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:51.408763 12145 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:51.409938 11904 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:51.426265 12246 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:51.455014  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 206440us
I20260709 13:17:51.458559  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:51.465736  8106 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:17:51.460615  8256 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:17:51.374219 12066 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.461370  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.467672  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.468801  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:51.375684 12079 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:51.398891 12185 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:51.466429 12246 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.477093 12238 raft_consensus.cc:2764] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:51.478757 12017 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:51.474141  8257 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:17:51.463198 12120 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:51.488905  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.466189 11965 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.490393  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:51.498425  8106 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:51.501870  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:51.458220 12146 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:51.497900  8221 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:51.505864  8223 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:51.506176  8104 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 12. Ops: []
I20260709 13:17:51.468678 12067 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.483166 12246 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.490723 11904 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:51.466598 12074 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.462510 12065 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.472637 12081 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:51.516770  8003 catalog_manager.cc:5697] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 5 to 7, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 7 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:51.525846  8099 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:17:51.529582  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.531235 11952 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.532183 11410 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:51.532842 11410 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.533686 11975 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:51.529393  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:51.535961  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1527) took 1796 ms. Trace:
I20260709 13:17:51.536211  8784 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:51.539415 11993 raft_consensus.cc:3055] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:51.539969 11993 raft_consensus.cc:740] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:51.542376  8102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2354) took 3115 ms (client timeout 2754 ms). Trace:
W20260709 13:17:51.542963  8102 rpcz_store.cc:269] 0709 13:17:48.427376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.446909 (+ 19533us) service_pool.cc:224] Handling call
0709 13:17:51.542027 (+3095118us) spinlock_profiling.cc:243] Waited 2.84 s on lock 0x7b54002a3854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:51.542256 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6529217920}
I20260709 13:17:51.554513 12146 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:51.558480 12049 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.562860 12067 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.520066 12007 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:51.563758 12007 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.564139 12007 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.516038 12017 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:51.573575  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.574659  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 77108.1us
I20260709 13:17:51.575730  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:51.576864 12090 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:51.577365 12090 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.536491  8175 rpcz_store.cc:276] 0709 13:17:49.739661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.712611 (+972950us) service_pool.cc:224] Handling call
0709 13:17:50.713121 (+   510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.961344 (+248223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.535675 (+574331us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400101154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:51.535885 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549556992}
W20260709 13:17:51.579038  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 202722us
I20260709 13:17:51.580085  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.585745  8178 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:17:51.586441  8107 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:51.584843  8248 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
W20260709 13:17:51.523850 11924 consensus_meta.cc:287] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.003s
I20260709 13:17:51.517570 11904 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.584197 12090 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:51.511243 12145 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:51.597246  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 122591us
I20260709 13:17:51.541138 11993 consensus_queue.cc:260] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.606491  8248 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:51.593082 11904 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:51.607231  8003 catalog_manager.cc:5697] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 6, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 6 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.616019  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.616686  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:51.618572  8251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2354) took 1458 ms (client timeout 1771 ms). Trace:
W20260709 13:17:51.619387  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.618989  8251 rpcz_store.cc:269] 0709 13:17:50.155475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.156424 (+   949us) service_pool.cc:224] Handling call
0709 13:17:51.611032 (+1454608us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b5400268c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:51.614034 (+  3002us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945044736}
I20260709 13:17:51.622761  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.623919  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.624809  8256 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
W20260709 13:17:51.614758  8149 connection.cc:256] RPC call timeout handler was delayed by -1.0875702390001152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260709 13:17:51.627424  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:51.629834  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.628024  8252 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
W20260709 13:17:51.640841  8100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1520) took 1863 ms (client timeout 2072 ms). Trace:
W20260709 13:17:51.641281  8100 rpcz_store.cc:269] 0709 13:17:49.777563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.777764 (+   201us) service_pool.cc:224] Handling call
0709 13:17:51.633825 (+1856061us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001685d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:51.640750 (+  6925us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2632100608}
I20260709 13:17:51.639511  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:51.642897  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.643477  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:51.644053  8251 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:51.648919  8223 leader_election.cc:400] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9.
I20260709 13:17:51.649461  8223 leader_election.cc:403] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:51.650251 11993 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:51.663740  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:51.650647 12066 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.651398 12185 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.665014  8072 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:17:51.673976  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 58732.9us
I20260709 13:17:51.674139  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.677213 12007 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:51.678921 11410 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.679355 12007 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:51.680068 12145 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.680727 12145 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:51.671552 12074 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:51.680877 11410 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.680948  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2361) took 1480 ms. Trace:
I20260709 13:17:51.681514  8255 rpcz_store.cc:276] 0709 13:17:50.200977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.201162 (+   185us) service_pool.cc:224] Handling call
0709 13:17:51.680760 (+1479598us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54002ae9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:51.680891 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1884928768}
I20260709 13:17:51.682287 12146 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:51.682869 12146 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.683343 12146 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.675165  8257 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
W20260709 13:17:51.680011  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 84202.8us
I20260709 13:17:51.675311  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:51.697755  8788 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:51.703342  8254 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:51.700765  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:51.673614 11975 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:51.715413  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:51.705022 12066 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.717207 12066 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.718420  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:51.719260 12029 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:51.719383  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:51.720075 12029 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:51.720551 12029 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.720938 12029 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.721413  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:51.721596 12067 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:51.724545 12054 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:51.724975 12054 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.725358 12054 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.725652 11975 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.719523 12066 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.720849  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:51.714864 12074 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:51.728376  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1530) took 1988 ms. Trace:
I20260709 13:17:51.732139  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:51.732266  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:51.739298  8251 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:51.715083 12051 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.734160 12074 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:51.748075  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:51.749606  8175 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:51.734261  8174 rpcz_store.cc:276] 0709 13:17:49.740462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.815428 (+1074966us) service_pool.cc:224] Handling call
0709 13:17:50.831967 (+ 16539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.836882 (+  4915us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:50.837575 (+   693us) log.cc:844] Serialized 14 byte log entry
0709 13:17:51.527830 (+690255us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b18003ea5e0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec23a 00007fa5a0e56a2a
0709 13:17:51.712447 (+184617us) log.cc:844] Serialized 14 byte log entry
0709 13:17:51.728057 (+ 15610us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:51.728112 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:51.728162 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.728224 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.728322 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15291,"prepare.queue_time_us":61139,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":25352,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":9712000,"thread_start_us":179903,"threads_started":2,"wal-append.queue_time_us":863397}
I20260709 13:17:51.751214  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:51.740207 12143 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:51.752650  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:51.746279 11975 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:51.751385  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:51.741714 12051 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.754357  8182 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:51.755106  8179 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:17:51.755452 12051 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:51.756505  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 70215.3us
I20260709 13:17:51.704375 12145 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.756852  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:51.744434 12074 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:51.762234  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2469) took 2127 ms. Trace:
I20260709 13:17:51.751847 12049 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:51.745702 12185 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:51.764093  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:51.760772 12120 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:51.771515  8782 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:51.763803 12149 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:17:51.788175  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:51.763233  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:51.775815  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55093.7us
I20260709 13:17:51.760308 12017 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:51.784610 12049 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:51.818351  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55200.3us
I20260709 13:17:51.826985 12054 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:51.827701 12049 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:51.807035 12145 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.809672 11780 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:51.817951 12148 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:51.806391 12149 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:51.768322  8250 rpcz_store.cc:276] 0709 13:17:49.634255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.636913 (+  2658us) service_pool.cc:224] Handling call
0709 13:17:49.653559 (+ 16646us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:49.933531 (+279972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.933564 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:49.971198 (+ 37634us) log.cc:844] Serialized 26 byte log entry
0709 13:17:50.479926 (+508728us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:50.480076 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.761616 (+1281540us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54000898d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:51.761657 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:51.761797 (+   140us) raft_consensus.cc:1685] finished
0709 13:17:51.761812 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.762044 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35340,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":9563,"spinlock_wait_cycles":642935552,"thread_start_us":416223,"threads_started":1,"wal-append.queue_time_us":375220,"wal-append.run_cpu_time_us":2558,"wal-append.run_wall_time_us":1041529}
I20260709 13:17:51.826355 12238 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:51.826447  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 69769.6us
I20260709 13:17:51.806813 12029 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:51.811348 12120 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.773363 12246 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.833604  8181 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:51.849988  8249 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:51.844133  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:51.845734  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:51.852468  8174 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:51.847824 12029 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.829615 12090 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.835197 12181 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.860827 12181 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.861794 12090 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:51.830243 11780 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:51.863180 12181 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.863334 11924 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9.
I20260709 13:17:51.863909 11780 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.837592 12007 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.845057 12120 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:17:51.866144 12007 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.866688 12066 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:51.844681 12238 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:17:51.868268 12007 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:51.868770 11780 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:51.829365  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:51.870604  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:51.838475  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 47846.5us
I20260709 13:17:51.847783 12246 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:51.891597  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 148576us
W20260709 13:17:51.890686  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 132472us
I20260709 13:17:51.845877 12149 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:51.829375 12054 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.902212 12051 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:51.902326 11691 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:17:51.902961 12051 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:51.903921 12051 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.881141 12181 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:51.812175 11904 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:51.851401 12146 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:51.837325 12049 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:51.932214  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 114919us
I20260709 13:17:51.915899 12181 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:17:51.945959  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 75501.6us
I20260709 13:17:51.945683 12149 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:51.947124  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:51.950475  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:51.951270 12150 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:51.952018 12150 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:51.952378 12150 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.952757 12150 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:51.931865 12067 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:51.942631 12181 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:51.942800 12148 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:51.991236  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 57748us
I20260709 13:17:51.997038  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:51.998231  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:51.999576 12261 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:52.000125 12261 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:52.000476 12261 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.999282  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:52.006839 12185 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:52.007303 12185 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.007685 12185 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.013980 12261 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:51.978718 12074 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:52.019857  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:52.021066 12024 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:51.954617 12259 consensus_queue.cc:1059] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:17:52.023247  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:52.024236  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:52.035498 12264 log.cc:927] Time spent T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:17:52.037366 12065 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:52.039903  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:52.049448  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.024278 12185 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.057926 11904 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:52.058889 12146 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:52.059751 12049 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:52.060240  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.076700 12145 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:52.077275  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:52.079103  8183 raft_consensus.cc:2368] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9.
W20260709 13:17:52.074020  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 80663.1us
I20260709 13:17:52.099776 12185 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:52.102083 12074 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:52.102844 12081 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:52.111696 11975 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:52.112319 11975 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:52.076176 12246 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:52.113749 12246 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.115151  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:52.115886 12246 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:52.119176  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:52.102917  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 68952.8us
I20260709 13:17:52.066183 12181 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:52.057291 12150 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:52.124608  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 103420us
I20260709 13:17:52.126679  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:52.127210  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:52.132023  8784 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:17:52.137470  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.116408 12145 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:17:52.138258  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 128042us
I20260709 13:17:52.143290  8182 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:52.124246 12194 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:52.143661  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:52.130112 12024 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:17:52.152091  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:52.144846 12145 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:52.144393 12054 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:52.113412 11975 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:52.183203  8221 leader_election.cc:336] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.506s (SENT)
I20260709 13:17:52.183799  8221 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:52.147888 12238 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.153610 12049 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:52.154482 12246 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:52.156152 11942 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:52.154630 12207 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:52.232529  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:52.232542  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:52.236832  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 554) took 1353 ms. Trace:
I20260709 13:17:52.228379 11942 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.239132  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:52.239353  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:52.237324  8099 rpcz_store.cc:276] 0709 13:17:50.878952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.904890 (+ 25938us) service_pool.cc:224] Handling call
0709 13:17:50.931958 (+ 27068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:51.526411 (+594453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.209234 (+682823us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b54000f4954. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:52.229275 (+ 20041us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1348687744}
I20260709 13:17:52.249131  8786 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:52.239984  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:52.249519  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:52.254796  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:52.255481  8788 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:52.256632 12074 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.259441  8223 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:52.232110 12272 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:52.260617  8791 raft_consensus.cc:2368] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12.
I20260709 13:17:52.270788  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:52.271121  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 502) took 2046 ms. Trace:
I20260709 13:17:52.271692  8254 rpcz_store.cc:276] 0709 13:17:50.219739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.667136 (+447397us) service_pool.cc:224] Handling call
0709 13:17:51.686424 (+1019288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.703744 (+ 17320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.265697 (+561953us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54002ae9d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:52.265897 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919331200}
I20260709 13:17:52.266460 11965 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:52.267139 12268 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:17:52.277611  8788 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:52.278301 11965 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:52.278756 11965 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:52.279747 12054 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:52.280185 12054 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:52.281754  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 106190us
I20260709 13:17:52.282684 12007 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:52.283156 12007 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.257246 12074 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.267645 11904 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:52.292446 12007 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:52.240476 12246 raft_consensus.cc:697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:52.273051  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:52.295320  8790 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:52.240351 12207 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:52.295492 12246 consensus_queue.cc:237] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:52.296574 12207 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.248910 12149 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:17:52.275017 12090 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:52.293720 11942 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:52.301642  8101 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:52.257418 12259 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:17:52.254601  8175 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:52.185459 12181 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:52.315980  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:52.276460 11975 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:52.320319  8790 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:52.321339  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 82280.5us
W20260709 13:17:52.209239  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 82680.7us
I20260709 13:17:52.324447  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:52.325477  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:52.326330 12079 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:52.207958 12271 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:52.248975 12238 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:52.328931  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:52.312795 12261 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:52.332449  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:52.335299  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.335995  8178 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:52.336794  8101 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:52.333866  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:52.331749  8791 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:52.339038  8175 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:52.339949  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:52.340198  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:52.343283  8784 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:17:52.345273  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:52.343591  8784 pending_rounds.cc:85] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 6
I20260709 13:17:52.346374 12067 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:52.354358 12067 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:52.354883 12067 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:52.355523  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.356379  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.322966 11942 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:17:52.357707  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.358116  8102 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:52.358629  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.359774  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.360227 12074 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:52.341156 12246 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:52.361200 12246 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.361708  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.346745 12066 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:52.352777 12238 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:52.346071  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:52.307929 12272 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.337332 12150 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:52.371443  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 47911.7us
I20260709 13:17:52.340615 12271 raft_consensus.cc:697] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 10 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:52.372948  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:52.376104  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51767.2us
I20260709 13:17:52.380985  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:52.378298  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:52.376204  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:52.388932  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.389456 11965 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:52.390318 12054 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.391769 11965 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:52.392460 12054 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:52.344146 12049 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:52.389272  8783 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:17:52.361632 12246 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:52.401674  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.401822  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.402597  8251 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:52.403440  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:52.378129 12149 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:52.404523 12149 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.404882 12149 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:52.405921  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.368712  8784 pending_rounds.cc:107] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:17:52.407440  8784 raft_consensus.cc:2889] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:52.396595  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:52.409343  8105 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:52.382917  8183 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:17:52.409797 12272 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:52.398464  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.410800  8254 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:52.393406 12238 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:52.412065 12238 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:52.412485 12145 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.399773  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.451153  8252 raft_consensus.cc:2410] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:52.452108  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.452422 12145 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:52.453249  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.453912  8252 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:52.453816 12271 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.400367  8249 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:52.400490  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.401167  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.369144 12066 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.413267 12238 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:52.398877  8256 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:17:52.414983  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:52.428126  8175 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:17:52.428824  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.429311  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:52.429843  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:52.430260 12049 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:52.434080 12146 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:52.434859  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:52.435542  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.435796  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:52.436726  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:52.439172  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:52.439985  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:52.477836  8255 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:52.441490 12148 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:52.442605  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 61728us
I20260709 13:17:52.445729 12277 consensus_queue.cc:1059] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:52.473726  8175 pending_rounds.cc:85] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 9
I20260709 13:17:52.480310  8175 pending_rounds.cc:107] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:17:52.481709  8257 raft_consensus.cc:2368] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9.
I20260709 13:17:52.449932  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:52.445636  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 48064.2us
I20260709 13:17:52.470309  8250 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:52.470734  8248 raft_consensus.cc:2410] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 14 because replica has last-logged OpId of term: 12 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 3.
I20260709 13:17:52.476333  8783 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:52.473205  8256 pending_rounds.cc:85] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 6
I20260709 13:17:52.484047  8147 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:52.484432  8256 pending_rounds.cc:107] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:17:52.484962  8256 raft_consensus.cc:2889] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:52.479442  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:52.486186  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.487038  8107 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:52.487397  8784 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:52.487905  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:52.488867  8103 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 12: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:52.480589  8175 raft_consensus.cc:2889] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:52.489456  8175 pending_rounds.cc:107] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:17:52.489813  8175 raft_consensus.cc:2889] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:52.493690  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 54618.1us
I20260709 13:17:52.496773  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:52.497190  8102 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 11: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:52.486461  8182 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:52.497469  8179 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:52.499456  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.499703  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:52.499456  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:52.501816  8251 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:52.506188  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.500084  8257 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:52.513790  8072 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:52.473887 12066 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:52.518119  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:52.520114  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:52.522478  8108 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.522732  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:52.455992 12246 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.524971  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:52.518759  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:52.527467  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 43494.7us
I20260709 13:17:52.528573  8248 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:52.530005  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:52.519553  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.531590  8250 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:52.525565  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:52.479862 12148 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.533473  8180 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:52.538470  8103 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:52.539642  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:52.542347  8183 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:17:52.544132  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 108399us
I20260709 13:17:52.545634  8072 leader_election.cc:400] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12.
I20260709 13:17:52.545184  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:52.546147  8072 leader_election.cc:403] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:52.497388 12054 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:52.548827  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:52.550627  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.552219  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:52.552767  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:52.553704  8788 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:52.554000  8782 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:52.515422 11975 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:52.558084  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:52.556238  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:52.560237  8255 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:17:52.560642  8782 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:52.562814  8784 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:17:52.570240  8104 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 12. Ops: []
I20260709 13:17:52.577984  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:52.582875  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:52.583137  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:52.538455 12148 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:52.590324  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 48544us
I20260709 13:17:52.591353  8072 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:52.543916 12065 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:52.547303 12024 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:52.593930  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:52.594313  8787 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:52.594657  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:52.594710  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:52.600095  8255 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:52.595867  8183 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:52.596284  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:52.544422 12279 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:52.596284  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 117563us
I20260709 13:17:52.596730  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:52.514993 12207 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:17:52.598243  8072 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:52.551553 12261 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:52.599407  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:52.679745 12261 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:52.669603  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:52.668597  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.680161 12261 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:52.564688 12017 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.680795 12017 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.682884 12017 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:52.683403 12017 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:52.561195 11975 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:52.684316 11975 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:52.677675  8789 raft_consensus.cc:2368] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9.
I20260709 13:17:52.582876 12145 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:52.688089 12145 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:52.688476 12145 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:52.689087  8182 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:52.678292  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.677686  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:52.696493  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 98333.9us
I20260709 13:17:52.699304  8256 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:52.698417  8182 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:52.699731  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:52.599036 12024 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.565951 12054 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.700991 12146 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:52.678097 11942 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:52.604259 12279 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:52.603092 12185 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 13:17:52.675940 12247 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:52.714080  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:52.757776  8252 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.758823 12065 consensus_queue.cc:1059] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:17:52.722438  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.735675  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.679095 11993 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:17:52.732836  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.762800  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.746573  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.747081  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:52.763953  8255 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:52.764910  8107 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:52.712056 12024 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:52.748142  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:52.763504  8106 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:52.754041 12295 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:52.785761  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:52.677812 12067 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.786827  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.787590  8252 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:17:52.787864  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:52.754316  8786 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:52.700220 12291 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12.
I20260709 13:17:52.748270 12207 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:52.778903  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.687803 12261 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.781219  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:52.782641  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.750000 12145 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:52.779971 12283 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:17:52.871445  8248 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 7.
I20260709 13:17:52.717259 11780 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:52.788722  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.792835  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.879447  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.718088 11942 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:52.880321  8106 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:52.821753  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:52.836213  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 166044us
I20260709 13:17:52.726150 12279 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:52.795022  8250 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:52.794282  8253 raft_consensus.cc:2410] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:17:52.717841 12074 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:17:52.793807  8175 raft_consensus.cc:2410] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:52.859416  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.854350  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:52.874171  8101 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:17:52.876936  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 80541.7us
I20260709 13:17:52.888393  8105 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:52.890059  8221 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:52.892009  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:52.892891  8256 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:52.893721 12079 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:52.900192  8221 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:52.871937 12247 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:52.901615  8103 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:52.903630  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:52.904592  8104 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:52.897374  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:52.895999  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:52.907089  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.857658 12207 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:52.913754  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:52.901392 12247 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:52.922591  8107 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:52.938203  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:52.887593 12150 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:52.937848  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:52.941706  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:52.950887  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:52.914937 11780 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:52.951503  8099 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:52.960525 12289 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.198s	user 0.001s	sys 0.003s
W20260709 13:17:52.961956 12288 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:17:52.973207  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:52.974313  8253 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:17:52.929224 12246 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:52.976114  8183 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:52.898317 12051 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:17:53.021190  8253 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:52.915517 12146 raft_consensus.cc:697] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:53.023069 12146 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:52.984934  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:53.025579  8248 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:52.993474  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:53.028482  8786 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:52.995760  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 118065us
I20260709 13:17:52.998871  8104 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:17:52.990979 12291 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.015743  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:52.953217 12150 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:53.029762  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 129660us
I20260709 13:17:53.032301  8175 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:53.029659  8104 pending_rounds.cc:85] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 5
I20260709 13:17:53.039449  8104 pending_rounds.cc:107] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:17:53.039865  8104 raft_consensus.cc:2889] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:53.042876  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 343968us
I20260709 13:17:53.012027 12079 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:52.677325 12273 consensus_queue.cc:1059] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.365s
I20260709 13:17:52.951224 11942 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.066431 12067 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:53.066313 12304 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:17:53.068647 12308 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.069802  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:53.002614 12247 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.070401  8106 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:17:53.070662 12247 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:53.071269  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:53.071925  8106 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 7: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:53.072095 12145 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:53.072665  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:53.073032 12261 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:52.820029 12295 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.074537 11942 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:53.075098 12295 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:53.074926 12148 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.076417 11975 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.005288 12207 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.038054 12054 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:53.088581  8108 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.000s
I20260709 13:17:53.014075 12066 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:53.118247  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 81991.3us
I20260709 13:17:53.119948  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:53.127550  8108 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:17:53.129150 12296 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:53.042719 12291 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.132648 12291 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:53.069240 12308 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.140316 12259 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:53.064779 11965 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:53.144055  8179 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 14: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:53.145789  8100 raft_consensus.cc:2393] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:17:53.148372  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 69885.8us
I20260709 13:17:53.149477  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:53.154313  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:53.155615  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:53.145182 12066 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:53.181951  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.188573  8104 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:17:53.189013  8099 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:53.190027  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:53.194621  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.198498 12305 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:17:53.198840 11975 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:53.087628 11780 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.211795  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:53.213126  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 57569.6us
I20260709 13:17:53.215482  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:53.209040 12149 consensus_meta.cc:287] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.804s	user 0.012s	sys 0.000s
I20260709 13:17:53.216446 12311 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:17:53.214745 12316 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:53.223345 12079 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:53.225123  8102 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:53.232939  8108 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:53.234164  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:53.187000 12024 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.179436 11965 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.238814  8108 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:53.232724 12316 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:53.239848 12316 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.235086 12079 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.240545 12079 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:53.233259 12149 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.247004  8178 raft_consensus.cc:2393] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:53.238471 12049 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:53.263131  8783 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:53.263367  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:53.264534  8074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.009s	sys 0.034s
W20260709 13:17:53.264851  8074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.009s	sys 0.034s
W20260709 13:17:53.265353  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 720294us
I20260709 13:17:53.266033  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:53.267050 12051 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:53.269184 12272 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:53.269641 12272 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:53.269517 12291 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:53.269984 11993 raft_consensus.cc:3055] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:53.270380  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.271083  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:53.273098  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:53.271936  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:53.277765 12017 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:17:53.278133  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 64272.8us
I20260709 13:17:53.279104 12146 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:53.279284  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:53.279846  8785 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:53.280910  8074 leader_election.cc:400] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9.
I20260709 13:17:53.281302  8074 leader_election.cc:403] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:53.282011  8221 leader_election.cc:400] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 8. Current term is 9.
I20260709 13:17:53.286891  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:53.292234  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:53.298686  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:53.320223  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 47145.6us
I20260709 13:17:53.321514  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:53.328610  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 53610.1us
I20260709 13:17:53.328418  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:53.329671  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:53.331736  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:53.333739  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 59478.1us
I20260709 13:17:53.328372  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:53.264863 12149 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:53.338963  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:53.341982  8257 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:53.346072  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.347537  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:53.354681  8251 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:53.335949  8180 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:17:53.347422  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:53.347908  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:53.349045  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:53.355948  8250 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:53.349690  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:53.349740  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:53.273840 12074 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.327787 12017 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:53.270413 11993 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:53.351029  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:53.364434  8183 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:53.356679  8248 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:53.357228  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:53.364756  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:53.365860  8074 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:53.367779  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:53.368552  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:53.353372 12273 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:53.286249 11975 consensus_queue.cc:1059] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:17:53.372287  8180 raft_consensus.cc:2410] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 13 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:53.379280  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:53.373224  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:53.374194  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45877.2us
I20260709 13:17:53.360694 12054 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:53.388484  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:53.388688  8074 leader_election.cc:400] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9.
I20260709 13:17:53.389052  8174 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:53.389732  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:53.351964 11942 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:17:53.364374 12120 raft_consensus.cc:3055] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:53.391987  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:53.392164  8103 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:53.330732 12051 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:17:53.372725 12291 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:53.393481  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:53.364341 12311 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:53.414287  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:53.415647  8180 raft_consensus.cc:2410] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 14 because replica has last-logged OpId of term: 12 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 3.
I20260709 13:17:53.407024  8181 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:53.369839 12304 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:53.382071 12029 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:53.380450 12246 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:53.411648  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:53.430418  8177 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:53.431778  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 72198.1us
I20260709 13:17:53.432900  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:53.424909  8251 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:17:53.414388  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:53.388196 12017 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:53.392616 12145 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:53.430282  8106 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:17:53.439776  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:53.400408 12067 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:53.369979 12074 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:53.406457 12120 raft_consensus.cc:740] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:53.383637 12295 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:17:53.443603  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:53.532194  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 105428us
W20260709 13:17:53.524210  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 84547us
W20260709 13:17:53.532598  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 89094.2us
I20260709 13:17:53.441385 12054 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:53.477890 12067 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:53.533519  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 167028us
I20260709 13:17:53.441483 12017 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:53.429188 12304 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:53.438243 12246 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.475257 11975 raft_consensus.cc:3055] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:53.574822 12185 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:53.574987  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:53.575529 12293 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.575994 12321 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.169s
I20260709 13:17:53.576709 12327 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.150s
I20260709 13:17:53.573223  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:53.578358  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:53.441190 12029 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.444139 12146 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 13:17:53.607152  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:53.577088 12301 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:53.578050 12067 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:53.579134 12309 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.511s	user 0.003s	sys 0.001s
W20260709 13:17:53.603842 12332 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:17:53.578195 12312 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9.
I20260709 13:17:53.616484  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:53.629916  8174 raft_consensus.cc:2410] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:53.630188  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:53.579596 12149 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:53.578191 12017 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:53.621618 12051 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:53.623855 12079 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:53.578807 12024 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:53.630769  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:53.632030  8785 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:17:53.436942 11993 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.580353 12246 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:53.633312  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:53.644538  8181 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:53.645574  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:53.646744  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:53.648290  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:53.648722 11993 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:53.649495  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:53.650259  8181 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:53.651383  8181 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:17:53.651688  8181 pending_rounds.cc:85] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 5
I20260709 13:17:53.651911  8181 pending_rounds.cc:107] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:17:53.652161  8181 raft_consensus.cc:2889] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:53.653789  8174 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
W20260709 13:17:53.654435 12328 log.cc:927] Time spent T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:17:53.654870  8174 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:53.655952 12330 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:17:53.635927 12149 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.657693 12149 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:53.608306 12300 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:53.659297 12300 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:53.659744 12300 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:53.661087 12318 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
W20260709 13:17:53.662273  8100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1531) took 1307 ms (client timeout 1638 ms). Trace:
W20260709 13:17:53.662778  8100 rpcz_store.cc:269] 0709 13:17:52.354754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.357448 (+  2694us) service_pool.cc:224] Handling call
0709 13:17:53.662052 (+1304604us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b540040b5d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:53.662204 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1810614016}
I20260709 13:17:53.617159 12334 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:53.605823 11975 raft_consensus.cc:740] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:53.604164 12326 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:53.611801 12247 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.612761 12307 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:53.654498 12051 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:53.658895 12323 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:17:53.691076 12337 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:17:53.694928 11993 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.693121 12246 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:53.639742 12279 consensus_meta.cc:287] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.738s	user 0.010s	sys 0.000s
I20260709 13:17:53.732589 12247 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.742810 12279 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.746335 12279 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:53.747473 11993 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:53.750393 12079 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:53.750752 11993 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:53.751322 12079 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.751497 11993 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.580227 12304 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:53.751825 11975 consensus_queue.cc:260] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.753260 11975 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:53.753814 12246 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:53.752038 11993 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:53.756412 11993 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:53.759011 12074 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:53.762480 12247 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:53.770913 12029 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:53.777243 12299 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.713s	user 0.002s	sys 0.000s
I20260709 13:17:53.778084 12333 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.778764 12333 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.613773 12293 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:53.720616 12207 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:53.786391 12150 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:53.790350 12336 log.cc:927] Time spent T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:17:53.790989 12051 raft_consensus.cc:697] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:53.792088 12051 consensus_queue.cc:237] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:53.731036 12309 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:17:53.801555 12337 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:53.802032 12337 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:53.639545 12329 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:53.803074 12337 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:53.803962 12329 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:53.804468 12337 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:53.805131 12329 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:53.639959 12301 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:54.554342 12301 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:53.722486 12326 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:54.598675 12326 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:53.703157 12334 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:53.960026 12300 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.608467 12300 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:53.633826 12120 consensus_queue.cc:260] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:54.018800 12310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.006s	sys 0.000s
W20260709 13:17:54.609603 12310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.273s	user 0.007s	sys 0.000s
I20260709 13:17:54.609694 12120 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:54.610767  8146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.393s	user 0.023s	sys 0.015s
W20260709 13:17:54.611083  8146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.394s	user 0.023s	sys 0.015s
I20260709 13:17:54.612257 11691 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.612706 11691 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:54.026163  8104 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.007s	sys 0.023s
W20260709 13:17:54.613651  8104 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.375s	user 0.008s	sys 0.023s
I20260709 13:17:54.614907 11691 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:54.029098 12304 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.616431  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:54.617017 12304 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:54.618253  8183 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:17:54.051548  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2385) took 1650 ms. Trace:
I20260709 13:17:54.624094 12312 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:54.624652 12312 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:54.626400 12308 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:54.626690 12312 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:54.062381  8250 consensus_meta.cc:287] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.706s	user 0.005s	sys 0.009s
I20260709 13:17:54.627426  8250 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:54.627887  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2397) took 1280 ms. Trace:
I20260709 13:17:54.628170  8250 rpcz_store.cc:276] 0709 13:17:53.347465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.347677 (+   212us) service_pool.cc:224] Handling call
0709 13:17:54.627822 (+1280145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:53.807199 12333 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:54.106354  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 522) took 1593 ms. Trace:
I20260709 13:17:54.629349  8179 rpcz_store.cc:276] 0709 13:17:52.513031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.517785 (+  4754us) service_pool.cc:224] Handling call
0709 13:17:54.106047 (+1588262us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54002f9754. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:54.106264 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1429055744}
I20260709 13:17:53.796554 12307 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:54.624085  8254 rpcz_store.cc:276] 0709 13:17:52.433562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.433767 (+   205us) service_pool.cc:224] Handling call
0709 13:17:52.434228 (+   461us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:52.434727 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.434768 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:52.444333 (+  9565us) log.cc:844] Serialized 52 byte log entry
0709 13:17:52.532669 (+ 88336us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:52.959879 (+427210us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:53.067947 (+108068us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b18002c98c0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa5a09f44bc 00007fa59dd4248b 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5c455 00007fa5a48443c7 00007fa5a0e569a7 00007fa5a0e660bf
0709 13:17:53.068112 (+   165us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.051036 (+982924us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b54003780a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0dc7733 00007fa5a0e4cdbf 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c
0709 13:17:54.051116 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.051220 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:54.051278 (+    58us) raft_consensus.cc:1685] finished
0709 13:17:54.051289 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.051477 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36869,"prepare.queue_time_us":369181,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":17662,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":172,"spinlock_wait_cycles":83016576,"thread_start_us":393923,"threads_started":2,"wal-append.queue_time_us":223709,"wal-append.run_cpu_time_us":12297,"wal-append.run_wall_time_us":1861179}
I20260709 13:17:54.632315 12307 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:54.633052  8107 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 572) took 2066 ms (client timeout 2200 ms). Trace:
W20260709 13:17:54.633508  8107 rpcz_store.cc:269] 0709 13:17:52.567057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.567199 (+   142us) service_pool.cc:224] Handling call
0709 13:17:54.632874 (+2065675us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54000f4e54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:54.632987 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376700672}
W20260709 13:17:54.143960 12049 consensus_meta.cc:287] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.859s	user 0.007s	sys 0.006s
I20260709 13:17:54.634660 12049 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:54.156395  8755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.011s	sys 0.019s
W20260709 13:17:54.635428  8755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.012s	sys 0.020s
W20260709 13:17:54.635542  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:54.157977  8223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.008s	sys 0.019s
W20260709 13:17:54.636050  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 1.06108e+06us
W20260709 13:17:54.636408  8223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.008s	sys 0.019s
I20260709 13:17:54.636852  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:54.637121  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:54.637636 12029 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:54.637825  8175 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:54.638381 11993 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:54.640107  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:54.167627 12272 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.176692 12278 raft_consensus.cc:3055] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:54.641535  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:54.641789 12278 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:54.641919 12272 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:54.642364 11993 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:54.642891 12307 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:54.642729 12278 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:54.643278 12307 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.643646 12307 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:54.643919 12278 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:54.181089  8178 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1535) took 1337 ms (client timeout 1684 ms). Trace:
I20260709 13:17:54.191841 12271 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:54.645272  8178 rpcz_store.cc:269] 0709 13:17:52.366061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.371656 (+  5595us) service_pool.cc:224] Handling call
0709 13:17:53.702700 (+1331044us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b5400003054. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:53.702904 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1777806208}
I20260709 13:17:54.645514 12271 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:54.642727 11993 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:54.646795 11993 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:54.647864 12271 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:54.224349  8181 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:54.649501  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2396) took 1276 ms. Trace:
I20260709 13:17:54.649816  8181 rpcz_store.cc:276] 0709 13:17:53.373405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.652937 (+279532us) service_pool.cc:224] Handling call
0709 13:17:53.653205 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.648457 (+995252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.649247 (+   790us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b5400248bd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:54.649446 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312999808}
I20260709 13:17:54.261641 12054 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:54.651223 12054 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:54.653151 12054 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:54.266857  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.274181 11780 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:54.654421 11780 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:54.655309 11780 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.656534 11780 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:54.657159 12351 log.cc:927] Time spent T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.155s	user 0.002s	sys 0.001s
W20260709 13:17:54.304412 12067 consensus_meta.cc:287] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.008s
W20260709 13:17:54.307638 12017 consensus_meta.cc:287] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.652s	user 0.012s	sys 0.000s
I20260709 13:17:54.658427 12067 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.658856 12017 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:54.660483 12067 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:54.660717 12017 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:54.307962  8222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.006s	sys 0.017s
W20260709 13:17:54.661381  8222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.007s	sys 0.017s
I20260709 13:17:54.328395 12293 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:54.662052  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.751901 12079 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.663936 12079 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:54.352327  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 720509us
W20260709 13:17:54.352717 12303 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.283s	user 0.015s	sys 0.018s
W20260709 13:17:54.664597 12303 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.595s	user 0.015s	sys 0.018s
W20260709 13:17:54.356781 11975 consensus_meta.cc:287] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.012s
W20260709 13:17:54.365283 12316 consensus_meta.cc:287] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.125s	user 0.005s	sys 0.008s
I20260709 13:17:54.666142 12316 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.668308 12316 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:54.353133  8176 consensus_meta.cc:287] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.972s	user 0.020s	sys 0.000s
I20260709 13:17:54.668964  8176 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 7.
I20260709 13:17:54.669481 12315 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:54.662019 11993 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.670218  8182 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:54.404217  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:54.671183  8784 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:54.671866 11993 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:17:54.673210  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.673383  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:54.411851  8787 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:54.675226  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:54.678113  8106 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:54.679461 12304 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:54.679982 12304 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.678758  7994 maintenance_manager.cc:643] P e5e50b3438e24144a9523cb9ae40543f: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 4.030s	user 0.174s	sys 0.040s Metrics: {"bytes_written":29949,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":7901,"dirs.run_cpu_time_us":389,"dirs.run_wall_time_us":8397,"drs_written":1,"lbm_read_time_us":487,"lbm_reads_lt_1ms":4,"lbm_write_time_us":19274,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":8196,"threads_started":1,"update_count":6}
I20260709 13:17:54.682020 12304 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:54.682668  7995 maintenance_manager.cc:419] P e5e50b3438e24144a9523cb9ae40543f: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9881 bytes on disk
I20260709 13:17:54.683054 12315 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.683670 12315 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:54.684489 12291 consensus_meta.cc:287] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.250s	user 0.012s	sys 0.001s
I20260709 13:17:54.684978 12291 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:54.682847 12271 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:17:54.685570  7994 maintenance_manager.cc:643] P e5e50b3438e24144a9523cb9ae40543f: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":424,"lbm_reads_lt_1ms":4}
I20260709 13:17:54.388945  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:54.379503  8149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.005s	sys 0.020s
W20260709 13:17:54.496912  8177 consensus_meta.cc:287] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.055s	user 0.005s	sys 0.010s
I20260709 13:17:54.686869 12271 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:54.686937  8177 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
W20260709 13:17:54.687672  8177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2398) took 1313 ms (client timeout 1611 ms). Trace:
I20260709 13:17:54.604899 12334 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:54.688002  8177 rpcz_store.cc:269] 0709 13:17:53.373859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.389077 (+ 15218us) service_pool.cc:224] Handling call
0709 13:17:54.687595 (+1298518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:54.389415  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:54.688634 12334 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:54.688957  8782 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
W20260709 13:17:54.490978  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.391251  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:54.531975  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.532975 12348 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.691182 12348 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:54.368129 11965 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:54.549712  8174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.003s	sys 0.017s
I20260709 13:17:54.554764  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 867) took 1291 ms. Trace:
I20260709 13:17:54.554821 12301 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:54.561967 12146 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:54.565996 12149 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.908s	user 0.016s	sys 0.000s
I20260709 13:17:54.542955  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:54.572535 12207 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.786s	user 0.011s	sys 0.002s
I20260709 13:17:54.588399  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2391) took 2151 ms. Trace:
I20260709 13:17:54.592279 12024 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.693382 12348 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:54.573355 12337 consensus_meta.cc:287] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.004s
I20260709 13:17:54.695763 12146 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.160811 12148 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:54.682699 12017 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:54.410256  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:54.697947 12146 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:54.694628  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:54.700766  8250 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:54.686786  8149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.006s	sys 0.028s
W20260709 13:17:54.701700  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 1.09457e+06us
I20260709 13:17:54.701637  8789 rpcz_store.cc:276] 0709 13:17:53.262905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.264341 (+  1436us) service_pool.cc:224] Handling call
0709 13:17:53.264663 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.265062 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:53.265097 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.273281 (+  8184us) log.cc:844] Serialized 26 byte log entry
0709 13:17:53.571230 (+297949us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:53.571297 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.571382 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:54.554496 (+983114us) raft_consensus.cc:1685] finished
0709 13:17:54.554525 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.554695 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4584,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":212996,"threads_started":1,"wal-append.queue_time_us":479778}
I20260709 13:17:54.703680 12149 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.704066  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:54.704854  8106 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:54.704931  8251 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:17:54.705312  8251 pending_rounds.cc:85] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 10
I20260709 13:17:54.705565  8251 pending_rounds.cc:107] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:17:54.705740 12149 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:54.707430  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:54.708168  8099 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:54.708799  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:54.709208  8100 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:54.709842  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:54.709976 12024 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:54.710489  8102 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:54.709362  8257 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:54.711714  8103 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:17:54.695230  8248 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:54.712106 12024 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:54.595935  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2383) took 1859 ms. Trace:
I20260709 13:17:54.712962  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:54.713125  8101 rpcz_store.cc:276] 0709 13:17:52.736442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.736579 (+   137us) service_pool.cc:224] Handling call
0709 13:17:52.741790 (+  5211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.888445 (+146655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.595649 (+1707204us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54000f4454. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:54.595875 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303402880}
I20260709 13:17:54.713847  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:54.694242  8254 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:54.714738  8257 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:54.714434 12024 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:54.669485  8176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1555) took 1331 ms (client timeout 1735 ms). Trace:
I20260709 13:17:54.705808  8251 raft_consensus.cc:2889] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:54.709498  8249 rpcz_store.cc:276] 0709 13:17:52.437306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.456220 (+ 18914us) service_pool.cc:224] Handling call
0709 13:17:52.456511 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.456868 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:52.835744 (+378876us) log.cc:844] Serialized 14 byte log entry
0709 13:17:53.024038 (+188294us) log.cc:844] Serialized 14 byte log entry
0709 13:17:53.024176 (+   138us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.024615 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:17:53.024760 (+   145us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:53.024792 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.024855 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:53.576812 (+551957us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:54.588134 (+1011322us) raft_consensus.cc:1685] finished
0709 13:17:54.588160 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.588328 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23201,"prepare.queue_time_us":397830,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":65,"raft.queue_time_us":64183,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":5311,"spinlock_wait_cycles":118183168,"thread_start_us":469545,"threads_started":2,"wal-append.queue_time_us":177914}
I20260709 13:17:54.709779  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:54.713523  8248 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:54.713893  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:54.715420  8176 rpcz_store.cc:269] 0709 13:17:53.352712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.357874 (+  5162us) service_pool.cc:224] Handling call
0709 13:17:54.669410 (+1311536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:54.716686  8106 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 10: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:54.641166  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1553) took 1316 ms. Trace:
I20260709 13:17:54.717680  8175 rpcz_store.cc:276] 0709 13:17:53.325259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.325496 (+   237us) service_pool.cc:224] Handling call
0709 13:17:53.325933 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.638304 (+1312371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.640944 (+  2640us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003408d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:54.641104 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3016724224}
W20260709 13:17:54.721662  8174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.004s	sys 0.017s
I20260709 13:17:54.722607  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2402) took 1348 ms. Trace:
I20260709 13:17:54.723021  8174 rpcz_store.cc:276] 0709 13:17:53.374440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.655681 (+281241us) service_pool.cc:224] Handling call
0709 13:17:53.656035 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.656363 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.656388 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.656896 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:17:54.722193 (+1065297us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:54.722248 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.722338 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:54.722394 (+    56us) raft_consensus.cc:1685] finished
0709 13:17:54.722411 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.722546 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4191,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":136,"thread_start_us":1064872,"threads_started":1,"wal-append.queue_time_us":853893}
I20260709 13:17:54.713639  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1557) took 1353 ms. Trace:
I20260709 13:17:54.725651  8182 rpcz_store.cc:276] 0709 13:17:53.360186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.360358 (+   172us) service_pool.cc:224] Handling call
0709 13:17:53.390847 (+ 30489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.670659 (+1279812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.713416 (+ 42757us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400180954. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:54.713587 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2941913344}
I20260709 13:17:54.715338 12024 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.731532 12024 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:54.732219  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:54.732771  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:54.733855  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:54.733973  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:54.734587  8252 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:54.737910  8107 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:54.739368  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:54.742421  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:54.743178  8106 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:54.742596  8182 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:54.744801  8252 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:54.732818  8249 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:54.734269  8791 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:17:54.746899 12185 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.747354 12185 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:54.748392  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.748394  8790 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:54.748844  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 864) took 1486 ms. Trace:
I20260709 13:17:54.735814 12301 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:54.751407 12181 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:54.751847 12316 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.751942 12181 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.752544 12185 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:54.752394 12316 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:54.754309 12181 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:54.755453  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:54.756172  8174 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:54.761929  8788 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:54.762425  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 120983us
I20260709 13:17:54.763151  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:54.764227  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:54.765131 12301 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:54.767169 12024 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:54.769799  8174 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:54.770689  8249 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:54.771595  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:54.780349  8175 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:54.773684  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:54.749266  8791 rpcz_store.cc:276] 0709 13:17:53.262079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.262251 (+   172us) service_pool.cc:224] Handling call
0709 13:17:54.748681 (+1486430us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54004cf9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:54.748788 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3244125056}
I20260709 13:17:54.781138  8100 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:54.777989  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:54.779285  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:54.765491  8182 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:54.780402  8103 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:54.772819  8102 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:54.786991 12316 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:54.796065  8102 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:54.797281 12278 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.779675 12024 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:54.798028 11993 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:54.798417  8223 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:54.798710 12348 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:54.799926  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:54.902460  8103 raft_consensus.cc:2368] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11.
I20260709 13:17:54.801705  8174 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:54.802228  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:54.804373  8248 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:54.806857  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:54.904269  8253 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:17:54.807368  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:54.808243  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08000f1c40 after lost signal to thread 7005
I20260709 13:17:54.904917  8175 raft_consensus.cc:2368] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11.
W20260709 13:17:54.905418  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08000f1d40 after lost signal to thread 8040
W20260709 13:17:54.906672  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5a00 after lost signal to thread 8132
W20260709 13:17:54.906949  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08001066c0 after lost signal to thread 8133
W20260709 13:17:54.907958  8278 debug-util.cc:398] Leaking SignalData structure 0x7b080013caa0 after lost signal to thread 8207
W20260709 13:17:54.908236  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08003c97a0 after lost signal to thread 8208
W20260709 13:17:54.909231  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08001573a0 after lost signal to thread 8281
W20260709 13:17:54.909515  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08003e3960 after lost signal to thread 8282
W20260709 13:17:54.910938  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08003a0640 after lost signal to thread 8823
W20260709 13:17:54.911288  8278 debug-util.cc:398] Leaking SignalData structure 0x7b0800246420 after lost signal to thread 8824
I20260709 13:17:54.808992  8250 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:54.796922  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:54.814028  8100 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
W20260709 13:17:54.912679  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 115863us
I20260709 13:17:54.816511  8254 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:54.817595  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:54.915045  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:54.818763  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:54.916606  8177 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
W20260709 13:17:54.918040  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 119693us
I20260709 13:17:54.919392  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:54.819495  8252 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:17:54.921571  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.822207  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:54.833199  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:54.834394  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:54.923885  8179 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:54.835465  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:54.805171 12326 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.882274  8106 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:17:54.928398  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 121611us
I20260709 13:17:54.813207 12307 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.887880  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:54.888561  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:54.888742  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:54.889662  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:54.897548  8001 catalog_manager.cc:5697] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 8, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 8 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:54.939016  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:54.939703  8102 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:17:54.940073  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:54.940778  8790 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:54.901531 12024 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:54.927706  8278 debug-util.cc:398] Leaking SignalData structure 0x7b080028f020 after lost signal to thread 12007
I20260709 13:17:54.929085  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:54.949185  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:54.931157  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:54.949800  8177 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:54.950829  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:54.951272  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:54.951591  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:54.914460 11993 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:54.932283  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:54.942848  8249 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:17:54.926769  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:54.944829  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:54.944717  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:54.956907  8782 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:54.944669  8001 catalog_manager.cc:5697] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 7 to 12, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 12 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:54.946777  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1548) took 1763 ms. Trace:
I20260709 13:17:54.944346 12337 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:54.883504 12316 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.932132  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:54.952909  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:54.959128  8791 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:54.948530  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:54.954336  8251 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:54.928236 12049 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:54.956830  8783 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:54.961807  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:54.962692  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:17:54.953753  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08003db880 after lost signal to thread 12263
I20260709 13:17:54.962972  8147 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:54.964686 12310 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:54.965245 12054 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:54.965576 12149 consensus_queue.cc:1059] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:54.991722 11780 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:54.992085 12149 raft_consensus.cc:3055] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:54.992213 11780 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:54.992556 12149 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:54.992731 11780 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:54.958391 12185 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:54.993587  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:54.993944 12185 raft_consensus.cc:697] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 14 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:54.994911 12307 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:54.995105 12291 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:54.995564 12291 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:54.995793  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 69117.2us
I20260709 13:17:54.949803 12066 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:54.967099  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 132071us
I20260709 13:17:54.901701 12315 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.958019 11993 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:54.997120 12066 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:54.997241  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:54.997692 12066 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:54.998997 12181 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:54.947312 11975 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:17:54.973295 12024 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:54.975656  8001 catalog_manager.cc:5697] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 6 to 9, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 9 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:54.978066 12207 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:54.984880 12337 raft_consensus.cc:697] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:54.978330  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:54.978997 12343 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:54.981523 12326 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:54.981968 12293 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:17:54.963364  8278 debug-util.cc:398] Leaking SignalData structure 0x7b080037cba0 after lost signal to thread 12270
I20260709 13:17:54.957736  8104 rpcz_store.cc:276] 0709 13:17:53.183385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.217906 (+ 34521us) service_pool.cc:224] Handling call
0709 13:17:53.233874 (+ 15968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.234003 (+   129us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:54.614026 (+1380023us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.946465 (+332439us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.946508 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:54.946554 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.946636 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.946727 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40419,"prepare.queue_time_us":81059,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":41147,"spinlock_wait_cycles":7333248,"thread_start_us":1667205,"threads_started":2}
I20260709 13:17:54.938800 12120 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:55.005016 12054 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:55.030110 12054 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:54.901789 12278 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.990862 12049 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:54.989265 12067 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:17:55.034799 12278 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:54.991406 12017 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:55.035598 12017 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:55.036055 12017 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:55.038071 12337 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:54.996019 12291 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:55.040587 12066 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.945930 12079 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:54.989727 12316 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:54.994940 12185 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.000545 12315 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:54.949196 12272 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:55.001742  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.017984 12310 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:54.998533  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:55.002415  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 100189us
I20260709 13:17:55.004334  8755 leader_election.cc:400] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11.
I20260709 13:17:55.054190  8755 leader_election.cc:403] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:17:55.054806  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 52870.4us
I20260709 13:17:55.055655  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:54.958762 12304 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:54.978202 12342 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.007184  8001 catalog_manager.cc:5697] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:55.018184  8147 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:55.066493  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 54360.3us
W20260709 13:17:55.018953  8003 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39828 (request call id 275) took 41543 ms (client timeout 15000 ms). Trace:
I20260709 13:17:55.066330  8001 catalog_manager.cc:5697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 11 to 12, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 12 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:54.982957 12301 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:17:55.022878  8179 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
W20260709 13:17:55.023855  8278 debug-util.cc:398] Leaking SignalData structure 0x7b0800393b80 after lost signal to thread 12287
I20260709 13:17:55.025517 12293 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:55.026628 12120 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:54.988464  8791 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:55.028677 12348 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:55.002213  8177 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:55.048593 12066 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:55.048897  8183 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:17:55.068826  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 70358.8us
I20260709 13:17:55.071451  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:55.049856 12272 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:55.074332  8278 debug-util.cc:398] Leaking SignalData structure 0x7b0800279260 after lost signal to thread 12302
I20260709 13:17:54.993498 12149 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:55.080181  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 86669.1us
I20260709 13:17:55.083292  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:55.081350  8147 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:55.103824  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:55.083412  8786 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:55.072642 12207 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:55.073798 12278 raft_consensus.cc:2764] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:17:55.075035 12024 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:55.095455  8791 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:17:55.102442  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 89225us
I20260709 13:17:55.072721 12049 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:55.068425  8001 catalog_manager.cc:5697] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 8 to 10, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 10 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:55.104911  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:55.083289 12304 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:55.093827 12333 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.111810  8001 catalog_manager.cc:5697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.111698  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:55.078851 12293 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:17:55.114096  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.109927  8788 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:55.067523  8003 rpcz_store.cc:269] 0709 13:17:13.465018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.465777 (+   759us) service_pool.cc:224] Handling call
0709 13:17:13.906886 (+441109us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540006a9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db6090 00007fa5a0e54f3a 00007fa5a6c0b1cc 00007fa5a6d0937e 00007fa5a51ca2a4 00007fa5a51ca232 00007fa5a51ca161 00007fa5a51ca0dc 00007fa5a51c9392 00007fa59f18748c 00007fa59f1868c6
0709 13:17:55.008480 (+41101594us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:52.152188 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:52.304643 (+152455us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:52.304701 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:17:52.304719 (+    18us) tablet.cc:662] Decoding operations
0709 13:17:52.305542 (+   823us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:52.305623 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:52.305652 (+    29us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:17:52.306219 (+   567us) tablet.cc:701] Row locks acquired
0709 13:17:52.306266 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:17:52.306435 (+   169us) write_op.cc:270] Start()
0709 13:17:52.306577 (+   142us) write_op.cc:276] Timestamp: P: 1783603072306371 usec, L: 0
0709 13:17:52.306602 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:17:52.309768 (+  3166us) log.cc:844] Serialized 2535 byte log entry
0709 13:17:52.756221 (+446453us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b18003052c0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f557 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:17:53.042478 (+286257us) op_driver.cc:464] REPLICATION: finished
0709 13:17:54.222316 (+1179838us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa59dd420ac 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a4882ef0
0709 13:17:54.429596 (+207280us) write_op.cc:301] APPLY: starting
0709 13:17:54.505947 (+ 76351us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:54.524516 (+ 18569us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:54.524558 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:54.535308 (+ 10750us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:54.535592 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:17:54.535635 (+    43us) write_op.cc:312] APPLY: finished
0709 13:17:54.536457 (+   822us) log.cc:844] Serialized 53 byte log entry
0709 13:17:54.566990 (+ 30533us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:54.567122 (+   132us) write_op.cc:454] Released schema lock
0709 13:17:54.567186 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:54.664919 (+ 97733us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:54.664966 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4071033,"reported_tablets":48,"spinlock_wait_cycles":238667008,"child_traces":[["op",{"apply.queue_time_us":1363347,"apply.run_cpu_time_us":33532,"apply.run_wall_time_us":145164,"num_ops":6,"prepare.queue_time_us":220098,"prepare.run_cpu_time_us":41667,"prepare.run_wall_time_us":385029,"raft.queue_time_us":235149,"raft.run_cpu_time_us":35293,"raft.run_wall_time_us":1666115,"replication_time_us":706226,"spinlock_wait_cycles":52066432,"thread_start_us":2026283,"threads_started":5,"wal-append.queue_time_us":267915,"wal-append.run_cpu_time_us":12182,"wal-append.run_wall_time_us":1872499}]]}
I20260709 13:17:55.117815  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:55.118494  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.116623  8001 catalog_manager.cc:5697] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 8 to 11, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 11 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:55.119869  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:55.120348  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:55.120599  8177 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:55.120697  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:55.121284  8001 catalog_manager.cc:5697] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 8 to 10, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 10 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:55.114471  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:55.115381  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:55.124182  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:55.124507  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:55.124852  8181 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:55.126624  8001 catalog_manager.cc:5697] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 10. New cstate: current_term: 10 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:55.110702 12148 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:55.127624  8001 catalog_manager.cc:5697] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 5 to 7, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 7 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:55.128523  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:55.129426  8223 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:55.113570 12300 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:55.130565  8175 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:55.135093  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:55.135905  8179 raft_consensus.cc:2410] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:55.116120 12370 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:55.140458  8249 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:55.123325 12316 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:55.087190 12326 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:17:55.127118 12149 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:55.131371  8001 catalog_manager.cc:5697] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 7 to 8, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 8 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:55.143420  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:55.122193 12334 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:55.144197  8176 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:55.144675  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:55.145292 12326 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:55.145717 12326 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:55.146551 12326 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.147698 12326 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.149361 11993 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:55.150003 12315 consensus_queue.cc:1175] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a0f96c12124b4e1a816d9fa970464091" responder_term: 12 status { last_received { term: 12 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 12 index: 10 } }
I20260709 13:17:55.133473  8223 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:55.132249  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:55.133074  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:55.132493  8257 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:55.142155  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:55.153445  8251 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:55.152164 12272 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:55.130599 12148 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:55.157028  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 45976.3us
I20260709 13:17:55.158890  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:55.128860 12343 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:55.135285 12308 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.155642 11993 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:55.134553 12374 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.138125 12371 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:55.141530 12024 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.125897 12146 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:17:55.171044  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:55.151615  8001 catalog_manager.cc:5697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 10 to 11, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 11 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.169016 11975 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:55.123236 12333 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.172425  8001 catalog_manager.cc:5697] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 8 to 9, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 9 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.174026  8001 catalog_manager.cc:5697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 7 to 12, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 12 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.164533  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:55.177732  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 44392.5us
I20260709 13:17:55.179292  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:55.180157  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:55.173523  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:55.132745 11780 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.193712 11780 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:55.171720  8786 raft_consensus.cc:2376] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12. Re-sending same reply.
I20260709 13:17:55.187220  8001 catalog_manager.cc:5697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 11, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 11 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:55.196033  8001 catalog_manager.cc:5697] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:55.161170 12148 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.156322 12300 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:55.200570  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:55.202102  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:55.200917  8001 catalog_manager.cc:5697] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 7 to 10, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 10 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:55.216542  8001 catalog_manager.cc:5697] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:55.170083 12051 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.205335  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:55.161538 12337 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:55.181891 11993 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:55.222096 12337 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:55.212353  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.222152 11993 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.224310 12337 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:55.224848 12337 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.225584 12054 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:55.209636  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:55.226398 12054 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:55.226687  8786 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:55.227246 12054 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:55.227052 12301 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:55.229756  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:55.233191  8107 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:55.233748  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:55.236055  8106 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:55.234476  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.234640  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:55.237449  8099 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:17:55.201570 12272 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:55.243489  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:55.205003 12316 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:55.245301  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:55.149673 12304 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.243908  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:55.244244  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:55.251127  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:55.253162  8181 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:55.251384  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:55.246008  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:55.205510 12067 raft_consensus.cc:3055] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:55.249042  8182 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:17:55.170488 12293 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:55.182019 12024 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:55.249971  8100 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:55.243710  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:55.254611  8107 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:55.197378  8176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:55.258662  8176 raft_consensus.cc:606] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:55.259016  8176 raft_consensus.cc:614] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:55.242189  8223 connection.cc:256] RPC call timeout handler was delayed by -1.4697879549999016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
I20260709 13:17:55.230317 12312 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:55.255381  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:55.259634  8223 connection.cc:256] RPC call timeout handler was delayed by -1.10258795499999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
I20260709 13:17:55.262634  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:55.264197  8174 raft_consensus.cc:2410] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:55.262825  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:55.236860 12029 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:55.265260  8103 raft_consensus.cc:2410] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:55.236583 12181 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:55.227614 12054 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:55.225265 12337 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.267442 12271 raft_consensus.cc:3055] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:55.228138 12278 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:17:55.275319 12333 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:55.247323 12051 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:55.280418  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:55.255448  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:55.309396  8183 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:55.270138 12066 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:55.310070 12337 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:55.228569 12370 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:17:55.284536  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 45984us
I20260709 13:17:55.331629  8106 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:17:55.286669  8102 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
W20260709 13:17:55.293704  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 72358.8us
I20260709 13:17:55.296973 12029 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:55.256736 12067 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:55.299203 12054 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:55.286339 12373 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.094s	user 0.000s	sys 0.003s
I20260709 13:17:55.277714 12120 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:55.285915 12278 consensus_queue.cc:1243] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 6.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:55.302035 12293 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.302789 12017 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.302852 12300 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:55.303464 12024 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:55.303956  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:55.359927  8181 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:55.243255 11975 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:17:55.304503  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.305197 12079 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:55.363394 12079 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:55.309474 11993 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:55.311030  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45063.9us
W20260709 13:17:55.311784  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 111289us
I20260709 13:17:55.366281  8223 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:55.366542  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:55.367871  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:55.368086  8176 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:55.334477  8755 leader_election.cc:400] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11.
I20260709 13:17:55.369050  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:55.369616  8176 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.300072 12272 raft_consensus.cc:697] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:55.337369 12291 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:55.286697 12372 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:17:55.345167  8149 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:55.350056  8183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
W20260709 13:17:55.343130 12377 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:17:55.333662 12148 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.373713  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:55.361100  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.333626 12029 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.351346 12334 raft_consensus.cc:697] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:55.282107 12271 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:55.280787  8786 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:55.371850 12054 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.343466 12307 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:17:55.376502  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:55.379778  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:55.380513  8106 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:17:55.380897  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:55.390424  8107 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:17:55.390787  8174 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:55.382071  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:55.374033  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:55.375115  8183 raft_consensus.cc:606] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:55.375602  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:55.374382  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:55.391585  8183 raft_consensus.cc:614] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:55.391975  8251 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:55.392583  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:55.388139  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:55.383384  8072 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:55.383884  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:55.385640  8147 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:55.390158  8176 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:17:55.393584  8255 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.394179  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:55.381724 12207 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11.
I20260709 13:17:55.373828 12316 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:55.395207  8176 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:55.397195  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:55.410300  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.442629 11993 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:55.419554 12387 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 13:17:55.441529  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 67555.8us
I20260709 13:17:55.377281 12024 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:55.401110 11780 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:55.444175  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 68638.5us
I20260709 13:17:55.421671  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:55.381388 12333 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:55.470901  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 49489.3us
I20260709 13:17:55.471607  8223 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:55.419946  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:55.444942  8180 raft_consensus.cc:2410] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:55.372862 12380 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.454398  8177 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 12: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:55.477605 12371 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:55.477962 12316 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:55.478807 12291 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:55.461789 12354 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
W20260709 13:17:55.455045  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.389043 12146 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.386497 12066 consensus_queue.cc:1059] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:17:55.463744  8174 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
W20260709 13:17:55.444113  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 58551us
I20260709 13:17:55.455775 12388 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:55.464665 12207 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:55.395689 12384 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:55.363678 12067 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:55.512001 12067 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:55.469674  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:55.492936  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:55.513173  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 43568.3us
I20260709 13:17:55.514520  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:55.515081  8174 raft_consensus.cc:606] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:55.515134  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:55.515501  8174 raft_consensus.cc:614] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:55.518438  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:55.389043 12348 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:17:55.455045 12051 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.523542  8100 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:55.454797 11993 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.395288 12337 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:17:55.524259 11993 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:55.477627 12334 consensus_queue.cc:237] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:55.524931  8785 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:55.488035 12375 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:55.526360 12375 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:55.526737 12375 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.527202  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:55.532950 12051 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:55.533326 11993 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:55.490103  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 103110us
I20260709 13:17:55.465305  8782 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:55.389240 12389 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:17:55.493868 12017 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:55.471401 12272 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:55.455973 12312 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:17:55.483155 12279 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:17:55.495337 12079 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:55.541929 12079 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.496747 11975 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:55.543076 11975 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:55.495293 12148 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:55.498669 12343 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:55.547552 12343 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:55.455144 12370 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:55.548511 12271 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.503418  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:55.556770  8786 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.504501 12308 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:17:55.506371 12379 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.315s	user 0.002s	sys 0.000s
I20260709 13:17:55.507117 12342 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:55.507587 12388 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:55.470590 12024 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:55.535265  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:55.468264 12374 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.536942  8255 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:17:55.538297  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:55.539065  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 144968us
I20260709 13:17:55.586814  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:55.536754 12310 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:55.540406  8250 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:55.534634 12149 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:55.541064  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:55.536921 12307 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:17:55.498549 12066 raft_consensus.cc:3055] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:55.502769  8178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45840
I20260709 13:17:55.540293  8249 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:55.545385  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:55.605307  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 60013.6us
I20260709 13:17:55.605608 12312 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.607347  8255 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:55.546535 11975 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:55.552263  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:55.610481  8107 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:55.611611  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:55.612306  8107 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.553664  8106 raft_consensus.cc:1240] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:55.554399  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:55.614210  8108 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:55.567560  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:55.614847  8101 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:55.582297  8786 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:17:55.583801  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:55.615962  8103 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 12: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:55.584326  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:55.586946  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:55.588195  8257 raft_consensus.cc:2410] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:55.540246  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:55.593849  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:17:55.558535 12017 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.600384  8253 raft_consensus.cc:2410] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:55.604627  8178 raft_consensus.cc:606] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Received request to transfer leadership
I20260709 13:17:55.607244  8074 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:55.543989 12333 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:17:55.481614 12278 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:17:55.608886  8251 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:55.558949 12304 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:17:55.616771  8104 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:55.618707  8256 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:55.624240  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:55.618947  8174 raft_consensus.cc:606] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:55.627765  8174 raft_consensus.cc:614] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:55.619451  8178 raft_consensus.cc:614] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:55.592254 12310 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.629606 12310 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:55.600874 12271 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:55.610183 12342 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:55.572849 12308 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.608672 12066 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:55.585970 12148 consensus_queue.cc:1059] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:17:55.645102  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 58241.2us
I20260709 13:17:55.650074  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:55.606385 12312 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.625826 12024 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:55.653121  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:55.655485  8107 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:17:55.616432 12391 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:55.608201 12326 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 13:17:55.659317  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 132181us
I20260709 13:17:55.657342  8183 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:17:55.595048 12374 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.655542  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:55.634903 12017 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:55.718327  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 63050.4us
I20260709 13:17:55.667667  8074 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:55.716758  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.719763  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:55.720619  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:55.636752 12395 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:55.626799 12051 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:17:55.651173 12207 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.721136  8788 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:55.652348 12334 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:55.654152 11975 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.726154  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:55.728997  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:55.730429  8785 raft_consensus.cc:2376] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11. Re-sending same reply.
I20260709 13:17:55.730957  8104 raft_consensus.cc:2410] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:55.721215  8783 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:17:55.654842 12272 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.666294 12371 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:55.733000  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 65453.9us
I20260709 13:17:55.658866 12342 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:55.735567  8147 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:55.735817  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:55.734867 12207 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.743259 11993 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:55.717314 12391 raft_consensus.cc:697] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:55.744347 12308 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:55.745900 12278 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:55.748198 12054 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.799391 12278 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:55.800287 12278 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:55.804049  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 211218us
I20260709 13:17:55.804980  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:55.749230  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:55.743268 12017 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:55.750138 12403 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:55.750430 12029 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.756067  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:55.741158  8789 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:55.737692  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:55.790462  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.666441 12384 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:55.728000 12120 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:55.794034  8101 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:55.796510  8250 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:55.796252  8183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
W20260709 13:17:55.798179  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 64319.2us
I20260709 13:17:55.735033 12301 consensus_queue.cc:1059] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:17:55.726850 12395 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:55.812077  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 428721us
I20260709 13:17:55.730268 12334 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:55.739797 12300 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:55.814101 12149 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:55.826865  8099 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:17:55.831393  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:55.831583  8791 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:55.838284  8255 pending_rounds.cc:85] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 8
I20260709 13:17:55.850395  8255 pending_rounds.cc:107] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 13:17:55.850680  8255 raft_consensus.cc:2889] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:55.839078  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:55.836611  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 99020.1us
I20260709 13:17:55.851018  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:55.851730  8101 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:55.722234 12388 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.825560 12403 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:55.761055 12272 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.860916  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:55.736675 12066 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.852880  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:17:55.863690  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 58752.9us
I20260709 13:17:55.871964  8105 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:55.872733  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:55.840701 12389 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:55.846846 12334 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.844280 12395 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:55.859371 12384 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.886950  8257 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:55.859854 12333 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.860075 12370 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.813197 12024 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:55.911648  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:17:55.917977  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45325us
I20260709 13:17:55.922533  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:55.954838  8252 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:55.926975  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.955257  8249 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:55.955134  8149 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:55.922240  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:55.916901  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:55.862973 12411 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:55.966377  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:56.005662  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:55.883980 12067 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:55.925598 12054 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:55.913115 12384 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.924697 12148 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:55.890205 12389 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:55.980484 12279 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:55.981354 12079 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:56.020447 12316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.006s	sys 0.025s
I20260709 13:17:55.890084 12207 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:56.008338 12291 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.069361 12291 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.070118 12413 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.071579 12291 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:56.003317 12278 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:17:56.073256 12380 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:56.073721 12380 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:56.008246 12403 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.074451 12380 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.075243 12312 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:56.075428 12380 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:56.076347 12146 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.000s
I20260709 13:17:56.064898 12411 consensus_queue.cc:1059] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:17:56.076774 12146 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:56.077204 12411 raft_consensus.cc:3055] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:56.077639 12411 raft_consensus.cc:740] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:56.078032 12310 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.078444 12411 consensus_queue.cc:260] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.079699 12411 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:56.080088 12310 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:56.074867 12403 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:55.886312 12300 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.149s
I20260709 13:17:56.060119 12079 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.084663 12079 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:56.037760 12279 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:56.086104 12279 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.089829 12029 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:56.090564 12398 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:56.090994 12398 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:56.091769 12398 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.091967 12343 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.092816 12398 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.092984 12343 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:56.089867  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:56.068820 12378 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.877s	user 0.005s	sys 0.000s
I20260709 13:17:56.032073 12067 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.099610  8072 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:56.109059  8252 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:56.122830  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:56.122637  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:56.125557  8177 raft_consensus.cc:2376] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10. Re-sending same reply.
I20260709 13:17:56.125797  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:55.973851 12333 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.126572  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:56.132241  8177 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 8: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:55.931499 12375 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.129271  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:56.063403 12316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.006s	sys 0.026s
I20260709 13:17:56.031915 12410 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:56.127000  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:56.133054  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:56.137305  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:56.137732  8177 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:56.138051  8180 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:56.138573  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:56.138760  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:56.139851  8177 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:56.060932 12120 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:55.983376 12370 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.130142 12300 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:56.144014  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:56.181872  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:56.189616  8178 raft_consensus.cc:2376] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14. Re-sending same reply.
I20260709 13:17:56.183023  8177 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:56.125313 12148 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.181872  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:55.889882 12342 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.4, Last appended by leader: 4, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.142483  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:17:56.196995  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 54591.6us
I20260709 13:17:55.991364 12149 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.124931 12310 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:56.126013 12067 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:56.187318  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:56.201470  8788 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:56.130931 12054 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.189213  8785 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:56.202821  8072 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:56.105508 12374 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:55.889456 12391 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.192907  8181 raft_consensus.cc:2410] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:56.194190  8251 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
W20260709 13:17:56.205147  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:56.355484  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.357909  8256 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:17:56.132797 12278 consensus_queue.cc:1059] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:17:56.200610 12148 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.239871 12384 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.240972 12415 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:56.242760 12416 log.cc:927] Time spent T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:17:56.243541 12409 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:17:56.186072 12410 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:56.260351 12272 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:56.388021  8176 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:56.260555 12334 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.193801 12300 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.204097 12408 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:56.190543 12403 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:17:56.232208 12337 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:56.271978 12293 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:17:56.283957 11965 raft_consensus.cc:3055] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:56.286424 12079 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.291361  8790 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:56.303143 12370 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:56.304364  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:56.305938  8174 raft_consensus.cc:2410] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:56.311376  8105 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
W20260709 13:17:56.312384 11975 consensus_meta.cc:287] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.577s	user 0.005s	sys 0.005s
I20260709 13:17:56.315894  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:56.316368  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:56.316592  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:56.470867  8252 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:56.317118 12407 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:56.233469 12389 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.236218 12054 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.330821 12375 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:56.275389 12333 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:56.183292 12404 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:56.369663  8175 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.018s	sys 0.020s
W20260709 13:17:56.382449  8223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.032s	sys 0.079s
W20260709 13:17:56.383131  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 377570us
W20260709 13:17:56.483289  8175 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.018s	sys 0.020s
I20260709 13:17:56.405754 12408 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.405489 12300 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:56.389036 12049 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
W20260709 13:17:56.405872  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:56.483349  8223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.032s	sys 0.079s
W20260709 13:17:56.492233  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 631622us
I20260709 13:17:56.493518  8223 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:56.483872  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:56.461408 12337 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:56.473122  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 156844us
I20260709 13:17:56.497812  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:56.402642 12181 consensus_queue.cc:1059] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:17:56.463244 11965 raft_consensus.cc:740] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:56.511157  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:56.486495 12310 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:56.409418 12279 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.488860 12408 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:56.385752 12415 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.514262  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:56.496748 12388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.029s	sys 0.049s
I20260709 13:17:56.516119  8223 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:56.529093  8183 raft_consensus.cc:606] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:56.507349 12337 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:56.537142  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:56.541616  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.550678  8221 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:56.540658  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:56.560148  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 44166.6us
I20260709 13:17:56.560994  8099 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:56.463196 12120 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.516983 12404 raft_consensus.cc:3055] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:56.570690  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:56.573062  8108 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:56.546962  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1559) took 1315 ms. Trace:
I20260709 13:17:56.548731 12415 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:56.542204 12382 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:56.528568 12407 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:56.562706  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:56.563493  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:56.545773  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:56.568504  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:56.517379 12370 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:56.586790  8104 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:56.587276  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:56.516234 11975 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:56.546422 11965 consensus_queue.cc:260] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.643501 12067 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.573835  8179 rpcz_store.cc:276] 0709 13:17:55.232033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.243572 (+ 11539us) service_pool.cc:224] Handling call
0709 13:17:56.546780 (+1303208us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b54000122d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:56.546906 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2148299648}
I20260709 13:17:56.533062 12310 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:56.604489  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:56.646404 12415 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:56.646270 12310 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.646992 12415 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:56.647138  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:56.648552 12051 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:17:56.556130 12388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.030s	sys 0.049s
I20260709 13:17:56.649061 12051 raft_consensus.cc:697] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:56.607412  8103 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:56.563419 12291 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:56.609529  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 46828.8us
W20260709 13:17:56.591154  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 45473.8us
W20260709 13:17:56.612913 12423 log.cc:927] Time spent T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:17:56.613288 12431 consensus_queue.cc:1059] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:56.554229 12427 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:17:56.616909  8181 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:56.605711 12312 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.582454 12342 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:56.581246 12293 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.622256 12079 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:56.625178  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:56.625700  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.693760 12293 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.554518 12410 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.696008 12293 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:56.626230 12412 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.697875 12412 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.700508 12412 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:56.581418 12382 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:56.701891 12382 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.703485 12382 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:56.703241 12337 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:56.583470 12395 consensus_meta.cc:287] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.666s	user 0.012s	sys 0.000s
I20260709 13:17:56.705865 12395 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.706343 12384 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:56.667212 12181 consensus_queue.cc:1059] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:17:56.662917 12049 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:17:56.629300  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:56.600005 12315 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:56.629798 12402 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:56.709627  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:56.630167 12326 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.709820  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:56.710297 12326 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.710810  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:56.711381  8108 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:56.674737 12316 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:17:56.631491 12398 consensus_meta.cc:287] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.002s
I20260709 13:17:56.633312 12149 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:56.712212 12316 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.633659 12054 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:56.635366 12279 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:56.640772 12148 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:56.572474 12404 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:56.713407  8108 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:17:56.714596 12316 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:56.581228 12278 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.651981  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:56.715747  8101 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:17:56.715690 12051 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.606392  8102 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:56.653090  8107 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:56.658743  8178 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:56.659981  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:56.659252  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:56.665823 12383 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:56.674108 12308 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:17:56.717955  8252 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:56.709878 12402 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:56.666034  8248 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:56.718678 12402 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:56.669096  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:56.720889  8786 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:56.669982  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:56.667053  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:56.670989  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:56.722110  8788 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:56.671482  8104 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:56.590410 12407 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.677692  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:56.611698 11975 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:56.679207  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:56.679597  8179 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:56.684381  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2544) took 1161 ms. Trace:
I20260709 13:17:56.685034 12420 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:56.668342  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:56.685838 12067 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:56.686201 12388 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.625766  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:56.733253  8177 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:56.705054 12413 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:17:56.708344 12395 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:56.592526 12146 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:17:56.723590 12407 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:56.714164 12404 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.641785 12334 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:56.718835  8248 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:56.667433  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:56.719295  8250 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:56.672088  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:56.722167  8785 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:17:56.718542 12308 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:17:56.724140  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 46563.2us
I20260709 13:17:56.788187  8223 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:56.724784  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 57793.3us
I20260709 13:17:56.784801  8248 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.647940 12415 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.727690  8255 rpcz_store.cc:276] 0709 13:17:55.522799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.819730 (+296931us) service_pool.cc:224] Handling call
0709 13:17:55.838081 (+ 18351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:55.863890 (+ 25809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.863937 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:55.864628 (+   691us) log.cc:844] Serialized 52 byte log entry
0709 13:17:56.093962 (+229334us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:56.201815 (+107853us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.202224 (+   409us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.216140 (+ 13916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.216312 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.539560 (+323248us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b1800486dc0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:17:56.637305 (+ 97745us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b1800486dc0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f522 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:17:56.684124 (+ 46819us) raft_consensus.cc:1685] finished
0709 13:17:56.684151 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.684315 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26259,"prepare.queue_time_us":585769,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":65,"raft.queue_time_us":318914,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":15609,"spinlock_wait_cycles":74477696,"thread_start_us":251228,"threads_started":2,"wal-append.queue_time_us":608186}
W20260709 13:17:56.731833  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 63592.6us
I20260709 13:17:56.699831 12408 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.727588 11975 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:56.727520 12431 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:56.725724 12291 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:56.802357  8248 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:56.712252 12326 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:56.794831  8175 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:56.793445 12396 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:17:56.795799  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:56.720553 12383 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.796489  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:56.796919  8107 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:56.807648  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:56.797194  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:56.751969 12054 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:56.808743  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:56.799613  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:56.772601 12375 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.776877 11780 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:56.804313  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:56.809162  8104 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:56.814371  8251 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:56.808233  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:56.809885  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:56.787747 12308 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:56.817937  8103 raft_consensus.cc:2410] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:56.822346  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:56.818322  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:56.820446  8252 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:56.821312  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:56.824486  8102 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:56.825271  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:56.826005  8102 raft_consensus.cc:2410] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:56.821317  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:56.826730  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:56.821477  8251 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:56.795318 12079 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:56.829039  8102 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:56.826885  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:56.886226 12300 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.828795 12326 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.884236 12408 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:56.906106 12391 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.909361 12326 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.909789 12391 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.910341 11965 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:56.911571 12326 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:56.913002  8107 raft_consensus.cc:2368] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15.
I20260709 13:17:56.913604 12300 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:56.913914 12348 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:56.751742 12420 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.849773  8251 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:56.828630 12371 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:56.830348  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:56.815868 12148 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.815727 11780 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.844667  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:56.830965  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:56.922274  8249 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
W20260709 13:17:56.922300  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 77717.1us
I20260709 13:17:56.849738  8108 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:56.829461  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:56.955082 12414 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 1.030s	user 0.014s	sys 0.000s
I20260709 13:17:56.892529 12308 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.844110  8104 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:56.802695 12291 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.959060 12291 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:56.816434 12054 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.802927 12404 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:56.900950 11975 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.822357 12413 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:56.902999  8182 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:56.882681 12436 log.cc:927] Time spent T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:17:56.816570 12431 raft_consensus.cc:697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:56.848306  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:56.843657  8181 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:56.830632 12185 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:56.905719  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 78936.4us
I20260709 13:17:56.907274  8074 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:56.912901 12333 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:56.773484 12388 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.914271 12427 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:56.916225 12391 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:57.019141  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:56.914305 12348 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:17:56.917833 12428 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:17:56.924346  8221 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:56.996142 12054 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:57.026434  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 102145us
I20260709 13:17:56.925832 12337 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:57.028120  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:56.929337 12148 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:56.934288 12272 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:56.914801 12396 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:56.846582 12343 consensus_queue.cc:1059] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:17:57.036536 12310 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:57.045940 12310 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.046336 12310 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.830354 12412 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:17:56.842054 12301 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:17:57.052893 12279 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:17:57.053149 12452 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.135s	user 0.002s	sys 0.000s
I20260709 13:17:57.053510 12279 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.054870 12148 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:57.010079 12333 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:57.056354 12333 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.821349 12383 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:56.923363 12371 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.057475 12148 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.058069 12148 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.058925 12383 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:57.059036 12371 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:56.914886 12410 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:57.059979 12148 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:57.060168 12410 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.060626 12410 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:56.949036 12420 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:56.957404  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2418) took 1829 ms. Trace:
I20260709 13:17:57.010898 12427 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:57.011519  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:57.085296  8180 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:17:57.012346  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 105130us
I20260709 13:17:57.016811  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:57.085915  8107 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:17:57.086452  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:56.997731 12415 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:57.028729  8251 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
W20260709 13:17:57.030228  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 201269us
I20260709 13:17:57.094336 12415 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:57.094671  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:57.094926  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:57.095206 12415 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.096005  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:57.032747 12456 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.097045  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:57.097240 12456 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.097863  8251 raft_consensus.cc:2410] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:17:57.098718  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:57.099260  8251 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:17:57.099418 12456 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:57.100063  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:57.100315 12301 consensus_queue.cc:1059] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:57.100631  8251 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:57.101397 12300 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:57.101348 12301 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:57.101871  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:57.033048 12457 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:57.035167  8790 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:57.035554  8791 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:57.035889  8785 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:57.103863 12391 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:57.036420  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:57.105298  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:57.105917  8104 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:17:57.106819  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:57.107128 12442 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.192s	user 0.001s	sys 0.001s
I20260709 13:17:57.107395  8104 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:57.107234 12407 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.036420  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:57.107952 12410 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.108536  8178 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:57.109532  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:57.110045  8178 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.110560 12410 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:57.111735  8177 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:17:57.112087  8177 pending_rounds.cc:85] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 5
I20260709 13:17:57.112298  8177 pending_rounds.cc:107] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:17:57.112509  8177 raft_consensus.cc:2889] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:57.037307  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:57.020509 12312 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:57.008738 12185 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.940171 12342 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.938382 12017 raft_consensus.cc:3055] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:57.061460  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:57.113845 12185 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:57.113945 12017 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:57.114416  8250 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:57.114953 12017 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.116174 12017 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.055482 12279 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:57.062242  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:57.118520  8255 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:57.118753  8176 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:57.062743 12384 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:57.062155  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:57.063565  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:57.120112  8248 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:17:57.120290  8176 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:57.120663 12308 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:57.036713 12272 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.121628 12272 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:57.122607  8249 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:57.124795  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51044 (request call id 38) took 1377 ms. Trace:
I20260709 13:17:57.025652 12326 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:17:57.125183  8183 rpcz_store.cc:276] 0709 13:17:55.747436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.796074 (+ 48638us) service_pool.cc:224] Handling call
0709 13:17:57.124641 (+1328567us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b5400003054. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e46853 00007fa5a5e1460a 00007fa59f39a7d4 00007fa59f39a762 00007fa59f39a691 00007fa59f39a60c 00007fa59f3998c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:57.124715 (+    74us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596520320}
I20260709 13:17:57.065907  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:57.126564  8100 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:17:57.126942  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.069936 11975 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:57.074190  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:57.137178  8174 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:57.009459 12413 raft_consensus.cc:697] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:57.075855  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:57.139706  8106 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
W20260709 13:17:57.082768  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.081174  8254 rpcz_store.cc:276] 0709 13:17:55.127663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.127790 (+   127us) service_pool.cc:224] Handling call
0709 13:17:55.128063 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.202605 (+ 74542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.202633 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.285285 (+ 82652us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b18003c8320. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd2d2a6 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a
0709 13:17:55.615518 (+330233us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b2c000e7a78. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:17:55.615952 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:17:55.815061 (+199109us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:55.815139 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.624883 (+809744us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b54001207d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:56.624941 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.954493 (+329552us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:56.956175 (+  1682us) raft_consensus.cc:1685] finished
0709 13:17:56.956241 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.957303 (+  1062us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2383,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":34084,"spinlock_wait_cycles":300812416,"thread_start_us":163770,"threads_started":1,"wal-append.queue_time_us":226801}
W20260709 13:17:56.960357  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 130980us
I20260709 13:17:57.142830  8223 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:57.083449  8175 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:57.086766  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:57.029858 12316 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.145411 12316 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.147336 12316 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:57.147293  8249 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:17:57.089965 12402 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.092027  8788 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:57.091661 12427 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.162120 12427 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:57.092900  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:57.087402  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:57.093488 12348 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:57.166255  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 78931.6us
I20260709 13:17:57.103556  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:57.168735  8106 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:17:57.168895  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 65418.8us
I20260709 13:17:57.169938  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:57.170680 12312 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:57.170957  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:57.171633  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:57.172158  8100 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:57.105393  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:57.174445  8252 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.101419  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:57.176477  8788 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:17:57.176837  8788 pending_rounds.cc:85] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 10
I20260709 13:17:57.177047  8788 pending_rounds.cc:107] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:17:57.072453 12388 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:57.130566  8178 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:57.131680  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:57.132439 12431 consensus_queue.cc:237] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.133849 11780 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:57.228538  8105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 586) took 1506 ms (client timeout 1840 ms). Trace:
I20260709 13:17:57.228698  8099 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:57.143803  8107 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:57.144119  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:57.144373 12375 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:57.144464 12413 consensus_queue.cc:237] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.144677 12291 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.151607  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:57.152352  8174 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:57.147873 12342 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:57.153391  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:17:57.157078 12454 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.131s	user 0.000s	sys 0.003s
I20260709 13:17:57.136785 12456 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:57.158970  8179 raft_consensus.cc:2410] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:57.103539 12457 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.166324 12348 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:57.129971  8177 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:57.178243  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:57.293994  8147 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:57.179586  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:57.180195  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:57.171128 12304 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:57.181793  8248 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:17:57.183076  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:17:57.298759  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 115785us
I20260709 13:17:57.113364 12310 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.226977  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:57.127672 12407 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:57.230342  8252 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:17:57.231899  8254 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:57.232271  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:57.232502  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 135752us
W20260709 13:17:57.229880  8105 rpcz_store.cc:269] 0709 13:17:55.721843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.727762 (+  5919us) service_pool.cc:224] Handling call
0709 13:17:57.228373 (+1500611us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b540043cbd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:57.228484 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98171648}
I20260709 13:17:57.239795  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:57.231309  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:57.227061 12326 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:57.191282 12398 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:57.303009  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.255825 12402 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:57.226207 12312 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:57.339174  8251 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:57.160632 12066 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:57.274212  8101 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:57.280191 12291 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:57.241165 12029 raft_consensus.cc:3055] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:57.252457 12148 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.253306 12388 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.294168  8106 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:57.177260  8788 raft_consensus.cc:2889] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:57.295076  8249 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:57.300523  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 121054us
I20260709 13:17:57.335942  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:57.238782  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:57.335843 12300 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:57.348891  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:57.500204  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:57.500635  8103 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:57.245332  8100 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:57.298940 12051 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:57.383093  8248 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:57.381415  8791 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:17:57.506263 12375 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:57.382617 12406 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 3, Time since last communication: 0.125s
I20260709 13:17:57.390866 12029 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:17:57.508626 12455 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:17:57.295075 12410 consensus_queue.cc:1059] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.207s
I20260709 13:17:57.509336 12410 raft_consensus.cc:3055] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:57.509791 12410 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:57.509112 12029 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.382778  8253 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:57.300338 11975 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:57.395818  8786 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:57.366312  8174 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:57.353646  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:57.512118  8176 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:57.511561 12410 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.513998 12411 raft_consensus.cc:3055] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:57.514206 12410 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.514593 12411 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:57.515699 12411 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.516942 12411 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:57.300580 12120 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:57.520112  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:57.311429 12387 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:57.522066  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 283309us
I20260709 13:17:57.471341  8183 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:57.492010  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:57.463162  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 73923.6us
I20260709 13:17:57.285951 12207 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:57.489367  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:57.497311  8249 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:57.464422  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:57.525964  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:57.501943 12148 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:57.510839  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 174977us
W20260709 13:17:57.525956  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 61625.3us
I20260709 13:17:57.500751  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:57.537807  8100 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:17:57.550406  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:57.550786  8100 pending_rounds.cc:85] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 5
I20260709 13:17:57.530510  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:57.551643  8100 pending_rounds.cc:107] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:17:57.552188  8100 raft_consensus.cc:2889] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:57.530026  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:57.529682  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:57.339618 12326 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.557174  8100 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:57.298092 12181 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.224s
W20260709 13:17:57.498565 12465 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:17:57.555058  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:57.527670  8106 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 3. Preceding OpId from leader: term: 14 index: 5. (index mismatch)
I20260709 13:17:57.542259 12407 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:57.545276  8178 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:57.542826  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:57.554451  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:57.392197 12312 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:57.501391 12374 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.569710 12374 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.295882 12316 consensus_queue.cc:1059] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.257s
W20260709 13:17:57.545944 12463 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:17:57.558736 12300 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:17:57.565268  8074 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:57.571877 12374 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:57.571738 12466 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:17:57.572392 12374 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.572837 12374 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.574160 12066 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:57.574509 12312 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.562283 12291 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:57.576112 12054 consensus_meta.cc:287] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.000s
I20260709 13:17:57.575690 12291 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.576515 12054 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.526930 12402 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:17:57.577513 12391 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.577715  8787 raft_consensus.cc:2368] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11.
I20260709 13:17:57.572408  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:57.548988 12185 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.578014 12391 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.580672 12185 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:57.582873 12148 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:57.561512  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:57.537629 12382 raft_consensus.cc:2764] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:17:57.584235 12382 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:57.546912 12384 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:57.569998 12310 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:57.584378 12457 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:57.584605  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:57.295915 11965 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.260s
I20260709 13:17:57.345897 12337 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.214s
I20260709 13:17:57.543042 11975 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.552731 12371 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:57.559734 12406 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 13:17:57.595870  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.596300 12316 raft_consensus.cc:3055] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:57.558039 12375 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.554009 12387 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.560840 12279 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.557847 12464 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:57.344594 12398 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.559060 12278 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:57.591970 12380 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:57.601812 11965 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:57.537181 12304 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:57.587339  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.546268 12051 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:57.587019  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:57.608300  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:57.586170 12467 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:17:57.584983 12185 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:57.617251  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:57.667691  8253 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:57.612689 12466 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:57.672977  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.621063  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:57.583204 12374 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:57.612794 12316 raft_consensus.cc:740] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:57.519874 12388 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.603785 12300 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:17:57.558871 12326 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.639930  8176 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:57.584909 12382 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:57.664469  8100 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:57.687886  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 66919.3us
I20260709 13:17:57.616614  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:57.557247 12207 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.674566 12304 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.585196 12384 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.636555 12457 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:57.682554  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:57.664719  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 77762.4us
I20260709 13:17:57.645864 12464 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:57.612637 11975 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.666569 12051 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.672700 12466 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.670902 12308 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:57.620263 12371 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.647272 12017 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:17:57.642431 12375 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.644210 12380 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.728792  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2549) took 1371 ms. Trace:
I20260709 13:17:57.634169 12279 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.735349  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 883) took 1593 ms. Trace:
I20260709 13:17:57.683445 12185 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:57.679251 11965 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:17:57.727594 12415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.008s	sys 0.019s
I20260709 13:17:57.717128 12408 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:57.669763  8147 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:57.746304  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:57.821985  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 152324us
I20260709 13:17:57.755836  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:57.613981 12310 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.114s
I20260709 13:17:57.762063  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:57.766597  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:57.767449 12464 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.772094  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:57.779552 12207 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:57.739320 12470 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:57.822926  8784 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:17:57.741348 12291 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:57.759961 12384 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:57.802917  8256 rpcz_store.cc:276] 0709 13:17:56.356922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.361287 (+  4365us) service_pool.cc:224] Handling call
0709 13:17:56.385889 (+ 24602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.551969 (+166080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.552013 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.552070 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:56.552119 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.728536 (+1176417us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54000898d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:57.728596 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.728725 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381394688}
W20260709 13:17:57.821501 12415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.008s	sys 0.020s
I20260709 13:17:57.785130 12466 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:57.781790 12051 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:57.816937 12413 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.806602 12380 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:57.798244 12017 consensus_queue.cc:1243] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:57.822036  8786 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:57.748029  8100 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:17:57.827299 12049 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:57.823547  8790 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.794480 12308 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:57.808377  8789 rpcz_store.cc:276] 0709 13:17:56.141989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.192228 (+ 50239us) service_pool.cc:224] Handling call
0709 13:17:56.234446 (+ 42218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:56.264426 (+ 29980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.264473 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:56.265083 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 13:17:57.228203 (+963120us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b18003b9080. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:17:57.297508 (+ 69305us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:57.297577 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.297689 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:57.727886 (+430197us) raft_consensus.cc:1685] finished
0709 13:17:57.727914 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.735270 (+  7356us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29429,"raft.queue_time_us":33460,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":8058,"spinlock_wait_cycles":18244736,"thread_start_us":69048,"threads_started":1,"wal-append.queue_time_us":1079417}
I20260709 13:17:57.781152 12457 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:57.823563 12272 consensus_meta.cc:287] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.701s	user 0.009s	sys 0.001s
I20260709 13:17:57.837257  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:57.836490  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 257173us
I20260709 13:17:57.902848  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1574) took 1778 ms. Trace:
I20260709 13:17:57.903362  8182 rpcz_store.cc:276] 0709 13:17:56.127582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.186511 (+ 58929us) service_pool.cc:224] Handling call
0709 13:17:56.201044 (+ 14533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.996810 (+795766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.902545 (+905735us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b5400180954. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:57.902768 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1613802752}
I20260709 13:17:57.904830  8176 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:57.905545  8256 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:57.906452  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:57.758605 12316 consensus_queue.cc:260] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.907155  8248 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:57.907475  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:57.907002  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:57.908061  8257 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:17:57.908108  8253 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.908257  8252 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:57.839603 12054 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:57.821501 12185 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.910979  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:57.916677  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 191732us
I20260709 13:17:57.917513  8223 leader_election.cc:400] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15.
I20260709 13:17:57.917800  8223 leader_election.cc:403] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:57.810729 12382 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.921510  8784 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:57.921833  8223 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:57.915858  8786 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:17:57.898276 12308 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:57.894622 12049 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.923590  8788 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:57.923487  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:57.922976  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:57.925613  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:57.926121  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:57.932173  8181 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:57.932329  8789 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:57.932854 12374 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:57.894106 12387 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:57.907498 12316 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:57.839476 12410 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:17:57.932991  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:57.928594  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:57.927791  8177 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:17:57.941609 12475 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:17:57.941756 12348 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:57.942085 12468 log.cc:927] Time spent T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:17:57.887347 12413 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:57.943145  8256 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:57.943257  8253 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:17:57.916484 12291 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:57.944691  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 178164us
I20260709 13:17:57.996819  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:57.934726 12049 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:57.924710 12398 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:57.933461 12431 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:57.932287 12476 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:57.891104 11965 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.943171 12485 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:57.914666 12272 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:57.996732 12415 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15.
I20260709 13:17:57.946589 12387 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.050218 12495 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:57.927729 12428 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 13:17:58.074146 12470 raft_consensus.cc:697] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:17:58.084635 12474 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260709 13:17:58.085966 12472 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:17:58.071231 12485 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:58.089777 12485 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:58.093113 12375 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:58.094115 12486 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:17:58.080039 12495 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.095094  8249 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:58.077557 12312 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:58.095662 12428 raft_consensus.cc:3055] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:58.075098 12410 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:58.096103 12428 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:58.000352 12310 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:17:58.097642 11993 raft_consensus.cc:3055] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:58.098057 11993 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:58.098644 12185 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:58.098870 11993 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.100035 12051 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.101593 11965 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.101987  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2414) took 1539 ms. Trace:
I20260709 13:17:58.102355  8099 rpcz_store.cc:276] 0709 13:17:56.562283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.562402 (+   119us) service_pool.cc:224] Handling call
0709 13:17:57.228498 (+666096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.229374 (+   876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.101805 (+872431us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b540043cbd0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:58.101932 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531202304}
I20260709 13:17:58.097115 12428 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.104609 12428 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:58.095032 12495 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.105295 12485 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:58.109155 12427 consensus_meta.cc:287] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.946s	user 0.009s	sys 0.000s
I20260709 13:17:58.109413  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1578) took 1291 ms. Trace:
W20260709 13:17:58.110018  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.125088  8789 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:17:58.127683  8101 rpcz_store.cc:276] 0709 13:17:56.817920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.822126 (+  4206us) service_pool.cc:224] Handling call
0709 13:17:58.109229 (+1287103us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54001662d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:58.109358 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037108992}
I20260709 13:17:58.112056 11780 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:58.112864  8790 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:17:58.113752 12304 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.072722 12388 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:58.116218 12484 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:17:58.116482  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.006840 12291 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.070822 12483 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:17:58.117133 12485 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.080518 12387 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.118185 12051 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.113209 12049 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.100855 12308 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.100400  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1579) took 1293 ms. Trace:
I20260709 13:17:58.175580  8175 rpcz_store.cc:276] 0709 13:17:56.806923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.807153 (+   230us) service_pool.cc:224] Handling call
0709 13:17:56.807393 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.143508 (+336115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.100156 (+956648us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54000127d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:58.100341 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634461440}
I20260709 13:17:57.992908 12407 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
W20260709 13:17:58.150221  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 224764us
I20260709 13:17:58.177448  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:58.153699  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 381640us
I20260709 13:17:58.161212  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:58.178710  8176 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:58.152158  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 325196us
I20260709 13:17:58.180871  8072 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:58.122957 12146 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.188742  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:58.197525  8787 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:58.153219 12278 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:58.185953  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:58.200150  8253 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.187819  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:58.203760  8252 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:17:58.188547  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:58.205003  8789 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:17:58.166483 12388 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.222344  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:58.223096  8256 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:17:58.221601  8180 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
W20260709 13:17:58.194352  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 249999us
I20260709 13:17:58.158922 12427 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:58.193013  8176 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
W20260709 13:17:58.207751  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.159431 11780 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:58.212191 12291 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.214565 11975 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:58.209581 12371 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:58.215935 12493 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:58.217010 12495 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.259605  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:58.259419  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 262679us
I20260709 13:17:58.227664 12415 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.219225 12308 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.219280 12508 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.220168 12489 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:58.229394  8253 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:58.177546 12457 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.232789  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:58.233599  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:58.226940 12054 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:58.234505  8221 leader_election.cc:400] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11.
I20260709 13:17:58.299196  8221 leader_election.cc:403] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:17:58.299896  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 65540.1us
I20260709 13:17:58.238145  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:58.238790  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:58.216120 12413 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.248178  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:58.261384  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:58.183298 12470 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:58.266232  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 86273.7us
I20260709 13:17:58.261186  8177 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
W20260709 13:17:58.308784  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 47480us
I20260709 13:17:58.221194 12407 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:58.305862  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:58.311162  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:58.309859  8253 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:58.247996  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:17:58.280969  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 88782.1us
I20260709 13:17:58.242425 12375 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.244421 11780 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:58.266783 12460 log.cc:927] Time spent T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 1.226s	user 0.007s	sys 0.000s
I20260709 13:17:58.242919 12431 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.321738  8253 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:17:58.249426  8179 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 14 index: 5. (term mismatch)
I20260709 13:17:58.323354  8179 pending_rounds.cc:85] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 4
I20260709 13:17:58.323714  8179 pending_rounds.cc:107] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 13.5
I20260709 13:17:58.324031  8179 raft_consensus.cc:2889] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:58.239538 12278 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.239900 12485 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.199484 12478 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:17:58.259202 12476 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:58.298415  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 109263us
I20260709 13:17:58.327224  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:58.328189  8100 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:58.228843 12388 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.328145  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:58.309314 12457 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:58.218117 12312 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:17:58.305200  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 66535.1us
I20260709 13:17:58.364719 12120 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:58.365794  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:58.306553 12477 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:58.367676 12477 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.368171 12477 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.367694 12120 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:58.210180 12146 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.239346 12427 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.315354  8221 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:58.378799  8072 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:58.379846  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 64567.6us
I20260709 13:17:58.266276 12374 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:58.303977 11975 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11.
I20260709 13:17:58.328346  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:58.301949  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:58.329135  8108 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:17:58.327244  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:58.329043  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:58.308108 12054 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.331560  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:58.329303  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:58.324707 12410 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.333215 12507 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:17:58.320430 12375 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.320276 12403 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:58.341696  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:58.361617 12504 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:58.287930 12415 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.311085 12407 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:58.377357 12480 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:58.307114 12473 log.cc:927] Time spent T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 13:17:58.303160 12508 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.317809 12483 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.372448  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:58.328485 12431 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.376370  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:58.376577  8786 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:17:58.378545  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:58.329813  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:58.398806  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:58.398090  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:58.385226  8175 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:58.398173  8099 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
W20260709 13:17:58.369827 12501 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:58.325292 12489 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:17:58.380363 12495 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.403945 12410 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:58.389158 12326 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.000s
I20260709 13:17:58.414862 12403 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.387523 12371 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:58.418486  8785 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:58.373952  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:58.362943 12485 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.438390 12326 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.443006 12485 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:58.443125 12326 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.363569 12380 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.443670 12279 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:58.334393 12278 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:58.421296  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45069us
I20260709 13:17:58.422047  8102 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:17:58.445935 12482 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:17:58.446919 12278 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:58.448107 12427 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:58.448348  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:58.452364  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:58.437906 12510 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:58.415737 12384 consensus_meta.cc:287] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.526s	user 0.004s	sys 0.009s
I20260709 13:17:58.454290 12510 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:58.454576  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:58.455355  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:58.422384  8104 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:17:58.426918  8179 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:58.433614 12499 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:17:58.430341  8182 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:58.430790 12506 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:58.403123  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 71656us
I20260709 13:17:58.401758 12051 consensus_queue.cc:1059] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:17:58.421865 12387 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.334838 12476 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.453403  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:58.454344 12384 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.425354  8176 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:58.440918 12403 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:58.426146 12412 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:58.459364  8107 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:58.456017  8783 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:58.462375 12404 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.469414  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:58.470067 12051 raft_consensus.cc:3055] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:58.440460 12466 consensus_meta.cc:287] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.001s
I20260709 13:17:58.477551  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:58.494494  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:58.479583  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:58.438265 12478 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:58.506527  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:58.480062  8790 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:17:58.402109 12120 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:58.508864  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:58.509249  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:58.471962 12371 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:17:58.481585  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:58.481644  8253 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:17:58.520274  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:58.483181 12496 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:58.483939 12508 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.484179  8104 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:58.433568 12511 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:17:58.485567 12476 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:58.455271 12510 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.486788  8256 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:58.489231  8251 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:17:58.422847 12483 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.473650 12457 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.490316  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:58.492712 12412 raft_consensus.cc:697] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:58.495193  8176 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
W20260709 13:17:58.497622  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 116832us
I20260709 13:17:58.493168 12494 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.436676 12493 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:17:58.498330 12466 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.501619 12387 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:58.424346 12480 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:58.503037 12316 consensus_meta.cc:287] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.000s
I20260709 13:17:58.453354 12477 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.510824  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:58.511624  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:58.513049  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:17:58.515033  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:58.553042  8103 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:58.476738 12506 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:58.519268  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:58.520563  8253 pending_rounds.cc:85] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 4
W20260709 13:17:58.482157  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 154973us
I20260709 13:17:58.557538  8253 pending_rounds.cc:107] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:17:58.557813  8253 raft_consensus.cc:2889] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:58.466102 12407 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.493536 12404 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.558948  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:58.559476  8253 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:58.522444  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:58.523825  8054 auto_rebalancer.cc:893] Removing replace marker failed: Replica 9bd264598fd2483e9e17674bab9ba4e8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:17:58.529102  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:58.562076  8104 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.562484  8105 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:58.534219  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:58.537075  8252 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:58.563861  8254 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:58.539938 12503 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:58.542785  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:58.491003 12051 raft_consensus.cc:740] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:58.545776  8072 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:58.504879 11780 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.520277 12478 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.521037 12456 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:58.581512  8101 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 13: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:17:58.521114 12485 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:58.525233 12408 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.551137  8102 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:17:58.553164  8786 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:17:58.555071 12451 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.010s	sys 0.018s
W20260709 13:17:58.557144  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.568166  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:58.567327 12506 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:58.570595  8054 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:17:58.570613  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 57676.5us
I20260709 13:17:58.546051 12508 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:58.579813 12470 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:58.582763 12388 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.550616 12387 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:58.572809 12427 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:17:58.569497  8253 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:17:58.567659 12512 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:58.595315 12412 consensus_queue.cc:237] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.579787 12509 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:58.625612  8254 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:58.627782  8255 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:17:58.579485  8105 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:17:58.545128 12457 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.580505 12478 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.547814 12384 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.586249 12507 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.603852  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:58.593159  8256 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.633847  8248 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:58.600427  8054 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:17:58.612133  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:58.589999 12485 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:58.592770 12456 raft_consensus.cc:697] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:58.609709 12508 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.599682 12408 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.628999  8103 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:17:58.614193 12387 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:58.631350 12514 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:17:58.614200 12415 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:58.611852  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:58.636906  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:17:58.637260  8786 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:58.557232 12494 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.651376  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:58.588724 12371 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.636576 12485 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:58.660333 12029 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.639001  8104 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:17:58.658583  8256 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:17:58.639488  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:58.639940 12480 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:58.632061 12509 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:58.631898 12512 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:17:58.665987  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:17:58.575672 12342 consensus_queue.cc:1175] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5033fc7e66374940a203908ea8b0078f" responder_term: 12 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12. Ops: [11.11-11.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:58.647652  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:58.682461  8783 raft_consensus.cc:2410] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:17:58.649755 12488 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:17:58.625174 12431 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:58.634276 12498 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:58.652918  8787 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:17:58.640067 12477 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:58.603747 12120 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.656308 12457 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.610020 12051 consensus_queue.cc:260] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:58.661149  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.663820  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:17:58.597231 12451 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.011s	sys 0.019s
I20260709 13:17:58.586277 12503 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.646401  8105 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:58.671033 12408 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:58.675181 12333 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.672199  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:58.676426  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:58.675710 12054 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:58.687963 12404 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.694463 12498 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:58.698700  8103 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:17:58.871621  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.872489  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:17:58.873337 12411 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:17:58.873641  8099 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:17:58.754069 12522 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:17:58.683320  8248 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:17:58.691211  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60806 (request call id 553) took 1075 ms. Trace:
I20260709 13:17:58.643438 12507 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:58.654210 12496 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:58.874043  8099 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:58.856241  8785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 890) took 1110 ms. Trace:
I20260709 13:17:58.898123  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:58.874704  8102 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:17:58.708348  8105 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:17:58.681985  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:17:58.830904  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.891505  8256 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
W20260709 13:17:58.918287  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 236415us
W20260709 13:17:58.841239  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:58.759929  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 512577us
W20260709 13:17:58.745698  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.904609  8249 rpcz_store.cc:276] 0709 13:17:57.616268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.616385 (+   117us) service_pool.cc:224] Handling call
0709 13:17:58.690999 (+1074614us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b5400197b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:58.691163 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806504704}
I20260709 13:17:58.925009  8223 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:58.926405  8249 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:58.918782  8785 rpcz_store.cc:276] 0709 13:17:57.745512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.745688 (+   176us) service_pool.cc:224] Handling call
0709 13:17:57.762867 (+ 17179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:58.440000 (+677133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.855918 (+415918us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54004cf9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:17:58.856161 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507331456}
I20260709 13:17:58.878928  8177 raft_consensus.cc:1217] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 1.3->[3.4-14.9]   Dedup: 9.7->[11.8-14.9]
I20260709 13:17:58.931838  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:58.932538  8177 pending_rounds.cc:85] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 7
I20260709 13:17:58.932860  8177 pending_rounds.cc:107] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:17:58.933056  8183 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:17:58.933185  8177 raft_consensus.cc:2889] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:58.881713  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:17:58.860707  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 302592us
I20260709 13:17:58.937245  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:58.937932  8176 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:17:58.864357  8147 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:58.950836  8249 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:58.952916  8249 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:58.690385 12466 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:59.040791  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:59.044031  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:59.056617  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:17:58.918828  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.770684 12391 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:58.905223 12496 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:59.061458  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.061728  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 136824us
W20260709 13:17:58.859820 12490 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.765s	user 0.000s	sys 0.001s
W20260709 13:17:59.063306  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 199277us
I20260709 13:17:58.833196 12508 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:58.810672 12528 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:17:59.069352  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:58.728369 12051 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.070377  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:58.769150 12375 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:58.893489 12049 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:59.068473  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:59.072343  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:17:58.867446 12312 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:59.040383 12066 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.074414  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:59.072007  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:59.092371  8182 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:17:59.076745  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:59.070178  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:59.093160  8249 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:17:59.093398  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:58.762864 12483 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:59.055585  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:59.092744  8785 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:17:59.094179  8147 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:59.094054  8182 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:17:58.718828 12477 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.896541 12407 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:58.726718 12494 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.892532 12503 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:58.768389 12272 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:58.770237 12380 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:58.695986 12456 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.054160 12054 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:58.763249 12413 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:58.758759 12487 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.674s	user 0.003s	sys 0.000s
I20260709 13:17:59.060516 12496 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:59.091660  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:17:59.080143  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:59.082136  8255 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:17:59.141469  8255 pending_rounds.cc:85] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 8
I20260709 13:17:59.141779  8255 pending_rounds.cc:107] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:17:59.142098  8255 raft_consensus.cc:2889] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:58.767797 12509 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.095289  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:58.873900 12411 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.041381 12384 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:59.068969 12420 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:59.099109  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:17:59.101006  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:17:59.068696 12493 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:59.074157 12408 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:59.107026  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2562) took 2040 ms. Trace:
I20260709 13:17:59.152616  8181 raft_consensus.cc:2410] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:59.092309 12348 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:17:59.121752 12395 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.071492 12415 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:59.130092 12054 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.086788  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:17:59.110096 12427 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.068743 12304 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:17:59.091439 12374 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:17:59.087343 12312 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:17:59.104843 12066 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:59.186199  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 597) took 1581 ms. Trace:
I20260709 13:17:59.078483 12337 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:17:58.840665 12387 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.072247 12481 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:17:59.171434 12408 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.896219 12478 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:17:59.135557  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.109148 12388 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:59.113554 12120 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:59.219067  8221 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:59.109346 12511 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:59.150349  8105 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:17:59.151711  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:59.152501  8250 rpcz_store.cc:276] 0709 13:17:57.066287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.115864 (+ 49577us) service_pool.cc:224] Handling call
0709 13:17:57.116125 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.116328 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.116352 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:58.455244 (+1338892us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b2c000e7a78. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:17:58.455598 (+   354us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.571656 (+116058us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:58.571702 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.571779 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:59.096443 (+524664us) raft_consensus.cc:1685] finished
0709 13:17:59.096465 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.106949 (+ 10484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44896640,"thread_start_us":115689,"threads_started":1,"wal-append.queue_time_us":184789}
I20260709 13:17:58.822928 12403 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:59.110268 12466 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.131923 12524 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.121932 12483 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.867321 12506 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.182243  8181 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:17:59.263278  8181 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:59.263598  8108 raft_consensus.cc:2368] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14.
I20260709 13:17:59.182503  8175 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.088460 12431 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:59.106769 12477 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:59.171288 12272 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:59.174829 12420 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:17:59.268144  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:59.186671  8106 rpcz_store.cc:276] 0709 13:17:57.604527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.604670 (+   143us) service_pool.cc:224] Handling call
0709 13:17:57.605054 (+   384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:57.796900 (+191846us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:57.796936 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:57.797531 (+   595us) log.cc:844] Serialized 52 byte log entry
0709 13:17:57.917210 (+119679us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:57.917251 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.917319 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.859135 (+941816us) spinlock_profiling.cc:243] Waited 46.2 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:59.182122 (+322987us) raft_consensus.cc:1685] finished
0709 13:17:59.182152 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.186137 (+  3985us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7820,"raft.queue_time_us":149154,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":41065,"spinlock_wait_cycles":106179456,"thread_start_us":266196,"threads_started":2,"wal-append.queue_time_us":274150}
I20260709 13:17:59.183784 12054 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.762487 12512 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:59.145021 12413 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:59.260442  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 161426us
I20260709 13:17:59.171633 12384 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.203874 12408 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.278705  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 892) took 1532 ms. Trace:
I20260709 13:17:59.183466 12395 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.220698 12388 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.183262 12415 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.219494 12120 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.321254  8074 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:17:59.290557  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 250519us
I20260709 13:17:59.192884 12427 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:59.326030  8791 rpcz_store.cc:276] 0709 13:17:57.746133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.749585 (+  3452us) service_pool.cc:224] Handling call
0709 13:17:57.749916 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.750313 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.750344 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:57.750783 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:17:57.888913 (+138130us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:57.888973 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.889085 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.758118 (+869033us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:17:59.269508 (+511390us) raft_consensus.cc:1685] finished
0709 13:17:59.269551 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.278620 (+  9069us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82879,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9703,"spinlock_wait_cycles":78537472,"thread_start_us":137645,"threads_started":1,"wal-append.queue_time_us":319583}
I20260709 13:17:59.327240  8179 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:59.318751  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 223739us
I20260709 13:17:59.261442 12511 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:17:59.273908 12466 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.338629  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:17:59.274473 12431 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:59.273336 12272 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.267495 12029 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.108s
I20260709 13:17:59.413933 12300 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:59.341945  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.419541 11965 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:59.413628 12508 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:17:59.383229  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 303152us
W20260709 13:17:59.420769  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.272384 12524 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:59.272843 12483 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.423067  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:59.430675  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.432075 12508 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:59.431227  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:59.373695  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:17:59.429127 12300 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:17:59.415719 12531 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 13:17:59.425017 12511 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:59.417598 12538 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
W20260709 13:17:59.416412 12547 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:17:59.417127 12535 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:17:59.418357 12537 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:17:59.415091 12532 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:17:59.443917  8782 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 10: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:17:59.444844  8250 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:17:59.329222 12380 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:59.449990 12300 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:59.453279  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.507275  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:59.494766  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45868.2us
I20260709 13:17:59.431453 12272 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.340190 12388 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:59.334122 12307 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:59.415849 12510 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.344630 12120 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.431192 12431 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.499922 12492 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.500058 12411 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:59.507261 12502 log.cc:927] Time spent T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:59.387607 12507 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:59.437554 12498 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:59.513415  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:59.542428  8223 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:17:59.515846 12536 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:17:59.496974 12342 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:59.516636 12413 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:59.552856  8180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2453) took 1642 ms (client timeout 2022 ms). Trace:
I20260709 13:17:59.512252 12380 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.500725 12348 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 13:17:59.553526  8180 rpcz_store.cc:269] 0709 13:17:57.910146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.910774 (+   628us) service_pool.cc:224] Handling call
0709 13:17:59.552629 (+1641855us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54000d75d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:17:59.552773 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700914048}
I20260709 13:17:59.564394  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:59.333544 12312 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:59.381929 12420 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.524303 12307 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:17:59.528781 12066 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:59.595793  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:17:59.539394 12480 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:17:59.549662 12387 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:59.568889 12380 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:59.602355 12508 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:59.573623 12307 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:59.603255 12506 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:59.595827 12427 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:59.573953 12539 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.621655 12544 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:59.624066  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 302858us
W20260709 13:17:59.625545  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 61235.9us
I20260709 13:17:59.633901  8223 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:17:59.527297 12510 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:59.573463 12478 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:59.612257 12312 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.606406 12342 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:59.631229  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:17:59.629590  8177 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.005s
I20260709 13:17:59.564080 12492 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:17:59.646095  8177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.006s	sys 0.005s
W20260709 13:17:59.632756 12485 consensus_meta.cc:287] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.968s	user 0.007s	sys 0.005s
I20260709 13:17:59.648095  8254 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:59.632509 12384 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:59.652963  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:17:59.631155 12403 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:17:59.665001  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.668210  8254 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:59.612053 12480 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:59.647940 12342 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.647145 12415 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:59.656922 12512 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.657244 12544 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:59.683809  8175 raft_consensus.cc:2410] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:17:59.665248 12479 log.cc:927] Time spent T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 1.416s	user 0.013s	sys 0.000s
I20260709 13:17:59.659549 12451 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:59.687397  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 54124.4us
I20260709 13:17:59.659988 12404 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.671495 12348 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.635175 12539 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.673835 12466 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:17:59.664736 12485 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.879281  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:17:59.876595  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 242797us
I20260709 13:17:59.880281  8223 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:17:59.683145 12342 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.681110 12550 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:59.891968  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.683187 12483 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:17:59.773833 12542 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
W20260709 13:17:59.792227 12548 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:17:59.798138 12051 consensus_meta.cc:287] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.708s	user 0.007s	sys 0.006s
W20260709 13:17:59.776589 12496 consensus_meta.cc:287] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.000s
I20260709 13:17:59.815411 12562 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:59.753199 12403 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:59.871121 12464 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.673393 12508 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.219s
I20260709 13:17:59.755254 12415 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.955441  8783 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:59.772497 12524 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:17:59.889339 12498 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:59.680507 11965 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.217s
I20260709 13:17:59.851120 12492 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:59.796646 12307 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.971186  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:17:59.753492 12512 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:59.989046 12539 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:59.971414 12403 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:17:59.991798  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 317573us
I20260709 13:17:59.799939 12054 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.889344 12348 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:59.889245 12404 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:00.004840  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.898315 12550 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:17:59.894858 12451 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:17:59.892493 12509 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 13:18:00.018613  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 47506.5us
I20260709 13:17:59.991214 12483 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:18:00.038739  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:00.007433 12498 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:00.012760 12333 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.141s	user 0.011s	sys 0.000s
I20260709 13:17:59.968569 12278 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.967413 12496 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.018222 12545 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:00.003244 12555 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:18:00.023635  8149 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:00.040009 12565 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:00.035596 12510 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.058233  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.020095 12492 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.043021  8789 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:00.013348 12481 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:00.029246 12403 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:00.027709 12570 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.049635 12557 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:00.048100 11975 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.969455 12544 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
W20260709 13:18:00.060417 12272 consensus_meta.cc:287] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.528s	user 0.003s	sys 0.007s
I20260709 13:18:00.035837 12480 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.054952  8175 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:18:00.065773 12561 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:18:00.057121  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:00.059899  8174 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:00.080632  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.082181  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.063592  8790 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:00.064209  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:00.045899 12498 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:00.068337  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.050892 12524 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 13:18:00.078979 12564 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:18:00.001616 12415 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.050642 12333 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.048053 12545 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:00.050536 12278 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.056341  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.060822 12181 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:00.110584 12181 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:00.111526 12181 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.075925 11975 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.088280  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.075567 12272 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.120106  8174 raft_consensus.cc:2410] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:00.066493 11965 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:00.086444  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:00.067775 12483 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:59.995846 12464 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.068766  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:00.094934  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:00.113341 12568 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:18:00.105120  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.089643 12480 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:00.067556 12492 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.092303 12051 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:00.067996 12481 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.108439 12571 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.109136  8181 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:00.085250  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:00.070513 12565 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.087910 12557 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.101788 12550 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:00.071833 12570 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.104094 12485 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.131492 12573 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.069490 12146 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:00.138357 12563 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:18:00.109294 12545 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:00.135958  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 50794.2us
I20260709 13:18:00.136050  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 565) took 1208 ms. Trace:
I20260709 13:18:00.148399  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:00.138708 11965 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:18:00.125222  8074 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.130:46389 timed out after 2.022s (SENT) [suppressed 15 similar messages]
I20260709 13:18:00.137271  8786 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:18:00.109119 12333 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.129396 12555 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:00.127619  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.129206  8175 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:00.145516 12573 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:00.152041 12300 consensus_meta.cc:287] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.004s
I20260709 13:18:00.173663  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.174793 12573 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:00.155366 12410 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.174867  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:00.176393  8175 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:00.178598 12415 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:00.178889 12431 consensus_meta.cc:287] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.001s
I20260709 13:18:00.179369 11965 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:00.179769 12509 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:00.180385 12509 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.180774  8174 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:18:00.180749 11965 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.182418  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.182955 12509 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.136178  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.149783  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:00.138051 12307 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:00.152278 12051 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:00.154628 12272 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:00.140147 12571 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.154781 12570 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.142903 12054 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:00.148082 12404 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.155444 12496 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.156930 12557 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:00.150609 12485 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:00.159869 12342 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.163326 12576 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:18:00.155390 12408 consensus_meta.cc:287] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.813s	user 0.007s	sys 0.004s
I20260709 13:18:00.165352  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:00.168448 12388 consensus_meta.cc:287] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.638s	user 0.005s	sys 0.002s
I20260709 13:18:00.143915 12550 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.143419 12512 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.142328 12348 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:00.148249  8248 rpcz_store.cc:276] 0709 13:17:58.927812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.927947 (+   135us) service_pool.cc:224] Handling call
0709 13:17:58.928335 (+   388us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:59.061214 (+132879us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:59.090945 (+ 29731us) log.cc:844] Serialized 14 byte log entry
0709 13:17:59.262518 (+171573us) log.cc:844] Serialized 14 byte log entry
0709 13:17:59.566933 (+304415us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:59.569471 (+  2538us) log.cc:844] Serialized 78 byte log entry
0709 13:17:59.569632 (+   161us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:59.569672 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.569764 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:00.135829 (+566065us) raft_consensus.cc:1685] finished
0709 13:18:00.135847 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.135996 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111744,"prepare.queue_time_us":22177,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":13089,"raft.queue_time_us":289980,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":19481,"spinlock_wait_cycles":97231744,"thread_start_us":462711,"threads_started":2,"wal-append.queue_time_us":307043}
I20260709 13:18:00.186419  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:00.187855  8175 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:00.190140  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:00.222836 12342 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:00.188421 12420 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:00.171802 12451 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.223065  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.193696  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 563) took 1317 ms. Trace:
I20260709 13:18:00.223711 12420 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.197098 12571 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:00.158412 12511 consensus_meta.cc:287] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.656s	user 0.007s	sys 0.003s
I20260709 13:18:00.224978 12511 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.223822  8177 rpcz_store.cc:276] 0709 13:17:58.876640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.878093 (+  1453us) service_pool.cc:224] Handling call
0709 13:17:58.878597 (+   504us) raft_consensus.cc:1471] Updating replica for 6 ops
0709 13:17:59.076036 (+197439us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:59.105652 (+ 29616us) log.cc:844] Serialized 14 byte log entry
0709 13:18:00.068176 (+962524us) log.cc:844] Serialized 14 byte log entry
0709 13:18:00.068433 (+   257us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:00.070899 (+  2466us) log.cc:844] Serialized 52 byte log entry
0709 13:18:00.071102 (+   203us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:00.071161 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.071272 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:00.193492 (+122220us) raft_consensus.cc:1685] finished
0709 13:18:00.193511 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.193643 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27884,"prepare.queue_time_us":188796,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":36078,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":14333,"thread_start_us":934612,"threads_started":3,"wal-append.queue_time_us":565034}
I20260709 13:18:00.226126 12420 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.172427 12555 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.183835 12431 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:00.215831  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 50569.5us
I20260709 13:18:00.188827 12300 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.238376  8149 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:00.238618  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:00.227109 12562 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:00.240279 12562 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:00.236725 12410 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.240710  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:00.241068 12404 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:00.241115 12410 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.241788 12404 raft_consensus.cc:697] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:00.241990 12511 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.242770 12404 consensus_queue.cc:237] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.240428  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:00.192224 12574 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:00.195289  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.223943  8175 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:18:00.226537  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:00.195835 12120 consensus_meta.cc:287] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.664s	user 0.005s	sys 0.006s
I20260709 13:18:00.202003 12051 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:00.215502 12312 consensus_meta.cc:287] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.568s	user 0.002s	sys 0.009s
I20260709 13:18:00.229470  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:00.250422  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:00.251124  8103 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:00.230263  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:00.231719  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:00.232591  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:00.252640  8106 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:00.252928  8248 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:18:00.254182  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:00.233976  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.234514  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2455) took 1100 ms. Trace:
I20260709 13:18:00.240325  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:00.255049  8248 raft_consensus.cc:2410] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:18:00.254962  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:00.245455  8107 raft_consensus.cc:2410] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:18:00.247789  8177 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:18:00.247593  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:00.248775  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.247653  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:00.228519 12512 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:00.226608 12550 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.217676 12408 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.259385 12512 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:00.258872 12051 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.260439 12512 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.261229 12408 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:00.261729 12574 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:00.262346 12464 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.235428 12555 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:00.263304  8100 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:00.276175  8251 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:00.265746  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:00.274839  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:00.276820  8248 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:00.277161  8254 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
W20260709 13:18:00.216950  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 91743.1us
I20260709 13:18:00.278175  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:00.243654 12410 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:00.233204  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:00.257643 12348 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:00.284150  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.284368 12348 raft_consensus.cc:697] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:00.285053  8251 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:00.257403 12120 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:00.258816 12380 consensus_meta.cc:287] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.000s
I20260709 13:18:00.240835 12562 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:00.215122 12485 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.256930  8175 raft_consensus.cc:2410] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:18:00.255070  8253 rpcz_store.cc:276] 0709 13:17:59.134225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.134407 (+   182us) service_pool.cc:224] Handling call
0709 13:17:59.134729 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:59.622551 (+487822us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:59.622598 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:59.623115 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:17:59.755645 (+132530us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:59.809152 (+ 53507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.809358 (+   206us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:00.234350 (+424992us) raft_consensus.cc:1685] finished
0709 13:18:00.234366 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.234474 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4691,"raft.queue_time_us":17732,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":7260,"thread_start_us":614676,"threads_started":2,"wal-append.queue_time_us":258122}
I20260709 13:18:00.280452  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:00.280287  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:00.220268 12388 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.285331  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:00.352108  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.352759  8174 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:18:00.245911 12570 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:18:00.354545  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:00.355811  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:00.303267  8248 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:00.356218  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:00.357860  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:00.358714  8103 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:00.354884  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.357138  8106 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:18:00.359608  8174 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:00.360584  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:00.262844 12533 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.070s	user 0.000s	sys 0.003s
I20260709 13:18:00.308238  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:00.310858  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:00.362974  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:00.307374  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:00.363971  8250 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:18:00.360869  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:00.365590  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:00.365927  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.366132  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:00.366989  8175 raft_consensus.cc:2410] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:18:00.367141  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 86945.8us
I20260709 13:18:00.366212  8103 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:00.367957  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:00.361248  8106 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:00.279532 12576 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:00.370752  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.368108  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:00.374823  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:00.377408  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:00.378999  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:00.382197  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:00.279292 12464 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.383147  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:00.370851 12576 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.285679 12476 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:00.386183 12476 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.310601 12571 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.384619  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:00.262822 12574 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.317735 12470 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:00.411947  8182 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:00.418644  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:00.359311 12492 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:00.422420  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:00.395839  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:00.388382  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:00.427556  8103 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:00.428308  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:00.381446 11965 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:00.381660 12410 raft_consensus.cc:2764] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:18:00.382437 12342 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:00.382119 12509 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:00.376641 12481 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.381471 12508 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:00.432358  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 49312.9us
I20260709 13:18:00.411245 12326 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:00.413348 12146 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:00.420248 12470 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:00.420934 12524 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:00.411356 12567 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:00.367645 12380 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.421823 12408 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:00.460471  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:00.435196 12333 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:00.441152  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:00.419910 12480 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:00.447826  8175 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:18:00.317392 12348 consensus_queue.cc:237] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.431676 11965 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.454187  8107 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:00.443639 12326 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.461190  8250 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:18:00.422421 12571 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.457494 12524 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.429821 12464 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.452042 12146 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.469187 12480 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.451499 12565 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:00.457050 12567 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.466640  8175 pending_rounds.cc:85] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 4
I20260709 13:18:00.481226 11965 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:00.485803  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:00.492632  8251 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:18:00.491726  8175 pending_rounds.cc:107] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:18:00.483692 12326 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:00.505664 12559 log.cc:927] Time spent T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.881s	user 0.003s	sys 0.000s
I20260709 13:18:00.506009 12480 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:00.506594 12480 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:00.507227 12480 consensus_queue.cc:1243] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer 5033fc7e66374940a203908ea8b0078f log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:00.507817 12481 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:00.508371 12481 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.509044 12571 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:00.509568 12570 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:00.509744 12576 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:00.510028 12570 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:00.510442 12570 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:00.512722 12555 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:00.513880  8101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1585) took 2187 ms (client timeout 2603 ms). Trace:
W20260709 13:18:00.514355  8101 rpcz_store.cc:269] 0709 13:17:58.326637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.326758 (+   121us) service_pool.cc:224] Handling call
0709 13:18:00.513667 (+2186909us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400211bd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:00.513817 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366573440}
I20260709 13:18:00.493647  8175 raft_consensus.cc:2889] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:00.488243 12524 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:00.496610 12477 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:00.501794 12579 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 13:18:00.502292 12578 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:18:00.503738 12380 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.492507 12567 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:00.510617 12581 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:18:00.486585 12431 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:00.456707 12342 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.525261  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:00.514915 12555 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:01.007107  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 481927us
I20260709 13:18:01.007953  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:00.688378 12391 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.008690 12506 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:01.009619  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:01.010133  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 406457us
I20260709 13:18:01.009239 12391 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:00.768782 12388 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.011008  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:00.494354 12470 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:00.931078 12348 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.643105 12503 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:00.944769 12403 consensus_meta.cc:287] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.873s	user 0.010s	sys 0.003s
I20260709 13:18:00.768579 12326 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:00.751201  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.738644 12420 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:00.516798  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.641958 12120 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.489398 12146 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:01.015287  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:01.013490  8175 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:01.067597  8782 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:18:01.016361  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:00.516669  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:01.010727  8787 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:00.605674  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:00.823103 12545 consensus_meta.cc:287] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.670s	user 0.002s	sys 0.008s
I20260709 13:18:01.037243  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2451) took 1948 ms. Trace:
W20260709 13:18:00.966784 12375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.008s	sys 0.003s
W20260709 13:18:00.768055 12580 log.cc:927] Time spent T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
W20260709 13:18:00.903738 12562 consensus_meta.cc:287] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.001s
W20260709 13:18:00.827220 12498 consensus_meta.cc:287] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.724s	user 0.009s	sys 0.000s
I20260709 13:18:00.602043 12576 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.008534 12464 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.528936 12481 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:00.642475 12508 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.069473  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:01.074536 12388 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:00.605625 12480 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:01.077013  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:01.057786 12477 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.079980  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:00.948987 12570 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:01.074003 12589 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:18:01.128018 12375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.012s	sys 0.026s
I20260709 13:18:01.064937 12503 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:01.037192 12512 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:01.075830 12420 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.077836 12431 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.141237 12342 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.152593 12375 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.153126 12342 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:01.153182 12375 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:01.153796 12342 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:01.154354 12420 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:01.154635 12342 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:01.155556 12375 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:01.155911 12342 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:01.156066 12552 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.538s	user 0.004s	sys 0.005s
W20260709 13:18:01.157636 12549 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 1.538s	user 0.002s	sys 0.000s
I20260709 13:18:01.157657 12431 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.159951 12431 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.161303 12395 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:01.163091 12588 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.385s	user 0.000s	sys 0.009s
I20260709 13:18:01.144104 12481 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:18:01.133128 12546 log.cc:927] Time spent T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 1.514s	user 0.007s	sys 0.000s
I20260709 13:18:01.074604 12470 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.066982 12403 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:01.143992 12508 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:01.151769 12594 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:18:01.100556 12545 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:01.142458 12464 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:01.135020 12498 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.186918 12403 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:01.188258 12498 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.152671 12512 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.149536 12480 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.171169 12503 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:01.186911 12508 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.188957 12512 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:01.133736 12562 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:01.144945 12477 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:01.190735 12480 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.190968 12562 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:01.174518 12570 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:01.191584 12477 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:01.178591 12476 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.179306 12524 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:01.180275 12567 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.194109 12524 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:01.188179 12545 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:01.173517 12550 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.195924 12567 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:01.178258 12569 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.082s	user 0.001s	sys 0.014s
I20260709 13:18:01.139171 12576 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.198789 12576 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:01.016528  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 122321us
I20260709 13:18:01.231011  8103 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:01.142994  8785 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
W20260709 13:18:00.813472  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 54933.8us
I20260709 13:18:01.058048  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:01.238404  8180 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:01.240121  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:01.170213 12326 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:01.075548  8252 rpcz_store.cc:276] 0709 13:17:59.088437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.088600 (+   163us) service_pool.cc:224] Handling call
0709 13:17:59.089000 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:59.119640 (+ 30640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.119689 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:00.476854 (+1357165us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b2c000e7a78. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:18:00.477345 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:18:00.934297 (+456952us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:00.934350 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.934448 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.017116 (+ 82668us) raft_consensus.cc:1685] finished
0709 13:18:01.017136 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.037143 (+ 20007us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17978,"raft.queue_time_us":40839,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":3961,"spinlock_wait_cycles":11916032,"thread_start_us":456452,"threads_started":1,"wal-append.queue_time_us":529107}
I20260709 13:18:01.242479 12326 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.243459 12326 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:01.068823  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 52532.6us
W20260709 13:18:01.142828 11965 consensus_meta.cc:287] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.000s
I20260709 13:18:01.246570 11965 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:01.246919  8149 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:01.247394 12326 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.172156 12485 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:01.240384  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:01.186069 12464 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.066165 12348 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:01.274787  8099 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.278468 12348 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:01.076056 12333 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:01.262498  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1604) took 1197 ms. Trace:
I20260709 13:18:01.245285  8147 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:01.169307 12391 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:01.274895  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:01.281003  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2458) took 1026 ms. Trace:
W20260709 13:18:01.264321  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.283324 12326 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:18:01.289716  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.296226  8782 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:18:01.285053  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:01.277290  8099 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.312544 12333 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:01.314172  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 303114us
I20260709 13:18:01.319818  8101 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:01.322230  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:01.323477  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 560) took 2875 ms. Trace:
I20260709 13:18:01.324021  8179 rpcz_store.cc:276] 0709 13:17:58.447590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.457234 (+  9644us) service_pool.cc:224] Handling call
0709 13:17:58.462475 (+  5241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.341819 (+879344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.322772 (+1980953us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54001c34d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:01.323212 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988428032}
I20260709 13:18:01.350291  8103 raft_consensus.cc:2410] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:18:01.350565 11993 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:01.351773 12492 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:01.352010  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:01.309258  8100 rpcz_store.cc:276] 0709 13:18:00.254603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.254729 (+   126us) service_pool.cc:224] Handling call
0709 13:18:01.280447 (+1025718us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b54003f2d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:01.280816 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16999808}
I20260709 13:18:01.354852  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:01.356732  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2470) took 1261 ms. Trace:
I20260709 13:18:01.305181  8174 rpcz_store.cc:276] 0709 13:18:00.065372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.432812 (+367440us) service_pool.cc:224] Handling call
0709 13:18:00.443622 (+ 10810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:00.443932 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.443960 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:00.444284 (+   324us) log.cc:844] Serialized 26 byte log entry
0709 13:18:00.489888 (+ 45604us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:00.489917 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.489976 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.162539 (+672563us) spinlock_profiling.cc:243] Waited 9.01 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:01.261546 (+ 99007us) raft_consensus.cc:1685] finished
0709 13:18:01.261596 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.262218 (+   622us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176,"raft.queue_time_us":743,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6576,"spinlock_wait_cycles":20725632,"thread_start_us":30802,"threads_started":1,"wal-append.queue_time_us":221959}
W20260709 13:18:01.326853  8180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1597) took 1271 ms (client timeout 1531 ms). Trace:
I20260709 13:18:01.327211  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2452) took 2221 ms. Trace:
I20260709 13:18:01.309563 12477 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:01.326903 12571 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:01.331889 12567 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:01.332463  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.362128 12567 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.332901  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2581) took 1099 ms. Trace:
I20260709 13:18:01.362704 12567 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:01.362890  8257 rpcz_store.cc:276] 0709 13:18:00.232842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.232972 (+   130us) service_pool.cc:224] Handling call
0709 13:18:01.332350 (+1099378us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54000924d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:01.332628 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236669312}
I20260709 13:18:01.361078 12477 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:01.334826  8108 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2444) took 2814 ms (client timeout 1901 ms). Trace:
W20260709 13:18:01.364612  8108 rpcz_store.cc:269] 0709 13:17:58.519890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.520021 (+   131us) service_pool.cc:224] Handling call
0709 13:18:01.334357 (+2814336us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b54001653d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:01.334616 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1707429632}
I20260709 13:18:01.365099  8177 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:01.365861  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2472) took 1264 ms. Trace:
I20260709 13:18:01.365990  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:01.366221  8177 rpcz_store.cc:276] 0709 13:18:00.102546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.364337 (+1261791us) service_pool.cc:224] Handling call
0709 13:18:01.364748 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.365553 (+   805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.365781 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.367110  8108 raft_consensus.cc:2410] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:18:01.368269  8182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2465) took 2328 ms (client timeout 1957 ms). Trace:
I20260709 13:18:01.338435 12570 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:01.369279 12570 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.369791 12570 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:01.369951 12464 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:01.371634 12333 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:01.372238  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2593) took 1088 ms. Trace:
I20260709 13:18:01.372696  8251 rpcz_store.cc:276] 0709 13:18:00.283286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.361109 (+ 77823us) service_pool.cc:224] Handling call
0709 13:18:00.389265 (+ 28156us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:00.493070 (+103805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.371508 (+878438us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400387a54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:01.372000 (+   492us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236978432}
I20260709 13:18:01.341578  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:01.368801  8182 rpcz_store.cc:269] 0709 13:17:59.039540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.095073 (+ 55533us) service_pool.cc:224] Handling call
0709 13:18:01.367799 (+2272726us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400248bd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:01.368034 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2863119232}
W20260709 13:18:01.358675  8180 rpcz_store.cc:269] 0709 13:18:00.055275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.057946 (+  2671us) service_pool.cc:224] Handling call
0709 13:18:01.326423 (+1268477us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002f8854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:01.326680 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2710754688}
I20260709 13:18:01.360792  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:01.368216  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:01.266436 12512 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:01.337409  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 92664.6us
I20260709 13:18:01.338635  8783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1133) took 1748 ms. Trace:
I20260709 13:18:01.369306 11965 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:01.359263  8249 rpcz_store.cc:276] 0709 13:17:59.105485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.105627 (+   142us) service_pool.cc:224] Handling call
0709 13:17:59.105957 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:59.121919 (+ 15962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.121964 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:00.499815 (+1377851us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b4800061158. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a5d75aa1 00007fa5a5d6cb37 00007fa5a5d6c9ca 00007fa5a5e6426f 00007fa5a5e63f37 00007fa5a5e7855c 00007fa5a5e78508 00007fa5a5e78488 00007fa5a5e78443 00007fa5a5e776ec 00007fa5a4da1a96
0709 13:18:01.006142 (+506327us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b2c000e7a78. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:18:01.006652 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.062660 (+ 56008us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:01.325647 (+262987us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.326198 (+   551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.326426 (+   228us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.326541 (+   115us) raft_consensus.cc:1685] finished
0709 13:18:01.326557 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.326919 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15511,"prepare.queue_time_us":257986,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":89,"raft.queue_time_us":62598,"raft.run_cpu_time_us":4032,"raft.run_wall_time_us":1360698,"spinlock_wait_cycles":27006592,"thread_start_us":227815,"threads_started":2,"wal-append.queue_time_us":125773}
I20260709 13:18:01.335687  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:01.360296  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 85712.6us
I20260709 13:18:01.357369  8175 rpcz_store.cc:276] 0709 13:18:00.092905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.068111 (+975206us) service_pool.cc:224] Handling call
0709 13:18:01.236848 (+168737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.246347 (+  9499us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:01.260757 (+ 14410us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.315264 (+ 54507us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.351100 (+ 35836us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.351192 (+    92us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:01.351247 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.353460 (+  2213us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.353732 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34678,"prepare.queue_time_us":17711,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":108,"raft.queue_time_us":49949,"raft.run_cpu_time_us":469,"raft.run_wall_time_us":470,"thread_start_us":44786,"threads_started":2}
I20260709 13:18:01.380100 12146 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:01.380894 12278 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.377288  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:01.361923 12571 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.409296  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:01.410519  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:01.410938  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:01.411407  8102 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:01.411895  8108 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:18:01.412329  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:01.367352 12477 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.387449 12181 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.417008 12464 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:01.417840 12485 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:01.388741  8256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60806 (request call id 563) took 2723 ms (client timeout 2026 ms). Trace:
I20260709 13:18:01.392485 12570 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.353229  8103 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:18:01.407613  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:01.413038  8102 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:01.407929  8100 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 14: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:01.408947  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2483) took 1258 ms. Trace:
I20260709 13:18:01.400548  8783 rpcz_store.cc:276] 0709 13:17:59.590417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.592593 (+  2176us) service_pool.cc:224] Handling call
0709 13:17:59.592998 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.993288 (+400290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.338079 (+1344791us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b54004ea054. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:01.338446 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":832858496}
I20260709 13:18:01.413026  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:01.422416  8175 rpcz_store.cc:276] 0709 13:18:00.150632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.404182 (+1253550us) service_pool.cc:224] Handling call
0709 13:18:01.408159 (+  3977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.408553 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.408578 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.408635 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:01.408686 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.408747 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.408869 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.423985  8101 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:01.423894  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2480) took 1270 ms. Trace:
W20260709 13:18:01.420483  8256 rpcz_store.cc:269] 0709 13:17:58.665403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.665599 (+   196us) service_pool.cc:224] Handling call
0709 13:18:01.388237 (+2722638us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400092ed4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:01.388474 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516967168}
I20260709 13:18:01.431198  8180 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:01.431965  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1607) took 1268 ms. Trace:
I20260709 13:18:01.432150  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:01.432343  8180 rpcz_store.cc:276] 0709 13:18:00.163838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.430388 (+1266550us) service_pool.cc:224] Handling call
0709 13:18:01.430864 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.431698 (+   834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.431911 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.432689  8147 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:01.439213  8182 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:01.427465  8174 rpcz_store.cc:276] 0709 13:18:00.135358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.370745 (+1235387us) service_pool.cc:224] Handling call
0709 13:18:01.371147 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.371695 (+   548us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:01.372459 (+   764us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.405324 (+ 32865us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.405506 (+   182us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:01.405640 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.405727 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.406114 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":195,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":127,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":183,"thread_start_us":32371,"threads_started":1}
I20260709 13:18:01.451951 12570 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:17:58.373900  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:01.456931  8108 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 14: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:01.458702  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:01.452466 11975 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:01.461535  8108 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:18:01.462350  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2473) took 1019 ms. Trace:
I20260709 13:18:01.456833  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:01.463258  8788 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:01.462894  8108 rpcz_store.cc:276] 0709 13:18:00.443308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.459963 (+1016655us) service_pool.cc:224] Handling call
0709 13:18:01.460436 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.461955 (+  1519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.462245 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:01.463902  8790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 905) took 2543 ms (client timeout 1967 ms). Trace:
W20260709 13:18:01.464375  8790 rpcz_store.cc:269] 0709 13:17:58.920105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.920244 (+   139us) service_pool.cc:224] Handling call
0709 13:18:01.463515 (+2543271us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b54005c80d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:01.463718 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2251609984}
I20260709 13:18:01.465628 12512 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:01.466939 12604 consensus_queue.cc:1059] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:01.469007 12604 raft_consensus.cc:3055] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:01.470971  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:01.439895 12333 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.481585 12494 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:01.482024 12494 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.482349 12494 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.480572 12539 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:01.480830 11965 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:01.487879 11965 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:01.488039  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:01.489048 11965 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:01.492260  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:01.493221  8103 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:01.494802  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2458) took 2555 ms. Trace:
I20260709 13:18:01.495088  8103 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:18:01.469475 12604 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:01.495275  8176 rpcz_store.cc:276] 0709 13:17:58.939462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.939559 (+    97us) service_pool.cc:224] Handling call
0709 13:17:58.939824 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:58.940073 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:59.054615 (+114542us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.493815 (+2439200us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b18000cc4c0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa5a09f44bc 00007fa59dd4248b 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec23a
0709 13:18:01.494172 (+   357us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.494244 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:01.494342 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.494422 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.494588 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":121284,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":3535,"raft.queue_time_us":1175,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":110,"spinlock_wait_cycles":8756096,"thread_start_us":23481,"threads_started":1,"wal-append.queue_time_us":74852,"wal-append.run_cpu_time_us":2421,"wal-append.run_wall_time_us":1368423}
I20260709 13:18:01.500939  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2469) took 1148 ms. Trace:
I20260709 13:18:01.484831 12539 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:01.507794  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:01.511194 12333 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.500999  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:01.520406  8147 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:01.521888  8104 raft_consensus.cc:2368] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11.
I20260709 13:18:01.522907  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:01.524446  8104 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:01.525090  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1598) took 1019 ms. Trace:
I20260709 13:18:01.530054  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1595) took 1015 ms. Trace:
I20260709 13:18:01.524441 12300 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.530238  8104 rpcz_store.cc:276] 0709 13:18:00.505491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.523843 (+1018352us) service_pool.cc:224] Handling call
0709 13:18:01.524226 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.524815 (+   589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.525006 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.518848  8107 rpcz_store.cc:276] 0709 13:18:00.352629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.411836 (+ 59207us) service_pool.cc:224] Handling call
0709 13:18:01.500468 (+1088632us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b5400226ad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:01.500696 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77141760}
I20260709 13:18:01.530529  8103 rpcz_store.cc:276] 0709 13:18:00.504560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.494131 (+989571us) service_pool.cc:224] Handling call
0709 13:18:01.494628 (+   497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.519230 (+ 24602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.519590 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.537377 12492 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:18:01.538892  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 77747.5us
I20260709 13:18:01.538617 12602 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.540876 12492 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.541450 12492 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.541649  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:01.554401 12604 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.556303 12604 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:01.557601  8791 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:18:01.548899 12602 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:01.558223  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.559183 11975 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.559804 11975 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.560778 12602 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:01.562258 11975 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.563107 11975 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.530350 12512 consensus_queue.cc:1059] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:18:01.563654 12567 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.563783 11975 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:01.564227 12512 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:01.564647 12512 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:01.565042  8786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48110 (request call id 1136) took 1496 ms. Trace:
I20260709 13:18:01.565470  8786 rpcz_store.cc:276] 0709 13:18:00.068356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.068506 (+   150us) service_pool.cc:224] Handling call
0709 13:18:01.564730 (+1496224us) spinlock_profiling.cc:243] Waited 8.67 ms on lock 0x7b540065e854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:01.564861 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19951360}
I20260709 13:18:01.566151 11975 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:01.565660 12512 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.568651  8100 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:18:01.569298  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1613) took 1059 ms. Trace:
I20260709 13:18:01.569635 12333 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.581562 12512 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:01.581888  8254 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:01.583861 12571 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.652426  8099 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:18:01.587877 12391 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:01.588176 12539 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:01.589594  8251 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:18:01.589933  8257 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:01.589754 12524 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:01.590175 12567 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.591194  8176 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:01.580266 12146 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:01.662571  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:01.569643  8100 rpcz_store.cc:276] 0709 13:18:00.510065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.567744 (+1057679us) service_pool.cc:224] Handling call
0709 13:18:01.568305 (+   561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.569055 (+   750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.569242 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:01.570753  8789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 904) took 2650 ms (client timeout 1957 ms). Trace:
I20260709 13:18:01.570214  8107 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:18:01.654367  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.652879  8099 pending_rounds.cc:85] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 9
I20260709 13:18:01.659102  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:01.661841 12407 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:01.663587  8789 rpcz_store.cc:269] 0709 13:17:58.919761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.919861 (+   100us) service_pool.cc:224] Handling call
0709 13:18:01.570358 (+2650497us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b540051a4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:01.570573 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219404544}
I20260709 13:18:01.678936  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:01.679142  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:01.679836  8253 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:01.681900  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1605) took 1162 ms. Trace:
I20260709 13:18:01.682649  8107 rpcz_store.cc:276] 0709 13:18:00.507382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.551763 (+1044381us) service_pool.cc:224] Handling call
0709 13:18:01.569913 (+ 18150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.669144 (+ 99231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.669385 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.684266  8104 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 12. Ops: []
I20260709 13:18:01.664062  8099 pending_rounds.cc:107] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:18:01.686343  8249 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:01.688175 12544 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.688802 12544 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:01.689827 12524 raft_consensus.cc:3055] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:01.690600 12524 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:01.695092  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:01.695868  8252 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:01.697540 12492 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:01.699803  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1595) took 1646 ms. Trace:
I20260709 13:18:01.700059 12492 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:01.695001  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:01.692467 12524 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:02.030074  8100 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
W20260709 13:18:01.826016  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 156470us
W20260709 13:18:01.836086  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:01.865558  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 212211us
I20260709 13:18:01.751960  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1603) took 1235 ms. Trace:
W20260709 13:18:01.809542  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.866313  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2474) took 1370 ms. Trace:
I20260709 13:18:01.715329  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:01.759161  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2585) took 1525 ms. Trace:
I20260709 13:18:01.751670  8791 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:02.087877  8104 rpcz_store.cc:276] 0709 13:18:00.506861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.543309 (+1036448us) service_pool.cc:224] Handling call
0709 13:18:01.670856 (+127547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.684694 (+ 13838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.741942 (+ 57248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.765333  8249 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:01.842494  8253 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:01.826049  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:01.921128  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 149720us
I20260709 13:18:01.755792  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:01.880934  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:01.700963  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2484) took 1538 ms. Trace:
I20260709 13:18:01.700511  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:01.821818  8102 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:02.085337  8100 pending_rounds.cc:85] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 9
I20260709 13:18:02.097080  8100 pending_rounds.cc:107] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:18:01.752250  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1601) took 1245 ms. Trace:
I20260709 13:18:02.099332  8176 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 14: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:01.741746  8099 raft_consensus.cc:2889] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:01.827956  8251 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:18:02.090318  8254 rpcz_store.cc:276] 0709 13:18:00.233968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.277928 (+ 43960us) service_pool.cc:224] Handling call
0709 13:18:01.758832 (+1480904us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540008acd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:01.759078 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2996628736}
I20260709 13:18:02.100561  8182 raft_consensus.cc:2368] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11.
W20260709 13:18:01.988337  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.101362  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.103127  8177 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.050s	sys 0.019s
W20260709 13:18:02.103662  8177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.051s	sys 0.020s
W20260709 13:18:02.052556 12494 consensus_meta.cc:287] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.570s	user 0.013s	sys 0.000s
I20260709 13:18:02.096273  8175 rpcz_store.cc:276] 0709 13:18:00.162118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.433219 (+1271101us) service_pool.cc:224] Handling call
0709 13:18:01.467757 (+ 34538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.468442 (+   685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.468496 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.469141 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.533794 (+ 64653us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:01.533850 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.533943 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.700699 (+166756us) raft_consensus.cc:1685] finished
0709 13:18:01.700727 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.700884 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5287,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":19973,"thread_start_us":64014,"threads_started":1,"wal-append.queue_time_us":229128}
I20260709 13:18:02.106019  8100 raft_consensus.cc:2889] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:01.825589  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:01.681900 12539 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:02.088253  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.089057  8108 rpcz_store.cc:276] 0709 13:18:00.495979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.464614 (+968635us) service_pool.cc:224] Handling call
0709 13:18:01.470562 (+  5948us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:01.515073 (+ 44511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.515119 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:01.549595 (+ 34476us) log.cc:844] Serialized 52 byte log entry
0709 13:18:01.658027 (+108432us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:01.658076 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.658154 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.866038 (+207884us) raft_consensus.cc:1685] finished
0709 13:18:01.866057 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.866226 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":917,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":872,"thread_start_us":80145,"threads_started":1,"wal-append.queue_time_us":216155}
I20260709 13:18:01.885386  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:01.988195  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:01.882938 12148 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.700278  8183 rpcz_store.cc:276] 0709 13:18:00.053026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.053180 (+   154us) service_pool.cc:224] Handling call
0709 13:18:00.053521 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:00.053941 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:00.053983 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.329356 (+1275373us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b2c000e6688. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:18:01.330223 (+   867us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.440138 (+109915us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:01.443681 (+  3543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.455098 (+ 11417us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.699192 (+244094us) raft_consensus.cc:1685] finished
0709 13:18:01.699224 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.699570 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13441,"raft.queue_time_us":1324,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":6604,"spinlock_wait_cycles":17346944,"thread_start_us":109249,"threads_started":1,"wal-append.queue_time_us":216588}
I20260709 13:18:02.112516  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:02.116405  8256 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:01.765806 12464 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.113308  8255 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:01.795430 12333 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:02.123522  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:02.123597 12148 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:02.124531  8180 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 13: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:01.700181 12407 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:02.127249  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:02.129673  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.130123 12613 log.cc:927] Time spent T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:18:02.130386 12148 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:02.131228 12625 log.cc:927] Time spent T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:18:02.131421  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1614) took 1877 ms. Trace:
I20260709 13:18:02.131582  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.131265  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.131829  8178 rpcz_store.cc:276] 0709 13:18:00.253594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.431021 (+1177427us) service_pool.cc:224] Handling call
0709 13:18:01.431455 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.432033 (+   578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.432064 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.432649 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.478648 (+ 45999us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:01.478689 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.478775 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.131116 (+652341us) raft_consensus.cc:1685] finished
0709 13:18:02.131133 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.131261 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2415,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":17318,"thread_start_us":45624,"threads_started":1,"wal-append.queue_time_us":252779}
I20260709 13:18:02.133160  8182 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 10: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:02.132346  8180 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:18:02.133913  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 604) took 3487 ms. Trace:
I20260709 13:18:02.134310  8099 rpcz_store.cc:276] 0709 13:17:58.646714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.873250 (+226536us) service_pool.cc:224] Handling call
0709 13:17:58.873534 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.267452 (+2393918us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b4c00138ec0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f118a20 00007fa59f129a29 00007fa59f0ef644 00007fa59f116f2d 00007fa59f116b93 00007fa5a0e4718b 00007fa5a0e47cb5 00007fa5a0e42f30 00007fa5a0e447de 00007fa5a0e4eb49 00007fa5a0e4f416
0709 13:18:02.133612 (+866160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.133847 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21043584}
I20260709 13:18:02.134891  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1614) took 1624 ms. Trace:
I20260709 13:18:02.135426 12483 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.111075 12544 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:02.136233  8250 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:02.136034 12483 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:02.136636 12604 consensus_meta.cc:287] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.001s
W20260709 13:18:02.137358 12560 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:18:02.138180  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:02.139220 12610 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.597s	user 0.008s	sys 0.034s
I20260709 13:18:02.140233  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:02.140916  8254 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:02.118526 12622 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:18:02.145015 12570 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:02.145479 12570 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:02.145869 12570 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:02.146610  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.147233  8251 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:18:02.148240  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.149602 12391 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:02.150152 12391 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:02.135339  8100 rpcz_store.cc:276] 0709 13:18:00.510337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.670768 (+1160431us) service_pool.cc:224] Handling call
0709 13:18:01.821328 (+150560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.134659 (+313331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.134841 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.152379 12391 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:02.149276  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.122290  8257 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:02.158013  8104 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 11: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:18:02.157173  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 50767us
I20260709 13:18:02.160831  8251 raft_consensus.cc:2368] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11.
I20260709 13:18:02.162695  8106 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:02.162830  8250 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:02.163566  8147 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:02.163636  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:02.097867  8105 rpcz_store.cc:276] 0709 13:18:00.506329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.526939 (+1020610us) service_pool.cc:224] Handling call
0709 13:18:01.527491 (+   552us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:01.528182 (+   691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.528213 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:01.529029 (+   816us) log.cc:844] Serialized 52 byte log entry
0709 13:18:01.536293 (+  7264us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:01.661612 (+125319us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.693877 (+ 32265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.693952 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.751923 (+ 57971us) raft_consensus.cc:1685] finished
0709 13:18:01.751951 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.752172 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30373,"prepare.queue_time_us":52629,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":31855,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":197,"thread_start_us":118296,"threads_started":2,"wal-append.queue_time_us":165403}
I20260709 13:18:02.170930  8252 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:02.172593  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.173121  8785 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:02.176328  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 55541us
I20260709 13:18:02.178516  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.183571  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.186658  8251 raft_consensus.cc:2368] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11.
I20260709 13:18:02.186566  8255 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:02.187479  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 306686us
I20260709 13:18:02.115868 12494 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:02.194159  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:02.194969  8791 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:02.174325 12492 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.197018  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:02.197779  8248 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:02.178695 12391 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.192307  8252 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:18:02.201830  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:02.206517  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 10 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.190769 12333 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:02.210711 12540 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.211270 12540 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:02.213168 12540 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:02.216473  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.213677 12333 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:02.172250 12464 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:02.220952  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:02.230167  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:02.231900  8784 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:02.238606  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.237764  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:02.208750 12492 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:02.240099  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.241343  8254 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:18:02.242770  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:02.214785 12391 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:02.248211  8108 raft_consensus.cc:2368] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14.
W20260709 13:18:02.249281  8181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2474) took 2113 ms (client timeout 2547 ms). Trace:
W20260709 13:18:02.249730  8181 rpcz_store.cc:269] 0709 13:18:00.118329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.189928 (+ 71599us) service_pool.cc:224] Handling call
0709 13:18:02.221049 (+2031121us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000d75d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:02.231677 (+ 10628us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2871591168}
I20260709 13:18:02.250211  8102 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:02.250819  8250 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:02.251202 12483 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:02.251482  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:02.251711  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.252132  8250 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:02.252697  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:02.253237  8102 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:02.255955  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.260805  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.262425  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:02.263075  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:02.268508  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:02.269600 12567 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.260010 12408 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:02.270243  8108 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 12: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:02.274600  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:02.277300  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:02.271795 12567 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:02.278326  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.279381  8183 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 12: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:02.275686  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:02.283344  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:02.283936  8108 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:18:02.285097 12624 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:18:02.282191  8105 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:02.287957  8249 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:18:02.285753 12567 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:02.343366  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:02.343753  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.343786  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:02.344347  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:02.346125  8250 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:18:02.372984  8256 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:02.373798  8177 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:02.292243  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:02.382825  8250 pending_rounds.cc:85] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 10
I20260709 13:18:02.383548  8250 pending_rounds.cc:107] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:18:02.365626  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:02.383845  8108 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
W20260709 13:18:02.384544  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 139401us
I20260709 13:18:02.385104  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:02.385548  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:02.383823  8250 raft_consensus.cc:2889] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:02.383168  8252 raft_consensus.cc:1240] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:18:02.385754  8254 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:02.383405  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.376952  8255 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:18:02.386889  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1604) took 1879 ms. Trace:
I20260709 13:18:02.387212  8256 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:02.388005  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.388548  8255 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:02.380394  8791 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:02.389740  8147 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:02.390034  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:02.392385  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:02.392995  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:02.393690  8256 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:02.392436  8183 raft_consensus.cc:2368] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14.
I20260709 13:18:02.394870  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.387396  8103 rpcz_store.cc:276] 0709 13:18:00.507132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.542859 (+1035727us) service_pool.cc:224] Handling call
0709 13:18:01.577722 (+ 34863us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.578310 (+   588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.578353 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.578948 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.969192 (+390244us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:01.969243 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.969505 (+   262us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.386657 (+417152us) raft_consensus.cc:1685] finished
0709 13:18:02.386675 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.386833 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6380,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":389784,"threads_started":1,"wal-append.queue_time_us":578879}
I20260709 13:18:02.395457  8256 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:02.394541  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:02.400599  8108 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:02.400780  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:02.401463  8255 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:02.386119 12494 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:02.405205  8105 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:02.402225 12333 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:02.407008 12148 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:18:02.408079  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 139680us
I20260709 13:18:02.401973 12567 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:02.414912  8786 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:02.415443  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:02.416648  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.418383  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.419098  8250 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:02.425276  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:02.412314 12612 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.220s	user 0.001s	sys 0.008s
I20260709 13:18:02.430292  8177 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:02.432494  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:02.433048 12628 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:18:02.431500  8149 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:02.435813  8177 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:18:02.426174 12567 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:02.438207  8183 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
W20260709 13:18:02.443269  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 57904.1us
I20260709 13:18:02.445268  8248 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:02.446647 12567 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:02.447311 12512 consensus_meta.cc:287] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.795s	user 0.007s	sys 0.004s
I20260709 13:18:02.449726  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2471) took 2353 ms. Trace:
I20260709 13:18:02.451004  8102 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:02.450129  8179 rpcz_store.cc:276] 0709 13:18:00.096015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.343938 (+1247923us) service_pool.cc:224] Handling call
0709 13:18:01.344571 (+   633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.345281 (+   710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.345317 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.346130 (+   813us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.436640 (+ 90510us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:01.436689 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.436776 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.449471 (+1012695us) raft_consensus.cc:1685] finished
0709 13:18:02.449493 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.449661 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":205,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":194,"thread_start_us":75762,"threads_started":1,"wal-append.queue_time_us":739629}
I20260709 13:18:02.454653  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.454317  8786 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:02.457283  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.457468  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:02.458333  8182 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:02.459625  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.460355  8177 raft_consensus.cc:2368] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10.
I20260709 13:18:02.457695  8147 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:02.438333 12492 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:02.461872  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.468700  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.457417  8181 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:02.468513  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.472889  8177 raft_consensus.cc:2410] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:18:02.482306  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:02.482307  8180 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 13: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:02.486538  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:02.486838  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 284517us
I20260709 13:18:02.456305 12494 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:02.449527 12464 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:02.488387  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 66124.2us
I20260709 13:18:02.489609  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:02.490378  8177 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:02.497148  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.498262  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.500242  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:02.502023 12407 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:02.502388 11993 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:02.496882 12492 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:02.503196 12492 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:02.503120  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.504734  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:02.504419 12492 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:02.487309 12632 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.509384  8255 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:02.517367  8248 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:18:02.493335 12560 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:02.522877  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.523820  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.526093 12632 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:02.527050  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:02.528522 12632 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:02.496698 12512 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.496198 12391 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:02.516953  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.529981  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:02.524372  8178 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:02.527101  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:02.533885  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 347213us
W20260709 13:18:02.534374  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.535640  8106 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:02.536940  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.539496  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.540647  8255 raft_consensus.cc:2410] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 16 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:18:02.542935  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.519928 11993 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:02.544499  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:02.545558  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.545730  8248 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:02.545955  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.552805  8180 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:18:02.537616 12148 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:02.556794  8256 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:02.558920  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:02.562726  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.563930  8254 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:18:02.564030  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.564670  8255 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:02.564901  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:02.565472  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.566628  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.567147  8255 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:18:02.567497  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:02.568295  8255 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:18:02.569413  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.569506  8255 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:02.569832  8254 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:02.571367  8254 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:02.575548  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.551759 11993 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:02.578626  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.581564  8182 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:02.534013 12560 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:02.584751  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:02.548588 12570 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:02.546432 12512 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:02.575006 12627 log.cc:927] Time spent T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:18:02.558614 12494 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:02.582731 11993 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:02.594079  8253 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 7.
I20260709 13:18:02.593696 12408 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:02.599584  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 614) took 1025 ms. Trace:
I20260709 13:18:02.600399  8106 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:02.601663  8254 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:02.599956  8101 rpcz_store.cc:276] 0709 13:18:01.574539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.756082 (+181543us) service_pool.cc:224] Handling call
0709 13:18:01.756529 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.756911 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.756961 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.766755 (+  9794us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.170807 (+404052us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:02.170986 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.171109 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.599412 (+428303us) raft_consensus.cc:1685] finished
0709 13:18:02.599432 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.599537 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":403626,"threads_started":1,"wal-append.queue_time_us":503553}
I20260709 13:18:02.608042  8256 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:02.599602  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 612) took 1025 ms. Trace:
I20260709 13:18:02.590183 12333 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:02.610137  8183 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:02.613981 12148 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:02.597103 12544 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:02.620085  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:02.621884 12333 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:02.622411 12333 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:02.591816 12494 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:02.625789 12494 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:02.627194 12631 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.627733 12631 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:02.610180  8107 rpcz_store.cc:276] 0709 13:18:01.573879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.789421 (+215542us) service_pool.cc:224] Handling call
0709 13:18:01.793886 (+  4465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.823245 (+ 29359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.823283 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.120978 (+297695us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.509865 (+388887us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:02.509910 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.509972 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.599444 (+ 89472us) raft_consensus.cc:1685] finished
0709 13:18:02.599456 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.599552 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26627,"raft.queue_time_us":33010,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":328079,"threads_started":1,"wal-append.queue_time_us":412842}
I20260709 13:18:02.630738  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:02.632609 12626 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.434s	user 0.003s	sys 0.000s
I20260709 13:18:02.632891 12570 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:02.635653  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.636143  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.636531  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.613689  8785 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:18:02.637228  8182 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:18:02.637674  8785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48110 (request call id 1152) took 1014 ms. Trace:
I20260709 13:18:02.640893  8785 rpcz_store.cc:276] 0709 13:18:01.622911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.654389 (+ 31478us) service_pool.cc:224] Handling call
0709 13:18:02.637616 (+983227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.652505  8174 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:18:02.651836  8147 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:02.656071  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 135138us
W20260709 13:18:02.657415  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 90009.2us
I20260709 13:18:02.659111  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:02.660241 12544 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:02.660521  8223 leader_election.cc:400] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11.
I20260709 13:18:02.660802 12544 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.661031  8223 leader_election.cc:403] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:18:02.661347 12544 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:02.668052  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:02.669523  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.672335  8176 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:18:02.682519  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 79046.4us
I20260709 13:18:02.680968  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:02.598857 12408 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:02.675429 12148 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:02.690442 12148 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.690541 12631 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:02.690964 12148 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:02.695331  8785 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:18:02.698228 12635 log.cc:927] Time spent T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:18:02.700688  8249 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:18:02.701828 12643 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11.
I20260709 13:18:02.679206 12570 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:02.702857 12570 raft_consensus.cc:697] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:02.703876 12570 consensus_queue.cc:237] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:02.714660  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 248789us
I20260709 13:18:02.721216  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:02.723980  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:02.725203  8786 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:02.723106 12644 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:18:02.731585  8791 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:02.740548 12512 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:02.740945  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.742494  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.743348  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:02.743515  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:02.745592 12539 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:02.746477 12539 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:18:02.718354 12634 log.cc:927] Time spent T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:18:02.750406  8149 leader_election.cc:400] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14.
I20260709 13:18:02.747756  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:02.751356  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 87212.8us
W20260709 13:18:02.752729  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.722200 12631 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:02.758665  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:02.759390  8785 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:02.759305  8784 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:18:02.747793 12636 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:02.721442 12333 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:02.720542 12492 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:18:02.758962 12631 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.764120 12512 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:02.787885  8785 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:02.788434  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:02.790616  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:02.782869 12631 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:02.764540 12494 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:02.762037 12643 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:18:02.783090 12512 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:02.795589  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 50271.7us
I20260709 13:18:02.810380  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:02.811527 12181 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:02.812876  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:02.817304 12146 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:02.819020 12146 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:02.819689 12544 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:02.819924 12146 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:02.822348 12545 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:02.822784 12545 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:02.826534 12333 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:02.824941 12148 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:02.827461 12524 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:02.827585 12333 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:02.821332 12146 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:02.828794 12146 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:02.826825 12494 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:02.835767  8784 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:02.839147  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:02.839710 12544 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:02.840075  8785 raft_consensus.cc:2368] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14.
I20260709 13:18:02.796574 12483 raft_consensus.cc:2764] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:18:02.842008  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:02.842689  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:02.843150 12181 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:02.843644 12181 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:02.844501 12181 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:02.845702 12637 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:02.846175  8248 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:02.847559  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:02.848119  8252 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:18:02.848258  8099 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:02.849529 12637 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:02.850492 12637 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:02.850569  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:02.850881 12637 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:02.850924  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:02.851259  8101 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:02.851799  8785 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:02.851943 12637 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:02.853421 12637 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:02.853828  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.854211  8107 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:18:02.861315  8252 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:18:02.799075 12512 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:02.878871  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 85979.9us
I20260709 13:18:02.880484  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:02.876004  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:02.891803  8074 leader_election.cc:400] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14.
W20260709 13:18:02.892043  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.892201  8074 leader_election.cc:403] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:18:02.891505 12545 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:02.895303  8001 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36106 (request call id 201) took 10316 ms. Trace:
I20260709 13:18:02.896862  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:02.901113  8107 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:02.881788 12492 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:02.874984 12644 consensus_queue.cc:1243] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:02.891647 12146 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:02.904623 12146 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:02.888258  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:02.910621  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.914446  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:02.901407  8101 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:02.919370  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:02.920361  8102 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:02.926746 12464 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.927377 12464 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:02.929512  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:02.929756  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:02.931157  8072 leader_election.cc:400] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14.
I20260709 13:18:02.931849 12560 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:02.932660 12560 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:02.933023 12560 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:02.919102 12483 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14.
I20260709 13:18:02.900897  8001 rpcz_store.cc:276] 0709 13:17:52.703393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.709761 (+  6368us) service_pool.cc:224] Handling call
0709 13:17:52.898633 (+188872us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b5400300110. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd280b2 00007fa5a6ca1a89 00007fa5a6c39da6 00007fa5a6c0b088 00007fa5a6d0937e 00007fa5a51ca2a4 00007fa5a51ca232 00007fa5a51ca161 00007fa5a51ca0dc
0709 13:17:53.226684 (+328051us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b540006a9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db6090 00007fa5a0e54f3a 00007fa5a6c0b1cc 00007fa5a6d0937e 00007fa5a51ca2a4 00007fa5a51ca232 00007fa5a51ca161 00007fa5a51ca0dc 00007fa5a51c9392 00007fa59f18748c 00007fa59f1868c6
0709 13:18:02.895023 (+9668339us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:55.336765 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:55.337593 (+   828us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:55.337639 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:17:55.337677 (+    38us) tablet.cc:662] Decoding operations
0709 13:17:55.339844 (+  2167us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:55.339956 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:55.340001 (+    45us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:17:55.342000 (+  1999us) tablet.cc:701] Row locks acquired
0709 13:17:55.342016 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:17:55.342181 (+   165us) write_op.cc:270] Start()
0709 13:17:55.342281 (+   100us) write_op.cc:276] Timestamp: P: 1783603075342129 usec, L: 0
0709 13:17:55.342300 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:17:55.351108 (+  8808us) log.cc:844] Serialized 7427 byte log entry
0709 13:17:55.815938 (+464830us) op_driver.cc:464] REPLICATION: finished
0709 13:17:56.487998 (+672060us) write_op.cc:301] APPLY: starting
0709 13:17:56.496235 (+  8237us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:56.693157 (+196922us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:56.693309 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:57.662724 (+969415us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:57.757039 (+ 94315us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:17:57.763727 (+  6688us) write_op.cc:312] APPLY: finished
0709 13:17:57.892432 (+128705us) log.cc:844] Serialized 172 byte log entry
0709 13:17:58.153088 (+260656us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:58.180606 (+ 27518us) write_op.cc:454] Released schema lock
0709 13:17:58.198221 (+ 17615us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:58.216741 (+ 18520us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:58.216770 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":53164,"reported_tablets":32,"spinlock_wait_cycles":53625984,"child_traces":[["op",{"apply.queue_time_us":633759,"apply.run_cpu_time_us":49903,"apply.run_wall_time_us":1744547,"cfile_cache_hit":74,"cfile_cache_hit_bytes":77293,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":2,"lbm_read_time_us":1355,"lbm_reads_lt_1ms":12,"num_ops":19,"prepare.queue_time_us":110782,"prepare.run_cpu_time_us":6551,"prepare.run_wall_time_us":14728,"replication_time_us":393048,"thread_start_us":619534,"threads_started":3,"wal-append.queue_time_us":348170,"wal-append.run_cpu_time_us":2670,"wal-append.run_wall_time_us":1235620}]]}
I20260709 13:18:02.937368  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.947712  8174 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:18:02.938019  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.947438  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:02.939414  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:02.952044  8176 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:02.939499  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:02.952970  8249 raft_consensus.cc:2376] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12. Re-sending same reply.
I20260709 13:18:02.937408  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.986820  8180 raft_consensus.cc:2410] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:18:02.942523  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:02.988050  8101 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
W20260709 13:18:02.970589  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.939810  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:02.940898  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:02.937717  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.992481  8182 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:18:02.959121  8108 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:02.933403 12560 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:03.005774  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:03.011096  8102 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:18:03.014199  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.949170 12539 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:03.015830  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:02.939723 12545 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:03.017947  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:03.016556  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:03.023772  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:03.025852  8174 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:02.934428  8006 catalog_manager.cc:5697] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 6 to 9, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 9 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:02.917541 12492 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:02.934888 12477 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:18:02.933498 12632 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:18:03.031010  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:03.035141 12633 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:03.036263 12407 raft_consensus.cc:3055] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:03.036660 12407 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:03.033360 12539 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:02.939262 12631 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:02.942310 12512 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:03.041051  8178 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:03.038254  8006 catalog_manager.cc:5697] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:03.030279 12464 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:02.934702 12636 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:18:02.960847 11993 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:03.053949  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.054641  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 107245us
I20260709 13:18:03.038822  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:03.060885  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:03.062955  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:03.087831  8103 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:03.088476  8255 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:03.088981  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:03.089748  8103 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:03.063385  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:03.090227 12567 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:03.065372  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:03.065980  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:03.067556 12494 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:03.074158 12646 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:03.091864 12646 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:03.091739 12494 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.093017  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:03.092935 12646 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.093953 12408 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:03.094271 12646 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:03.094587 12494 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:03.096709  8107 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:03.086236  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:03.098584  8252 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:03.099426  8100 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 14: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:03.100108  8179 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 14: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:03.081192  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:03.092214 12567 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:03.086511  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:03.082872  8182 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:18:03.096884  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:03.107069  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:03.107259  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:03.108062  8254 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:03.048484 12148 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:03.116253  8249 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:18:03.122097  8104 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:03.122502  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:03.124428  8149 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:03.126096  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:03.126852  8254 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:03.128448  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:03.129184  8101 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 13: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:03.131901  8006 catalog_manager.cc:5697] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:03.138152  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:03.139204  8101 raft_consensus.cc:2410] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:18:03.048794 12407 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.140779  8006 catalog_manager.cc:5697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 5 to 8, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 8 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.146524  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:03.104939 12639 consensus_queue.cc:1059] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:18:03.158098  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:03.160329 12653 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:03.166647 11993 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:03.170176 12492 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:03.171653 12639 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:03.172190 12639 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:03.173180 12639 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.173686 12512 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:03.175316 12539 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:03.175688 12663 raft_consensus.cc:3055] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:03.176134 12663 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:03.176968 12663 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:03.177554  8101 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:03.178249 12663 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:03.180653  8006 catalog_manager.cc:5697] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:03.185828  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:18:03.200924  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.200685  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:03.205641 12632 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:03.154547 12148 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:03.206470 12148 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.206856 12148 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:03.209913 12494 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:03.210094 12631 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:03.210566 12494 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:03.211479  8103 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:03.212193 12560 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:03.212791 12494 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:03.214643  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.217832  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:03.218532  8789 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:03.214289 12560 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:03.224071  8006 catalog_manager.cc:5697] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 7, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 7 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.225673 12632 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:03.226518 12656 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:03.252010 12656 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.251868 12632 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.252599 12656 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:03.229950 12407 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:03.263787 12567 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:03.264516 12567 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:03.238050  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.263911  8785 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:03.240345 12633 raft_consensus.cc:3055] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:03.243408  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:03.263896  8790 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:18:03.270299 12633 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:03.275897 12633 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:03.277490 12512 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:03.285405  8789 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:03.291050 12657 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:18:03.299512  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.293944 12663 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:03.266765  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.302148  8074 leader_election.cc:400] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11.
I20260709 13:18:03.303848  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:03.304435 12663 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:03.269559 12560 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:03.308248  8788 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:18:03.237917  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 52218.9us
I20260709 13:18:03.330093  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:03.327651  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:03.277251 12633 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:03.334414 12483 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:03.335110  8791 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:18:03.339164  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 332396us
I20260709 13:18:03.328711 12560 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.328352 12545 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:03.344544  8223 connection.cc:256] RPC call timeout handler was delayed by -1.2745505729999422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260709 13:18:03.349341  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:03.265467 12567 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:03.350455  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 46765.1us
I20260709 13:18:03.359858 12657 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:03.360524 12657 raft_consensus.cc:697] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:03.361696 12494 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:03.361546 12657 consensus_queue.cc:237] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:03.363292  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.363673  8223 connection.cc:256] RPC call timeout handler was delayed by -1.0459505730000274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 13:18:03.364260 12646 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.349697 12570 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:03.364745 12646 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.365648 12570 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:03.366600 12570 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:03.367435 12646 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:03.348342 12408 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:03.370117 12408 raft_consensus.cc:697] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:03.348471 12560 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:03.370188  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.341627 12148 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:03.373461  8006 catalog_manager.cc:5697] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 6 to 9, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 9 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:03.379446  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:03.380573  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:03.381052  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:03.347245 12483 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:03.390944  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:03.384159 12181 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:03.385749 12637 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:03.395571 12181 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.382582 12494 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:18:03.393527 12544 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:03.387701 12646 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:03.385445 12545 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:03.415406  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:03.392225 12668 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:03.395478 12637 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.438028 12637 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:03.438453  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:03.439739  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:03.440802  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:03.429275  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.430428 12148 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:03.431308 12656 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:03.444761 12656 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:03.434654 12668 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:03.445673 12669 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:03.412286 12539 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:18:03.446895  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.428516  8006 catalog_manager.cc:5697] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.451702  8006 catalog_manager.cc:5697] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 6 to 9, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 9 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:03.452508  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.457187  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.446455 12669 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:03.415375 12181 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:03.418016 12544 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:03.460299  8755 leader_election.cc:400] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11.
I20260709 13:18:03.458909  8006 catalog_manager.cc:5697] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 4 to 7, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 7 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.462167  8755 leader_election.cc:403] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:03.414495 12408 consensus_queue.cc:237] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.466029 12668 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:03.466599 12483 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:03.451627 12545 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:03.451496 12632 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:03.472847  8006 catalog_manager.cc:5697] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:03.478199 12560 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.459872 12644 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:03.471325 12148 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:03.495272 12148 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:03.496245 12148 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.499136 12560 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:03.472795 12464 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11.
I20260709 13:18:03.500309 12148 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:03.506023  8006 catalog_manager.cc:5697] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 3 to 10, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 10 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.507638  8006 catalog_manager.cc:5697] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 4 to 7, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 7 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.488885 12181 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.490172  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:03.462047 12544 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:03.491115 12679 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:18:03.493578  8223 leader_election.cc:400] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10.
I20260709 13:18:03.515125  8223 leader_election.cc:403] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:03.469743 12656 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:18:03.509095  8006 catalog_manager.cc:5697] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
W20260709 13:18:03.516630  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 45624.2us
I20260709 13:18:03.516541  8006 catalog_manager.cc:5697] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 1 to 7, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 7 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.520797 12644 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 9. Current term is 10.
I20260709 13:18:03.523784  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.524978 11993 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:03.526028  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.526448 11993 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:03.527506  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:03.528342  8223 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:03.528462 12633 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:03.529019 12633 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:03.529476 12633 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:03.529628 12632 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:03.530225 12632 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:03.530684 12632 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:03.537683 12637 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:03.529224  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.543606  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.547224  8006 catalog_manager.cc:5697] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 2 to 4, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 4 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:03.549150  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 165585us
I20260709 13:18:03.551347  8099 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 13:18:03.552604  8107 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:18:03.553011  8107 pending_rounds.cc:85] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 8
I20260709 13:18:03.553143  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:03.545794  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 131842us
I20260709 13:18:03.554333  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:03.553347  8107 pending_rounds.cc:107] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:18:03.555240  8107 raft_consensus.cc:2889] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:03.555426  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:03.557569  8102 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:03.558403  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:03.558897  8099 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:03.559712  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:03.559520  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:03.560420  8252 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:03.560314  8249 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:03.541652 12560 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:03.543370 12644 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:03.565347  8250 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:18:03.565800  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:03.568908  8248 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:03.572252  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:03.572623  8099 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:03.574034  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:03.556425 12545 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:03.575615  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:03.576150 12545 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.580973  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:03.573920 12494 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:18:03.581275 12545 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:03.582335  8253 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:18:03.583299  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:03.583105 12544 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.583841  8253 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:03.585549 12679 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:03.585944 12679 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:03.586295 12679 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:03.576515  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:03.576691 12483 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:03.570006 12512 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:18:03.593791  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:03.577863  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.578550  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:03.595162 12637 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:03.565500 11993 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:03.580073  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.596678 12181 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:03.579017 12678 log.cc:927] Time spent T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:03.595896  8256 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:03.599517  8256 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:03.599957  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:03.597584  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:03.595263  8248 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:03.579015  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:03.602152  8100 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 14: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:03.597383 12633 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.568612 12644 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:03.609810  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.615249  8253 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
W20260709 13:18:03.615794  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.598692 12544 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:03.599166 12668 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:18:03.617959 12464 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:03.610246 12407 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:03.605041 12483 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:03.619699  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:03.619078  8223 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:03.580591 12673 consensus_queue.cc:1059] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:18:03.627691 12673 raft_consensus.cc:3055] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:03.628044 12673 raft_consensus.cc:740] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:03.628826 12673 consensus_queue.cc:260] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:03.620513 12680 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:18:03.614426 12644 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:03.577909 12669 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:18:03.630138 12673 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:03.607179 12560 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:18:03.634232  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 59611.2us
I20260709 13:18:03.646584  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:03.643321  8249 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:03.648057  8102 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:03.649564 12464 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:03.649910 12691 consensus_queue.cc:1059] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:03.658946  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:03.660471  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:03.645866 12483 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:03.665880  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:03.663839  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 88281.4us
I20260709 13:18:03.667193  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:03.668673  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:03.671164  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:03.672706  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:03.674005  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:03.674789  8107 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 13: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:03.678938  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:03.679201  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.680691  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:03.681284  8174 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:03.682956  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:03.683468  8182 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:03.683730  8179 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 13: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:03.685190  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:03.663508 12663 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:03.663261 12650 raft_consensus.cc:2764] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:18:03.687769  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 72342.6us
I20260709 13:18:03.667539 12407 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:03.692741  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.675954 12544 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:03.674451 12669 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:03.668267 12148 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:03.675645 12539 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:03.674185 12560 raft_consensus.cc:697] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:03.703835  8174 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:03.708853  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.690728 12391 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:03.698314 12544 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:03.716213  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.722618  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:03.723191  8176 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:03.696584 12407 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.704440 12181 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:03.696134 12540 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:18:03.707407 12333 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:03.704334 12148 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:03.727216  8054 auto_rebalancer.cc:629] Failed to schedule move for tablet b491e7c261394e498f940b0169e957b6: Illegal state: Replica 9bd264598fd2483e9e17674bab9ba4e8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:03.760936  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:03.741248  8755 leader_election.cc:400] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 10. Current term is 11.
I20260709 13:18:03.651074 12464 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:03.729949 12687 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:18:03.724189 12544 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:03.746126  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45896.8us
W20260709 13:18:03.723631 12682 log.cc:927] Time spent T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.203s	user 0.005s	sys 0.000s
I20260709 13:18:03.747648 12545 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.710553 12646 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:03.749898 12560 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:03.759037 12148 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:03.751274  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:03.787206  8254 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:03.751726  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:03.751811  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:03.752887 12632 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:03.721521 12650 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:03.730592 12686 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:18:03.740095 12407 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:03.754477 12540 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:03.761834  8177 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 10: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:03.749938 12539 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:18:03.724654 11993 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:03.779692  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:03.781183  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:03.781601  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:03.782406  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 64134.3us
I20260709 13:18:03.789880  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:03.778582  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:03.790772  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:03.792855  8178 raft_consensus.cc:1240] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:18:03.807340  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:03.808053  8177 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:03.809991  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.811378  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.813235  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.814033  8175 raft_consensus.cc:2393] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:03.795948  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:03.841027  8177 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:03.764788 12181 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:03.761912  8174 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:03.841077  8179 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:03.796700 12633 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:03.803197 12540 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:03.785211 12679 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:03.807050 11993 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.757721 12483 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.843884 12333 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:03.802028 12657 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:18:03.848405 12646 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:18:03.875079  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.857825 11993 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:03.879314  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:03.880257  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:03.841831 12650 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:18:03.882131 12688 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 13:18:03.882894 12639 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:03.883158  8252 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:03.876886 12689 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:03.883447 12181 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.884172 12702 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:03.891458  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:03.884980 12669 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:03.920858  8252 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:18:03.924022  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 68755.1us
I20260709 13:18:03.924896  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.925767  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:03.926887  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:03.928462  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:03.882910 12333 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 14.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:18:03.952252 12679 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:03.953632 12704 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:03.954403 12704 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:03.954869 12704 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:03.954725 12560 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:03.955998 12704 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.917997 12689 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:03.923424 12669 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.929356 12691 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:03.931375 12639 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:03.984694  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:03.889110 12540 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:03.920058 12636 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:18:03.930183 12702 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:04.012177  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.984295 12669 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:04.056885  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 124917us
I20260709 13:18:04.005810 12685 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:04.005414 12646 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:03.985381 12477 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 13:18:04.077307 12697 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:18:04.079550 12701 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:18:04.017618 12391 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:04.053200 12691 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:18:04.105687  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 309797us
I20260709 13:18:04.018355 12668 raft_consensus.cc:3055] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:04.111649  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:04.117374  8255 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.113296  8102 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:18:04.023730 12524 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
W20260709 13:18:04.126312  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 308373us
I20260709 13:18:04.131356  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:04.133149  8108 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:04.134814  8099 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 12: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:04.135567  8248 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:18:04.119033 12668 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:04.062361 12702 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:18:04.108740 12391 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:18:04.130716 12706 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:18:04.146704  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:04.129578 12333 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:04.106033 12685 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:04.169989  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 391197us
I20260709 13:18:04.156450  8786 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:18:04.187116  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.147260 12632 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:04.281781  8255 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
W20260709 13:18:04.281629  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 100576us
W20260709 13:18:04.264964 12644 consensus_meta.cc:287] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.634s	user 0.008s	sys 0.004s
I20260709 13:18:04.309666  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:04.293550  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:04.265369 12702 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:04.339444  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 46038.2us
I20260709 13:18:04.215497 12679 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:18:04.365944  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:04.258930 12407 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:04.291157 12659 log.cc:927] Time spent T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:18:04.183223 12464 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.130s
I20260709 13:18:04.127393 12689 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:04.284399 12477 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.181876 12333 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:04.270673 12391 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:04.290341 12720 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:18:04.373971  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.337854 12722 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:04.185467 12646 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:04.381093 12512 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.337850 12644 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:04.431162 12707 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:18:04.356081 12702 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:04.434165 12694 raft_consensus.cc:2764] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:18:04.434801 12650 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:04.435246 12650 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:04.436002 12650 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.5, Last appended by leader: 5, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:04.437455 12650 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.181849 12691 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:04.447324 12148 consensus_meta.cc:287] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.662s	user 0.010s	sys 0.001s
I20260709 13:18:04.447994 12148 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:04.421604 12688 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:04.449474  8180 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:18:04.450150 12512 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:04.425580 12722 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:04.455303 12722 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:04.313517 12668 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:04.459688  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:04.460309  8248 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.465245  8249 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:04.481166  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:04.489603  8257 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:18:04.486853 12673 consensus_meta.cc:287] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.826s	user 0.006s	sys 0.007s
I20260709 13:18:04.524107  8108 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:18:04.524554  8108 pending_rounds.cc:85] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 4
I20260709 13:18:04.524777  8108 pending_rounds.cc:107] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:18:04.525023  8108 raft_consensus.cc:2889] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:04.528012 12723 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:18:04.528308 12644 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:04.544010 12724 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:18:04.547895  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.472617 12539 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:18:04.471743 12477 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:04.557936  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 199244us
I20260709 13:18:04.559424  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:04.564512  8248 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
W20260709 13:18:04.550338  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 370052us
I20260709 13:18:04.424054 12720 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:04.567551 11993 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.680s	user 0.009s	sys 0.005s
I20260709 13:18:04.614727  8100 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:18:04.646790  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 87454.5us
I20260709 13:18:04.650745  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:04.654726  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:04.683635  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.712996  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:04.595316 12688 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.587291 12181 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:04.723009  8181 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 13: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:04.613464 12681 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.734095  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:04.739593  8174 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:04.613837 12704 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:04.740465  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 92586.2us
I20260709 13:18:04.613011 12407 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:04.724989 12646 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.773903  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:04.781589  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 424192us
I20260709 13:18:04.664225 11993 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:04.785902  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1642) took 1108 ms. Trace:
W20260709 13:18:04.780599  8221 leader_election.cc:336] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.215s (SENT)
I20260709 13:18:04.786453  8180 rpcz_store.cc:276] 0709 13:18:03.677704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.678267 (+   563us) service_pool.cc:224] Handling call
0709 13:18:03.691354 (+ 13087us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:04.449984 (+758630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.785651 (+335667us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b540031ecd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:04.785842 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742960896}
I20260709 13:18:04.787024  8221 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:04.771023 12669 consensus_meta.cc:287] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.696s	user 0.011s	sys 0.000s
W20260709 13:18:04.788667  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 183655us
I20260709 13:18:04.791651  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:04.790089  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 135246us
I20260709 13:18:04.768751 12148 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:04.737555 12673 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:18:04.803047  8254 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:18:04.789759 12689 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:04.764505 12704 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:04.813128 12729 log.cc:927] Time spent T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:18:04.793305 12644 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:04.822988  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2503) took 1064 ms. Trace:
I20260709 13:18:04.753993 12181 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:04.823396  8176 rpcz_store.cc:276] 0709 13:18:03.758901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.766021 (+  7120us) service_pool.cc:224] Handling call
0709 13:18:04.822777 (+1056756us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b5400329454. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:04.822928 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1273023232}
I20260709 13:18:04.831055 12745 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:18:04.831797 12719 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.556s	user 0.001s	sys 0.005s
I20260709 13:18:04.832986 12745 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:04.829285 12726 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.248s
I20260709 13:18:04.835225 12726 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.835698 12726 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:04.815732 12544 consensus_meta.cc:287] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.031s	user 0.013s	sys 0.000s
I20260709 13:18:04.783082 12646 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:04.736873 12688 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:04.804087 12702 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:04.852628  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 72208us
W20260709 13:18:04.855559  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 64048.3us
I20260709 13:18:04.760731 12681 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:04.858508 12720 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:04.858954 12681 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:04.859874 12540 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.863005  8177 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:04.854045  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 80142.9us
I20260709 13:18:04.865130  8248 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:04.865177  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:04.866894  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:04.870785  8257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2639) took 1292 ms (client timeout 1636 ms). Trace:
I20260709 13:18:04.796711 12669 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:04.871218  8257 rpcz_store.cc:269] 0709 13:18:03.578046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.580736 (+  2690us) service_pool.cc:224] Handling call
0709 13:18:04.870595 (+1289859us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b5400197154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:04.870721 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2083538688}
I20260709 13:18:04.821926 12689 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:04.873979  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:04.878731  8176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:04.879508  8176 raft_consensus.cc:606] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:04.876905 12644 consensus_queue.cc:1059] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:18:04.880573 12644 raft_consensus.cc:3055] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:04.880924 12644 raft_consensus.cc:740] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:18:04.882091 12733 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:18:04.881836 12644 consensus_queue.cc:260] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:04.882980  8255 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:18:04.883716 12739 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:18:04.883853 11993 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:04.884685 12477 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:04.885510 12735 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.110s
I20260709 13:18:04.886387 12688 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:04.886904 12688 consensus_queue.cc:1059] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:04.887909 12688 raft_consensus.cc:3055] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:04.888394 12688 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:04.889081 12663 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:04.889217 12688 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:04.889695 12747 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:04.891067  8252 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:04.887059 12690 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:04.893124  8177 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:04.887844  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:04.894459  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:04.854259 12544 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:04.900139  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:04.902377 12688 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:04.902899 12735 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:04.903288 12726 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:04.904120 12685 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:04.907637  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:04.909042  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.909042  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:04.878177 12681 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.904764 12717 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.944382 12717 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:04.946945  8072 leader_election.cc:336] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.518s (SENT)
I20260709 13:18:04.947306 12708 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:04.947675 12708 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:04.920264  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:04.883020 12644 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.922812  8149 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:04.909595 12560 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:18:04.925477 12464 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:04.960651  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:04.961546  8250 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:04.925661 12690 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:04.926643  8176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:04.927354 12669 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:04.928256 12685 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:04.928575 12181 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:04.928750 12735 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:04.979130  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:04.979981  8788 raft_consensus.cc:2393] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 9: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:04.979497  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:04.877562 12689 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.920305 12736 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:04.915083  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:04.939409 12483 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.939658  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:04.982350  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:04.940289  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.983140  8103 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:04.942890  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2502) took 1178 ms. Trace:
I20260709 13:18:04.984076  8249 rpcz_store.cc:276] 0709 13:18:03.764447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.764640 (+   193us) service_pool.cc:224] Handling call
0709 13:18:04.942660 (+1178020us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b5400197654. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:04.942823 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354077568}
I20260709 13:18:04.948470  8257 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:18:04.921123 12704 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:04.988837  8255 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:04.958653  8248 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.959435  8256 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:04.963424  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:04.992439  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 84910us
I20260709 13:18:04.917884 12747 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:18:04.979673  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:04.987818  8253 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:18:04.954023  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:04.965833  8176 raft_consensus.cc:606] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:04.964915 12726 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:05.032357  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:05.001588  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:05.033138  8253 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:05.034250  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:04.995903 12656 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:05.034858  8253 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:18:05.035820  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:05.008368 12512 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:04.965886 12464 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.981750 12745 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:18:05.013022 12716 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.835s	user 0.007s	sys 0.000s
I20260709 13:18:05.017809 12148 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.994581 12685 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:04.988258 12748 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:18:05.020395 12717 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:05.020048 12735 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:05.021478 12524 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.965186 12494 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:04.999040 12483 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.026882  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:05.028656 12720 raft_consensus.cc:993] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:18:05.030192 12544 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:05.030480 12545 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:04.981703 12632 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:18:04.970556 12540 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.033193  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:05.033815 12708 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.005040 12753 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.033107  8254 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:04.953166 12663 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.000988  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:05.001838 12731 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:04.978583 12146 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:18:05.046082  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:05.159366  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 94769.7us
I20260709 13:18:05.038692  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:05.160379  8108 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:18:05.161520  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:05.048350  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.051066  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:05.053009  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:05.054623  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:05.162640  8789 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:18:05.163131  8099 raft_consensus.cc:2410] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
W20260709 13:18:05.162998  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 108496us
I20260709 13:18:05.066910  8103 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:18:05.089469  8249 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:05.083192  8248 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:05.090983  8106 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:05.167528  8108 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 15: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:18:05.067711 12679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.018s	sys 0.018s
I20260709 13:18:05.095062  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:05.170806  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:05.171080  8101 raft_consensus.cc:2393] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:05.103668 12681 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:05.112279  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.103176  8257 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 15: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:18:05.166548  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 91371us
I20260709 13:18:05.081310 12148 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:05.167622  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 174563us
I20260709 13:18:05.168541  8107 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:05.050706 12464 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:05.098188 12646 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:05.090095 12494 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.129662 12731 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:05.186156  8249 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:05.128899 12704 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:05.080438 12524 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:05.170439 12679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.018s	sys 0.018s
I20260709 13:18:05.174404 12717 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:05.126814 12540 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:05.243027  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55903.5us
I20260709 13:18:05.288179  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:05.188024 12747 raft_consensus.cc:1081] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Signalling peer 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:18:05.188232 12750 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:05.247162  8103 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:18:05.271363  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 94341.4us
I20260709 13:18:05.251086  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:05.159989 12663 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:05.272215  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2497) took 1522 ms. Trace:
W20260709 13:18:05.244325  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 68072.5us
I20260709 13:18:05.271698  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2503) took 1478 ms. Trace:
I20260709 13:18:05.301059  8147 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:05.232391 12631 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:05.170207 12754 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:18:05.308377 12736 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:05.306988 12391 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:05.234153 12673 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:05.239034 12731 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:05.298123  8251 rpcz_store.cc:276] 0709 13:18:03.765681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.765848 (+   167us) service_pool.cc:224] Handling call
0709 13:18:03.788106 (+ 22258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:03.788522 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.788563 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:03.789050 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:18:04.062062 (+273012us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:04.062129 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.062216 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:05.012368 (+950152us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:05.234970 (+222602us) raft_consensus.cc:1685] finished
0709 13:18:05.235000 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:05.243628 (+  8628us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4109,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":3111,"spinlock_wait_cycles":65497856,"thread_start_us":211506,"threads_started":1,"wal-append.queue_time_us":317032}
I20260709 13:18:05.297534  8250 rpcz_store.cc:276] 0709 13:18:03.750193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.750929 (+   736us) service_pool.cc:224] Handling call
0709 13:18:03.751304 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:04.961941 (+1210637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.271759 (+309818us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540030cfd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:05.272126 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2782934912}
I20260709 13:18:05.287369 12646 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:05.316385 12725 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:18:05.180457 12685 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:05.347451  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.272235 12704 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.317525 12741 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:05.352216  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:05.304067 12720 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:18:05.361276  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:05.371937  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 75358.8us
I20260709 13:18:05.374123  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.387540  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:05.377760 12540 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:05.381666  8177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:05.382802 12752 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.372151  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.348845 12748 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:05.316612 12631 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.347885 12544 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.408107  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.408318  8149 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:18:05.414324  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 163325us
I20260709 13:18:05.419757  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.325841 12673 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.344558 12646 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:05.429143  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.412168 12748 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.431862  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:05.509557  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.436733  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.515805  8786 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:18:05.413281 12181 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:05.554149  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:05.556504  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:05.518260  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 86479.6us
I20260709 13:18:05.504951 12483 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:05.535184  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.536392  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.536754  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:05.562407  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:05.563143  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:05.561843  8783 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:05.568356  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:05.561287  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:05.573984  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.438516 12570 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:05.517096 12702 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.430346 12750 raft_consensus.cc:697] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:05.535295 12656 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:05.535092 11993 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.504658 12704 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:05.421077 12544 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.579480  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:05.534430 12748 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:05.560938 12741 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.573619 12633 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:05.560739 12181 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:05.568147 12545 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.567973 12540 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:05.596964  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.591504  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.410728 12752 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.575680 12717 raft_consensus.cc:697] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:05.573607 12754 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:18:05.577595 12333 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:05.577847 12570 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.161214 12753 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:05.731276  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 117094us
I20260709 13:18:05.622665  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:05.691226  8784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.004s	sys 0.012s
I20260709 13:18:05.590533 12656 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:05.734402  8784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.004s	sys 0.012s
I20260709 13:18:05.696837 12540 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:05.704564 12766 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:18:05.705160 12760 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.354s	user 0.000s	sys 0.001s
W20260709 13:18:05.706007 12644 consensus_meta.cc:287] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.743s	user 0.011s	sys 0.000s
I20260709 13:18:05.706362 12668 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:05.709709 12673 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:05.710390 12744 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.368s	user 0.001s	sys 0.001s
I20260709 13:18:05.710762 12730 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.730526 12483 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.585146 12148 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:05.642414 12681 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:18:05.721596  8253 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:05.723843  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.724192  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.702183 12181 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:05.579504 12567 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:05.742862 12759 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 13:18:05.744098 12757 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
W20260709 13:18:05.745457  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.745713 12750 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:05.747598 12753 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:05.721721 12727 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:18:05.588660 12702 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:05.711126 12752 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:05.614555 12745 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 13:18:05.729346 12570 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:05.596016 11993 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.761183  8256 raft_consensus.cc:2410] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:18:05.622921 12741 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:05.753181 12756 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.568s	user 0.002s	sys 0.000s
I20260709 13:18:05.764550  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:05.740681 12656 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:05.748226 12540 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:05.737905 12735 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:05.816669  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.818910  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.712522 12545 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:05.825089  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:05.817283 12689 consensus_meta.cc:287] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.804s	user 0.008s	sys 0.003s
I20260709 13:18:05.843708 12689 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.796057 12637 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:18:05.847360 12637 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:05.847882 12637 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:05.740142 12746 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:18:05.734639 12749 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.425s
I20260709 13:18:05.830036  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:05.852533  8784 raft_consensus.cc:2368] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11.
I20260709 13:18:05.853408  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.853998  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:18:05.822662 12683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.011s	sys 0.027s
W20260709 13:18:05.837638  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 73151.1us
I20260709 13:18:05.838101  8253 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:05.797191 12483 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.841581  8785 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:18:05.839166 12752 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:05.873900  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:05.842962 12673 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.838950 12646 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:05.863539 12636 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:05.864776  8105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:18:05.864774  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:05.867120  8100 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:05.878420  8183 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:05.869484  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:05.877722  8105 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:18:05.871172 12464 consensus_meta.cc:287] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.627s	user 0.005s	sys 0.008s
I20260709 13:18:05.879688  8105 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:05.797191 12730 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.834977 12524 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:05.879151  8103 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
W20260709 13:18:05.870070 12683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.012s	sys 0.027s
I20260709 13:18:05.881716  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:05.894392  8100 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:05.881680  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.882879  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:05.893837  8177 raft_consensus.cc:606] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:05.895474  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.895687  8101 raft_consensus.cc:2410] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:18:05.895776  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.875164 12633 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:18:05.879215 12777 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.186s	user 0.004s	sys 0.000s
I20260709 13:18:05.899783  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:05.878317 12631 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:05.901945  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.902520  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.848991 12637 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.904330  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:05.882336 12689 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:05.905315  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.909373  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2517) took 1255 ms. Trace:
I20260709 13:18:05.909464  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:05.835645 12717 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:05.918221  8183 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:05.911917 11993 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:05.880501 12673 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.916167 12702 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:05.894616 12524 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:05.903010 12646 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.878600 12753 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:18:05.941905 12524 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.907328  8791 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
W20260709 13:18:05.924422 12391 consensus_meta.cc:287] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.596s	user 0.007s	sys 0.000s
I20260709 13:18:05.950206  8784 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:05.909503  8785 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:05.909888  8179 rpcz_store.cc:276] 0709 13:18:04.653841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.654019 (+   178us) service_pool.cc:224] Handling call
0709 13:18:04.654395 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:04.783497 (+129102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:04.783529 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:04.823993 (+ 40464us) log.cc:844] Serialized 52 byte log entry
0709 13:18:04.958207 (+134214us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:04.958471 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.958810 (+   339us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:05.909109 (+950299us) raft_consensus.cc:1685] finished
0709 13:18:05.909133 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:05.909310 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":171047,"raft.run_cpu_time_us":43,"raft.run_wall_time_us":43,"thread_start_us":145843,"threads_started":2,"wal-append.queue_time_us":273666}
W20260709 13:18:05.918125 12783 log.cc:927] Time spent T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:18:05.921167 12781 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:18:05.923825 12738 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:05.924502 12512 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:05.926587 12483 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:05.880955 12636 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.979620  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.980934  8791 raft_consensus.cc:2410] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:18:05.874394 12735 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:05.931348  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:05.934592 12786 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:05.935263 12778 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:18:05.935882 12673 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:05.884236 12464 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:05.936756 12741 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:05.937700 12730 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:05.904788 12789 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.956947  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:05.959570  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 54178.7us
W20260709 13:18:05.976689  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.927604 12494 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:05.941944 12646 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.943827 12570 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:05.977140 12512 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:06.096318  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:06.103701 12773 raft_consensus.cc:2764] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:18:06.104481 12773 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:05.977630 12738 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:06.105751 12512 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.107016 12738 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.107637 12786 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.108316 12738 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:05.977401 12749 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 13:18:06.109683  8179 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:06.038558  8790 raft_consensus.cc:2410] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:18:06.038057 11993 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.117202 12646 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:06.120849  8105 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:05.979207 12752 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:06.111460  8787 raft_consensus.cc:2393] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 13: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:06.111268 12540 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.113024 12464 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:06.113724  8249 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:06.115638  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.115779  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:06.147400  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.118543  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:05.985359  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:06.148164  8183 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:05.963093 12544 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:06.080044 12631 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.071012 12524 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:06.145812  8179 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:18:06.148535  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:06.148846  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 44760.4us
I20260709 13:18:06.129297  8103 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 14: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:06.094895 12636 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:06.097276 12731 consensus_meta.cc:287] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.751s	user 0.004s	sys 0.010s
I20260709 13:18:06.014931 12633 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.161989  8105 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:06.146184 11993 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.166507  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.161569 12631 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.162520  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:06.161042  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:06.168466  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:06.169589  8179 pending_rounds.cc:85] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 7
I20260709 13:18:06.170024  8179 pending_rounds.cc:107] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:18:06.170338  8179 raft_consensus.cc:2889] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:06.058743 12787 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:18:06.175915  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:06.172416 12786 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:06.174175 12631 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:06.174213  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.177901  8105 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:06.160985 12734 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.153059  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:06.180821 12734 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:06.170182  8223 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.129:45123 timed out after 1.715s (SENT) [suppressed 26 similar messages]
I20260709 13:18:06.168301  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2660) took 1123 ms. Trace:
I20260709 13:18:06.181919  8253 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:06.151417 12148 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:06.182300  8251 rpcz_store.cc:276] 0709 13:18:05.044785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.382469 (+337684us) service_pool.cc:224] Handling call
0709 13:18:05.382759 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.407201 (+ 24442us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:05.599551 (+192350us) log.cc:844] Serialized 14 byte log entry
0709 13:18:05.817974 (+218423us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:05.818028 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:05.818085 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.168099 (+350014us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b54002e9354. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:06.168142 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.168255 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12617,"prepare.queue_time_us":148356,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":82,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2231,"spinlock_wait_cycles":55556480,"thread_start_us":397377,"threads_started":2,"wal-append.queue_time_us":285007}
W20260709 13:18:06.193615  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45157.9us
I20260709 13:18:06.194355  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:06.195740  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:06.196297  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:06.162600 12540 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:06.174239  7993 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9abaa411847e4bf9907f7af5e2689c7b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9bd264598fd2483e9e17674bab9ba4e8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:06.131332 12789 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.201088 12795 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:06.186300 12731 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:06.202472 12570 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:06.195039 12148 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.203848 12731 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:06.204810 12148 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:06.205802 12748 consensus_meta.cc:287] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.000s
I20260709 13:18:06.206074 11993 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:06.206243 12748 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:06.208532 12748 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:06.213064  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:06.214010  8251 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
W20260709 13:18:06.216120  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 47703.9us
I20260709 13:18:06.218044  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:06.197803 12752 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:06.198980 12749 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:06.223719  8179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:06.225266  8179 raft_consensus.cc:606] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:06.225771  8179 raft_consensus.cc:614] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:06.214779 12685 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:06.223289 12752 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.231182 12752 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:06.232829 12789 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:06.236838 12181 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.238265  8174 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:18:06.239500 12181 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:06.241334  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:06.225989 12731 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:06.224752 12749 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.215766 12656 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.261917 12656 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:06.262416 12752 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.262945  8108 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:18:06.264809 12752 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:06.266880  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2651) took 1303 ms. Trace:
I20260709 13:18:06.267468  8256 rpcz_store.cc:276] 0709 13:18:04.963103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.992255 (+ 29152us) service_pool.cc:224] Handling call
0709 13:18:06.266627 (+1274372us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54000924d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:06.266805 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665862400}
I20260709 13:18:06.271562 12708 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:06.266957  8179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
W20260709 13:18:06.273574  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.274008  8179 raft_consensus.cc:606] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:06.274510  8179 raft_consensus.cc:614] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:06.275748  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:06.276824 12773 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:06.277455  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:06.279126 12464 raft_consensus.cc:2764] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:18:06.280962 12746 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:06.281728 12746 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.282518 12731 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:06.284207  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:06.284921 12746 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:06.259400 12795 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:06.259858 12749 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:06.258244  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.289753 12734 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:06.292958  8072 connection.cc:256] RPC call timeout handler was delayed by -1.2396603380000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 13:18:06.297811  8072 leader_election.cc:336] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.517s (SENT)
I20260709 13:18:06.298375  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:06.284950  8786 raft_consensus.cc:2368] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11.
I20260709 13:18:06.292690  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:06.229310 12685 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.300311  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:06.304055  8072 connection.cc:256] RPC call timeout handler was delayed by -1.0293451210000057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
I20260709 13:18:06.303460  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:06.257197  8253 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:06.310546  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2647) took 1354 ms. Trace:
I20260709 13:18:06.310948  8255 rpcz_store.cc:276] 0709 13:18:04.956566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.957840 (+  1274us) service_pool.cc:224] Handling call
0709 13:18:04.985753 (+ 27913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:04.989211 (+  3458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.310352 (+1321141us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b54002e8950. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:06.310502 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63425920}
I20260709 13:18:06.306663 11993 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:06.306753 12669 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.314441 12669 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.316720 12669 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:06.311290 12633 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.318092 12633 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.294803 12146 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.321983 12146 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.324635 12146 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:06.277384 12773 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:06.309633  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:06.303022 12789 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:06.305729 12685 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:06.305716 12560 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:06.337114  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:06.312927 12752 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:18:06.342125 12734 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:06.351019  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.352563  8182 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:06.361783  8178 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 9: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:06.350651  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.362993  8103 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:06.364588  8223 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:06.365653 12789 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:06.366155 12789 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:06.366627 12789 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.350431 12734 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:06.345574 12801 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:18:06.373235  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:06.371882 12734 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:06.348465 12775 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.655s	user 0.001s	sys 0.001s
W20260709 13:18:06.378567  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.378880 11993 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:18:06.383630  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2658) took 1393 ms. Trace:
I20260709 13:18:06.384110  8257 rpcz_store.cc:276] 0709 13:18:04.989931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.246422 (+256491us) service_pool.cc:224] Handling call
0709 13:18:05.246779 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:05.294233 (+ 47454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.294272 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:05.304399 (+ 10127us) log.cc:844] Serialized 52 byte log entry
0709 13:18:05.582340 (+277941us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:05.582385 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.582453 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:06.347867 (+765414us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:06.383267 (+ 35400us) raft_consensus.cc:1685] finished
0709 13:18:06.383296 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.383545 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27749,"raft.queue_time_us":27913,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":13966,"spinlock_wait_cycles":12840320,"thread_start_us":244198,"threads_started":1,"wal-append.queue_time_us":372384}
I20260709 13:18:06.386117  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:06.386850  8783 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:06.388101  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.388764  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:06.388931  8105 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:06.389986  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.390133  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:06.390627  8101 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:18:06.391155  8105 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:06.388597 12786 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:06.391564  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.396680  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.397255  8102 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
W20260709 13:18:06.398195  8054 auto_rebalancer.cc:629] Failed to schedule move for tablet 3393bfbad81242a2a3374049ddfa0b63: Illegal state: Replica 9480609eccc44250a4d7fcc9686e76cf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:06.379387 12773 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:06.401526  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:06.402657  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:06.403674  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:06.404209 12786 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:06.406000 12544 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:06.406387 12544 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.406733 12544 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:06.407011  8106 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:06.344259 12633 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:06.353801 12746 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:06.409289 12746 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:06.409610  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1646) took 1453 ms. Trace:
I20260709 13:18:06.409865  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:06.410333 12746 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.411192  8223 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:06.404675 11993 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:06.411916 12702 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:06.412537 12786 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:06.411990 11993 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.413415 11993 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:06.412941 12786 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.420339 12786 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:06.422832 12690 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:06.392213  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.423449 12690 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:06.424355  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.412851  8252 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:06.428527  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.428843  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.435065  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.435386  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.436805  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:06.436899  8174 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:06.440996  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.443789  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.444046  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.444458  8179 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:06.445041 12512 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:06.445251 12746 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:06.445677 12544 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.447721 12544 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:06.428213 12694 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:06.449856 12694 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:06.450806 12734 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:06.450937 12694 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:06.452358 12694 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.454262 12685 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.461891  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:06.435948  8099 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:06.410038  8104 rpcz_store.cc:276] 0709 13:18:04.955995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.956136 (+   141us) service_pool.cc:224] Handling call
0709 13:18:04.978814 (+ 22678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.962738 (+983924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.962779 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:05.962833 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:05.962886 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.409344 (+446458us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b540037a854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:06.409388 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.409527 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15403,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":12202,"spinlock_wait_cycles":2262142848}
I20260709 13:18:06.466615  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:06.475394  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.475945  8177 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:18:06.486009  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.489046  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:06.453245 12734 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:06.500159  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:06.496169  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.496325 11993 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.497522  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:06.498291  8054 auto_rebalancer.cc:629] Failed to schedule move for tablet 8ea7d5dc3d1d486a8f4ff9478d8fcefb: Illegal state: Replica 9bd264598fd2483e9e17674bab9ba4e8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:06.501377  8105 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 8.
I20260709 13:18:06.502539  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.499367  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:06.499583  8786 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:18:06.503348  8178 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:18:06.500928  8104 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:06.504570  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.506451  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.507246  8106 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:18:06.425410 12690 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:06.509106  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.474733 12544 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:06.514773 11993 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:06.488749 12407 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:06.516606  8782 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:06.495419 12646 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:18:06.518687  8790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48110 (request call id 1202) took 1565 ms (client timeout 2030 ms). Trace:
W20260709 13:18:06.519136  8790 rpcz_store.cc:269] 0709 13:18:04.953559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.953778 (+   219us) service_pool.cc:224] Handling call
0709 13:18:06.518487 (+1564709us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540050e1d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:06.518626 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2396102016}
I20260709 13:18:06.520355  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:06.529307  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:06.529464  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:06.530972  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:06.531576  8183 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:06.533886  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:06.533946  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:06.464048 12709 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:18:06.539062  8783 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:18:06.568776  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.521775 12646 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.607700 12646 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:06.683990  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.714607 12492 raft_consensus.cc:3055] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:06.715236 12492 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:06.716095 12492 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.718276  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.719079  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2529) took 1283 ms. Trace:
I20260709 13:18:06.719368  8180 rpcz_store.cc:276] 0709 13:18:05.436120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.436277 (+   157us) service_pool.cc:224] Handling call
0709 13:18:06.603676 (+1167399us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b58000d7d98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27eee 0000000000375939 00007fa5a5d9b1e0 00007fa5a5e640c4 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:18:06.719023 (+115347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43743488}
I20260709 13:18:06.720417  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2523) took 1720 ms. Trace:
I20260709 13:18:06.720772  8107 rpcz_store.cc:276] 0709 13:18:04.999585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.999757 (+   172us) service_pool.cc:224] Handling call
0709 13:18:05.000026 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.179801 (+179775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.615605 (+1435804us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540001bdd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:06.720367 (+104762us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292149504}
I20260709 13:18:06.721892 12735 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:06.722695 12750 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:06.723239 12750 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.723641  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:06.724819  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:06.726315  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:06.726878  8255 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:06.729967  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.730556  8100 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:06.714670  8174 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:06.733615  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.735442  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:06.736570  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.737120  8108 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
W20260709 13:18:06.737807  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 207283us
I20260709 13:18:06.738189  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.738474  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:06.726467 12750 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:06.739760  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:06.739923  8183 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:06.740368  8782 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:06.740494  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:06.740767  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:06.741364  8253 raft_consensus.cc:2368] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12.
I20260709 13:18:06.741328  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:06.741488  8787 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:18:06.742236  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:06.804769  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.856704  8253 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:06.786027  8252 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:06.744532  8099 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:18:06.773222  8104 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:06.780115  8100 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:06.742939  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:06.745671  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:06.859238  8101 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:06.859443  8255 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:06.743263  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:06.784408  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2662) took 1734 ms. Trace:
I20260709 13:18:06.743024  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.743846  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:06.743566  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:06.861627  8108 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
W20260709 13:18:06.833026  8054 auto_rebalancer.cc:629] Failed to schedule move for tablet c0190f54981846a5a2a1df128af42b35: Illegal state: Replica 9bd264598fd2483e9e17674bab9ba4e8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:06.861675  8102 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:06.742511  8256 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:06.798563  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.860466  8250 rpcz_store.cc:276] 0709 13:18:05.050346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.699046 (+648700us) service_pool.cc:224] Handling call
0709 13:18:05.699428 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.721257 (+ 21829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.722936 (+  1679us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:06.404409 (+681473us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b180035a6a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd2d2a6 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a
0709 13:18:06.404827 (+   418us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b2c000e7a78. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:18:06.405275 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:18:06.510704 (+105429us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:06.510745 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.510811 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:06.784204 (+273393us) raft_consensus.cc:1685] finished
0709 13:18:06.784222 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.784350 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9250,"raft.queue_time_us":11476,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":8814,"spinlock_wait_cycles":37418112,"thread_start_us":104992,"threads_started":1,"wal-append.queue_time_us":377362}
I20260709 13:18:06.744453  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.840392  8180 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:18:06.860610  8106 raft_consensus.cc:2368] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12.
I20260709 13:18:06.866338  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:06.867900  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:06.741747  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:06.870476  8180 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:18:06.867352  8108 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:18:06.871798  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:06.872879  8183 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:06.874326  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:06.831310 12789 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:06.878228 12814 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:06.880627  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:06.881338  8787 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:18:06.881907  8174 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:06.883143  8180 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:06.883769  8182 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:18:06.883083  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:06.885679  8180 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:06.886889  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:06.889295  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.769968 12407 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:06.890241  8182 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:06.892115 12694 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:06.878472 12545 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:06.815807 12708 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:06.882771 12749 consensus_meta.cc:287] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.003s
I20260709 13:18:06.905997  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.775018 12639 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:06.831310 12736 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:06.915552  8256 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:06.909215 12694 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.786470 12646 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.918707 12789 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:06.920251  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.935436  8174 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:06.785104 12663 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:06.924559  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.925093  8255 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
W20260709 13:18:06.937764 12808 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:18:06.938205 12721 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:06.938799  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.938877 12721 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.929867  8180 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: [11.12-11.12]
W20260709 13:18:06.941912 12780 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:18:06.929347 12708 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.942515 12708 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:06.756811 12702 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.144s
I20260709 13:18:06.926951  8104 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:06.926242 12544 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.922868 12685 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:06.957253  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.960626  8183 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 10.
I20260709 13:18:06.932957 12694 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:06.961671  8249 raft_consensus.cc:2368] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14.
W20260709 13:18:06.961753  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 223331us
I20260709 13:18:06.931569 12407 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:06.970135  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 479054us
I20260709 13:18:06.954773 12789 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:06.971537  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:06.973182  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.976001  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:06.977034 11993 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:06.978528 11993 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.978967  8102 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:06.979600  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:06.980997  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:06.981397  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:06.982702  8183 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:06.982980  8183 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:06.930306 12749 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:06.957275  8101 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:06.991875  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:06.997514  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.998340  8175 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:06.999466  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:06.935714 12639 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:07.003003 12639 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:07.015214  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:07.016047  8177 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:06.969082  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:06.935599 12736 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:07.027863  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.018342  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 49348.8us
I20260709 13:18:07.019112  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:07.033689  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:07.034590  8179 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:07.036860 11993 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:07.046752  8177 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:06.973917 12789 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:07.049695  8181 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 14. Ops: []
W20260709 13:18:07.056042  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.967854 12544 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:07.059474  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:07.011298 12721 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:07.063346  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:07.026324 12745 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.986310 12545 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
W20260709 13:18:07.051373 12746 consensus_meta.cc:287] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.005s
I20260709 13:18:07.043721 12734 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:07.070796 12734 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.071314 12734 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:06.974787 12407 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:07.068781  8179 raft_consensus.cc:2393] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:07.065038  8177 raft_consensus.cc:2393] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:07.072772  8180 raft_consensus.cc:2410] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:18:07.072808  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.074132  8102 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:07.093343 12708 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:07.098129  8176 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:07.111534  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2527) took 1676 ms. Trace:
I20260709 13:18:07.112015  8176 rpcz_store.cc:276] 0709 13:18:05.435483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.483210 (+ 47727us) service_pool.cc:224] Handling call
0709 13:18:07.097601 (+1614391us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b58000d7d98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:18:07.097873 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:07.111245 (+ 13372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.111467 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59760000}
I20260709 13:18:07.111016 12746 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:07.074649 12761 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:18:07.117877 12753 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.132789 12753 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:07.135149 12753 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:07.128012 12746 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:07.138899 12746 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:07.077302 12745 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:07.163103  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.131409 12761 consensus_queue.cc:1243] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:07.152868 12746 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:07.174346 12786 consensus_meta.cc:287] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.753s	user 0.012s	sys 0.000s
I20260709 13:18:07.184175 12786 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:07.185530 12819 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:07.186055 12819 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:07.187776 12745 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:07.188022 12819 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:07.189033 12736 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:07.189642 12736 raft_consensus.cc:3055] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:07.189978 12736 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:07.194116  8257 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:07.186378 12786 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:07.164224 12637 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:07.126444 12789 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:07.190881 12736 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:07.206092  8183 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:07.207341  8183 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:07.210000 12818 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:07.165391 12646 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:07.197500 12407 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:07.210603 12818 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.225615  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:07.226142 12709 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:07.229506 12709 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:07.231352  8790 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:07.231478 12709 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:07.226125  8147 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:07.233914  8786 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:07.234241  8786 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:07.234375 12681 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:07.226290  8783 raft_consensus.cc:3055] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:07.235322  8783 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:07.234990  8786 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:07.236001  8786 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:07.236126  8783 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:07.237246  8783 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:07.237751  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:07.240233  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 465284us
W20260709 13:18:07.240793  8221 connection.cc:256] RPC call timeout handler was delayed by -1.4062161659999219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
I20260709 13:18:07.219532  8101 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:07.200248 12708 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:07.246219  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:07.199934 12816 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:07.241180  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.251904  8221 leader_election.cc:336] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.752s (SENT)
I20260709 13:18:07.252707  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:07.268918  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 411632us
I20260709 13:18:07.269114  8786 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:18:07.276221  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.227011 12789 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:07.195884 12746 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:07.353609  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 43720.9us
I20260709 13:18:07.360198  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:07.238768 12818 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:07.369169 12753 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:07.374959  8183 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:18:07.384228  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:07.244457 12749 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:07.388960  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 412420us
W20260709 13:18:07.390173  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 138321us
W20260709 13:18:07.390919  8221 leader_election.cc:336] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.831s (SENT)
I20260709 13:18:07.393798  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:07.394613  8785 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
W20260709 13:18:07.398317  8221 leader_election.cc:336] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.871s (SENT)
I20260709 13:18:07.398900  8221 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:07.372363 12708 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:07.382452 12753 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.390830  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:07.416491  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:07.420084  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.371929 12745 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:18:07.301592 12734 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:07.408609 12720 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:18:07.427205  8221 connection.cc:256] RPC call timeout handler was delayed by -1.2866433889998916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 13:18:07.431171  8221 connection.cc:256] RPC call timeout handler was delayed by -1.2439604399999098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 13:18:07.431687  8221 connection.cc:256] RPC call timeout handler was delayed by -1.2367604399998982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
I20260709 13:18:07.409950 12753 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:07.435915  8221 leader_election.cc:336] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.577s (SENT)
I20260709 13:18:07.438482  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:07.423413 12639 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:07.452929  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.452734  8221 leader_election.cc:336] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.590s (SENT)
I20260709 13:18:07.454519  8221 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:07.457649  8788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 932) took 1022 ms. Trace:
I20260709 13:18:07.436755 12709 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:07.426499 12821 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:07.437297 12708 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.430927 12720 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:07.447216 12639 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:18:07.459967  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 427805us
I20260709 13:18:07.441172 12816 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.443753  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:07.485711  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.485680  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:07.467234  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 484512us
W20260709 13:18:07.480599  8221 leader_election.cc:336] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.906s (SENT)
I20260709 13:18:07.487008  8221 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:07.487936  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:07.489943  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.490311  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.491596  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:07.490375  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:07.456260 12646 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:07.499012  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:07.501245  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:07.504438  8177 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:07.461038 12407 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:07.513542  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.504288  8176 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:07.514428  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:07.458256  8788 rpcz_store.cc:276] 0709 13:18:06.435096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.436233 (+  1137us) service_pool.cc:224] Handling call
0709 13:18:06.453769 (+ 17536us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:06.454274 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:06.454315 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:06.454977 (+   662us) log.cc:844] Serialized 52 byte log entry
0709 13:18:06.713511 (+258534us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:07.020753 (+307242us) log.cc:844] Serialized 14 byte log entry
0709 13:18:07.457152 (+436399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.457259 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.457323 (+    64us) raft_consensus.cc:1685] finished
0709 13:18:07.457342 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.457568 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6275,"prepare.queue_time_us":643956,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":30028,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":30175,"thread_start_us":889468,"threads_started":3,"wal-append.queue_time_us":331603}
I20260709 13:18:07.497236 12720 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:07.497733 12639 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:07.521719  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.501566 12786 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:07.500890 12567 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.550235 12567 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:07.552479 12567 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:07.562399 12567 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.563053 12567 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:07.515908 12821 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:07.564574 12821 raft_consensus.cc:697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:07.565647 12821 consensus_queue.cc:237] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:07.566047 12567 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:07.540477 12694 consensus_meta.cc:287] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.002s
I20260709 13:18:07.502012 12816 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:07.541034 12746 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:07.542035 12734 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:07.545444 12685 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.497895 12708 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:07.546000 12540 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:07.522271 12545 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:07.479632 12709 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:07.546989  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.549605 12786 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:07.567552  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1657) took 1133 ms. Trace:
I20260709 13:18:07.613214  8181 rpcz_store.cc:276] 0709 13:18:06.433928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.436396 (+  2468us) service_pool.cc:224] Handling call
0709 13:18:06.436640 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:07.064339 (+627699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.567319 (+502980us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b540033fed4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:07.567493 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409377536}
I20260709 13:18:07.539341 12633 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:18:07.586908  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.524555 12646 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:07.603827 12769 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.039s	sys 0.045s
I20260709 13:18:07.613036 12685 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:07.613498 12545 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.637120  8783 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:18:07.638124  8783 pending_rounds.cc:85] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 9
I20260709 13:18:07.638425  8783 pending_rounds.cc:107] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:18:07.638726  8783 raft_consensus.cc:2889] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:07.630813 12769 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.039s	sys 0.045s
I20260709 13:18:07.616744 12633 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.606554 12694 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:07.645241  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:07.645961  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.646906  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:07.654331  8180 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:07.648707  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:07.641621 12545 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:07.665542  8784 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:07.654017 12633 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:07.674436  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:07.674228 12734 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:07.703655  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 319504us
I20260709 13:18:07.704782  8149 leader_election.cc:400] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12.
I20260709 13:18:07.705152  8149 leader_election.cc:403] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:18:07.679205  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:07.728685  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:07.738853  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.685941 12827 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:07.665791 12786 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:07.747246  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 96600.4us
W20260709 13:18:07.741183  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 366291us
W20260709 13:18:07.739876  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 254248us
W20260709 13:18:07.742029  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 261478us
I20260709 13:18:07.736272 12789 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:07.756943  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:07.758492  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:07.755309  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:07.759871  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:07.741237 12708 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:07.742650 12827 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:07.763516  8221 leader_election.cc:336] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.996s (SENT)
I20260709 13:18:07.764767  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:07.721122 12734 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:07.749976 12746 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12.
W20260709 13:18:07.773487  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.773926  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.775063  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:07.755295 12789 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:07.778154  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:07.774278  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:07.776172  8072 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:07.750226 12818 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:07.779542  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:07.801975  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:07.763478 12828 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:07.778837  8176 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:07.806738  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:07.810766  8174 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:07.811393  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:07.762709 12827 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:07.813575  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:07.814389  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:07.780514  8147 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:07.768244 12831 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:07.779732  8221 leader_election.cc:336] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.021s (SENT)
W20260709 13:18:07.823130  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 63352.6us
I20260709 13:18:07.775542 12835 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:07.781543 12789 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:07.824602  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2560) took 1080 ms. Trace:
I20260709 13:18:07.825472 12845 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:07.814090 12828 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:07.774996 12816 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:07.823513  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 47379.1us
W20260709 13:18:07.831425  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.844973  8107 rpcz_store.cc:276] 0709 13:18:06.744479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.777021 (+ 32542us) service_pool.cc:224] Handling call
0709 13:18:06.777355 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:07.001344 (+223989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.001389 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:07.001506 (+   117us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:07.001558 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.824304 (+822746us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400212ad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:07.824367 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.824535 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514578304}
I20260709 13:18:07.777215 12721 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:07.780527 12753 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:07.849237 12835 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:07.850032 12837 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:18:07.850617 12637 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:07.847668  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:18:07.851435  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 70880.9us
I20260709 13:18:07.852979  8180 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:18:07.776226 12708 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:07.775889 12668 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:07.773248 12512 consensus_queue.cc:1059] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:18:07.765774 12834 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
W20260709 13:18:07.878283  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.869289  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.846843  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45474.5us
I20260709 13:18:07.843659 12646 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:07.918808  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:07.912885  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:07.919616  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:07.919951  8257 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.920185  8100 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:07.915182  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:07.915799  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:07.902706  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.918529  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:07.918941  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:07.921584  8249 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:07.921873  8101 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:18:07.911880  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:07.810079 12746 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:18:07.845088 12694 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:07.819753 12843 consensus_queue.cc:1059] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 13:18:07.924810  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:07.961143  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:07.971117  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.971953  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:07.856024 12840 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:07.940744  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:07.847234 12845 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.941956  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:07.898618 12637 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.941351  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:07.940604  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 160881us
I20260709 13:18:08.028488  8256 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
W20260709 13:18:08.028702  8221 leader_election.cc:336] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.056s (SENT)
I20260709 13:18:07.989351  8101 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:07.989552  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:07.971614  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.030196  8250 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:07.940310 12407 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:07.924674  8254 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:18:07.990737 12836 log.cc:927] Time spent T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:18:08.034834  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:07.991725 12854 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:07.993542  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:07.920466 12646 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:07.996558 12844 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:07.846486 12833 consensus_queue.cc:1059] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 13:18:08.004801  8257 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:08.009691  8782 raft_consensus.cc:2393] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:07.856525 12828 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:07.970052  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:08.013672  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.918509 12745 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.150s
I20260709 13:18:08.015241 12851 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:08.078884 12663 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:08.079062 12851 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.079464 12851 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:07.886551 12835 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.012879  8252 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:07.925544  8183 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:08.025707 12845 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.023746  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:08.083249  8108 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:08.086304 12492 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:08.026269  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 171573us
I20260709 13:18:08.029374  8221 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:07.899550 12721 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:08.016499 12750 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:08.029670  8099 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:08.035656  8249 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:07.926091 12731 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:07.995994 12639 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.041366  8251 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.033154 12637 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:08.034488 12407 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:18:08.045567  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.012943 12746 consensus_queue.cc:1243] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer 5033fc7e66374940a203908ea8b0078f log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:08.047958 12740 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:08.051154 12846 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:08.052196 12852 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:08.057201 12685 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:08.064337 12749 raft_consensus.cc:3055] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:07.856485 12831 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:07.940902 12816 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:08.014750  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 212889us
W20260709 13:18:08.103471  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 113022us
I20260709 13:18:08.137161  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:08.137948  8783 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:08.106316  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:07.921281 12668 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.037196 12840 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:08.071373 12646 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:08.118938  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 90309.3us
W20260709 13:18:08.144481  8221 leader_election.cc:336] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.064s (SENT)
I20260709 13:18:08.103386 12750 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.126331 12753 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:08.128305 12720 consensus_meta.cc:287] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.000s
I20260709 13:18:08.128629 12740 consensus_queue.cc:1243] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:18:08.130153  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.131563  8107 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:08.139874  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:08.142146 11993 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:08.095589 12774 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:08.071138 12854 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.148250 12702 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:08.148550 12842 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:18:08.148313  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:08.092739 12844 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.149519 12734 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:08.118368 12731 raft_consensus.cc:697] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:08.113893 12761 raft_consensus.cc:3055] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:08.117956 12749 raft_consensus.cc:740] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:08.150544 12737 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:08.153961 12840 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.157573 12750 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:08.160315  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 54102.9us
I20260709 13:18:08.079470 12663 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:08.145897  8221 leader_election.cc:336] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.157s (SENT)
W20260709 13:18:08.118103 12848 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:18:08.168159  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:08.163375  8251 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
W20260709 13:18:08.171785 12836 log.cc:927] Time spent T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:18:08.216353  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 48305.8us
W20260709 13:18:08.220552  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 74676.9us
W20260709 13:18:08.225083  8221 leader_election.cc:336] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.214s (SENT)
I20260709 13:18:08.225569  8221 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:08.225857  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:18:08.227211  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 216861us
I20260709 13:18:08.171558 12774 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:08.176494 12740 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:08.158443 12833 consensus_queue.cc:1059] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:18:08.177181 12694 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:08.183009 12736 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:08.233357  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:08.234287  8174 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:18:08.248564  8174 pending_rounds.cc:85] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 7
I20260709 13:18:08.248829  8174 pending_rounds.cc:107] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:18:08.249068  8174 raft_consensus.cc:2889] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:08.234841  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.177402 12761 raft_consensus.cc:740] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:08.222868 12681 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:08.229525  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:18:08.245267  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.173085 12720 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.131510 12852 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.171025 12789 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.237783  8176 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:08.171335 12853 consensus_queue.cc:1059] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:18:08.237813 12818 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:08.238948 12859 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:08.263581  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1663) took 1754 ms. Trace:
I20260709 13:18:08.240151 12740 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:08.269843  8182 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:18:08.228662 12858 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.274720 12663 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:08.215351 12721 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.278573 12639 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:08.295053  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.296787  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.297166  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.329305  8250 raft_consensus.cc:2368] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10.
I20260709 13:18:08.329214  8257 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:08.330344  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.176931 12702 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.216898 12544 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:08.237599  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 168600us
I20260709 13:18:08.253854 12816 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:08.315919  8178 rpcz_store.cc:276] 0709 13:18:06.508954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.509157 (+   203us) service_pool.cc:224] Handling call
0709 13:18:06.515352 (+  6195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:06.775482 (+260130us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:06.775537 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:06.776130 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.607532 (+831402us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b18004c27c0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:18:07.770365 (+162833us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:07.770409 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.770507 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:08.257881 (+487374us) raft_consensus.cc:1685] finished
0709 13:18:08.257910 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.263499 (+  5589us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":249233,"raft.queue_time_us":259749,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9736,"spinlock_wait_cycles":66115968,"thread_start_us":162638,"threads_started":1,"wal-append.queue_time_us":1272562}
I20260709 13:18:08.215423 12856 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 13:18:08.318367  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.318948  8179 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:08.338721  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 103892us
I20260709 13:18:08.321074  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.339895  8251 raft_consensus.cc:2368] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14.
I20260709 13:18:08.321287  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.340934  8249 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:08.321873  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.262199 12681 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:08.324617  8248 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:08.279831 12746 raft_consensus.cc:2764] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:18:08.291064 12833 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:08.236254 12407 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.319617 12512 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.334846  8250 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:08.318303 12857 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.343536  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.355711  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.358750  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:08.344630  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:08.332937 12545 consensus_meta.cc:287] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.002s
I20260709 13:18:08.262508 12749 consensus_queue.cc:260] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:08.346069  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 113784us
W20260709 13:18:08.347072  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 171716us
I20260709 13:18:08.347078  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:08.351419  8254 raft_consensus.cc:2410] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:08.352730  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:08.332085 12859 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:08.353613  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:08.366051  8251 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:08.366909  8178 raft_consensus.cc:2410] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:18:08.367764  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:08.370153  8180 raft_consensus.cc:2368] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16.
I20260709 13:18:08.344087 12818 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.367951  8149 leader_election.cc:400] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12.
I20260709 13:18:08.374459  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 632) took 1518 ms. Trace:
I20260709 13:18:08.346127 12821 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:08.368655  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:18:08.351366 12633 consensus_meta.cc:287] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.677s	user 0.009s	sys 0.003s
I20260709 13:18:08.393666 12633 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.396435 12832 raft_consensus.cc:3055] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:08.396571 12633 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:08.396937 12832 raft_consensus.cc:740] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:08.347182 12681 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:08.397891 12832 consensus_queue.cc:260] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.399223 12832 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:08.376631  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:08.347684 12544 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:08.402523 12847 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.372s	user 0.002s	sys 0.000s
I20260709 13:18:08.402123 12544 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.407717  8248 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:08.408928  8248 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:08.350292 12833 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:08.385686 12821 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.386862 12844 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:08.387714 12854 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:08.429790  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:08.389823  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.431885  8252 raft_consensus.cc:2410] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 13:18:08.431928  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.327008 12858 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.411557  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:08.436304  8099 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:18:08.412173  8256 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:08.412828  8103 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:08.375487  8106 rpcz_store.cc:276] 0709 13:18:06.856162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.926859 (+ 70697us) service_pool.cc:224] Handling call
0709 13:18:06.956142 (+ 29283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:06.974819 (+ 18677us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:07.035754 (+ 60935us) log.cc:844] Serialized 14 byte log entry
0709 13:18:07.749124 (+713370us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:07.749664 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.749822 (+   158us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:07.753203 (+  3381us) log.cc:844] Serialized 14 byte log entry
0709 13:18:07.753408 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.753493 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:08.330500 (+577007us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b18002faee0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:18:08.374245 (+ 43745us) raft_consensus.cc:1685] finished
0709 13:18:08.374271 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.374404 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13511,"prepare.queue_time_us":71185,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":90,"raft.queue_time_us":125275,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":10188,"spinlock_wait_cycles":11444736,"thread_start_us":674572,"threads_started":2,"wal-append.queue_time_us":630370}
I20260709 13:18:08.414304  8249 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:18:08.414872  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:08.418208  8248 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:08.442698  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:08.443380  8176 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:08.420486  8251 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:08.422431  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:08.423388  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:08.426337  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:08.433880  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:08.446049  8105 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:18:08.447203  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 70689.4us
W20260709 13:18:08.446537  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 108460us
W20260709 13:18:08.432921  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 64567.2us
I20260709 13:18:08.331557 12731 consensus_queue.cc:237] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.429421 12734 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:18:08.434998 12867 log.cc:927] Time spent T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:18:08.450030  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:08.361550 12512 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.405414 12544 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:08.454947 12852 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:08.469411  8099 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:08.457370  8108 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:08.456624 12858 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:08.456805  8072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.016s	sys 0.044s
W20260709 13:18:08.485394  8072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.016s	sys 0.044s
W20260709 13:18:08.485755  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 629698us
I20260709 13:18:08.446242 12749 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:08.368374 12545 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.452024 12862 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:08.412420 12818 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.490386  8179 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:08.347270 12761 consensus_queue.cc:260] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.352603 12740 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:08.494356  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 44416.3us
I20260709 13:18:08.447211 12831 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:08.496218  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 48163.6us
I20260709 13:18:08.492260  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:08.496083  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 48054.8us
I20260709 13:18:08.488338  8256 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:18:08.497207  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:08.500478  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:08.500589  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:08.495746  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:08.495304  8074 leader_election.cc:400] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16.
I20260709 13:18:08.504093  8074 leader_election.cc:403] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:18:08.451547 12844 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:18:08.366654 12857 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.539601 12857 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:08.535218 12740 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:08.491757  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:08.549726  8099 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:08.505085  8149 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:08.497119  8107 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:08.505760  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:08.499819  8147 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:08.456984 12873 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:08.553869 12633 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16.
I20260709 13:18:08.502511  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:08.488901 12734 raft_consensus.cc:697] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:08.536231 12540 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:08.492398 12663 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:18:08.536906 12545 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:08.571473 12745 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:08.572365 12745 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:08.573271 12821 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:08.573307 12745 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.574391 12734 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.578286 12845 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.579671  8253 raft_consensus.cc:2368] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14.
I20260709 13:18:08.554250 12873 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.540632 12851 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.555472  8176 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:08.556025  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:08.558776  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:08.496783 12833 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.494616 12874 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:08.560436  8099 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:08.561630 12761 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:08.562265  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 62511.7us
W20260709 13:18:08.562888  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 57894.6us
I20260709 13:18:08.583989  8149 leader_election.cc:400] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14.
I20260709 13:18:08.583811  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:08.585028  8099 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:08.586084  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:08.560216  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:08.587034  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:08.587116  8248 raft_consensus.cc:2368] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16.
I20260709 13:18:08.587610  8099 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:08.537062 12865 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:18:08.585726  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:08.536247 12737 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:08.592170  8248 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:08.548980 12856 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.536099 12818 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:08.598547  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1667) took 1103 ms. Trace:
I20260709 13:18:08.606822  8179 rpcz_store.cc:276] 0709 13:18:07.495625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.495797 (+   172us) service_pool.cc:224] Handling call
0709 13:18:08.598391 (+1102594us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54001c2ad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:08.598491 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1848675584}
I20260709 13:18:08.600011  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:08.608505  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:08.608729  8101 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
W20260709 13:18:08.604636  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.499774 12746 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:18:08.610714  8099 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:08.611119  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:08.491547 12863 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:18:08.565737 12540 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:08.616082  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:08.617806  8787 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:08.618850  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.589756 12857 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:08.671814  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.699780  8251 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:08.699842  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.607607 12702 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:08.658993 12851 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:08.509707 12859 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.674047  8106 raft_consensus.cc:2410] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:18:08.660676 12789 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:08.668637 12540 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.664359 12749 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:18:08.662039  8182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2537) took 1737 ms (client timeout 1941 ms). Trace:
W20260709 13:18:08.662673 12646 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.000s
I20260709 13:18:08.652792 12845 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:08.739246 12646 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.741766  8255 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:18:08.721313 12828 consensus_meta.cc:287] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.643s	user 0.000s	sys 0.009s
I20260709 13:18:08.743513 12828 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.744939  8102 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:08.717792 12657 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:08.746057 12657 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:08.748092 12881 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:08.748749 12657 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:08.699258 12818 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:18:08.749301 12512 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:08.750761 12818 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.751173 12873 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:08.751264 12818 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.758883 12833 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:08.717702 12827 consensus_meta.cc:287] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.892s	user 0.007s	sys 0.005s
I20260709 13:18:08.759903 12827 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.760998  8257 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:08.761371  8102 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
W20260709 13:18:08.762338  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.764662  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:08.765602  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:08.766779  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:08.767371  8176 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:08.772006  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.622078  8105 raft_consensus.cc:2368] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14.
I20260709 13:18:08.693756  8099 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:18:08.698560  8248 raft_consensus.cc:2410] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:18:08.700687  8249 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:08.608093 12831 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:08.703540  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.708747  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.669317 12720 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:08.612340 12856 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:08.721390  8182 rpcz_store.cc:269] 0709 13:18:06.924188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.924324 (+   136us) service_pool.cc:224] Handling call
0709 13:18:08.661867 (+1737543us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54000127d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:08.661978 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3064369024}
I20260709 13:18:08.720374  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:08.723379 12540 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:08.683760 12681 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.738569 12709 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:08.741796 12749 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.664031  8107 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: [11.7-14.8]
I20260709 13:18:08.803947  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:08.784682  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 199035us
W20260709 13:18:08.785820  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 191820us
I20260709 13:18:08.806710  8149 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:08.788654  8176 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:08.798182  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:08.807659  8179 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.798879  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:08.808959  8182 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:08.801621 12845 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:08.801806  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 83973.5us
I20260709 13:18:08.802340 12818 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:08.785962 12844 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:08.813326  8782 pending_rounds.cc:85] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 10
I20260709 13:18:08.719714 12737 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:08.809684  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:08.799093 12750 consensus_meta.cc:287] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
I20260709 13:18:08.813645  8782 pending_rounds.cc:107] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:18:08.811129  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:08.827037  8782 raft_consensus.cc:2889] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:08.808444  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:08.811944  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:08.821404 12646 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:08.824585 12891 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:18:08.824986 12745 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:18:08.810995 12749 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:08.831534  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:08.825258  8179 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:08.834842  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:08.835860  8176 raft_consensus.cc:2368] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11.
I20260709 13:18:08.837340  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:08.838038  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:08.838332  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:08.832449 12863 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:08.841008  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:08.841109 12863 raft_consensus.cc:697] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:08.842280 12863 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.814705 12746 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:08.845665 12746 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.845935  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:08.846051 12746 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.846369  8790 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:08.848330 12736 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:08.848722 12736 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:08.850068  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:08.850716  8791 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
W20260709 13:18:08.851265 12835 consensus_meta.cc:287] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.770s	user 0.006s	sys 0.004s
I20260709 13:18:08.851643  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:08.852790  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:08.853097  8790 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:08.853816  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:08.853960  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:08.834319 12646 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:08.854835  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:08.854993 12855 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:08.855523 12855 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:08.856187  8790 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:18:08.856480 12831 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:08.856377 12855 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 14.5, Last appended by leader: 5, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.856884 12681 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:08.857070 12831 raft_consensus.cc:697] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:18:08.854846  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 43789.1us
I20260709 13:18:08.858009 12831 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.858312  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:08.812930 12861 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:08.859395 12861 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:08.859851 12861 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:08.867354  8788 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:08.868396  8221 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:08.859409  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:08.871376  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:08.865042  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:08.874030  8072 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:08.876763  8787 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:08.878100  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.880486  8074 leader_election.cc:400] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11.
I20260709 13:18:08.880970  8074 leader_election.cc:403] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:18:08.883270  8072 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:08.887145  8254 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:08.871515 12748 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:08.889472 12748 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.890040 12748 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:08.907815  8072 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:08.878960 12846 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:08.884510 12639 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:08.909060 12633 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:08.909273 12830 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11.
I20260709 13:18:08.909566 12639 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:08.887050 12873 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:08.826122 12737 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.887853  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:08.913331  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48110 (request call id 1220) took 1687 ms. Trace:
I20260709 13:18:08.872092 12862 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:08.827504 12844 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.873745 12646 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:08.928431  8784 rpcz_store.cc:276] 0709 13:18:07.226020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.226614 (+   594us) service_pool.cc:224] Handling call
0709 13:18:08.913045 (+1686431us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b5400750154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:08.913251 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":954372480}
I20260709 13:18:08.877970 12819 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:08.927065  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 596) took 1437 ms. Trace:
I20260709 13:18:08.851675 12835 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.936167  8248 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:18:08.830195 12750 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.937029  8183 rpcz_store.cc:276] 0709 13:18:07.489586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.490061 (+   475us) service_pool.cc:224] Handling call
0709 13:18:07.517185 (+ 27124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.081687 (+564502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.926772 (+845085us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b5400248bd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:08.926992 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938451840}
I20260709 13:18:08.948618  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:08.875046 12761 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:18:08.916006 12740 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:08.957090  8789 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:18:08.938850  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51068.1us
W20260709 13:18:08.931962 12891 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:08.910898 12840 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:08.963760  8149 leader_election.cc:400] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14.
I20260709 13:18:08.964161  8149 leader_election.cc:403] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:18:08.936546 12646 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:08.926127 12873 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:08.968344  8248 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:08.969813  8103 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 14: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:08.951815 12854 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:08.887720 12736 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:08.936707 12748 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:08.978650  8248 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:08.974759 12873 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.963698 12840 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.991813  8248 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:18:08.968995 12646 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:08.972359 12685 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.976760 12827 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:08.999908  8248 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:08.989398 12854 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:09.007814  8248 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:08.991811 12840 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:09.000240 12736 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:09.002271 12637 consensus_meta.cc:287] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.885s	user 0.008s	sys 0.003s
I20260709 13:18:09.016837  8183 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:09.017978  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.014470 12856 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:09.027053  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.027580  8248 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:08.993173 12639 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.037593 12846 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:09.039006  8249 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:09.038825 12846 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.047950  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.048892  8256 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:09.050918 12861 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.021874 12637 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:09.068910 12685 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14.
I20260709 13:18:09.037250 12832 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:18:09.086354 12832 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:09.086877 12832 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:09.088014 12832 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:09.089661  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.092577 12750 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:09.045849 12854 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.095350 12637 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:09.097141  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:09.097939 12899 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:18:09.098220  8256 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:09.098803 12844 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:09.099021 12900 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:18:09.102988 12748 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:09.097862  8250 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:09.103873  8786 raft_consensus.cc:2410] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:18:09.109825  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.110626  8250 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:18:09.113291 12749 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.109757  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.118379  8252 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:09.120113  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2688) took 1202 ms. Trace:
I20260709 13:18:09.120536  8255 rpcz_store.cc:276] 0709 13:18:07.918162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.918600 (+   438us) service_pool.cc:224] Handling call
0709 13:18:09.118063 (+1199463us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b5400412dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:09.120040 (+  1977us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890477824}
I20260709 13:18:09.096788 12746 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:09.122825  8248 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8.
I20260709 13:18:09.133572 12749 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:09.121506 12861 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:09.140293  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 169495us
I20260709 13:18:09.117333 12828 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:09.146473  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.148221  8248 raft_consensus.cc:2410] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:09.120008 12873 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:09.148348  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:09.141206 12832 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:09.121073 12840 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.149745  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.121400 12646 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:09.151726  8255 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:09.145704 12827 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:09.155547  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.164309  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.165370  8248 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:09.165337  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.166038  8256 raft_consensus.cc:2376] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12. Re-sending same reply.
I20260709 13:18:09.166334  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.169075  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.169914  8256 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:09.153250 12748 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:09.178074  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.177567  8250 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12. Ops: []
W20260709 13:18:09.179040  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.176941  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.180370  8249 raft_consensus.cc:2376] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11. Re-sending same reply.
I20260709 13:18:09.182602  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.183395  8253 raft_consensus.cc:2368] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10.
I20260709 13:18:09.185633  8255 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:09.185750  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.186321  8257 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:09.186614  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.189178  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.211014  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:09.181334 12736 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.214479  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:09.218458  8256 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:09.166766 12827 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.220543  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.221127  8256 raft_consensus.cc:2368] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14.
I20260709 13:18:09.221833  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.222396  8257 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:09.222321  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.219846 12736 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:09.238487 12746 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:09.240128  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.247526  8254 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:09.240356 12827 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:09.219350 12685 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:09.250341  8257 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:09.214946 12905 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:09.227052 12774 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.246042  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.256279  8256 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 10: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:09.253262  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.256465  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:09.257081  8788 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:09.256978  8257 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:09.261406  8254 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:09.263648  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:09.264384  8790 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:09.262821  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:09.266144 12902 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:18:09.267844 12774 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:09.268445  8788 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:09.269201 12840 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:09.270323  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.270876  8257 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:09.252339 12685 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:09.271370 12685 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:09.273985 12646 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:09.274432  8787 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:18:09.274852  8787 pending_rounds.cc:85] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 8
I20260709 13:18:09.275056  8787 pending_rounds.cc:107] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:18:09.275331  8787 raft_consensus.cc:2889] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:09.278661  8257 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:09.279713  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.280331  8257 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:09.281949 12840 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.282462 12840 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.284492 12840 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:09.286106  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.287201  8257 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:09.289079 12873 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:09.289855  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.291118  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:09.291952  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:09.295944  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:09.296662  8099 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 14: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:09.298419  8147 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:09.265542  8256 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:09.306027  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:09.306752  8790 raft_consensus.cc:2410] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:18:09.308223  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.313192  8256 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:09.324095 12736 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:09.326083  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.330968  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:09.332867  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:09.334262  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:09.342941 12905 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:09.350311  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.316910 12492 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:09.329643 12738 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:18:09.370664  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:09.368105  8103 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:09.371017  8108 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:09.374172  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:09.374863  8104 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:09.376928  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:09.377671  8108 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:09.387725  8104 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:09.364540 12492 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:09.373553 12831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.012s	sys 0.020s
I20260709 13:18:09.400528  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:09.402122  8103 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:09.401547 12831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.013s	sys 0.020s
I20260709 13:18:09.409955  8099 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:09.413374  8108 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:09.414680  8099 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 5. Preceding OpId from leader: term: 16 index: 6. (index mismatch)
I20260709 13:18:09.416194  8103 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:09.427502  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:09.428505  8103 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:09.467495  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:09.471446  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:09.476090 12746 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:09.475389  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:09.474573 12905 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:09.475066 12878 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:09.506102 12512 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.506603 12512 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:09.508711 12512 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:09.461634 12492 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:09.487932 12681 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:09.481648 12875 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:18:09.522274  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:09.494203  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:09.523717  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:09.524916  8099 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:09.494756  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:09.484957 12748 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:09.494915  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:09.495657  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:09.496609  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:09.497277  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:09.497967  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:09.499248  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:09.520063  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:09.521108  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:09.522023  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:09.522042  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:09.526578  8108 raft_consensus.cc:2376] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15. Re-sending same reply.
I20260709 13:18:09.490747 12846 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:09.530755  8782 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
I20260709 13:18:09.525084 12685 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:09.530239  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.527886  8102 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:18:09.530282  8100 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:09.530648  8107 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:18:09.540400  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:09.541096  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:09.544615  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:09.549957  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:09.551111 12685 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:09.551743  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:09.552227  8175 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:09.552736  8183 raft_consensus.cc:2368] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14.
I20260709 13:18:09.553848  8147 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:09.554483  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.558862  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:09.558157 12681 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:09.562179  8107 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:09.563864 12875 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:09.564294 12875 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.564626 12875 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:09.565842  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1672) took 1068 ms. Trace:
I20260709 13:18:09.566198  8105 rpcz_store.cc:276] 0709 13:18:08.497644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.502306 (+  4662us) service_pool.cc:224] Handling call
0709 13:18:09.565670 (+1063364us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b54003f3254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:09.565789 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142694144}
W20260709 13:18:09.567857  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.568256  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.569003 12736 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:18:09.525403 12896 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.685s	user 0.000s	sys 0.004s
I20260709 13:18:09.573531 12774 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.574085 12774 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.575470  8178 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:09.576092 12774 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:09.576938  8176 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:09.561646 12681 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.579082  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:09.580070  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:09.584444  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 98281.2us
I20260709 13:18:09.587630  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:09.589376  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:09.589600  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:09.590152  8174 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:09.591670  8105 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:09.593493  8107 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:18:09.559440  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:09.595376  8181 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:09.596575  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:09.598984  8176 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 9.
I20260709 13:18:09.602725  8180 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 13:18:09.582592 12907 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.370s	user 0.000s	sys 0.001s
I20260709 13:18:09.606243  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:09.608139  8180 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:09.610999  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:09.615149 12835 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:09.606112 12646 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:09.618980  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:09.619589  8177 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:09.617385  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:09.620117  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:09.637317  8223 leader_election.cc:400] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14.
I20260709 13:18:09.638002  8223 leader_election.cc:403] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:18:09.619686 12540 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:09.642174  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:09.645118  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:09.622017 12753 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:09.582815 12832 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:18:09.649654  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:09.635133 12736 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.642129 12726 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:09.661324 12721 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:09.661834 12726 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:09.662021 12721 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.662622 12721 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:09.663120 12726 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.666276 12736 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:09.651041 12685 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:18:09.655117 12818 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14.
I20260709 13:18:09.641717 12774 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:09.679294 12818 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:09.679898 12818 raft_consensus.cc:697] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:09.641654 12646 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:09.681612 12646 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.641852 12827 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:18:09.686625 12827 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:09.654606 12888 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:09.687829 12888 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:09.688689 12888 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.680732 12818 consensus_queue.cc:237] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.692169 12753 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:09.695837 12753 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.690616 12736 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:09.706341  8248 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 5. Preceding OpId from leader: term: 16 index: 6. (index mismatch)
I20260709 13:18:09.706596  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.707242  8256 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 8.
W20260709 13:18:09.710615 12863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.030s	sys 0.034s
I20260709 13:18:09.701190 12668 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:09.720331  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.722276  8254 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:09.726495 12734 raft_consensus.cc:3055] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:09.726792  8255 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:09.726945 12734 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:09.719528 12840 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.727771 12734 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:09.728346 12840 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.728756 12734 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:09.730628 12840 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:09.721262 12863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.031s	sys 0.034s
I20260709 13:18:09.734030 12721 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.736254 12721 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:09.734464  8254 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
W20260709 13:18:09.746426  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.747319  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.752173  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.752041  8783 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:09.754272 12721 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:09.763477  8149 leader_election.cc:400] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14.
W20260709 13:18:09.764672  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.768821  8149 leader_election.cc:403] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:18:09.706300 12875 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:09.777561  8255 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:18:09.780977  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.788241  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:09.780093  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 195804us
I20260709 13:18:09.788197  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:09.791278  8785 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:09.780469  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.794824  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:09.799386  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:09.801131  8149 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:09.799186 12721 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:09.808655 12886 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:09.815443  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:09.815783  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:09.816689  8104 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:09.780361 12875 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:09.821327 12737 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:09.821892 12737 raft_consensus.cc:697] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:09.822806 12737 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:09.800241 12841 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:09.832194 12841 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:09.832648 12841 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:09.831612 12846 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.842689 12846 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:09.844836 12846 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:09.794397 12567 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14.
W20260709 13:18:09.853904  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 261233us
I20260709 13:18:09.854419  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:09.853682  8001 catalog_manager.cc:5697] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 8 to 10, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 10 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:18:09.857532  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.506842  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:09.857075  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:09.866328  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 212292us
I20260709 13:18:09.867266  8223 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:09.869807  8001 catalog_manager.cc:5697] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 12 to 14, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 14 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:09.871474  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:09.870728  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:09.874843  8001 catalog_manager.cc:5697] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 9 to 11, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 11 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:09.876344  8001 catalog_manager.cc:5697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 12 to 13, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 13 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.877863  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:09.886149  8001 catalog_manager.cc:5697] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:09.894722  8001 catalog_manager.cc:5697] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 10 to 11, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 11 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:09.855436 12851 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:09.904913  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:09.906227  8785 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:18:09.908857  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:09.909039  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:09.912539  8074 leader_election.cc:400] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16.
I20260709 13:18:09.863384 12774 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:09.910892  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:09.915316  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:09.914324  8147 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:09.870173 12846 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:09.931978 12871 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:09.896627 12646 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:18:09.917964 12936 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:18:09.932682 12871 raft_consensus.cc:697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:09.912761 12925 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:09.916095 12831 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:09.911952 12863 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:09.947332  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:09.912865 12875 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.897410 12835 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:18:09.945915 12512 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:09.874034 12761 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:18:09.910143 12833 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:18:09.911022 12930 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:09.911094 12832 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:18:09.915858 12668 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:18:09.916515 12859 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:18:09.962368  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51571us
I20260709 13:18:09.947176 12925 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:09.966277  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.966396  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.966969  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.915686 12734 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:18:09.968034  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.967226  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.984681  8256 raft_consensus.cc:2376] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13. Re-sending same reply.
I20260709 13:18:09.969762  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:09.985743  8253 raft_consensus.cc:2376] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 8. Re-sending same reply.
I20260709 13:18:09.941717 12774 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:09.953835 12831 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:09.981072  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:09.956535 12646 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:09.991134  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:09.992502  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:10.007298  8251 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:10.007718  8100 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:09.995661  8102 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:10.008317  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:10.007970  8001 catalog_manager.cc:5697] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 10 to 12, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 12 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:10.009522  8001 catalog_manager.cc:5697] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 8 to 12, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 12 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.010414  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:09.981757 12818 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:10.012238  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:10.012842  8252 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:10.013581  8255 raft_consensus.cc:2368] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10.
I20260709 13:18:10.012065 12646 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:09.950011 12871 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:09.952919 12878 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:18:09.971876 12736 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:09.981524 12753 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:10.011086  8001 catalog_manager.cc:5697] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:18:10.052131  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 55538.1us
I20260709 13:18:09.949200 12841 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:10.012079 12818 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:09.997466 12925 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:10.009733 12831 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:10.006654 12888 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:18:09.997102 12774 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:09.958114 12875 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:10.020766 12846 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:10.099908  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:10.027758 12734 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:10.087122  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:10.102797  8254 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 15: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:10.022884 12827 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:10.034083 12927 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:10.086997 12567 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:18:10.078549 12736 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:10.095760 12774 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:10.115868  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 200609us
I20260709 13:18:10.119369  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:10.119839  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 212083us
I20260709 13:18:10.121523  8223 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:10.122020  8252 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:18:10.097947 12935 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:10.132386  8256 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:10.090236 12753 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:10.170142  8250 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:10.116312 12736 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:10.133798  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:10.178496  8254 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:10.180469  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:10.183601  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:10.140283  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.130627 12832 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:10.104895 12846 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:10.193753  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 61972.9us
I20260709 13:18:10.195987  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:10.115903 12927 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:10.212863  8074 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:10.115944 12827 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:10.131007 12646 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.214250  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:10.130863 12934 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:10.191406 12859 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:10.219278  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 238270us
I20260709 13:18:10.233199  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:10.235662  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:10.236610  8785 raft_consensus.cc:2368] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14.
I20260709 13:18:10.239084  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:10.239475  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 152001us
I20260709 13:18:10.240641  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:10.241968  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:10.214264 12832 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:10.243914  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:10.185725 12935 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:10.245505  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:10.245772  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:10.251327  8789 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:10.235391 12863 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:10.249993  8785 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:10.245605  8074 leader_election.cc:400] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10.
I20260709 13:18:10.253679  8103 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:10.255327  8107 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:18:10.251138  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:10.255895  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:10.257081  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:10.258574  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:10.214205 12835 consensus_queue.cc:1059] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:18:10.260337 12846 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:10.260944 12846 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.261443 12846 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:10.263653 12846 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:10.264266 12935 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:10.264485 12818 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:10.249120 12859 raft_consensus.cc:2764] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:18:10.265604 12955 consensus_queue.cc:1059] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:10.269047 12844 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:10.269421 12844 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:10.269882  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:10.270502  8254 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:18:10.270291 12844 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:10.271492 12844 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:10.273736  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:10.277992 12943 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
W20260709 13:18:10.274010 12944 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:10.284881  8221 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:18:10.286486  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.285123  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:10.287168  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:10.287639  8253 raft_consensus.cc:2368] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13.
I20260709 13:18:10.295787  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:10.296407  8256 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:10.297916  8253 pending_rounds.cc:85] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 7
I20260709 13:18:10.298311  8253 pending_rounds.cc:107] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:18:10.298588  8253 raft_consensus.cc:2889] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:10.298588 12761 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:10.299675 12761 raft_consensus.cc:3055] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:10.300534  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:10.246822 12950 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:10.302817  8221 leader_election.cc:400] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14.
I20260709 13:18:10.312875  8221 leader_election.cc:403] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:18:10.303333  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:10.318461  8100 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:10.307047  8178 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:10.308467  8181 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:10.308887  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:10.319690  8789 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:10.311705  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:10.320422  8176 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:10.320469  8786 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 13:18:10.318747  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 70522us
I20260709 13:18:10.324441  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:10.325981 12930 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.326402  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:10.326486 12930 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:10.332090  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:10.343747  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:10.344475  8104 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:10.344477  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:10.347533  8256 raft_consensus.cc:2410] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:18:10.293776 12833 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:10.327728 12886 consensus_meta.cc:287] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.004s
I20260709 13:18:10.300029 12761 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:10.322638 12863 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:10.353924  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:10.237075 12646 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:10.241686 12753 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:10.314296 12720 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
W20260709 13:18:10.353989 12922 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:10.364693 12886 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:10.414108  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 54523us
I20260709 13:18:10.357628 12832 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:10.353156 12951 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:10.416602  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 113907us
W20260709 13:18:10.408012 12941 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 13:18:10.353701 12875 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:10.426028  8221 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:10.412094 12863 raft_consensus.cc:697] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:10.428356  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:10.415259 12720 consensus_queue.cc:1243] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:10.432106  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:10.440253 12833 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.414856 12959 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14.
W20260709 13:18:10.435139 12945 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:18:10.432854 12951 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:10.437417 12851 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.002s
I20260709 13:18:10.446329  8221 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:10.426371 12841 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:10.471848  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:10.472689  8253 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:10.474392  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:10.477809 12959 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:10.434428 12955 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:18:10.478112  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:10.478472  8252 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:10.478981  8253 raft_consensus.cc:2368] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14.
I20260709 13:18:10.479918  8253 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 13:18:10.480149  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:10.448529  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:10.432065 12958 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:10.425104 12957 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:10.451368 12827 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:10.486052  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:10.468233 12851 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:10.509895  8001 catalog_manager.cc:5697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.480890 12927 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:10.450915 12833 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:10.465140 12963 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:10.436602 12761 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:10.584728 12827 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:10.651839 12945 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:18:10.490713 12774 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:10.447647 12966 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:18:10.490928 12969 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.151s
I20260709 13:18:10.466315 12818 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:10.490840 12951 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:10.741112  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 414790us
I20260709 13:18:10.774789  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:10.520610 12863 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:10.744300 12736 consensus_meta.cc:287] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.000s
I20260709 13:18:10.747189  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:10.750111  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:10.750114  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:10.779253  8248 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:10.780148  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:10.758056 12639 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:18:10.759691 12960 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.346s	user 0.007s	sys 0.004s
I20260709 13:18:10.784029  8101 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:10.787034  8074 leader_election.cc:400] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 9 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10.
I20260709 13:18:10.786064  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:10.800673  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:10.801780  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:10.784539 12639 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:10.805373  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:10.766410 12827 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:10.778764 12930 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:10.806999  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:10.785559 12818 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:10.786266 12832 raft_consensus.cc:697] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:10.784029 12736 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:10.846186  8223 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:10.805137 12959 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:10.808779 12639 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:10.783619 12963 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:18:10.809738 12646 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:10.859187  8223 leader_election.cc:400] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14.
I20260709 13:18:10.821099 12930 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:10.841463 12873 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:10.809950 12977 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:10.867676  8176 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:10.848788 12964 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:18:10.883961 12965 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 13:18:10.899099  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 88569.1us
I20260709 13:18:10.887141 12930 raft_consensus.cc:2764] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:18:10.886003 12832 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:10.867296 12959 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:10.889957 12774 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:10.901546  8253 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:10.846339 12975 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:10.894368 12976 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:10.904042  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:10.911661  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2603) took 1102 ms. Trace:
I20260709 13:18:10.920130  8074 leader_election.cc:400] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14.
I20260709 13:18:10.921347  8074 leader_election.cc:403] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:10.915781  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:10.914229  8248 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:10.877858 12977 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:10.912861 12844 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.000s
I20260709 13:18:10.934988  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:10.983273  8180 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:18:10.982075  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 62080.2us
I20260709 13:18:10.883656 12873 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:10.993247  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:10.914103 12959 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:10.988422  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:10.914423 12975 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:10.918563  8105 rpcz_store.cc:276] 0709 13:18:09.809281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.810745 (+  1464us) service_pool.cc:224] Handling call
0709 13:18:09.811082 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:09.811484 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:09.811775 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.023716 (+211941us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.029113 (+  5397us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.029291 (+   178us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:10.031031 (+  1740us) log.cc:844] Serialized 52 byte log entry
0709 13:18:10.031208 (+   177us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:10.250248 (+219040us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b18003e2180. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dcd9c0a 00007fa5a7419219 00007fa59dd61a40 00007fa59dd5c4e4 00007fa59dd5c455 00007fa5a48443c7 00007fa5a0e569a7 00007fa5a0e660bf 00007fa5a0e66038
0709 13:18:10.250456 (+   208us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.264975 (+ 14519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.265071 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.439754 (+174683us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b18003e2180. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:18:10.911429 (+471675us) raft_consensus.cc:1685] finished
0709 13:18:10.911456 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.911610 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20781,"prepare.queue_time_us":2917,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":28,"raft.queue_time_us":67854,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":14278,"spinlock_wait_cycles":290455424,"thread_start_us":209874,"threads_started":1,"wal-append.queue_time_us":304745}
I20260709 13:18:10.918542 12973 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:10.986660 12925 consensus_meta.cc:287] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.883s	user 0.016s	sys 0.005s
I20260709 13:18:10.918236 12978 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:11.020711  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 240617us
W20260709 13:18:10.986958 12831 consensus_meta.cc:287] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.883s	user 0.013s	sys 0.008s
I20260709 13:18:11.035247  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:11.052052  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:10.979285 12977 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:10.984905 12957 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:10.984901 12927 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:10.991051 12833 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:11.000255 12774 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:11.075682  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:10.979044 12646 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:18:11.016727 12844 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:11.020128 12975 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:11.053855 12978 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.111745  8183 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:11.025943 12964 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:18:11.114073  8253 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:11.084975 12886 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.058141 12925 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.096665 12833 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:11.090375 12927 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.072497 12831 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.056715 12973 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.112541 12978 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:11.118894 12774 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:11.094623 12875 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.119027 12976 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14.
I20260709 13:18:11.123991 12827 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:11.105629 12844 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.121141 12984 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:11.171200 12984 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:11.171967 12984 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.172118 12844 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:11.089138 12957 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.154109 12983 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:11.154517 12951 raft_consensus.cc:3055] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:11.112748 12959 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.190595 12959 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:11.133602 12833 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.120855 12966 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:18:11.100301 12873 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.125717 12886 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.183036 12951 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:11.172546 12984 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.180488 12957 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:11.179512 12983 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.211133 12886 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:11.212538  8790 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:11.214161 12984 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:11.214411 12983 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:11.215744 12873 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:11.216548 12951 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.208823 12978 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.217777 12951 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:11.218994 12978 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:11.219446  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:11.222107 12925 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:11.196264 12844 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:11.225873 12844 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.228673 12844 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:11.229930  8001 catalog_manager.cc:5697] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 3 to 8, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 8 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:11.231539  8789 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:11.169696 12875 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.181499 12973 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:11.161232 12831 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:11.195307  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 291330us
I20260709 13:18:11.144035 12736 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:11.188437  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 136477us
I20260709 13:18:11.245369  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:11.249051  8072 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:11.243413  8001 catalog_manager.cc:5697] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:11.275609  8001 catalog_manager.cc:5697] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 10 to 11, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 11 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:11.278101  8001 catalog_manager.cc:5697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:11.282346  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.283277  8006 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39828 (request call id 276) took 29453 ms (client timeout 15000 ms). Trace:
I20260709 13:18:11.284179  8072 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:11.235741 12990 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:11.355857 12990 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:11.287119 12980 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:18:11.356951 12990 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.297932  8755 leader_election.cc:400] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13.
W20260709 13:18:11.324939  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.358644  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 69819.4us
I20260709 13:18:11.328352 12738 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.359495  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:11.359846 12738 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.361660 12844 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:11.361984 12738 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:11.362047  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:11.362809  8257 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:11.363787 12840 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:11.364293 12875 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:11.365070 12927 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:11.288036 12976 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:11.365622  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:11.296350 12639 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.367983 12639 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:11.370023 12833 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:11.370905 12970 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.578s	user 0.010s	sys 0.006s
I20260709 13:18:11.351203 12987 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:11.396229  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:11.397125  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:11.398622  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:11.399876  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:11.400584  8099 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:11.401887  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:11.406231  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 122166us
I20260709 13:18:11.352018  8001 catalog_manager.cc:5697] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:11.407298  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:11.407905  8099 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:11.353746 12975 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.419397  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:11.420163  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:11.420825  8103 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:11.348534  8006 rpcz_store.cc:269] 0709 13:17:41.789993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.797376 (+  7383us) service_pool.cc:224] Handling call
0709 13:17:41.824040 (+ 26664us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b540006a9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db6090 00007fa5a0e54f3a 00007fa5a6c0b1cc 00007fa5a6d0937e 00007fa5a51ca2a4 00007fa5a51ca232 00007fa5a51ca161 00007fa5a51ca0dc 00007fa5a51c9392 00007fa59f18748c 00007fa59f1868c6
0709 13:18:11.243176 (+29419136us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:03.814614 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:03.883371 (+ 68757us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:03.883434 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:18:03.883456 (+    22us) tablet.cc:662] Decoding operations
0709 13:18:03.983905 (+100449us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:04.005761 (+ 21856us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:04.019833 (+ 14072us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:18:04.488855 (+469022us) tablet.cc:701] Row locks acquired
0709 13:18:04.533798 (+ 44943us) write_op.cc:260] PREPARE: finished
0709 13:18:04.565790 (+ 31992us) write_op.cc:270] Start()
0709 13:18:04.720644 (+154854us) write_op.cc:276] Timestamp: P: 1783603084548835 usec, L: 0
0709 13:18:04.725946 (+  5302us) op_driver.cc:348] REPLICATION: starting
0709 13:18:04.813659 (+ 87713us) log.cc:844] Serialized 6347 byte log entry
0709 13:18:06.135243 (+1321584us) op_driver.cc:464] REPLICATION: finished
0709 13:18:06.269591 (+134348us) write_op.cc:301] APPLY: starting
0709 13:18:06.269699 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:06.363620 (+ 93921us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:06.365528 (+  1908us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:06.705928 (+340400us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:06.722867 (+ 16939us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:18:06.722910 (+    43us) write_op.cc:312] APPLY: finished
0709 13:18:06.723329 (+   419us) log.cc:844] Serialized 148 byte log entry
0709 13:18:06.724292 (+   963us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:06.724485 (+   193us) write_op.cc:454] Released schema lock
0709 13:18:06.724585 (+   100us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:06.727825 (+  3240us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:06.727869 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":95948,"reported_tablets":49,"spinlock_wait_cycles":10992000,"child_traces":[["op",{"apply.queue_time_us":107439,"apply.run_cpu_time_us":26315,"apply.run_wall_time_us":458224,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70975,"num_ops":16,"prepare.queue_time_us":83402,"prepare.run_cpu_time_us":49433,"prepare.run_wall_time_us":1266260,"raft.queue_time_us":194837,"raft.run_cpu_time_us":19315,"raft.run_wall_time_us":56933,"replication_time_us":1409124,"spinlock_wait_cycles":32640,"thread_start_us":559860,"threads_started":4,"wal-append.queue_time_us":286088,"wal-append.run_cpu_time_us":25447,"wal-append.run_wall_time_us":2631548}]]}
I20260709 13:18:11.313364 12831 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:11.346199 12934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.045s	user 0.021s	sys 0.045s
I20260709 13:18:11.373226  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2615) took 1381 ms. Trace:
I20260709 13:18:11.425184  8101 rpcz_store.cc:276] 0709 13:18:09.991722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.991848 (+   126us) service_pool.cc:224] Handling call
0709 13:18:09.997816 (+  5968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.785012 (+787196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.372894 (+587882us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54003c32d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:11.373105 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807724928}
I20260709 13:18:11.376911  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:11.377636  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:11.426307  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:11.426690  8255 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:11.378376  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:11.427585  8107 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:11.379554  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:11.393373  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:11.430171  8248 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:18:11.430512  8103 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:11.431556  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:11.432219  8101 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:11.408186  8001 catalog_manager.cc:5697] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 5 to 12, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 12 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:11.411067  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:11.411649  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:11.406724 12840 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:11.418126  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:11.423466  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:11.429589  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:11.445664  8108 raft_consensus.cc:2410] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 17 because replica has last-logged OpId of term: 16 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 5.
I20260709 13:18:11.433298  8106 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:11.433672  8105 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:11.446280  8001 catalog_manager.cc:5697] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 10 to 11, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 11 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:11.434913  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:11.449390  8183 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:11.429196 12734 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:11.425748 12980 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:11.417851 12987 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.436751  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:11.412966  8099 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:11.441071  8100 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:11.418828 12827 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:11.430915 12934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.137s	user 0.021s	sys 0.045s
I20260709 13:18:11.436481  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:11.442248  8104 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:11.454264 12833 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:11.453301  8001 catalog_manager.cc:5697] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 7 to 14, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 14 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:11.457482  8255 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:11.424988 12831 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:11.454525  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:11.471680  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:11.477028  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2732) took 1179 ms. Trace:
I20260709 13:18:11.437321 12639 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:11.436846 12977 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.507828 12982 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.461042 12934 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:11.448679 12950 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:11.444772 12840 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:11.461548 12512 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.478966 12980 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:11.511582 12831 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:11.461925 12964 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:18:11.521369 12925 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:11.523342 12859 raft_consensus.cc:3055] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:11.461262 12734 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.458374 12646 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:18:11.518082 12774 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:11.525816 12840 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:11.510926 12873 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:11.463496 12827 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.509604 12989 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:18:11.523008 12983 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:18:11.537108 12988 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:11.518397 12982 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.543659 12925 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.543701 12859 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:18:11.533687  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 62117.6us
I20260709 13:18:11.533090 12512 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.561795 12988 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:11.566354 12925 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:11.583253 12988 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:11.553948 12774 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.558741 12873 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.597851 12987 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:11.605520 12977 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:11.607410 12988 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.609536 12988 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:11.611701 12761 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:11.612767 12982 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:11.614667 12827 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:11.615370 12968 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.810s	user 0.004s	sys 0.008s
I20260709 13:18:11.616650 12859 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.618358 12859 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:11.571465 12934 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.624347 12950 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:11.624871 12950 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:11.625946 12950 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.634320 12950 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:11.634845 12873 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:11.632069 12774 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:11.590188 12980 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.641784 12975 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:11.647926 12734 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:11.657442 12512 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:11.530807 12639 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.801529 12984 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:11.738336  8074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.021s	sys 0.022s
I20260709 13:18:11.742053  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:11.823488  8074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.022s	sys 0.023s
W20260709 13:18:11.823969  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 837891us
I20260709 13:18:11.742282  8107 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: []
W20260709 13:18:11.759691  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 350877us
W20260709 13:18:11.765606  8179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.007s	sys 0.043s
I20260709 13:18:11.766557  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 609) took 1508 ms. Trace:
W20260709 13:18:11.517120  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 62676.3us
I20260709 13:18:11.829680  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:11.825642  8182 rpcz_store.cc:276] 0709 13:18:10.257983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.258130 (+   147us) service_pool.cc:224] Handling call
0709 13:18:10.258406 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.294395 (+ 35989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.294424 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.294885 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.466605 (+171720us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:10.466650 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.466717 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.537633 (+1070916us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:11.765620 (+227987us) raft_consensus.cc:1685] finished
0709 13:18:11.765686 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.766255 (+   569us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35607,"raft.queue_time_us":42998,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":13924,"spinlock_wait_cycles":59093888,"thread_start_us":112650,"threads_started":1,"wal-append.queue_time_us":435837}
W20260709 13:18:11.832327  8179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.007s	sys 0.043s
I20260709 13:18:11.833992 12973 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.514585  8254 rpcz_store.cc:276] 0709 13:18:10.297813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.297948 (+   135us) service_pool.cc:224] Handling call
0709 13:18:10.298291 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.423157 (+124866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.423196 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.423618 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.467456 (+ 43838us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:10.467514 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.370331 (+902817us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:11.476747 (+106416us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400386b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:11.476800 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.476841 (+    41us) raft_consensus.cc:1685] finished
0709 13:18:11.476853 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.476965 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2409,"raft.queue_time_us":23848,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":10545,"spinlock_wait_cycles":298599040,"thread_start_us":42157,"threads_started":1,"wal-append.queue_time_us":368623}
I20260709 13:18:11.570991  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:18:11.855448  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 284468us
I20260709 13:18:11.855868 12761 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:11.856478 12761 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.856673  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:11.857652 12973 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.858749 12966 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.859571 12966 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.860570 12973 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:11.681257 12955 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.019s	sys 0.018s
I20260709 13:18:11.854066 12959 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:18:11.866660 12827 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.867197 12963 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:11.867602 12827 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.868319 12959 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.868116 12963 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.801412  8789 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:11.871057 12990 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:11.821798 12734 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:11.866851 12951 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.872201 12734 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.872730  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:11.837917  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:11.873242 12963 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:11.824985 13005 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:11.874672  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 49544.3us
I20260709 13:18:11.875038 13005 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.869088 12959 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.856918 12761 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:11.877254 12905 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:11.877928 12953 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:11.878391 13005 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:11.700484 12925 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.879778 12736 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:11.853991 12934 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:11.866814 12955 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.020s	sys 0.019s
I20260709 13:18:11.961792  8223 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:11.811931 12984 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.962754 12966 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:11.962631 12981 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:11.963023 12934 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.872407 12951 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.873976 12859 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:11.875504 12734 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:11.821509 12831 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:11.878444 12953 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.846436 12950 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:11.696487 12840 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.865792 12980 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:11.881927 12925 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:11.951161  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2576) took 1474 ms. Trace:
I20260709 13:18:11.951247  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:11.952567 13001 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:11.956964  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:11.957195  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:11.957535 12736 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.958442  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:11.959213  8786 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:18:11.992902  8786 pending_rounds.cc:85] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 10
I20260709 13:18:11.993283  8786 pending_rounds.cc:107] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:18:11.993407 12984 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:11.993687  8786 raft_consensus.cc:2889] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:11.994339 13001 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:11.995573  8788 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:18:11.959684  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:11.996799  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:11.997152 13001 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:12.000077 12831 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:11.815070 12835 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.525s	user 0.008s	sys 0.037s
W20260709 13:18:11.973544  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 141381us
I20260709 13:18:11.974277  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:11.977099 12953 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:11.988219  8782 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:18:11.984707 12959 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:11.985946  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.010198 12851 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:12.011088 12851 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.012408  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:11.988775 12973 raft_consensus.cc:2764] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:18:11.989655  8252 rpcz_store.cc:276] 0709 13:18:10.476834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.479264 (+  2430us) service_pool.cc:224] Handling call
0709 13:18:10.479532 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.760324 (+280792us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:10.760356 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:11.313414 (+553058us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b2c000e7a78. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:18:11.313870 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:18:11.865494 (+551624us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:11.865593 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.865750 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.950550 (+ 84800us) raft_consensus.cc:1685] finished
0709 13:18:11.950569 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.950913 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102962,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":1750,"spinlock_wait_cycles":26522496,"thread_start_us":772196,"threads_started":2,"wal-append.queue_time_us":552838}
I20260709 13:18:12.014698  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2581) took 1212 ms. Trace:
I20260709 13:18:12.014799  8223 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:12.016947  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:12.017649 12973 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:12.017768 12886 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:12.018522 12973 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.019194 12973 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.019739 12886 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:12.020493  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.015296  8179 rpcz_store.cc:276] 0709 13:18:10.801828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.801992 (+   164us) service_pool.cc:224] Handling call
0709 13:18:10.802325 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:10.802692 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.802718 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:10.805952 (+  3234us) log.cc:844] Serialized 52 byte log entry
0709 13:18:11.833221 (+1027269us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:11.833909 (+   688us) log.cc:844] Serialized 14 byte log entry
0709 13:18:11.964066 (+130157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.980590 (+ 16524us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.983822 (+  3232us) raft_consensus.cc:1685] finished
0709 13:18:11.983847 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.014598 (+ 30751us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14281,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":48011,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":4272,"spinlock_wait_cycles":1537408,"thread_start_us":1109611,"threads_started":2,"wal-append.queue_time_us":838703}
I20260709 13:18:11.987965 12840 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:11.986545 12975 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:18:11.988394 12639 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:11.960906  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:11.997586  8788 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:11.882648 12738 consensus_queue.cc:1059] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:18:11.998119 12753 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.006961  8789 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:12.007556 12951 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:12.008250 12980 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:12.009521 12835 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.727s	user 0.008s	sys 0.038s
I20260709 13:18:12.002305  8782 pending_rounds.cc:85] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 10
I20260709 13:18:12.034554  8782 pending_rounds.cc:107] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:18:12.034854  8782 raft_consensus.cc:2889] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:12.028499  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 151072us
I20260709 13:18:12.031124  8791 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 13: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:12.002553 12827 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:12.040987 12981 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:12.041589 12981 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.042003 12981 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:12.046849  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.044836 12761 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.057650 12952 consensus_queue.cc:1059] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:12.057865 12753 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.037110 12736 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.062552 12846 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:12.062963 12846 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:12.063692 12736 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:12.065847  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:12.066668 12886 raft_consensus.cc:3055] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:12.067127 12886 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:12.064193 12846 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.035740 13001 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.067718 12951 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:12.068078 13001 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.068406 12886 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:12.070390  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 53658.8us
I20260709 13:18:12.070103 12886 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:12.079000  8254 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:12.083050 12980 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:12.048182 12973 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:12.086292  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:12.087069  8249 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:12.087363  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:12.091022  8104 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:18:12.092024  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:12.093214  8101 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 13:18:12.094851  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:12.096077  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:12.122963 13001 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:12.115832 12851 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:12.123217  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:12.125988  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.123077  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:12.126860  8255 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:12.127120  8101 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:12.127841  8104 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:12.129988 12846 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:12.125033  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.153275  8255 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:18:12.146251  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.121536 12753 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:12.166311  8099 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:12.166183  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.167946  8108 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:12.169026  8257 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:12.169834  8103 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:12.170303  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:12.174674  8180 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:12.174799  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.176155  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:12.176719  8175 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:12.178046  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.168929 12934 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:12.180176  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.190042  8251 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
W20260709 13:18:12.192780  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 51630.7us
I20260709 13:18:12.164443 12761 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:12.200826  8183 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:12.203724  8101 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:18:12.200856  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:12.201172  8250 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:12.211287  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:12.212267  8104 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:12.213707  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:12.214135  8254 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:12.214552  8099 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:12.224390  8249 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:12.213409  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:12.227423  8104 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:12.231268  8255 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 13:18:12.189451 12953 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.237637  8251 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:18:12.239924  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:12.245641  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.246526  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.247167  8249 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:12.244681 12753 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:18:12.250492  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.252976  8252 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:12.254215  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.258245  8257 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:12.259392  8250 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:12.263180  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.263243  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.265790  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:12.276486  8179 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:18:12.275279  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:12.278087  8107 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:12.280212  8183 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:18:12.280511  8784 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:12.281929  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.282600  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.284143  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.284711  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:12.286128  8248 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:12.289690  8182 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:12.293936  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:12.294828 12995 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:12.295588 12995 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.286233  8253 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:12.299173  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.304414  8103 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:12.312644  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.322777 12990 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:12.323586 12990 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.324582  8106 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:12.326056  8254 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:12.318104  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.320099 12952 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:12.318475  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:12.321630  8257 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:12.335742  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.339221  8252 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:12.340267  8250 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:12.341774  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.342754  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.344244  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:12.348888  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:12.360049 12851 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:12.360867 12851 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.362514  8257 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:12.363056 12851 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:12.363176 12875 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:12.363991  8101 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:18:12.368081  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 102378us
I20260709 13:18:12.316252 13025 consensus_queue.cc:1059] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.121s
I20260709 13:18:12.364964  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:12.373953  8253 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:12.379475  8182 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:12.380760  8103 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:12.382417  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:12.386214  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.384006  8784 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:12.367040 12934 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:12.397737  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:12.398110 13032 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:18:12.398209  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:12.410606 13036 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:18:12.412624 13028 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:18:12.406605  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:12.414824  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:12.407177  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.412855 12975 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:12.391726 12990 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:12.417651  8106 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:18:12.393863 12761 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:12.408762  8221 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.523s (SENT) [suppressed 26 similar messages]
I20260709 13:18:12.430997  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:12.422818 12995 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:12.449373  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.447532  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:12.451869 12951 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:12.452605  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.457204  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.458907  8104 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:12.442996 12953 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:12.425269 12973 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:12.485018  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.484848  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 87734.4us
I20260709 13:18:12.486382  8253 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:12.442668 12934 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:12.489702  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.493739 12951 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.493948  8248 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:18:12.494750  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 49552.6us
I20260709 13:18:12.452749 12761 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.501420  8107 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
W20260709 13:18:12.507925 13031 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:18:12.508512 12827 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:12.508643 12844 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.509130 12827 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.509370 12844 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.511857 12844 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:12.511890 12827 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:12.509395  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.514201  8253 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:12.512687 12981 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.506085 12925 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.498031 12736 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:12.505026  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:12.480079 12975 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.535271  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:12.538498  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 131261us
I20260709 13:18:12.541712  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:12.541635 12980 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:12.542670 12639 raft_consensus.cc:3055] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:12.543136 12639 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:12.543318 12540 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.544042 12540 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.524296 12827 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:12.542521  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:12.528308 12567 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.533620 12959 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:12.554260  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:12.559333  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:12.561461  8101 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:12.555670 12995 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:18:12.561954  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:12.562252 12995 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:12.562605  8105 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:12.562721 12995 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:12.561141 12827 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.527742 12973 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.544210 12639 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.520130 12925 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.558640  8107 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:12.569157 12567 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.571050  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:12.571703 13018 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:12.566334  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:12.564658 13030 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.288s	user 0.005s	sys 0.000s
I20260709 13:18:12.584666 12748 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:12.585330 12748 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.585767 12973 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:12.586378 12973 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:12.586616 12844 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:12.587208 12844 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:12.587541 12748 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:12.587733 12844 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:12.587680 13020 consensus_queue.cc:1059] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:12.592237 12953 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.592757 12953 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.593923 12540 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:12.594983 12953 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:12.599704 12934 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:12.601038  8054 auto_rebalancer.cc:629] Failed to schedule move for tablet b3279fc005d149f8aad5d0df46e09fda: Illegal state: Replica a0f96c12124b4e1a816d9fa970464091 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:12.556072 12959 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:12.606607  8182 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:12.565968 12980 raft_consensus.cc:2764] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:18:12.608182  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.608111  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 43719.6us
I20260709 13:18:12.610767  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:12.619778 13018 raft_consensus.cc:697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:12.621802 13020 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:12.622241 13020 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:12.623072 12512 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:12.623497 12512 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:12.623286 13020 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.624300 12512 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.626730 12567 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:12.627350 12975 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:12.609504 12959 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:12.628109 12956 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:12.628710 12956 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:12.629096 12956 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:12.627380  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 56455.9us
I20260709 13:18:12.630306  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:12.638216  8105 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:12.643579  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.644600  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.645326  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.645793  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.645961  8257 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:12.646833 12746 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:12.647337 12951 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:12.647915 12951 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.648509 12951 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:12.648993  8054 auto_rebalancer.cc:629] Failed to schedule move for tablet d0adcb7796ea47a4be5ddd094575ed19: Illegal state: Replica 9bd264598fd2483e9e17674bab9ba4e8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:12.644762  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.624585 13020 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:12.650121  8254 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:18:12.659240  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.661194  8250 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:18:12.662125  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 131168us
I20260709 13:18:12.664664  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.664693  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.651369 12975 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:12.666510  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:12.669070  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:12.669632  8253 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:12.658032 12512 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:12.637908 12934 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:12.635893 12990 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:18:12.674520  8248 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 16: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:12.674460  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:12.576694 12995 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:12.679608  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.682969  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 136893us
I20260709 13:18:12.672086 12639 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:12.673985 12981 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:12.696312 12846 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.566s	user 0.004s	sys 0.011s
I20260709 13:18:12.685333 12761 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:12.708573 12736 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:12.717743  8054 auto_rebalancer.cc:629] Failed to schedule move for tablet aacbbdcc46cd40c0bf26d6ceb75d464d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:12.710913  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:12.726608  8102 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:12.718412 12540 raft_consensus.cc:3055] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:12.734723 12540 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:12.734925 12827 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:12.735070  8790 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:12.735653 12540 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.661681 13018 consensus_queue.cc:237] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:12.724270 12886 consensus_meta.cc:287] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.003s
I20260709 13:18:12.685604 12934 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:12.754974 13044 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.205s	user 0.003s	sys 0.000s
I20260709 13:18:12.723186 12925 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:12.793056 12567 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:18:12.793821 13047 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:18:12.794070 12567 consensus_queue.cc:1243] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:12.794767 12567 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:18:12.796156 13046 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:18:12.796703 12567 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:18:12.798188 13049 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:12.714018 13050 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:12.741382 12995 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:12.754231 13043 log.cc:927] Time spent T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:18:12.712214 12748 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:18:12.728345 12736 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:12.758728  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:12.749549 12846 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:12.757696 12959 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:12.785563 13042 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:18:12.740635 13024 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:18:12.745020 12540 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:12.786490  8183 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:12.790755  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:12.791297 12738 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:12.792119 12746 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:12.704523 12975 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:12.818969  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 107154us
I20260709 13:18:12.820111  8253 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
W20260709 13:18:12.822863  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 120117us
I20260709 13:18:12.797238 12567 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:12.835027  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 44395.1us
I20260709 13:18:12.835767 12512 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:12.835654 12840 consensus_queue.cc:1059] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:12.839897  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 165539us
I20260709 13:18:12.825954 13050 raft_consensus.cc:697] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:12.828333 12846 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:12.857494  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:12.861353  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:12.837294 12761 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:12.839804 12512 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:12.870173  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 141389us
I20260709 13:18:12.874245  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:12.863206 12738 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:12.865072 12951 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:12.883710 12959 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:12.884553 12567 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.885989 12567 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:12.891342 12844 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.892227 13050 consensus_queue.cc:237] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.893075 12886 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:12.893580 12886 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:12.894474 12886 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.895785 12886 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:12.897270 12975 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:12.872030 12512 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:12.898506 12846 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.900096 13025 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:12.879750 12738 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:12.901140 12952 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:12.876246 12761 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:18:12.906360  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 47369.8us
I20260709 13:18:12.906570 13053 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:12.915828  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:12.919567  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 58354.3us
I20260709 13:18:12.920356  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:12.923938  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:12.926059  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:12.927510  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.907675 13025 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:12.928679  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:12.945740  8223 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:12.927608 13053 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:12.950784 13053 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.927915 12952 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:12.954795 12973 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:12.955251 12973 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.954587 12952 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.955600 12973 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:12.929651 12990 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:12.940542 13054 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:12.928260 12844 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:12.963037  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:12.965710  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:12.978227  8100 raft_consensus.cc:2410] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:12.966403  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.967938 12761 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.934520 13025 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:12.969753  8106 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:12.970389 12738 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:12.987528 12738 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:12.971649  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.972637 13052 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:12.933532 12975 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:12.940969 12951 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:12.999459 12951 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.999851 12951 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:12.978775  8181 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:18:12.945269 12748 raft_consensus.cc:2764] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:18:12.975392 12981 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:18:12.984493  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.985335  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:12.974499 12956 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:12.990849  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.994138  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:12.975548 12990 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:12.999071  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.977080 13054 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.003961  8182 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:13.002210  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:13.011209  8174 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:13.000972 12540 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:13.014017  8787 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: []
W20260709 13:18:13.015164  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 52259.8us
I20260709 13:18:13.016738  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:12.997020 12975 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.009109 12990 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.017976 12975 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.010735 13054 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:13.019366 12905 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 13:18:13.014038  8147 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa9dafbde3954b8487327ba47919b4d5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:13.025259  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:13.025806  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.030365 12956 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:13.032075  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:13.034853  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:13.038331  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:13.038478  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:13.038757  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:13.023907 12980 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:13.040659  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:13.042052  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:13.046924  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:13.051005  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:13.040906  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:13.031018 12934 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:13.034075 12844 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:13.036070 12846 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:13.024547 13050 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:18:13.013808 12875 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:18:13.077204  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:13.048668 12835 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:13.040570 12981 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:13.041016 12980 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:13.081570  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 44087.4us
I20260709 13:18:13.083783  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:13.085793  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:13.086408  8105 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.087754  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:13.049763 12851 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:18:13.090839 12934 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:18:13.050513 12748 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
W20260709 13:18:13.103367  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 56518.7us
I20260709 13:18:13.104236  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:13.105940  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:13.104879  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:13.082597 12835 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:13.110564  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:13.115052  8103 raft_consensus.cc:2410] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:13.083971 12980 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.084244 12981 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:13.104501 12540 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.106818 12840 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:13.109486 12846 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.125181  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:13.127398  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:13.117028 12835 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:13.117861 12981 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:13.126766 12840 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.148104  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:13.164347  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 122992us
I20260709 13:18:13.156565 12840 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.145401 12846 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:13.197947  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:13.199895  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 65027.4us
W20260709 13:18:13.204735  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.205463  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:13.209488 13064 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:18:13.210167 13066 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:18:13.210685 13063 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
W20260709 13:18:13.210955 13065 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:18:13.222417  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 52972.2us
I20260709 13:18:13.176261 12905 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:18:13.194562 13067 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:13.253093  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:13.208007 12736 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:13.247552 13062 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:18:13.248015 13020 raft_consensus.cc:3055] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:13.279966 12761 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:13.319491  8782 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:13.325520  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:13.326478  8251 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:18:13.329196  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:13.332438  8251 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:18:13.335397 13024 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:13.336735 13024 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:13.337641 13024 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:13.355801  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:13.369385  8255 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:13.309937 13020 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:13.312122 13067 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:18:13.380424  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 67416.7us
W20260709 13:18:13.390246  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.346283 12512 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:13.417670  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 87345.3us
I20260709 13:18:13.419939 13070 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:13.420341 13074 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:18:13.420521 13070 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:13.406394 12851 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:13.424588 12512 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:13.422850 13070 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:13.429688  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 281680us
W20260709 13:18:13.456269 13081 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:13.461146 13006 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.150s
W20260709 13:18:13.441080 12995 consensus_meta.cc:287] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.624s	user 0.019s	sys 0.000s
I20260709 13:18:13.462616 13067 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:13.463675 13020 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:13.467291  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:13.472774  8108 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:18:13.474802 13076 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:18:13.475544 12975 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:13.476007 12639 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.771s	user 0.006s	sys 0.006s
I20260709 13:18:13.546170 12746 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:13.546566 13020 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:13.546684 12746 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:13.535399 12951 consensus_meta.cc:287] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.535s	user 0.012s	sys 0.000s
I20260709 13:18:13.547675 12746 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:13.548103 12951 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:13.549281  8257 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:13.549600  8102 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:13.546208  8255 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:13.552418  8250 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:13.537619 12835 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:13.557528  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:13.577167  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.490027  8105 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:13.589077  8103 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:13.549162 12746 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:13.598318  8252 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 13:18:13.600148  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:13.513329 12738 consensus_meta.cc:287] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
W20260709 13:18:13.485862 12973 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.530s	user 0.002s	sys 0.009s
I20260709 13:18:13.539994 12540 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:13.650211  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.651952  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 50578.7us
I20260709 13:18:13.653232  8182 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:18:13.560181 12753 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:13.481527 12512 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 13:18:13.541899 12736 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:13.654760  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.485738 12953 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:13.675499  8183 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:13.657622 13092 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:13.520335 12981 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:13.512897 12990 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:13.683159  8101 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:13.514235 12980 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:13.684846 13092 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:13.698391 12975 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:13.683561 12835 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:13.687577 13061 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.003s	sys 0.033s
I20260709 13:18:13.688987  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:13.689335  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:13.690030  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:13.694351  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:13.695185 13025 consensus_meta.cc:287] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.698s	user 0.007s	sys 0.002s
I20260709 13:18:13.694864 12840 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:13.675226 13070 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:18:13.684994 12721 consensus_queue.cc:1059] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:18:13.716286  8183 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:13.512387 13054 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:13.710891  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:13.718995  8251 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:13.647957 12973 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:13.714519 13061 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.003s	sys 0.033s
I20260709 13:18:13.719568  8107 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:13.725093  8104 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:18:13.726495  8100 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:18:13.674115 12951 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:13.720222  8255 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:18:13.720533  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.709527 13092 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:13.721221  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:13.730263  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 235607us
I20260709 13:18:13.679736 12953 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:13.745848 12990 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:13.746306 13068 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.747066 13068 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:13.747730 12981 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:13.751677 13054 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:13.723680 13075 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:13.752766 12721 raft_consensus.cc:3055] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:13.752908 13075 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:13.757448 13088 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.757921 12840 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:13.759356  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 75683.6us
I20260709 13:18:13.759913 12567 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:13.760404  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:13.761581 13100 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:13.717687 13025 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:13.753391  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 547998us
I20260709 13:18:13.763785  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:13.765565 13053 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:13.766175 13053 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:13.768723 13053 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:13.766512 12951 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:13.760322 12753 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:18:13.774953 12973 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:13.763793 13025 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:13.780915  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:13.784440  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:13.786356  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:13.753260 12721 raft_consensus.cc:740] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:13.798745 12973 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.799268 13068 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:13.826109  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 96489.5us
I20260709 13:18:13.800112  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:13.826784  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:13.827557  8257 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 15: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:13.801455  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:13.802147  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:13.803900  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:13.804800 13072 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.651s	user 0.004s	sys 0.010s
I20260709 13:18:13.790624 13100 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:13.806347  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:13.806761  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:13.807192 13075 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:13.815696 13098 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:13.818791  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:13.819746  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:13.838013  8253 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:13.830837  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:13.783596 12981 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:13.793583 13050 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:13.840308  8099 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:13.834877  8223 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:13.847791  8072 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:13.849555  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:13.851275  8104 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:13.852615  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:13.856411  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:13.858733  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:13.850636  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:13.860445  8250 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.862776  8105 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:13.864344  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:13.865994  8108 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:13.867197  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:13.868784  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:13.869561  8105 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.833315 12840 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:13.881510  8256 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:13.836709 13098 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:13.873270  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:13.873879  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:13.874866  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:13.855722 13068 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:13.871021  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:13.849107 13053 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:13.834149 12952 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:13.888242  8104 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.901013  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:13.858767 13075 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:13.901863  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:13.836933 13106 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:18:13.890406  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:13.830256 12973 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:13.897825  8177 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.899019  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:13.878070 12840 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.881608 12990 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:13.910696  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:13.884433 12905 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:13.918237  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:13.918691  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:13.904911  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:13.923395  8099 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.892462 13068 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.925268  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:13.926542  8102 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:18:13.871749 12981 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:13.891170 13092 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:18:13.926991 12952 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:13.907016 13107 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:13.914124 12840 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:13.898029 12540 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:13.904479 12753 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:13.932169  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:13.986804  8102 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:13.899751 13053 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:13.958420  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:13.919382 13050 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.930845  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:13.992288  8256 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.913182 12995 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:13.954142  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:13.951483 13068 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:13.927193 13071 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.942622 13001 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:13.930908 13099 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:18:13.933825 13110 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:13.967634 12846 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:13.969116  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:13.973841 12980 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:13.974535 13100 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:13.976269  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:13.977638  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:13.978632  8177 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:13.979182  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:14.020761  8103 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 14: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:13.913741 12721 consensus_queue.cc:260] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:13.980609 12905 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:13.981839 13112 ts_tablet_manager.cc:933] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:13.983752  8249 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: [15.7-17.8]
I20260709 13:18:13.958374  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:14.026283  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:14.001013 12512 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:13.989555  8104 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:14.044174  8104 raft_consensus.cc:1240] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:13.994984  8250 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:13.997169  8105 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:13.998131  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:13.949147 12953 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:13.948199 12973 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:14.001684  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:14.051824  8174 raft_consensus.cc:606] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:14.052214  8174 raft_consensus.cc:614] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:13.991393 12540 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:13.995654 13050 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:13.989145 13053 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:13.957845 13098 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.063500 13098 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.010085  8256 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:14.010505 13068 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.065503 13024 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:18:14.066071 12567 consensus_queue.cc:1175] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9480609eccc44250a4d7fcc9686e76cf" responder_term: 16 status { last_received { term: 15 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:14.011272 13099 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:14.067004 13068 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:14.067327 13099 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:14.012620 13106 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:13.987668  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:14.068885  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 81294.3us
I20260709 13:18:13.927874 13075 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:14.030766  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:14.028689  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:14.070627 13054 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:14.033401 12995 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:14.071530 13075 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:14.020800 13001 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:18:14.071732 12995 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:14.074855 12540 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:14.017935 13094 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:18:14.039340 12835 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.021229 12981 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:14.049389  8180 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:13.994616 13092 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:18:13.986254 12990 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:14.055402  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1723) took 1001 ms. Trace:
I20260709 13:18:14.130463  8182 rpcz_store.cc:276] 0709 13:18:13.041541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.060813 (+ 19272us) service_pool.cc:224] Handling call
0709 13:18:14.042363 (+981550us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b5400340654. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:14.042527 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1297762560}
I20260709 13:18:13.990384 12934 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:18:14.059598  8250 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:14.060818  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:14.061401 13116 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:14.061865  8176 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:18:14.148862  8099 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:14.065775  8256 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:18:14.030825  8177 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:14.018949 13110 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:14.082612  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 57921.1us
I20260709 13:18:14.083866  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:14.049382  8105 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:14.055918 12753 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:14.153587  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:14.085762 13094 consensus_queue.cc:1243] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:14.084688 13050 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:14.087549 13075 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:14.047315 13107 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
W20260709 13:18:14.164606  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 206287us
I20260709 13:18:14.171499  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:14.172181  8177 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 15. Current term is 16. Ops: []
W20260709 13:18:14.165972  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 82221us
I20260709 13:18:14.092239 12746 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.150131 12981 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.126744 13088 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:14.021466 13071 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.174158  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:14.092841 12953 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:14.180606  8182 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:18:14.168373  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 89449.9us
I20260709 13:18:14.127346 12835 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.178503 13068 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:14.152647 12990 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:14.202819  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:14.205376  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:14.212421  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:14.240705  8254 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:18:14.241256  8254 pending_rounds.cc:85] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 6
I20260709 13:18:14.258766  8254 pending_rounds.cc:107] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:18:14.259455  8254 raft_consensus.cc:2889] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:14.182103 12746 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:14.226115  8176 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:18:14.272342  8176 pending_rounds.cc:85] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 9
I20260709 13:18:14.243563 12925 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:14.285422  8176 pending_rounds.cc:107] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:18:14.164171 13116 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:14.287952  8176 raft_consensus.cc:2889] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:14.245573 12953 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:14.215943 13106 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:18:14.220979 13050 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:18:14.221268 12512 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:18:14.262367 12952 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:14.244128 13068 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:14.258085 13088 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:18:14.267426 12846 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:14.299878  8174 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:14.187482 12981 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.324460  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:14.287272 13024 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:14.287000 12925 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:14.326503 13114 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.319s	user 0.000s	sys 0.002s
I20260709 13:18:14.293617 12953 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:14.354966 12925 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:14.287909 13112 tablet_copy_client.cc:323] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.130:46389
I20260709 13:18:14.349121 12952 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:14.390067  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 184785us
I20260709 13:18:14.397787  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:14.398736  8105 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:14.350871 13091 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:14.326388 13080 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.234s
I20260709 13:18:14.361809 12953 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:14.426101  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:14.383029 12540 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:14.357724 12905 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:14.358870 13024 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:14.475467 13106 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:14.420218 12952 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.476513 13024 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.462666 12990 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:14.426879 13130 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:18:14.432564 13094 consensus_queue.cc:1059] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:18:14.480104 13094 raft_consensus.cc:3055] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:14.480489 13094 raft_consensus.cc:740] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:14.480700  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2654) took 1280 ms. Trace:
I20260709 13:18:14.481693 12835 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:14.481350 13094 consensus_queue.cc:260] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.482877 13094 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:14.483855 13068 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.465072 13123 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:14.469549 12748 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:14.486294 12748 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:14.487190 12748 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:14.488443 13124 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:18:14.470292  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:14.489749 13106 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.489895  8100 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:14.490259 13106 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:14.491719 13071 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:14.492249 13106 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:14.478714 13131 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:14.492862 13131 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.478675 12952 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:14.493414 13116 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:14.493256 13131 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:14.492288 12738 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:14.494992 12738 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:14.496935 12738 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:14.499531 12540 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:14.501027  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:14.354801 12846 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.501682  8102 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 9.
I20260709 13:18:14.503430 12846 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:14.503721  8102 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:18:14.507117  8101 pending_rounds.cc:85] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 5
I20260709 13:18:14.507404  8101 pending_rounds.cc:107] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:18:14.507679  8101 raft_consensus.cc:2889] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:14.507905 12840 consensus_meta.cc:287] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.001s
I20260709 13:18:14.507977  8100 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:14.508375 12840 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.510684 12840 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:14.434423 13091 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:14.481135  8106 rpcz_store.cc:276] 0709 13:18:13.200172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.485791 (+285619us) service_pool.cc:224] Handling call
0709 13:18:13.560094 (+ 74303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.604269 (+ 44175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.604299 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.658077 (+ 53778us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.908808 (+250731us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:13.908847 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.908912 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.480484 (+571572us) raft_consensus.cc:1685] finished
0709 13:18:14.480504 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.480642 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43681,"raft.queue_time_us":64494,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":6297,"thread_start_us":208751,"threads_started":1,"wal-append.queue_time_us":290432}
I20260709 13:18:14.515148 13131 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:14.516180 12746 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:14.534205  8100 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:14.535532  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:14.541141  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.541363  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.542083  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.531705  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:14.549093  8108 consensus_meta.cc:287] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.001s
I20260709 13:18:14.549697  8099 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:14.549719  8108 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:14.552062  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:14.552670  8108 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:14.556265  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:14.553117 13116 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:14.569052  8108 raft_consensus.cc:2410] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:14.570384 13116 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.570740  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:14.558990 13071 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:14.543473 13091 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:14.582155  8178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:14.584514  8106 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:18:14.621017  8178 raft_consensus.cc:606] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:14.553784 13110 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:14.581673 12746 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:14.588165  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:14.617585  8100 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
W20260709 13:18:14.571332 13053 consensus_meta.cc:287] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.000s
I20260709 13:18:14.578847 12995 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.621399  8178 raft_consensus.cc:614] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:14.556910 13094 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:18:14.575882 13088 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:14.618494  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:14.627568 12746 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:14.637929  8108 raft_consensus.cc:2410] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:14.630820 12840 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.632009 13106 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:14.645612  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 321226us
I20260709 13:18:14.649011  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:14.650141  8099 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:18:14.648698  8149 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:14.653198  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:14.647325 12981 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:14.624444 13071 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:14.640453 12746 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:14.663533  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.663898  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:14.664541  8791 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:14.664827  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.665573  8787 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:14.666282  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.667295  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.667835  8787 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:14.668648  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.670107  8785 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:14.671332  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.671672  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:14.672246  8256 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:14.673038  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:14.673697  8256 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:14.669296  8787 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:14.674753  8256 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:18:14.674882  8791 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:14.688244  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:14.718314  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.718989  8787 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:14.719964  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:14.720613  8787 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:14.723153  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:14.723367  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:14.723846  8181 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:14.724925  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:14.726001  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:14.726642  8178 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:14.714781  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.727123  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.727710  8790 raft_consensus.cc:2376] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14. Re-sending same reply.
I20260709 13:18:14.728107  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.728545  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.728855  8791 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:18:14.729543 13117 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.493s	user 0.003s	sys 0.000s
I20260709 13:18:14.731649 12753 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:14.724617  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:14.732043 12753 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:14.733121  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 56582.2us
I20260709 13:18:14.732926 13050 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:14.738030  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:14.737969  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:14.716382  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:14.742324  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:14.742596  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.635594 13053 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:14.759261  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:14.760329  8257 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:18:14.721328  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.655893 13110 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:14.642665 13098 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:18:14.766947 13108 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:14.766826  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.767522  8103 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:14.768033  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:14.768193  8193 tablet_copy_service.cc:140] P 9bd264598fd2483e9e17674bab9ba4e8: Received BeginTabletCopySession request for tablet fa9dafbde3954b8487327ba47919b4d5 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:37206)
I20260709 13:18:14.773166  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:14.783815  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.773813 12721 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:14.766700  8178 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 16: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:14.764851  8177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:14.778954  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:14.787375  8099 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:14.653674 13106 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.780186  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2760) took 1690 ms. Trace:
I20260709 13:18:14.640512 13088 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:14.661526 12844 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:14.676851 12956 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:14.776151 12761 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:14.784471  8108 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 15: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:14.785972  8251 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: [15.7-17.8]
W20260709 13:18:14.779945  8074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.009s	sys 0.012s
I20260709 13:18:14.791167  8252 rpcz_store.cc:276] 0709 13:18:13.089660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.089817 (+   157us) service_pool.cc:224] Handling call
0709 13:18:13.107622 (+ 17805us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:13.602599 (+494977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.779932 (+1177333us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54002e8954. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:14.780124 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041162496}
W20260709 13:18:14.803990  8074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.010s	sys 0.012s
I20260709 13:18:14.732934 12753 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.795799  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.762530 12973 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:14.800750  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2644) took 1712 ms. Trace:
I20260709 13:18:14.651252 12639 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:14.802448  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.808600  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.811450  8791 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:14.786502 13110 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:14.800050  8193 tablet_copy_service.cc:161] P 9bd264598fd2483e9e17674bab9ba4e8: Beginning new tablet copy session on tablet fa9dafbde3954b8487327ba47919b4d5 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:37206: session id = 5033fc7e66374940a203908ea8b0078f-fa9dafbde3954b8487327ba47919b4d5
I20260709 13:18:14.807789 12905 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:18:14.810482  8107 rpcz_store.cc:276] 0709 13:18:13.088416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.089043 (+   627us) service_pool.cc:224] Handling call
0709 13:18:13.089312 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.724183 (+634871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.800410 (+1076227us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54003f2854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:14.800647 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1448933120}
I20260709 13:18:14.838635 13105 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:14.840674 12851 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.800383 12956 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.842294 12995 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:14.843066 12753 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:14.893097 13020 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 16.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:14.899120 13106 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:14.904894 13071 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:14.814236 12844 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:14.814117 12973 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:14.812479  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.813973  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:14.874760  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.875228 12746 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:14.651947 12840 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.776211 13091 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:14.785013 13100 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.013s	sys 0.023s
I20260709 13:18:14.887979  8107 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:14.848384 13137 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.159s
I20260709 13:18:14.927273  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:14.907366  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2785) took 1044 ms. Trace:
W20260709 13:18:14.971511 12925 consensus_meta.cc:287] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.612s	user 0.005s	sys 0.004s
I20260709 13:18:15.249373  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:15.247860  8248 rpcz_store.cc:276] 0709 13:18:13.863344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.964808 (+101464us) service_pool.cc:224] Handling call
0709 13:18:13.965102 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:14.075854 (+110752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.075885 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:14.076341 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:18:14.296579 (+220238us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:14.518041 (+221462us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.518292 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.906862 (+388570us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400197154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:14.906923 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.906981 (+    58us) raft_consensus.cc:1685] finished
0709 13:18:14.907111 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.907287 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21388,"prepare.queue_time_us":206628,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":8459,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":17722,"spinlock_wait_cycles":253904768,"thread_start_us":381595,"threads_started":2,"wal-append.queue_time_us":381073}
I20260709 13:18:15.250355  8252 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:14.916493  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:14.908924  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:14.933055  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.251909 13092 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:15.265686  8787 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:14.877094 13105 consensus_queue.cc:1243] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:14.970161 13099 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.867187 12639 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:14.909296 13110 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:15.058115  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.246605 12721 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.086969 13116 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:14.972548  8249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.006s	sys 0.025s
I20260709 13:18:15.266052 13092 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:15.313792  8249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.008s	sys 0.028s
W20260709 13:18:15.070957  8104 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.001s	sys 0.014s
I20260709 13:18:14.991075  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2782) took 1128 ms. Trace:
W20260709 13:18:15.314577  8104 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.133s	user 0.003s	sys 0.019s
I20260709 13:18:15.276757  8175 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:15.314663  8254 rpcz_store.cc:276] 0709 13:18:13.862586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.934420 (+ 71834us) service_pool.cc:224] Handling call
0709 13:18:13.934741 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.282621 (+347880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.990764 (+708143us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b5400268c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:14.990989 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660676352}
I20260709 13:18:15.263039 13088 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:15.298789  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:15.328068  8174 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:14.967072 13075 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:15.266578 13100 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.224s	user 0.020s	sys 0.026s
I20260709 13:18:15.273240  8183 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:15.332715  8177 raft_consensus.cc:606] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:15.333205  8177 raft_consensus.cc:614] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:15.252501  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 336096us
I20260709 13:18:14.884948 12956 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:15.070753 13006 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.000s	sys 0.015s
I20260709 13:18:15.072278 13141 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:15.351970  8223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.015s	sys 0.029s
I20260709 13:18:14.884330 12851 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:15.307971  8782 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:14.988658 12905 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.305153 12973 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:15.330657  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:15.336426  8100 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.010s	sys 0.017s
I20260709 13:18:15.332348  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:15.338610  8176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.008s	sys 0.032s
W20260709 13:18:15.360534  8176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.008s	sys 0.032s
W20260709 13:18:15.012183  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 238068us
I20260709 13:18:15.167798 12761 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:15.302891  8181 raft_consensus.cc:2393] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:18:15.353354  8223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.016s	sys 0.029s
I20260709 13:18:15.323554 13092 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:15.335039  8193 tablet_copy_source_session.cc:215] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:18:15.360275  8100 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.010s	sys 0.017s
W20260709 13:18:15.367215  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 636537us
W20260709 13:18:15.370018  8106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.026s	sys 0.027s
W20260709 13:18:15.370675  8106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.026s	sys 0.027s
W20260709 13:18:15.371205  8182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.021s	sys 0.027s
I20260709 13:18:15.372829  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:15.329627 12721 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:15.389690  8182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.021s	sys 0.028s
I20260709 13:18:15.390357 13134 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:18:15.392954  8179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.005s	sys 0.017s
W20260709 13:18:15.393244  8179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.005s	sys 0.017s
I20260709 13:18:15.380153  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:15.381120  8108 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:15.370847  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:15.397146  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:15.337402 13075 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:15.406339  8100 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
W20260709 13:18:15.361893 13018 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.013s	sys 0.019s
I20260709 13:18:15.386593  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:15.397939  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:15.352360 12980 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:15.400211  8108 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:15.275624 12925 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:15.385048 12886 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.012s	sys 0.031s
I20260709 13:18:15.380678 12746 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:15.390878 13134 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:15.408099 13068 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.030s	sys 0.058s
W20260709 13:18:15.447610  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 49753us
I20260709 13:18:15.448896  8223 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:15.451043 12934 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:15.451380  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:15.450251  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:15.440696 13018 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.019s	sys 0.023s
I20260709 13:18:15.408317 13071 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.371836 12905 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:15.408386 13149 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:18:15.438645 12738 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:15.442440 12886 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.013s	sys 0.032s
I20260709 13:18:15.366464 13141 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:15.371693 12761 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:15.440927 13024 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.015s	sys 0.017s
I20260709 13:18:15.369565 12844 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:15.445906 13068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.030s	sys 0.059s
I20260709 13:18:15.451516 12934 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:15.551043  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 100903us
I20260709 13:18:15.551971  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:15.406028 13162 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:15.437179 13106 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:18:15.447486 12953 consensus_meta.cc:287] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.987s	user 0.004s	sys 0.009s
W20260709 13:18:15.493965 13024 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.016s	sys 0.017s
I20260709 13:18:15.483210 13152 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:15.559777  8253 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:15.448550 13006 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:18:15.608495 13018 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:15.609083 13018 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:15.610105 13018 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:15.611449 13018 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:15.558039 13159 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:18:15.613169 13144 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:15.613777 13025 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:15.614291 13025 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:15.615424 13025 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:15.561931 13162 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:15.624203 12639 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:15.626003 13162 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:15.486766 13071 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:15.626425 13141 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:15.626796 12905 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:15.627242 13025 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:15.555611 12934 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:15.636271  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 628) took 1706 ms. Trace:
I20260709 13:18:15.638805  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2796) took 1144 ms. Trace:
I20260709 13:18:15.639288  8253 rpcz_store.cc:276] 0709 13:18:14.494344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.513554 (+ 19210us) service_pool.cc:224] Handling call
0709 13:18:14.513848 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.571572 (+1057724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.638547 (+ 66975us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54004137d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:15.638740 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2404988800}
I20260709 13:18:15.578266 13091 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:15.585415 12738 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:15.641857 12738 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:15.643154 12973 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:15.558218 13120 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:18:15.588760 13152 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:15.646010 13152 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:15.571756 12953 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:15.647852  8785 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:15.583504 13100 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:15.636719  8179 rpcz_store.cc:276] 0709 13:18:13.930016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.930924 (+   908us) service_pool.cc:224] Handling call
0709 13:18:13.931212 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.127158 (+195946us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:14.640084 (+512926us) log.cc:844] Serialized 14 byte log entry
0709 13:18:15.409028 (+768944us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.409109 (+    81us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:15.409180 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.636007 (+226827us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400100c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:15.636068 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.636207 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29801,"prepare.queue_time_us":57731,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":4366,"raft.queue_time_us":42559,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":9695,"spinlock_wait_cycles":338173184,"thread_start_us":1190163,"threads_started":2,"wal-append.queue_time_us":932220}
I20260709 13:18:15.649626 13100 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:15.650908 13100 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:15.652513 13100 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:15.652956  8183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 627) took 1723 ms (client timeout 1761 ms). Trace:
I20260709 13:18:15.573107 12851 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:15.653595 13164 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.076s	user 0.004s	sys 0.000s
W20260709 13:18:15.653378  8183 rpcz_store.cc:269] 0709 13:18:13.929672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.958076 (+ 28404us) service_pool.cc:224] Handling call
0709 13:18:15.652776 (+1694700us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002481d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:15.652887 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2784056064}
I20260709 13:18:15.649096 12953 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:15.591059 12567 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:15.655453 12567 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:15.656352 12567 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.6, Last appended by leader: 6, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:15.594808  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:15.595660  8178 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:15.596827  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:15.675354  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1343) took 1135 ms. Trace:
I20260709 13:18:15.675963  8789 rpcz_store.cc:276] 0709 13:18:14.540005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.540128 (+   123us) service_pool.cc:224] Handling call
0709 13:18:15.674380 (+1134252us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b5800003c98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27eee 0000000000375939 00007fa5a5d9b1e0 00007fa5a5e640c4 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:18:15.674604 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.674863 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.674903 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.674966 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:15.675022 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.675100 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.675242 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5062400}
I20260709 13:18:15.687271 13131 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:15.693845 13107 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:15.694574 13107 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:15.703459 13142 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:15.704035 13142 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:15.707165 13053 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:15.709492  8782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1336) took 1192 ms. Trace:
I20260709 13:18:15.709968  8782 rpcz_store.cc:276] 0709 13:18:14.516865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.529327 (+ 12462us) service_pool.cc:224] Handling call
0709 13:18:14.537611 (+  8284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.359374 (+821763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.709180 (+349806us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b5400750154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:15.709390 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763270400}
W20260709 13:18:15.597981  8180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 626) took 1687 ms (client timeout 2120 ms). Trace:
W20260709 13:18:15.598767 12753 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.709s	user 0.008s	sys 0.004s
I20260709 13:18:15.622395 13075 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:15.623409 12956 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:15.628265 13071 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:15.571082 13116 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:15.628605  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2668) took 1128 ms. Trace:
I20260709 13:18:15.630143 13134 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:15.631698 12761 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:15.602854 12840 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:15.570353 13068 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:15.720109 13068 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:15.719224  8105 rpcz_store.cc:276] 0709 13:18:14.500071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.504249 (+  4178us) service_pool.cc:224] Handling call
0709 13:18:14.504730 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:14.505063 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.505089 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:14.505953 (+   864us) log.cc:844] Serialized 506 byte log entry
0709 13:18:14.785717 (+279764us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:14.785772 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.785869 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:15.628336 (+842467us) raft_consensus.cc:1685] finished
0709 13:18:15.628363 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.628532 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":279338,"threads_started":1,"wal-append.queue_time_us":566376}
I20260709 13:18:15.722277 12956 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:15.717692  8180 rpcz_store.cc:269] 0709 13:18:13.910171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.910353 (+   182us) service_pool.cc:224] Handling call
0709 13:18:15.597730 (+1687377us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54002f9254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:15.597879 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253249920}
W20260709 13:18:15.730055 13155 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.277s	user 0.004s	sys 0.000s
I20260709 13:18:15.740209 13099 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:15.741973  8785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48096 (request call id 800) took 1072 ms. Trace:
I20260709 13:18:15.705183 13142 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:15.747184 13142 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:15.742550  8785 rpcz_store.cc:276] 0709 13:18:14.669298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.671092 (+  1794us) service_pool.cc:224] Handling call
0709 13:18:15.741712 (+1070620us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54005c80d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:15.741861 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2244520320}
I20260709 13:18:15.658407  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:15.796945  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.799669  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:15.802561  8149 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:15.812935  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:15.810315  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:15.814131  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.442691 12980 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:15.819188  8147 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.006s	sys 0.014s
W20260709 13:18:15.820628  8147 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.006s	sys 0.014s
W20260709 13:18:15.825623  8104 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.039s	sys 0.068s
I20260709 13:18:15.826333  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:15.814787  8221 connection.cc:256] RPC call timeout handler was delayed by -1.0332756580000932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
W20260709 13:18:15.831089  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.801852 12567 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:15.860139  8753 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.001s	sys 0.018s
W20260709 13:18:15.865983  8753 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.002s	sys 0.018s
I20260709 13:18:15.863627  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2788) took 1999 ms. Trace:
I20260709 13:18:15.864375  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1727) took 1968 ms. Trace:
W20260709 13:18:15.874696  8072 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.004s	sys 0.017s
W20260709 13:18:15.875286  8072 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.004s	sys 0.017s
W20260709 13:18:15.875723  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 591125us
I20260709 13:18:15.828528 13075 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.867986  8249 rpcz_store.cc:276] 0709 13:18:13.864091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.037699 (+173608us) service_pool.cc:224] Handling call
0709 13:18:14.038090 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:14.078545 (+ 40455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.078589 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:14.155293 (+ 76704us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.314242 (+1158949us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:15.861940 (+547698us) log.cc:844] Serialized 14 byte log entry
0709 13:18:15.863207 (+  1267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.863308 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:15.863360 (+    52us) raft_consensus.cc:1685] finished
0709 13:18:15.863378 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.863552 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54448,"prepare.queue_time_us":487007,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":22575,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":1602738,"threads_started":2,"wal-append.queue_time_us":1257887}
I20260709 13:18:15.828639 12748 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:15.892235  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:15.893883  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:15.858604 12721 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:15.871179 13080 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:15.938783  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:15.899678 13159 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:15.943241  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 55839.9us
I20260709 13:18:15.954113  8102 pending_rounds.cc:85] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 5
I20260709 13:18:15.954480  8102 pending_rounds.cc:107] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:18:15.898679 13050 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.954694  8221 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:15.959852  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:15.918212  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 95469us
I20260709 13:18:15.954768  8102 raft_consensus.cc:2889] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:15.956573  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:15.959223  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:15.888417 13068 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:15.911958 12851 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.908187 12925 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:15.969208  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:15.910097 13088 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.964288  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:15.966459  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:15.967048  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:15.979121  8179 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:15.910955 12846 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.962045  8108 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
W20260709 13:18:15.972201  8106 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.009s	sys 0.040s
W20260709 13:18:15.972486  8787 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.046s	sys 0.024s
I20260709 13:18:15.972896  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:15.980497  8106 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.010s	sys 0.040s
I20260709 13:18:15.974238  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1737) took 1253 ms. Trace:
I20260709 13:18:15.980832  8100 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:15.976583  8221 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:15.980418  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:15.942407 12956 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:15.981673  8787 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.046s	sys 0.024s
W20260709 13:18:15.962491 13155 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:15.932595  8177 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:15.987090  8221 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:15.981181  8182 rpcz_store.cc:276] 0709 13:18:14.721229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.725509 (+  4280us) service_pool.cc:224] Handling call
0709 13:18:14.725902 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:14.737026 (+ 11124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.737059 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:14.737584 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.390086 (+652502us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:15.390124 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.390199 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:15.973961 (+583762us) raft_consensus.cc:1685] finished
0709 13:18:15.973990 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.974169 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10618,"raft.queue_time_us":10772,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":652155,"threads_started":1,"wal-append.queue_time_us":1063075}
I20260709 13:18:15.997611  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:15.911434 12905 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:18:15.987954 13020 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.960007 13107 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:15.969033 12851 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:15.900610 13075 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:15.940335  8072 leader_election.cc:336] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.841s (SENT)
I20260709 13:18:15.964138 12995 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.999979  8101 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
W20260709 13:18:16.019649  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 79355.4us
I20260709 13:18:16.019577 12995 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.020900  8101 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:18:16.022454 12995 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:15.942693 13006 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:18:16.023219 12995 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:16.023797 12995 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.024326 12995 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:16.000980  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:16.001783  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 449894us
I20260709 13:18:16.013511  8791 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:15.984759 13068 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:15.990151 12956 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:16.015086  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 464584us
W20260709 13:18:16.007339  8788 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.018s	sys 0.043s
I20260709 13:18:15.994019 13071 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:16.020920 13116 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:16.039744  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:15.973701 13080 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.053947  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:15.991338 12846 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.010560  8221 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:16.033614  8788 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.018s	sys 0.043s
I20260709 13:18:15.969370 13050 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.062772 13053 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:16.026424 12748 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:16.064059 12748 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:16.027822  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:15.985394 13088 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.009872 12925 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:15.963822 13159 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:16.038127 12956 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:16.031306 13068 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:16.034905 13071 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:16.017174 13020 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:16.043522 13092 consensus_meta.cc:287] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.662s	user 0.007s	sys 0.004s
W20260709 13:18:16.088537  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 45082.8us
I20260709 13:18:16.100502  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:16.049290 13116 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.093932  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:16.110255  8177 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:16.097218 13053 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:16.101294 13071 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:16.043817 12934 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:16.136288 13018 consensus_queue.cc:1059] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:16.136288  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:16.137243  8786 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:16.137571 13024 raft_consensus.cc:3055] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:16.137882  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:16.137959 13024 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:16.099727 13068 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:16.123901  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:16.065492 12748 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:16.130210 13165 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:18:16.165340  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:16.073761 12738 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:16.174559  8784 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
W20260709 13:18:16.185683  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.867671  8104 rpcz_store.cc:276] 0709 13:18:13.896336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.045051 (+148715us) service_pool.cc:224] Handling call
0709 13:18:14.045343 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.050410 (+  5067us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:14.181640 (+131230us) log.cc:844] Serialized 14 byte log entry
0709 13:18:15.729643 (+1548003us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b24003d4ee8. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dbe59c4 00007fa59dbe3acb 00007fa59dd9edc9 00007fa59dd9ea55 00007fa59dd9e09d 00007fa5a09d010e 00007fa5a09e788c 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221
0709 13:18:15.862264 (+132621us) log.cc:844] Serialized 14 byte log entry
0709 13:18:15.863857 (+  1593us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.863936 (+    79us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:15.864010 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.864148 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.864301 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24019,"prepare.queue_time_us":276278,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":2109,"raft.queue_time_us":751,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":6517,"spinlock_wait_cycles":110250752,"thread_start_us":1795811,"threads_started":3,"wal-append.queue_time_us":1213952}
I20260709 13:18:16.187960  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:16.174268 12753 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:16.193326 12512 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.197522 13170 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.197625 12512 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:16.198171 13170 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.109813 13092 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:16.199262  8107 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:16.199674 13098 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.200233 13098 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.196313 13107 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.200249 13178 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:16.204097 13107 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.204839 13178 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.139724 13024 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:16.207991  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:16.208681  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:16.212916  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:16.208792  8252 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:16.223832  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:16.227698  8254 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:18:16.234016  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 267639us
I20260709 13:18:16.235074 13134 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:16.235340  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:16.235561 13134 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.236203  8249 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
W20260709 13:18:16.284485  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 48059.8us
I20260709 13:18:16.217144 12951 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:16.306712  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 278973us
I20260709 13:18:16.307852  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:16.309346  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 300654us
I20260709 13:18:16.310788  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:16.312037  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:16.312518  8784 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:16.286273 13134 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:16.310021  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:16.308947  8223 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:16.285135 12925 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:16.331215  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:16.336474  8784 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:16.316287  8108 raft_consensus.cc:2955] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:18:16.339260  8107 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:16.339509  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:16.294068 13136 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:16.348647  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:16.352172  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:16.353747  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:16.357954  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.354543  8783 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:16.307999 13053 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:18:16.370066  8103 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:16.351455  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:16.374687  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:16.377171  8147 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:16.330868 12748 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:16.388975  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:16.334383 12512 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:16.386119  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:16.329689 12746 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:16.331146 13092 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:16.385387  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:16.394296  8790 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:16.371927 13006 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:16.389727  8785 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:16.369508 12846 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:16.385663 13185 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:16.306310 12951 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.420644  8789 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:16.380862 13171 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:16.385273 13075 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:16.348989 12925 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.434547  8788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 984) took 1066 ms. Trace:
I20260709 13:18:16.379837 12980 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:16.378520 12844 consensus_queue.cc:1059] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:18:16.414142 12746 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:16.438936  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 401219us
I20260709 13:18:16.419059 12934 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:16.381166 13136 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.420241 13006 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:16.443467  8788 rpcz_store.cc:276] 0709 13:18:15.367946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.368097 (+   151us) service_pool.cc:224] Handling call
0709 13:18:15.381808 (+ 13711us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.382096 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:16.060693 (+678597us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.432094 (+371401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.432144 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:16.432197 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.432264 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.434482 (+  2218us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":751352,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":7233,"thread_start_us":988527,"threads_started":2}
I20260709 13:18:16.459259  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:16.462116 13024 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:16.465320  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 785) took 1800 ms. Trace:
I20260709 13:18:16.435820 13020 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:16.435391 12851 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:16.484984  8791 rpcz_store.cc:276] 0709 13:18:14.665033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.837722 (+172689us) service_pool.cc:224] Handling call
0709 13:18:14.837988 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.027183 (+1189195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.465023 (+437840us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540050fad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:16.465244 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2702814080}
I20260709 13:18:16.453332 13107 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:16.453172 13171 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:16.139266 13127 raft_consensus.cc:2955] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
W20260709 13:18:16.514308 13166 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.545s	user 0.003s	sys 0.001s
I20260709 13:18:16.517194 13080 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:16.518805 12925 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:16.519558 12925 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:16.448983 13088 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:16.470777 12746 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:16.453504 13159 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:16.470149 13168 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:16.477837 12905 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.527766 12905 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:16.530004 12905 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:16.506520 12738 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:16.513252 13171 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:16.469414 13050 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:16.483392 13053 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:16.477293 13170 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:16.499295 13006 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:16.526561 13186 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:18:16.499295 13116 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:16.479077  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 168792us
W20260709 13:18:16.539682  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 230812us
I20260709 13:18:16.573109  8223 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:16.522337 12934 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:16.604478  8786 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
W20260709 13:18:16.607132  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 253891us
I20260709 13:18:16.610005  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:16.556564 13025 consensus_meta.cc:287] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.880s	user 0.020s	sys 0.007s
I20260709 13:18:16.482208 13191 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.079s
W20260709 13:18:16.571496 12973 consensus_meta.cc:287] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.928s	user 0.016s	sys 0.003s
W20260709 13:18:16.608907  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 373245us
I20260709 13:18:16.616329  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:16.609968 12934 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:16.638616  8149 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:16.652364  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:16.628901  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 251811us
I20260709 13:18:16.640429 13198 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.640199 13098 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:16.666776  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1738) took 2041 ms. Trace:
I20260709 13:18:16.642817 12925 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:16.665264  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 353281us
I20260709 13:18:16.662667  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:16.679006  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:16.680701  8102 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:16.680512  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:16.677440  8147 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:16.684257  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:16.637084 13053 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:18:16.651772 13179 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:16.685587  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:16.686798  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:16.689092  8105 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:16.640841 13050 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:18:16.655351 12934 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:16.690016  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:16.677147  8106 rpcz_store.cc:276] 0709 13:18:14.625519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.625680 (+   161us) service_pool.cc:224] Handling call
0709 13:18:14.626034 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.626283 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:14.652190 (+ 25907us) log.cc:844] Serialized 14 byte log entry
0709 13:18:15.991518 (+1339328us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.420194 (+428676us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.666415 (+246221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.666482 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:16.666542 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.666602 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.666715 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28555,"prepare.queue_time_us":683816,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":5238,"raft.queue_time_us":443924,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":7043,"spinlock_wait_cycles":37205632,"thread_start_us":1997689,"threads_started":4,"wal-append.queue_time_us":933606}
I20260709 13:18:16.696789  8103 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:16.691998  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:16.690237  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:16.698025  8102 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:16.659273 13025 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:16.693884  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:16.699249  8107 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:16.647560 13020 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:18:16.665906 13200 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:16.684863 12925 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.730546 13050 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:16.731251 13050 raft_consensus.cc:3055] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:16.731633 13050 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:16.732987 13179 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:16.705231 13098 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:16.733870 13098 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.690690 13112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9dafbde3954b8487327ba47919b4d5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:16.709954 13195 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:18:16.713843 13197 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:18:16.703890  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:16.662899 13127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:45846 (request call id 5) took 3900 ms. Trace:
I20260709 13:18:16.719870 12753 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:18:16.728160 13071 consensus_meta.cc:287] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.001s
I20260709 13:18:16.730216 13110 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:16.707435 13194 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:18:16.734165  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 48646.4us
I20260709 13:18:16.718991 12721 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:16.739585 13025 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:16.742234  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:16.742974 12951 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:16.695026 13116 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:16.746196 13178 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:16.746475  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:16.739800 13088 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:16.749866 13203 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:16.806039  8257 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:16.823243  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:16.751824  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:16.740687 13200 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:16.829583  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 83249us
I20260709 13:18:16.824261  8256 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:18:16.830965  8221 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:16.734062 13179 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:16.756461 13134 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.838692  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:16.766551 13099 consensus_meta.cc:287] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.024s	user 0.004s	sys 0.015s
W20260709 13:18:16.768379 13142 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.021s	user 0.010s	sys 0.010s
I20260709 13:18:16.738310 13098 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:16.770740 12925 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:16.784528  8223 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:16.737383 13171 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:18:16.796300  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 184903us
I20260709 13:18:16.787070  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:16.756917 12753 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:16.824863  8787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 985) took 1456 ms. Trace:
I20260709 13:18:16.783758 13071 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:16.861572  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 77118.4us
I20260709 13:18:16.835543  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:16.862607  8253 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:16.863509  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:16.803912 13152 consensus_meta.cc:287] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.157s	user 0.015s	sys 0.024s
I20260709 13:18:16.870241  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:16.827426 13088 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.856276 13106 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.874593 13219 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:16.874804 13088 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:16.875138 13219 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:16.877132 13219 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:16.685844 13198 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.839334  8255 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:16.785493 13116 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.787983 12721 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.844101  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:16.844897 13178 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:16.825557 12639 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.825801 12980 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:16.825385  8252 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:16.877875  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:16.878774  8178 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:16.929108  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:16.878825 13006 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.872785 13106 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.880005  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:16.880198 13220 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:16.836553  8102 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:18:16.859225  8787 rpcz_store.cc:276] 0709 13:18:15.368254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.370059 (+  1805us) service_pool.cc:224] Handling call
0709 13:18:15.386950 (+ 16891us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.991337 (+604387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.991369 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.991965 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.389762 (+397797us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:16.389800 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.389868 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.706842 (+316974us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:16.789156 (+ 82314us) raft_consensus.cc:1685] finished
0709 13:18:16.789186 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.824778 (+ 35592us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1495,"raft.queue_time_us":239260,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":7339392,"thread_start_us":945634,"threads_started":2,"wal-append.queue_time_us":479997}
W20260709 13:18:16.882012  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 422790us
I20260709 13:18:16.870266 13203 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:16.882052 13196 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:16.883415 13100 consensus_meta.cc:287] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.231s	user 0.024s	sys 0.013s
I20260709 13:18:16.886750 13092 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.886996 12746 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:16.885371  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 243031us
I20260709 13:18:16.755956 13127 rpcz_store.cc:276] 0709 13:18:12.746312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.784428 (+ 38116us) service_pool.cc:224] Handling call
0709 13:18:12.912443 (+128015us) log.cc:844] Serialized 506 byte log entry
0709 13:18:16.642172 (+3729729us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30252,"raft.queue_time_us":28957,"raft.run_cpu_time_us":1820,"raft.run_wall_time_us":5930,"thread_start_us":14691,"threads_started":1,"wal-append.queue_time_us":59373,"wal-append.run_cpu_time_us":2559,"wal-append.run_wall_time_us":1219454}
I20260709 13:18:16.870311 13152 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:16.888531 13136 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:16.890218  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:16.890903 13071 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:16.891762  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:16.842293 12973 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:16.752799 13050 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:17.029647  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 130342us
I20260709 13:18:16.903280 13189 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:17.030562  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:17.026495  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:16.924036  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 246716us
I20260709 13:18:16.888962 12753 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:16.929989  8175 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:17.033941  8102 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:18:16.961166 12956 consensus_meta.cc:287] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.858s	user 0.017s	sys 0.000s
W20260709 13:18:16.893463 12567 consensus_meta.cc:287] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.019s	user 0.013s	sys 0.009s
W20260709 13:18:16.892480 13183 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:18:16.931850  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 233314us
I20260709 13:18:16.871628 13175 raft_consensus.cc:3055] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:16.863770 13025 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:16.836287 13200 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:16.965837  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:16.933554  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.021196  8180 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:16.934986  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:16.990346  8072 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:16.982389  8182 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:17.025295  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:16.904013 12844 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:16.928253 13116 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:17.032779  8147 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:16.883451 13206 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:16.928458 12721 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:17.039393  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:17.043843  8248 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:17.048589  8102 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:18:16.963940 13068 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.770s	user 0.012s	sys 0.000s
W20260709 13:18:16.975446 12995 consensus_meta.cc:287] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.951s	user 0.025s	sys 0.006s
I20260709 13:18:17.058746  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:17.021027 13159 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:17.066531  8174 raft_consensus.cc:2410] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:18:17.067305  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 77040us
I20260709 13:18:17.038148 13203 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:16.976070 13098 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:17.090977  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.061910  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.077203  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:17.079007  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.093254  8101 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:17.093820  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:17.095360 13188 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:17.095772 13188 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:17.096124 13188 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.096371 13193 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:17.096414  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.096956 13193 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.097997  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.098592  8174 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:17.099193 13193 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:17.099607  8174 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:17.101915 13219 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:17.102324 13219 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.102664 13219 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:17.103204 12753 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:16.933385 12980 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:17.067003 13110 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.061563  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:17.091956  8176 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:16.977680 13112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48110 (request call id 1328) took 3366 ms. Trace:
I20260709 13:18:17.084690 13221 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:17.089830  8251 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:16.966390 12639 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.082494  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:17.108544  8255 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:17.023085 13092 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:17.059398 13175 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:17.109666  8178 raft_consensus.cc:2376] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15. Re-sending same reply.
I20260709 13:18:17.070425 13196 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:17.042601 12956 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:17.112439  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 53743.3us
W20260709 13:18:17.118278  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 83601.3us
I20260709 13:18:17.129503 13205 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:17.130534  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.059306 12925 consensus_queue.cc:1059] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:18:17.106178 13050 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:17.132368 13098 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.134399  8177 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:17.134863  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:17.120414 13099 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:17.111869  8181 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:18:17.153810  8176 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:17.158035  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 75605.7us
I20260709 13:18:17.162840  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.159447  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:17.109124 13127 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:17.173719  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.174849  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.031139 13220 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.175345 13092 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.175536 13203 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.175832 13175 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.176671 12980 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.174420 12721 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.182650 13152 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:17.072466 13189 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:17.184841  8251 raft_consensus.cc:2410] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:18:17.080178 13206 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:17.244976  8179 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 10.
I20260709 13:18:17.245929 13206 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.083806 12995 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:17.187770 12639 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:17.189669 12925 raft_consensus.cc:3055] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:17.247399 12721 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:17.247646 12925 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:17.247882 12995 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.212703  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:17.248881  8249 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:17.213294 13134 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.159817 13221 raft_consensus.cc:697] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:18:17.215430  8001 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36106 (request call id 202) took 13773 ms (client timeout 15000 ms). Trace:
I20260709 13:18:17.215689 13116 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:17.218082  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2812) took 1008 ms. Trace:
I20260709 13:18:17.254716  8248 rpcz_store.cc:276] 0709 13:18:16.209610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.209738 (+   128us) service_pool.cc:224] Handling call
0709 13:18:16.226806 (+ 17068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.073305 (+846499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.217865 (+144560us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b540020a154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:17.218026 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878443392}
I20260709 13:18:17.222213  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:17.072793 12844 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.212500  8002 catalog_manager.cc:5697] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 5 to 8, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 8 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:17.229799  8072 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:17.230773  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 190072us
I20260709 13:18:17.232372  8183 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: [14.9-16.10]
I20260709 13:18:17.229794  8252 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:17.260222  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.230743  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.231455 13099 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.232177  8257 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:17.263315  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.264653  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:17.235929  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 76598.2us
I20260709 13:18:17.090767 13068 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.119884 13110 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.265961  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:17.265285  8257 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.269556  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:17.270117  8254 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.270236  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:17.239778  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 174325us
I20260709 13:18:17.251459  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.238086 13006 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.260957  8252 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:17.266913  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.278416  8249 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:17.280812  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:17.286335  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.287031  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.287328  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.287636  8103 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:17.288408  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.288678  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.289392  8102 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:17.289258  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.290095  8248 raft_consensus.cc:2410] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:18:17.290120  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.292106  8102 raft_consensus.cc:2410] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:18:17.296202  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.297976  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:17.298524  8106 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:17.299701  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.300906  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.302017  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:17.302561  8102 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:17.303625 13221 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.304692 13188 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:17.306815 13188 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.307031  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:17.277631 13206 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.307161  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:17.307615  8108 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:17.307685 13206 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:17.308409  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.309681  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.309753  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.310586  8103 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:17.310853  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:17.311123  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.311338  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.311769  8107 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:17.312351  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:17.312661  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:17.312783 13178 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:17.313078  8103 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:17.313313 13178 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.313699 13178 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:17.313905  8099 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:17.314286  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.262813 12746 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:17.318040  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.322664 13224 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:17.323197 13224 raft_consensus.cc:697] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:17.324496  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.331692  8250 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:17.332520  8100 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:17.340808  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:17.341799  8782 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:18:17.283907 13092 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:18:17.271685 12639 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:17.272034 13134 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.346405 13134 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:17.348749  8249 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:17.349979  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.284567 12905 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:17.350953  8251 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 16: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:17.351107 12905 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.351651 12905 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:17.352114  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:17.354810  8002 catalog_manager.cc:5697] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 5 to 10, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 10 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:17.267998 13099 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:17.358098  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2631) took 1436 ms. Trace:
I20260709 13:18:17.358560  8183 rpcz_store.cc:276] 0709 13:18:15.921609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.922656 (+  1047us) service_pool.cc:224] Handling call
0709 13:18:15.922987 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:17.259524 (+1336537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.357864 (+ 98340us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54000d75d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:17.358045 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3010693376}
W20260709 13:18:17.359871 13228 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:18:17.353178  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:17.367894  8251 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:17.372921  8252 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:17.324123 13224 consensus_queue.cc:237] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.319231  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:17.315434  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:17.314910  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.426239  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2809) took 1164 ms. Trace:
I20260709 13:18:17.356860  8002 catalog_manager.cc:5697] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:17.430033  8147 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:17.433334  8108 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:17.435290  8101 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:17.395996  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 93117.4us
I20260709 13:18:17.442173  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:17.281028 12721 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.427194  8250 rpcz_store.cc:276] 0709 13:18:16.208334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.208444 (+   110us) service_pool.cc:224] Handling call
0709 13:18:17.332741 (+1124297us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001e6254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:17.372556 (+ 39815us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2581329792}
I20260709 13:18:17.309727 13206 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.457310  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.458120  8252 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 10.
I20260709 13:18:17.459184  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:17.460487  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:17.451184  8251 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:17.454784  8099 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:17.455142  8102 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:17.317222 13220 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:17.456176  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.467113  8105 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:18:17.467680  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:17.468508  8791 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:17.248575 12925 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:17.435222 13200 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:17.467607  8248 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:17.465831  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:17.471642  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.475564  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:17.476238  8252 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:17.391187 12886 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:17.472213  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:17.436178 13136 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.472122  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.487609  8250 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
I20260709 13:18:17.488468  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.483763  8249 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:17.119355 13112 rpcz_store.cc:276] 0709 13:18:13.619679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.624164 (+  4485us) service_pool.cc:224] Handling call
0709 13:18:14.030611 (+406447us) ts_tablet_manager.cc:934] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
0709 13:18:16.335897 (+2305286us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:16.962168 (+626271us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:16.962300 (+   132us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:16.976820 (+ 14520us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:16.977174 (+   354us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:16.977518 (+   344us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:16.977591 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":94102,"tablet-copy.queue_time_us":285949,"thread_start_us":356163,"threads_started":2}
I20260709 13:18:17.456881 13094 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:17.466940 13222 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:17.477265 13229 log.cc:927] Time spent T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:18:17.450171 12746 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:17.489686  8149 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:17.492985  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.487480 13098 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:17.479946 13220 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:17.490940 13196 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:17.252606  8001 rpcz_store.cc:269] 0709 13:18:03.441885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.442073 (+   188us) service_pool.cc:224] Handling call
0709 13:18:17.215224 (+13773151us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:12.019816 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:12.020671 (+   855us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:12.020730 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:18:12.020765 (+    35us) tablet.cc:662] Decoding operations
0709 13:18:12.053498 (+ 32733us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:12.053626 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:12.053682 (+    56us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:18:12.260183 (+206501us) tablet.cc:701] Row locks acquired
0709 13:18:12.270376 (+ 10193us) write_op.cc:260] PREPARE: finished
0709 13:18:12.312363 (+ 41987us) write_op.cc:270] Start()
0709 13:18:12.346370 (+ 34007us) write_op.cc:276] Timestamp: P: 1783603092303965 usec, L: 0
0709 13:18:12.346408 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:18:12.452012 (+105604us) log.cc:844] Serialized 7107 byte log entry
0709 13:18:13.024213 (+572201us) op_driver.cc:464] REPLICATION: finished
0709 13:18:13.478317 (+454104us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa59dd420ac 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a4882ef0
0709 13:18:13.770851 (+292534us) write_op.cc:301] APPLY: starting
0709 13:18:13.770959 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:13.968740 (+197781us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:13.968782 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:14.040080 (+ 71298us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:14.040518 (+   438us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:18:14.040576 (+    58us) write_op.cc:312] APPLY: finished
0709 13:18:14.041101 (+   525us) log.cc:844] Serialized 164 byte log entry
0709 13:18:14.193241 (+152140us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:14.218462 (+ 25221us) write_op.cc:454] Released schema lock
0709 13:18:14.247125 (+ 28663us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:14.301742 (+ 54617us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:14.328191 (+ 26449us) write_op.cc:454] Released schema lock
0709 13:18:14.487256 (+159065us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b18000fa780. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd2d2a6 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db
0709 13:18:14.487841 (+   585us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
Metrics: {"mutex_wait_us":1376877,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":741795,"apply.run_cpu_time_us":39303,"apply.run_wall_time_us":516894,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79331,"num_ops":18,"prepare.queue_time_us":169102,"prepare.run_cpu_time_us":48675,"prepare.run_wall_time_us":544199,"raft.queue_time_us":179606,"raft.run_cpu_time_us":37553,"raft.run_wall_time_us":745645,"replication_time_us":653986,"spinlock_wait_cycles":125516160,"thread_start_us":1142423,"threads_started":5,"wal-append.queue_time_us":361936,"wal-append.run_cpu_time_us":28213,"wal-append.run_wall_time_us":2556155}]]}
I20260709 13:18:17.510161  8250 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:17.517365  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:17.511441  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:17.492537 12567 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:17.492785 13094 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.519487  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.514307  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.519948  8791 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:17.515214  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.516088  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.463492 12721 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.520062  8180 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:17.509632 13112 tablet_copy_client.cc:806] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:17.522243  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.522964  8182 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:17.524012  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.525187  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.506570 13127 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.549065  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.528265  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.534479  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.555284  8176 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:17.542685  8250 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:18:17.492110 12886 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:17.561923  8175 raft_consensus.cc:2410] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:18:17.522565 13094 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:17.567749  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:17.574209  8179 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:17.526546 13112 tablet_copy_client.cc:670] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:17.493096 13136 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:17.510339 12956 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.509835 13068 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:17.520031 13024 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:17.528110 13220 raft_consensus.cc:697] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:17.558833 12567 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:18:17.601985 13238 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:18:17.602195 13220 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.602797  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:17.603813  8248 raft_consensus.cc:2368] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13.
I20260709 13:18:17.511751 12746 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:17.527017 13110 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.553053 13106 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.586772  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:17.611109  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.611277  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:17.611691  8175 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
W20260709 13:18:17.589543  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.612787  8257 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
W20260709 13:18:17.613670  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.506295 13222 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.594787  8002 catalog_manager.cc:5697] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:17.560606 13189 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.583814  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:17.585281 12934 consensus_meta.cc:287] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.845s	user 0.008s	sys 0.005s
I20260709 13:18:17.612123  8183 raft_consensus.cc:2368] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17.
I20260709 13:18:17.590195 12886 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.618448  8250 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:17.619446  8254 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:17.603125 13024 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.626602  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:17.606820  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 336644us
I20260709 13:18:17.635893  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:17.576712 13204 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.631973  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:17.637178  8755 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.131:45561 timed out after 1.778s (SENT) [suppressed 21 similar messages]
I20260709 13:18:17.638430  8002 catalog_manager.cc:5697] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:17.606962 13134 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.640355  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:17.639096  8248 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:17.561398 13127 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:17.663228  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:17.675631  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.528781 13196 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.638015 13024 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:17.679457  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.641719 13071 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:17.697794  8178 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:17.653565 13068 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:17.668308 13200 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:17.669267 13204 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
W20260709 13:18:17.712560  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 199259us
I20260709 13:18:17.676991 13179 raft_consensus.cc:2764] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:18:17.715708  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.677299 13116 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:17.719431  8099 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:17.724349  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.724466  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:17.724961  8100 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:17.728928  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.729494  8100 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:17.692732 13203 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:18:17.639896 12934 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:17.739341  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.740279  8249 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:17.684514 12844 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:17.732985  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:17.735437  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:17.742063  8784 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:17.701824 13068 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:17.746529  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:17.753463  8103 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:17.747586  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:17.749708  8106 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:17.754001  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:17.758670  8787 raft_consensus.cc:2368] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15.
I20260709 13:18:17.765648  8183 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:18:17.783604  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 114600us
I20260709 13:18:17.788138  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:17.791277 13236 log.cc:927] Time spent T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:18:17.796212 13136 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.797092  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.798789  8253 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:17.801236  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:17.798596  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:17.702250  8002 catalog_manager.cc:5697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 6 to 8, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 8 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:17.878019  8252 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:17.879642  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:17.880468  8252 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:17.718035 13240 consensus_queue.cc:1059] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:18:17.751528 13068 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:18.063781  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:17.912205  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.065872  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:18.071192  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:18.072860  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:18.063670  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:18.065673  8248 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:18.079566  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:17.861815 13152 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:17.861649 13116 raft_consensus.cc:2764] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:18:18.086447 13098 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:17.878121 13092 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:17.951817  8101 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:17.885097  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.113972  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.114751  8252 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:18.115711  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.116395  8252 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:18:18.117336  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:18.108549  8221 connection.cc:256] RPC call timeout handler was delayed by -1.6733525279998958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
I20260709 13:18:18.110877  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:18.081413 13050 consensus_meta.cc:287] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.866s	user 0.011s	sys 0.002s
I20260709 13:18:18.078763 13222 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:18.124028  8248 raft_consensus.cc:2376] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15. Re-sending same reply.
I20260709 13:18:18.079533 12746 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:17.882772 13179 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:18.124612  8221 connection.cc:256] RPC call timeout handler was delayed by -1.5572525279999354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 13:18:17.999187 13099 consensus_meta.cc:287] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
I20260709 13:18:18.124645  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:18.018237 13127 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:18.131090 13253 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:18:18.132093 13242 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:18:18.144097  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:18.152451  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:18.166755 13100 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:18.167239 13100 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.167614 13100 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:18.172510  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:18.173179  8251 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:18.134442  8250 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:18:18.119100 12905 consensus_meta.cc:287] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.751s	user 0.013s	sys 0.000s
I20260709 13:18:18.136350  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.075868 13200 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:18:18.119485 13098 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:18.141947  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 69140.7us
I20260709 13:18:18.148898  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:18.142342 13099 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:18.179975  8253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2621) took 1317 ms (client timeout 1538 ms). Trace:
W20260709 13:18:18.210315  8253 rpcz_store.cc:269] 0709 13:18:16.862584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.863256 (+   672us) service_pool.cc:224] Handling call
0709 13:18:18.179769 (+1316513us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b5400092ed4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:18.179915 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2123763072}
I20260709 13:18:18.180059  8254 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:18.151772 13050 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:18.130081 13092 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:18.157404 13223 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:18.197461  8252 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 15: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:18.152311 12746 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:18.212653 13050 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:18.238291  8181 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:18.240623  8251 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:18.245210  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60806 (request call id 629) took 1079 ms. Trace:
I20260709 13:18:18.147409 13251 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:18:18.248401  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 82516.7us
I20260709 13:18:18.219198 13136 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.203176 12905 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.145287 13179 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.207551  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:18.159868 13196 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:18.191282 13219 consensus_meta.cc:287] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 1.088s	user 0.006s	sys 0.011s
I20260709 13:18:18.256335 13203 raft_consensus.cc:2764] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:18:18.256723 13219 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:18.258951 13219 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:18.259785  8782 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:18:18.187477 13178 consensus_meta.cc:287] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.873s	user 0.011s	sys 0.023s
I20260709 13:18:18.260591 13178 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.261463 13136 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:18.262590 13099 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:18.263039 13178 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:18.263449 13251 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:18.263904  8256 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:18:18.183914 13205 consensus_meta.cc:287] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.959s	user 0.009s	sys 0.000s
I20260709 13:18:18.264238 13136 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:18.264730 13205 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:18.264422 13251 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:18.185194 13198 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:18.196085 13110 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:18.265847 13110 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:18.266935 12905 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:18.267953 13110 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:18.188050 13204 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:18.235385 13050 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:18.219645 13223 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.213271 12934 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:18.162231  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:18.281793  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 119863us
I20260709 13:18:18.268762 13179 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:18.181377 13094 consensus_meta.cc:287] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.000s
I20260709 13:18:18.249183  8251 rpcz_store.cc:276] 0709 13:18:17.166141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.172223 (+1006082us) service_pool.cc:224] Handling call
0709 13:18:18.245129 (+ 72906us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.192786 13024 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:18.255774  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 48297.8us
I20260709 13:18:18.269164  8180 raft_consensus.cc:2368] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17.
I20260709 13:18:18.275663  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:18.289942  8183 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:18.276504  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:18.291196  8177 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:18.240808 12746 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:18.277451  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:18.134011  8221 connection.cc:256] RPC call timeout handler was delayed by -1.2332525279998663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
W20260709 13:18:18.293363  8221 connection.cc:256] RPC call timeout handler was delayed by -1.2278525279998576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
I20260709 13:18:18.293529  8223 leader_election.cc:400] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17.
W20260709 13:18:18.293828  8221 connection.cc:256] RPC call timeout handler was delayed by -1.1063525279998885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
W20260709 13:18:18.294219  8221 connection.cc:256] RPC call timeout handler was delayed by -1.0910525279998637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260709 13:18:18.290452  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:18.282621 13223 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.293912  8223 leader_election.cc:403] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:18:18.284013 13222 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:18.286610  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:18.315603  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:18.316928 12746 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.320225 12925 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:18.323551 13202 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.324134 13202 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:18.326114  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:18.326543 13202 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:18.328331  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:18.366158  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 50615.7us
I20260709 13:18:18.330581  8179 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:18.337193  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:18.288565 13205 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.367403  8223 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:18.369311  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:18.369670  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:18.373520  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:18.377329  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:18.378286  8105 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:18.379531  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:18.298683  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 508924us
I20260709 13:18:18.380283  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:18.328644 13200 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:18.384704  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:18.365360 12886 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:18.385625  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:18.405200  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:18.404688  8251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:47520
I20260709 13:18:18.406173  8251 raft_consensus.cc:606] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:18.406603  8251 raft_consensus.cc:614] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:18.406087  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:18.330376 13024 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:18.328498 13204 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17.
I20260709 13:18:18.413615  8101 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:18.374832 13106 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:18.292393 13094 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:18.410679  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:18.419420  8108 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:18:18.379101 13261 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:18.334421 13222 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:18.409381  8149 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:18.381232 13202 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:18.381412 12905 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:18.371454 13178 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:18.424758  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:18.421623  8101 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:18.410009 12886 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.328855 12934 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:18:18.382158 13205 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:18.381708 13098 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.446825  8182 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:18.385090 13259 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:18:18.448110  8099 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:18.414728 12844 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:18.415868 13136 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:18.424943 13222 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.448601  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:18.455467  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 85877.9us
I20260709 13:18:18.425770 13204 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:18.424126 12905 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:18.424552 13106 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:18.416111 13263 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:18:18.458847  8101 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:18.459874  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:18.430341 13024 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:18.459508  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:18.463708  8102 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:18.464375  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:18.464947  8100 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:18.434414 12886 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.429575 13202 raft_consensus.cc:697] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:18.456265  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:18.471565 13189 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:18:18.463726  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 126651us
I20260709 13:18:18.466125  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:18.494031  8103 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:18.494199  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:18.461200  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 52962.3us
I20260709 13:18:18.495576  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:18.466950  8105 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:18.496709  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:18.450183 13092 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:18.499333  8072 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:18.500170  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:18.454381 12844 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:18.502372  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:18.503719  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:18.504542  8101 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:18.507081  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:18.460726 12905 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:18.512209  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:18.508291  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:18.513098  8103 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:18.507314  8072 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:18.467310 13259 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:18.517259  8255 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:18.517128  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:18.521442  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 65247.8us
I20260709 13:18:18.521801  8108 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:18.500876 13189 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:18.523212 13189 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:18.523618 13189 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:18.525300 13159 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:18:18.526075 13267 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:18:18.525921 13159 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.526595 13159 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:18.530292 13247 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.495s	user 0.007s	sys 0.000s
I20260709 13:18:18.534123 13248 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:18.536083  8221 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:18.536926 13204 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:18.537322 13204 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:18.537791 13204 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:18.538779 13175 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:18.545111  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2638) took 1029 ms. Trace:
I20260709 13:18:18.545640 13204 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:18.546432  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 635) took 1230 ms. Trace:
I20260709 13:18:18.546785  8254 rpcz_store.cc:276] 0709 13:18:17.316198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.644084 (+327886us) service_pool.cc:224] Handling call
0709 13:18:18.179891 (+535807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.211444 (+ 31553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.546244 (+334800us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b5400092ed0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:18.546375 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231664000}
I20260709 13:18:18.547781  8221 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:18.548555 13275 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:18.548367 13202 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:18.550166  8221 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:18.551054 13275 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:18.552790  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.553580  8250 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:18.554445 13098 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:18.520139 13258 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:18:18.507683 12844 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:18.555619 13244 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.693s	user 0.002s	sys 0.000s
I20260709 13:18:18.557807  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:18.558527  8251 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:18.559355  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:18.559751 13159 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:18.507735 13024 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:18.561132 13024 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:18.564823 13237 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.904s	user 0.001s	sys 0.001s
I20260709 13:18:18.565135 13204 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:18.566011  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.566439 13220 raft_consensus.cc:3055] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:18.567015 13220 raft_consensus.cc:740] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:18.568339  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.569070  8252 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:18.569478 13071 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:18.570062 13071 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:18.571348 13071 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.572602 13071 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:18.573681 13243 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.539s	user 0.002s	sys 0.000s
I20260709 13:18:18.575139  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1766) took 1161 ms. Trace:
I20260709 13:18:18.575640  8104 rpcz_store.cc:276] 0709 13:18:17.414027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.444144 (+ 30117us) service_pool.cc:224] Handling call
0709 13:18:17.444532 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.444778 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.444814 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.445355 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.671161 (+225806us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:17.671229 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.671327 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.573035 (+901708us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:18.574769 (+  1734us) raft_consensus.cc:1685] finished
0709 13:18:18.574790 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.575061 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71121792,"thread_start_us":178181,"threads_started":1,"wal-append.queue_time_us":450902}
I20260709 13:18:18.525344 13273 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:18.577767 13273 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.578155 13273 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.572580 13159 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:18.581808  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2642) took 1058 ms. Trace:
I20260709 13:18:18.582228  8180 rpcz_store.cc:276] 0709 13:18:17.523704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.523809 (+   105us) service_pool.cc:224] Handling call
0709 13:18:18.581607 (+1057798us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b5400328a54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:18.581747 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1711780096}
I20260709 13:18:18.583029 13205 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:18.583691  8180 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:18.584520 13094 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:18.585060  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2646) took 1051 ms. Trace:
I20260709 13:18:18.585510  8178 rpcz_store.cc:276] 0709 13:18:17.533746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.534176 (+   430us) service_pool.cc:224] Handling call
0709 13:18:18.584887 (+1050711us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400011dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:18.585006 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328178432}
I20260709 13:18:18.589965 12753 raft_consensus.cc:3055] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:18.590569 12753 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:18.591661 13134 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:18.592269 13134 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.592718 13134 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:18.585186 13106 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.603654  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.604470  8252 raft_consensus.cc:2368] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 16. Current term is 17.
I20260709 13:18:18.606005 13274 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:18.606652 13274 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:18.607177 13274 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.607263  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:18.545542  8181 rpcz_store.cc:276] 0709 13:18:17.515792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.515895 (+   103us) service_pool.cc:224] Handling call
0709 13:18:18.544904 (+1029009us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b540031e7d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:18.545041 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1648754048}
I20260709 13:18:18.609978  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.610713  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.611352  8254 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:18.612890  8782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48110 (request call id 1375) took 1220 ms. Trace:
I20260709 13:18:18.613399  8782 rpcz_store.cc:276] 0709 13:18:17.392658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.441816 (+ 49158us) service_pool.cc:224] Handling call
0709 13:18:18.612716 (+1170900us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54005591d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:18.612832 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878008704}
I20260709 13:18:18.616693  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:18.617027  8282 heartbeater.cc:646] Failed to heartbeat to 127.6.214.190:45311 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.6.214.190:45311 timed out after 15.000s (SENT)
W20260709 13:18:18.612923 13241 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.657s	user 0.002s	sys 0.000s
I20260709 13:18:18.618906  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1758) took 1330 ms. Trace:
I20260709 13:18:18.619333  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.619275  8107 rpcz_store.cc:276] 0709 13:18:17.288291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.328026 (+ 39735us) service_pool.cc:224] Handling call
0709 13:18:17.328342 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.328697 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.328728 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.329198 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.605757 (+276559us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:17.605792 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.605851 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.612287 (+1006436us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:18.618618 (+  6331us) raft_consensus.cc:1685] finished
0709 13:18:18.618639 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.618846 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":4493056,"thread_start_us":276181,"threads_started":1,"wal-append.queue_time_us":425394}
I20260709 13:18:18.619268 12721 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:18.568123 13220 consensus_queue.cc:260] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:18.622223 13220 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:18.621133  8256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2831) took 1328 ms (client timeout 1567 ms). Trace:
W20260709 13:18:18.624228  8256 rpcz_store.cc:269] 0709 13:18:17.292778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.319003 (+ 26225us) service_pool.cc:224] Handling call
0709 13:18:18.602157 (+1283154us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b54002e8e54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:18.621076 (+ 18919us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1899534080}
W20260709 13:18:18.624846  8255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2642) took 1536 ms (client timeout 1919 ms). Trace:
W20260709 13:18:18.625236  8255 rpcz_store.cc:269] 0709 13:18:17.088661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.238841 (+150180us) service_pool.cc:224] Handling call
0709 13:18:18.624698 (+1385857us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002ea254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:18.624794 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2861707648}
I20260709 13:18:18.627259  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1758) took 1116 ms. Trace:
I20260709 13:18:18.627722  8174 rpcz_store.cc:276] 0709 13:18:17.510800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.548885 (+ 38085us) service_pool.cc:224] Handling call
0709 13:18:17.553065 (+  4180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.595791 (+ 42726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.595822 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.595862 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:17.595897 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.626981 (+1031084us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b540031ecd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:18.627031 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.627175 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97790720}
I20260709 13:18:18.628633  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:18.627277  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:18.629850  8786 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:18.631767  8786 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:18.631861  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:18:18.632762  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.633105  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:18.462076 13136 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:18.634519  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:18.634342 13136 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.635121  8787 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:18.554807  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.644201  8099 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:18.612969  8252 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:18:18.650596 13116 consensus_queue.cc:1059] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:18.651315  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:18.652127 13116 raft_consensus.cc:3055] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:18.652529 13116 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:18.653697 13116 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:18.655198 13116 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:18.656330  8787 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:18.662737  8178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:18.663815  8178 raft_consensus.cc:606] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:18.664520  8178 raft_consensus.cc:614] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:18.671851  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.672709  8250 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:18.674095  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.675740  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.676501  8100 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:18.676592  8252 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:18.674392  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:18.710662  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 188890us
I20260709 13:18:18.577142 13100 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.714090  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:18.638448 12753 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:18.715699 13100 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:18.716318 12753 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:18.717660 13276 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:18.718096 13276 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.718415 13276 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:18.722048 13092 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:18.725185  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:18.713450  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:18.728789  8177 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 13: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:18.732950  8174 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:18.733857  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:18.734946 13273 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:18.743371  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 85873.1us
I20260709 13:18:18.743860  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:18.744378  8147 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:18.711833 13196 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:18.726559 13205 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:18.750183  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:18.755965  8255 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:18.751272  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:18.757685  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:18.758292 13099 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:18.758704 13099 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.759059 13099 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:18.760411  8147 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:18.761266 12748 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:18.762104 13116 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:18.762923 13116 raft_consensus.cc:3055] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:18.763224 13116 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:18.763362 13273 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:18.749382 13248 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:18.764401 13248 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.764046 13116 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.764724 13248 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.765277 13116 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:18.766691 12905 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.768682 12905 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:18.740175 13179 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.770548  8249 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:18.771415 13179 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:18.696873 12844 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:18.773530 12844 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:18.788663  8106 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:18.793648  8147 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:18.799023  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 381719us
I20260709 13:18:18.797737  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2844) took 1070 ms. Trace:
I20260709 13:18:18.797676  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:18.774377 13094 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:18.807643  8174 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:18.784099 13098 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:18.811815  8257 rpcz_store.cc:276] 0709 13:18:17.727592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.178199 (+450607us) service_pool.cc:224] Handling call
0709 13:18:18.178460 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.178666 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:18.250297 (+ 71631us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.797236 (+546939us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:18.797311 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:18.797390 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.797502 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.797662 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22852,"prepare.queue_time_us":114228,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":32496,"raft.queue_time_us":69261,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":6238,"thread_start_us":617764,"threads_started":3,"wal-append.queue_time_us":362922}
I20260709 13:18:18.814846 13189 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.795077 12721 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:18:18.808156 13068 consensus_meta.cc:287] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.002s
I20260709 13:18:18.801128 13198 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:18.818742  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:18.823830 13098 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.856644  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:18.798249 13206 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:18:18.867048  8182 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:18.864758  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:18.869270  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:18.838652 13094 raft_consensus.cc:697] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:18.878777  8791 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:18.849520 12721 raft_consensus.cc:697] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:18.854805 13092 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:18.857645 13266 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:18.820940 13134 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:18.790539 13205 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:18:18.890607  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 383340us
I20260709 13:18:18.890818  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:18.897307  8174 raft_consensus.cc:606] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:18.855731 13198 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:18.896026  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 387791us
I20260709 13:18:18.897480  8072 leader_election.cc:400] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15.
I20260709 13:18:18.867026 13209 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:18.903210  8102 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.876664 13263 consensus_queue.cc:1059] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:18:18.907262 12886 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.876346 13249 raft_consensus.cc:2764] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:18:18.909869  8181 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:18.911578  8102 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:18.881242 13098 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.911428  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:18.912851  8072 leader_election.cc:403] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:18:18.913276  8255 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:18.886336 13260 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.931842  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:18.935621  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:18.913483  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:18.841473 13068 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.909153 12721 consensus_queue.cc:237] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:18.916836 13050 consensus_meta.cc:287] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.632s	user 0.007s	sys 0.004s
I20260709 13:18:18.943651  8755 leader_election.cc:400] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 16. Current term is 17.
I20260709 13:18:18.953873  8755 leader_election.cc:403] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:18.955284  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:18.944800  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 47502.7us
I20260709 13:18:18.957154  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:18.946280  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:18.948374  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:18.949404  8249 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 13. Ops: []
I20260709 13:18:18.949606  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:18.958561  8252 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:18.949761  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:18.913208 12886 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:18.959404  8149 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:18.928109 13171 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:18.960815  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:18.916584 13253 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:18.962949  8181 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:18.963922  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:18.969789  8256 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:18.970141  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:18.964325  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:18.961094  8254 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:18.970865  8251 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.971050  8103 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:18.965543  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:18.901912 13092 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:18.943596 13175 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.913770 13222 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.976882  8175 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:18.975577  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:18.975641  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:18.975903  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:18.959885 13100 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:18.937752 13263 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:18:18.989781  8252 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:19.000900  8256 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:18.964728 13266 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 16. Current term is 17.
W20260709 13:18:18.977398 13281 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:18:18.968918 13171 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:18.959801 13209 consensus_queue.cc:1059] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:18:18.959995 13050 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:18.928633 13260 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.001968 13024 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:19.006449 13263 consensus_queue.cc:1243] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:19.062330  8251 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:19.094300 13261 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:19.051893 13286 raft_consensus.cc:2764] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:18:19.044955  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 53317.4us
I20260709 13:18:19.103065  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:18.986728 13006 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.062784 13127 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:19.055572  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.090598 13277 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.235s	user 0.001s	sys 0.001s
I20260709 13:18:19.058419  8103 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:18.975417 13196 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:18.979015 13025 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:19.057790  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:19.114874  8099 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.989678 13198 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.107400  8149 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:18:19.114009  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.159335  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 202258us
I20260709 13:18:19.158599 13202 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:19.179847  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 233634us
I20260709 13:18:19.007622 13205 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 16.6, Last appended by leader: 6, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.165032 13189 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:19.160774 13281 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:19.116708 13025 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.185446  8099 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:19.008744 13094 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.097175 13272 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15.
I20260709 13:18:19.111863 13006 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.211231 13136 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:19.114491 13127 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.167480 13134 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:19.111335 12886 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:19.131855  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.295648  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.194180 13223 consensus_meta.cc:287] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.826s	user 0.011s	sys 0.002s
W20260709 13:18:19.204084  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.219290 13222 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:19.216486  8255 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:19.217715  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:19.231436 13274 consensus_meta.cc:287] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.004s
I20260709 13:18:19.215790 13068 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:19.232513 13285 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:19.234494 13261 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:19.236974  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 997) took 1502 ms. Trace:
I20260709 13:18:19.238459  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:19.239849 13287 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:19.310830  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:19.311666  8106 raft_consensus.cc:2368] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13.
W20260709 13:18:19.218902 13283 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:18:19.312551  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:19.249300 13282 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:18:19.156986 13171 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.314199 13171 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:19.309090  8789 rpcz_store.cc:276] 0709 13:18:17.734138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.734266 (+   128us) service_pool.cc:224] Handling call
0709 13:18:17.754666 (+ 20400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:18.072311 (+317645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.072347 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:18.091682 (+ 19335us) log.cc:844] Serialized 52 byte log entry
0709 13:18:18.533450 (+441768us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b18004974a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:18:18.799683 (+266233us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:18.825564 (+ 25881us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.927965 (+102401us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b18004974a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dcd9c0a 00007fa5a7419219 00007fa59dd61a40 00007fa59dd5c4e4 00007fa59dd5c455 00007fa5a48443c7 00007fa5a0e569a7 00007fa5a0e660bf 00007fa5a0e66038
0709 13:18:18.938109 (+ 10144us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.938325 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.938407 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.236666 (+298259us) raft_consensus.cc:1685] finished
0709 13:18:19.236698 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.236894 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90880,"prepare.queue_time_us":148008,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":361878,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":18428,"spinlock_wait_cycles":45335936,"thread_start_us":266039,"threads_started":1,"wal-append.queue_time_us":783825}
W20260709 13:18:19.268816 13290 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.003s
I20260709 13:18:19.207911 13092 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:19.274371  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:19.274483  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:19.179512 13288 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:18:19.290724  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:19.265354 13099 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.001s
W20260709 13:18:19.207849  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 100539us
I20260709 13:18:19.265146 13025 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:19.323347  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:19.324026  8106 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:19.324508  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:19.298624  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 80939.3us
I20260709 13:18:19.261368 13178 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:18:19.291325 13220 consensus_meta.cc:287] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.669s	user 0.009s	sys 0.002s
W20260709 13:18:19.304304  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 70892.5us
W20260709 13:18:19.246748 13291 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:18:19.224938 13276 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.218219 13202 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.330714  8099 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:18:19.335907  8074 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:19.301373 13274 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:19.466202  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 140268us
I20260709 13:18:19.466800  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:19.327543 13092 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:19.467320  8223 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:19.310786 13136 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:19.302605 13223 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.472685  8223 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:19.474845  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:19.475008  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:19.475445  8099 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:18:19.332388 13134 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:19.328107 13178 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:19.476544  8251 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:19.477602  8104 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:19.326680 13099 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.334839 13222 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:19.332127 13068 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:19.334709 13301 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:19.479763  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 143895us
I20260709 13:18:19.468982 13296 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.491343  8250 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:18:19.507308  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:19.489360  8103 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:19.510612  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:19.474538 13291 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:18:19.335685 13116 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:19.510697  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:19.336318 13196 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.143s
I20260709 13:18:19.471822 13092 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:18:19.495038 13098 consensus_meta.cc:287] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.000s
I20260709 13:18:19.329392 13299 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.164s
I20260709 13:18:19.502167 13006 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:19.511773 13068 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.533381 13178 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.511662 13134 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:19.518105  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:19.489210 13276 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:19.514585 13222 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:19.512213 13127 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:19.514622 13285 raft_consensus.cc:2764] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:18:19.538409  8099 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:19.542541 13189 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:19.506944 13159 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:19.487983 13202 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:19.555377  8103 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:19.506985 13205 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:19.547626 13098 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.567169 13222 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.570868 13293 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:18:19.571743 13293 consensus_queue.cc:1243] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:19.572183 13261 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:19.572638 13261 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:19.573448 13261 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.574733 13261 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:19.548648 13175 consensus_meta.cc:287] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.557s	user 0.005s	sys 0.006s
I20260709 13:18:19.511716 13301 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.581877 13134 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.582317 13301 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:19.583127 13301 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:19.583694 13301 raft_consensus.cc:697] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:19.501657 13136 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.585955 13175 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:19.594158  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 121327us
I20260709 13:18:19.559716 13196 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:19.543166 13296 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.563810 13159 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.618395  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:19.585672 13068 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:19.564698 13189 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:19.548947 13116 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.631491  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:19.681051  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 49689us
I20260709 13:18:19.584828 13301 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:19.682487  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 209847us
I20260709 13:18:19.615306 13196 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:19.624971 13159 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:19.623767 13307 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:19.627264 13189 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:19.625478 13205 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.693334  8223 leader_election.cc:400] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13.
W20260709 13:18:19.693766  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 175775us
I20260709 13:18:19.686390 13196 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:19.696594  8223 leader_election.cc:403] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:18:19.697327  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:19.698623  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:19.685014 13068 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:19.702049  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:19.703897  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.689133 13308 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:19.700068 13276 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:19.705698 13248 consensus_meta.cc:287] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.941s	user 0.007s	sys 0.007s
I20260709 13:18:19.683096 13092 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.704633 13314 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.724661 13248 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:19.726131 13304 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:18:19.761782 13203 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.762384 13203 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.764637 13203 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:19.730762  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1765) took 1351 ms. Trace:
W20260709 13:18:19.766132  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 64159.8us
I20260709 13:18:19.766397  8183 rpcz_store.cc:276] 0709 13:18:18.378877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.384438 (+  5561us) service_pool.cc:224] Handling call
0709 13:18:19.730549 (+1346111us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54000d7fd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:19.730699 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386799872}
I20260709 13:18:19.702970 13293 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:19.771744 12567 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:19.734526 13310 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:19.735385  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 652) took 1121 ms. Trace:
W20260709 13:18:19.737695  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.738799 13116 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:19.739290 13134 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:19.739483 13094 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:19.740408 13249 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:18:19.742852  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 782089us
I20260709 13:18:19.780632  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:19.781777  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:19.782366  8101 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:19.743407 13253 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:19.743978  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 647) took 1333 ms. Trace:
I20260709 13:18:19.744290 13209 raft_consensus.cc:3055] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:18:19.747133  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.791563  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.702520 13205 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.768834  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:19.770597  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:19.770699  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:19.705426 13202 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13.
I20260709 13:18:19.707712 13025 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.710100 13274 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:19.776136  8254 rpcz_store.cc:276] 0709 13:18:18.613672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.639697 (+ 26025us) service_pool.cc:224] Handling call
0709 13:18:18.639976 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.971060 (+331084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.735166 (+764106us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400387f54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:19.735329 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":738051968}
I20260709 13:18:19.782998  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:19.819837  8782 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:19.821455  8782 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:19.783890  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:19.784725  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:19.720656 13311 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:19.787477  8786 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:19.788139  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:19.790995  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:19.765167 13203 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.788609  8175 rpcz_store.cc:276] 0709 13:18:18.410377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.541716 (+131339us) service_pool.cc:224] Handling call
0709 13:18:18.542005 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.990550 (+448545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.743738 (+753188us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b5400101154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:19.743919 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":999633664}
I20260709 13:18:19.792411  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:19.832842  8100 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:19.832638  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:19.834159  8784 raft_consensus.cc:2368] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17.
I20260709 13:18:19.827409  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:19.794721  8105 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:19.838339  8787 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:19.795395  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:19.839373  8789 raft_consensus.cc:2368] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11.
I20260709 13:18:19.795440  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:19.798219 13205 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:19.798499  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.768476 13314 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.788296 13116 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:19.799928 13249 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:19.800952 13248 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:19.802356 12748 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:19.803241 13309 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:19.833726 13272 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:19.791687 13223 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:19.793733 13209 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:19.856204 12748 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:19.856827 13209 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.857070 12748 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.857460 13159 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.858063 13209 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:19.858215 13260 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:19.806912 13099 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:19.807621  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:19.861121  8257 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:19.815505  8101 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:19.816990  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:19.720498 13068 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:19.822423  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.824105  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 53513.1us
I20260709 13:18:19.771785 13276 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.840438  8100 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:19.872455 13276 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.840764  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:19.873817  8790 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:19.873555 13189 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.875464 13276 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:19.877158 13112 tablet_copy_client.cc:538] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:19.848148  8788 raft_consensus.cc:3055] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:19.877647  8788 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:19.878439  8788 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.849730  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:19.791435 13263 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:18:19.840833 13203 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.852828 13314 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:19.848966 13249 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:19.821588 13092 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:19.882525 13249 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:19.882555 13203 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:19.837064 13311 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:19.884397  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.885294 13311 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:19.886049  8789 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:19.879375  8788 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:19.854496  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 51768.9us
I20260709 13:18:19.869813  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:19.888013  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:19.855914 13278 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.855175  8251 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:19.869180  8103 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:19.868889  8787 raft_consensus.cc:2410] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:18:19.862036  8782 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:19.862537  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:19.870724 13319 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.871776  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:19.875543 13189 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:19.846274  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:19.865659  8783 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:19.894920  8074 leader_election.cc:400] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17.
I20260709 13:18:19.895581  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:19.895850  8252 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:19.911582  8252 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:19.911618  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:19.854590 13272 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:19.861649 13159 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:19.908934 13249 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:19.906831  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:19.918509 13315 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:18:19.919467  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:19.860723 13296 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:19.902990 13205 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:19.926610 13205 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.926987 13205 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:19.932320 13272 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:19.903385 13278 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.912631 13263 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:18:19.913895 13319 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.936596  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1769) took 1298 ms. Trace:
I20260709 13:18:19.936837  8255 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:19.937047  8181 rpcz_store.cc:276] 0709 13:18:18.638212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.639069 (+   857us) service_pool.cc:224] Handling call
0709 13:18:19.936435 (+1297366us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b540031f6d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:19.936535 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593115392}
I20260709 13:18:19.938635  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:19.913012  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:19.940290 13223 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:19.940588  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:19.940798 13223 raft_consensus.cc:697] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:19.941676  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:19.941733 13223 consensus_queue.cc:237] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:19.942480  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:19.908291  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 71662.8us
I20260709 13:18:19.938756 13294 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:18:19.835860 13273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.006s	sys 0.013s
I20260709 13:18:19.912514  8252 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:20.087311  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:20.014850  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 72422.3us
W20260709 13:18:20.080778  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.043469  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:19.936599  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:20.067400  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 148004us
I20260709 13:18:19.947201  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:19.929304  8790 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:19.896340 13253 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.093389  8257 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:20.069914  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:20.130198  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:20.092482  8175 raft_consensus.cc:2368] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17.
I20260709 13:18:20.120683  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:20.092170  8248 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:20.079458  8788 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:18:20.093752  8250 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:19.944367  8103 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
W20260709 13:18:20.061931 13289 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.869s	user 0.012s	sys 0.000s
I20260709 13:18:20.154153  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:20.077064  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:20.134645  8788 pending_rounds.cc:85] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 10
I20260709 13:18:20.155830  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:20.156236  8788 pending_rounds.cc:107] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:18:20.136262  8103 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:20.138567  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2752) took 1193 ms. Trace:
I20260709 13:18:20.156414  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:20.141258  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:20.157857  8783 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:20.154976  8253 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:20.161155  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:20.133060  8181 raft_consensus.cc:2368] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13.
I20260709 13:18:20.151033  8782 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:18:20.089956  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 151409us
I20260709 13:18:20.091574  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:20.153024  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:19.903321 13276 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:20.153463  8787 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:20.066658 13112 tablet_bootstrap.cc:492] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:18:20.171455  8253 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:20.157200  8788 raft_consensus.cc:2889] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:20.014341 13179 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:20.156709  8104 rpcz_store.cc:276] 0709 13:18:18.945311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.945420 (+   109us) service_pool.cc:224] Handling call
0709 13:18:18.945713 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.508823 (+563110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.138337 (+629514us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b540001b8d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:20.138508 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1222764928}
I20260709 13:18:20.172837  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:20.044013 13309 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:20.175388  8783 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:20.015221 13260 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:20.014499 13189 raft_consensus.cc:2764] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:18:20.118041 13273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.012s	sys 0.019s
I20260709 13:18:20.044153 13296 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:20.065073 13025 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:20.191996  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 100518us
I20260709 13:18:20.193295  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:20.178611  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:20.178848  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:20.180882  8785 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:20.094692 13323 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:20.184003  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:20.185058 13278 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:20.154239 13253 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:20.064126 13196 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:20.131556 13294 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:20.159009 13301 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:20.179638 13309 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.040619 13263 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:20.189733  8176 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:20.190899  8074 leader_election.cc:400] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13.
I20260709 13:18:20.297755  8074 leader_election.cc:403] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:20.196973  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:20.208935  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.274266  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 81037.5us
W20260709 13:18:20.275978  8102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2744) took 1776 ms (client timeout 1688 ms). Trace:
I20260709 13:18:20.278008  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:20.300091  8181 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:20.286823  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:20.300630  8103 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:20.189590 12567 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.130378 13249 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:18:20.176656 13319 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:20.175093 13231 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:20.258100 13179 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:20.170804 13308 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:20.294445 13018 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:18:20.305863  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 115097us
I20260709 13:18:20.331748  8074 leader_election.cc:400] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17.
I20260709 13:18:20.332139  8074 leader_election.cc:403] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:18:20.299741  8102 rpcz_store.cc:269] 0709 13:18:18.499779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.499917 (+   138us) service_pool.cc:224] Handling call
0709 13:18:20.275734 (+1775817us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b540035fa54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:20.275884 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925239040}
I20260709 13:18:20.296303 13309 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:20.256441 12748 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:20.293746 13298 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:18:20.289640  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.319430 13159 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:20.333990  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.334358 13159 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:20.305414 13068 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:20.310964 13189 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:18:20.342165  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:20.343011  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.343330 13246 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:20.344846 13178 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:20.341274 12748 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:20.329180  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:20.359133  8101 raft_consensus.cc:2393] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 15: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:20.293839  8257 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:20.384090  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:20.384749  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.385264  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:20.386128  8257 raft_consensus.cc:2410] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:18:20.306905 13301 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:20.313922 12567 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:20.347728 13018 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:20.445617  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:20.446238  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:20.446322  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:20.448568  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.447491  8072 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:20.507179  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 59780.6us
I20260709 13:18:20.452267  8782 raft_consensus.cc:2376] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15. Re-sending same reply.
I20260709 13:18:20.342211 13198 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:18:20.376437 13246 raft_consensus.cc:697] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:20.519485  8250 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:20.356180 13094 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:18:20.338750 13308 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:20.364457 13286 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17.
I20260709 13:18:20.526762  8103 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:20.541966  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:20.542593  8250 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:20.530956 12748 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:20.531222 13205 consensus_meta.cc:287] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.604s	user 0.016s	sys 0.005s
I20260709 13:18:20.531559  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:20.516103 13293 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:20.530315 13018 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:20.543596  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:20.564126  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:20.566059  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:20.538688 13159 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:20.570474  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:20.571045  8257 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:20.575843 13308 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:20.506050 13272 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:20.578877  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:20.584419 13333 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:20.585343 13272 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:20.586038  8105 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:20.586156  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:20.587110 13050 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:20.587255  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:20.588018  8249 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 11: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:20.588701  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:20.589959  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:20.590966  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:20.591619  8249 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:20.592320  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:20.551753 13296 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:20.599282 13296 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:20.606546  8248 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:20.601050  8105 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:20.609534 13293 consensus_queue.cc:1059] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:18:20.618462  8256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2850) took 1944 ms (client timeout 1844 ms). Trace:
I20260709 13:18:20.619122  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:20.563352 13279 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:18:20.619020  8256 rpcz_store.cc:269] 0709 13:18:18.674068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.674176 (+   108us) service_pool.cc:224] Handling call
0709 13:18:20.618189 (+1944013us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54002aeed4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:20.618346 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626363136}
I20260709 13:18:20.614145  8248 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:18:20.554849 13300 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:18:20.627581  8248 raft_consensus.cc:1217] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 8.8->[9.9-13.12]   Dedup: 10.10->[11.11-13.12]
I20260709 13:18:20.628268  8248 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: [9.9-13.12]
I20260709 13:18:20.636351  8250 raft_consensus.cc:2368] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17.
I20260709 13:18:20.643533  8257 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:20.558777 13205 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:20.648267  8248 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:18:20.540576 13179 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:20.651340  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:20.611855 13323 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:20.656219  8254 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:20.657124  8256 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 15. Current term is 16. Ops: []
W20260709 13:18:20.679411  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 498239us
I20260709 13:18:20.689651  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:20.690925  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:20.695013  8175 raft_consensus.cc:1240] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:20.653731 13127 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.627009 13246 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:20.719049  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:20.705998  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 54773.8us
I20260709 13:18:20.721704  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:20.722851  8104 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 15. Current term is 16. Ops: [13.10-15.11]
I20260709 13:18:20.685050 13302 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:20.699167 13308 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.727581 13100 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:20.723862 13249 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:20.749627  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 62696us
I20260709 13:18:20.740286 13301 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:20.729836 13127 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:20.758167  8149 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:20.732583 13309 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:20.744655 13100 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.748546 13224 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:20.740216 13308 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:20.736781 13302 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:20.771168 13306 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:20.747107 13249 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:20.762867 13100 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:20.791088 13309 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:20.793077  8252 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:20.798923 13306 raft_consensus.cc:697] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:20.795478 13224 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:20.805014 13306 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:20.805863 13224 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:20.808564 13205 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:20.825552  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:20.827340  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:20.832819  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:20.833460  8174 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:20.821635 13106 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.828626 13309 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.856276  8103 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:18:20.858174  8106 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:20.859189  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:20.861115  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:20.861975  8100 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:20.866529  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:20.878919  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:20.880548  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:20.882052  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:20.882817  8101 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:18:20.883885  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 89576.7us
I20260709 13:18:20.888095  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:20.888942  8102 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:20.890501  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:20.891324  8103 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:20.892321  8182 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:20.898787  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:20.901976  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:20.903589  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:20.905857  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:20.906075  8099 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:20.914745  8108 raft_consensus.cc:2410] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:20.907549  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:20.907650  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:20.913116  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:20.915792  8180 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:18:20.916674  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:20.917390  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 159302us
I20260709 13:18:20.920003  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2875) took 1024 ms. Trace:
I20260709 13:18:20.920513  8252 rpcz_store.cc:276] 0709 13:18:19.895350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.895506 (+   156us) service_pool.cc:224] Handling call
0709 13:18:19.895748 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.792878 (+897130us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b58009611d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0da80aa 00007fa5a0e2a447 00007fa5a0e42fe7 00007fa5a0e447de 00007fa5a0e4eb49 00007fa5a0e4f416 00007fa5a0e4bd8f 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4
0709 13:18:20.919492 (+126614us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:20.919521 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.919581 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:20.919648 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.919761 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.919933 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149,"spinlock_wait_cycles":963634048}
I20260709 13:18:20.921268  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:20.882843 13309 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:20.901650 13222 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:18:20.882721 13106 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:20.995577  8786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 811) took 1212 ms. Trace:
I20260709 13:18:20.996387  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2868) took 1208 ms. Trace:
I20260709 13:18:20.991348  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:21.012260  8255 rpcz_store.cc:276] 0709 13:18:19.787732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.787862 (+   130us) service_pool.cc:224] Handling call
0709 13:18:20.996206 (+1208344us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000929d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:20.996323 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254848768}
W20260709 13:18:21.004346  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.999248  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:21.016948  8180 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:21.013278  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:21.017762  8179 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:20.961267 13231 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:20.921976  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45167.6us
W20260709 13:18:20.967520  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 49487us
I20260709 13:18:21.018658  8107 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:21.022362  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:21.022923  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:21.025629  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:20.911861 13196 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.021914  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:21.027788  8106 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 15: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:21.011662  8786 rpcz_store.cc:276] 0709 13:18:19.783237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.783375 (+   138us) service_pool.cc:224] Handling call
0709 13:18:19.783742 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.825554 (+ 41812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.995284 (+1169730us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b54004cf9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:20.995497 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7835008}
I20260709 13:18:21.070072  8182 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:21.035471  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:21.038846  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:21.081106  8255 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:21.025363  8252 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:21.029518  8107 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:18:21.026861  8180 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:21.029795  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:20.998584 13209 consensus_meta.cc:287] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 1.140s	user 0.012s	sys 0.006s
I20260709 13:18:21.033551  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:20.996920 13249 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:20.992172 13308 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:20.993871 13098 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:20.914026 13024 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.144s
I20260709 13:18:20.960430 13301 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.170s
I20260709 13:18:21.085315  8248 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:21.204172 13205 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.206802  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:21.203909  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:20.998798 13334 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.118014  8257 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:18:21.207736  8107 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:21.212513  8104 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:21.217808  8106 raft_consensus.cc:2410] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:20.989878 13306 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.229s
W20260709 13:18:21.218585 13189 consensus_meta.cc:287] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.852s	user 0.009s	sys 0.003s
I20260709 13:18:21.229386  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:21.207507  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:20.987571 13300 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:21.009526 13127 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:21.254295  8108 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:21.069911 13050 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:21.031636 13302 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.162642 13299 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:21.034940 13178 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.222s
I20260709 13:18:21.255975 13189 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13.
I20260709 13:18:21.258190 13334 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:21.092810  8174 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:21.036890 13106 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:21.144994 13196 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.186472 13253 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.257272  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:21.314716  8257 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:21.206405 13205 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.280947 13179 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.083667 13279 consensus_queue.cc:1059] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.175s
I20260709 13:18:21.125789 13209 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:21.273061 13050 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.030812 13231 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.282212 13309 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.160120 13294 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.273490 13299 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.285641 13302 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:21.286967 13249 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:21.285853  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 252316us
I20260709 13:18:21.259044 13300 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.309118  8183 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:21.254956  8104 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:21.317585  8108 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:21.328462  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:21.331117  8221 leader_election.cc:400] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17.
I20260709 13:18:21.332332  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:21.332442  8221 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:21.333206  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:21.322402  8257 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
W20260709 13:18:21.314288 13100 consensus_meta.cc:287] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.006s
I20260709 13:18:21.310343 13301 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:21.325505  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:21.326434 13205 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:21.322149  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 283338us
I20260709 13:18:21.371649  8254 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:21.329715 13299 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:21.318060 13196 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.334008 13249 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.379763 13371 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:21.381356 13249 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:21.383481 13196 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.384944 13279 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:21.385743 13279 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:21.386051 13112 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:21.386605 13050 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:21.386987 13231 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.387157 13050 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:21.338052 13100 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.388796  8176 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:21.386094 13279 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:21.389896 13279 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:21.394953 13100 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:21.395357 13357 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:21.396880 13024 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:21.397593 13106 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:21.336859 13294 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:21.399542  8181 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 15. Ops: []
I20260709 13:18:21.338290 13301 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:18:21.410426  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 78065us
I20260709 13:18:21.324504 13209 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.420442  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:21.323459 13179 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.424448  8221 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:21.330597 13302 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:21.427598  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 94442.3us
I20260709 13:18:21.428586  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:21.431203 13209 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.432087 13371 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:21.432574 13371 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.433314 13302 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.433554 13369 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:21.434013 13369 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.434350 13369 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:21.434593 13371 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:21.435463 13302 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:21.435966 13302 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.437961 13302 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:21.438462  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:21.431305  8108 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:21.441139  8254 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:18:21.440845  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:21.446707  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:21.447041 13106 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:21.448638 13106 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.448993 13106 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:21.463943 13371 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.464185 13050 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:21.466032 13127 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:21.466449 13179 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:21.439055 13367 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:21.470719  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:21.472113 13302 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:21.472641 13302 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:21.473824  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:21.473593 13302 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.439114 13309 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:18:21.461917 13024 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:21.476538 13024 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:21.477568 13024 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.479714  8183 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:21.481179  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:21.481750 13334 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.461335 13301 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.438755 13300 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:21.650350  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 68749.8us
I20260709 13:18:21.483335  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:21.508394  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 50939us
W20260709 13:18:21.609474  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.600091  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2871) took 1810 ms. Trace:
I20260709 13:18:21.599715  8104 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:18:21.654664  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 230275us
W20260709 13:18:21.655541  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.656175  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:21.562475  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 655) took 1367 ms. Trace:
I20260709 13:18:21.655603  8251 rpcz_store.cc:276] 0709 13:18:19.789696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.789815 (+   119us) service_pool.cc:224] Handling call
0709 13:18:19.795407 (+  5592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.889442 (+ 94035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.599794 (+1710352us) spinlock_profiling.cc:243] Waited 59.3 ms on lock 0x7b54002e8e54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:21.600014 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136440704}
I20260709 13:18:21.658808  8256 rpcz_store.cc:276] 0709 13:18:20.194969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.626582 (+431613us) service_pool.cc:224] Handling call
0709 13:18:20.656879 (+ 30297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.678857 (+ 21978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.562257 (+883400us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b5400197150. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:21.562408 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67555456}
I20260709 13:18:21.656340  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:21.548070  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:21.569561 13372 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:18:21.663782  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:21.464285 13098 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.200s
I20260709 13:18:21.539944 12567 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.657994 13367 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:21.670042 13300 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:21.670601  8250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2663) took 1510 ms (client timeout 1892 ms). Trace:
I20260709 13:18:21.654773 13189 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:21.677049  8221 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:21.660887 13374 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:18:21.674343 13178 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:21.689406 13367 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.690017 13178 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:21.688355 13231 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:21.691038 13178 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.691440 13231 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.691864 13367 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:21.692170 13178 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:21.688262 13261 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:18:21.694553 13261 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:21.694486 13189 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.695093 13261 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:21.696007 13261 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 17.7, Last appended by leader: 7, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.696890 13189 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.675909  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:21.676865  8100 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:18:21.466493 13127 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:21.672163 13369 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:21.686722  8250 rpcz_store.cc:269] 0709 13:18:20.160280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.569868 (+409588us) service_pool.cc:224] Handling call
0709 13:18:21.670411 (+1100543us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b5400089dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:21.670542 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9141120}
I20260709 13:18:21.520351 13272 raft_consensus.cc:3055] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:21.678746  8108 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:21.670707  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:21.520749 13179 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:21.709502 13323 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.710016 13323 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.712080 13323 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.716718 13299 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.689208 13092 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:21.662343 13373 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:18:21.734007  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:21.734324  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:21.734756  8100 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:21.697223 13261 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:21.738037  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 58730.7us
I20260709 13:18:21.700053  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:21.679260 13205 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.686904 13348 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:18:21.679347 13209 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:21.700665 13231 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.699282  8103 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:21.708670 13367 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:21.709177 13179 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.678926 13336 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:18:21.719342  8221 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:21.754035  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:21.754379 13369 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:21.755074 13369 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:21.738891 13092 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.755343  8221 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:21.755685 13369 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:21.721386 13279 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:21.723925 13361 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.325s	user 0.003s	sys 0.000s
I20260709 13:18:21.569355 13106 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.540144 12748 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.768465  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:21.679142  8105 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2770) took 1784 ms (client timeout 1742 ms). Trace:
I20260709 13:18:21.674531  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:21.741710  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:21.742043  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:21.777400  8105 rpcz_store.cc:269] 0709 13:18:19.895098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.895261 (+   163us) service_pool.cc:224] Handling call
0709 13:18:21.678944 (+1783683us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b540035f554. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:21.679066 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1551723392}
I20260709 13:18:21.780791  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:21.781558  8105 raft_consensus.cc:2376] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17. Re-sending same reply.
I20260709 13:18:21.778712  8108 raft_consensus.cc:2410] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:18:21.704803 13127 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:21.745754  8100 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:21.726293 13272 raft_consensus.cc:740] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:21.520533 13371 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.718446 13377 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:21.750316 13367 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:21.750541 13263 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:18:21.761827  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.730854  8107 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:18:21.812314  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:21.812894  8108 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:21.813273  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:21.758976  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:21.768718 13092 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.769790  8790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1394) took 1630 ms. Trace:
I20260709 13:18:21.783768  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:21.814913  8105 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:21.814819  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55911.4us
W20260709 13:18:21.776115  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.768950 13134 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:18:21.788502  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2660) took 1683 ms. Trace:
I20260709 13:18:21.769331 13050 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:21.827742 13366 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:21.828200 13050 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:21.828295 13366 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.828455 13367 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.829119 13050 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.830516 13366 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.820973  8249 rpcz_store.cc:276] 0709 13:18:20.104929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.593131 (+488202us) service_pool.cc:224] Handling call
0709 13:18:20.593369 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.593580 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:20.730455 (+136875us) log.cc:844] Serialized 14 byte log entry
0709 13:18:21.168192 (+437737us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b180031e100. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:18:21.787619 (+619427us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b180031e100. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa5a09f44bc 00007fa59dd4248b 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec23a
0709 13:18:21.788026 (+   407us) log.cc:844] Serialized 14 byte log entry
0709 13:18:21.788179 (+   153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.788226 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:21.788271 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.788339 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.788438 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":157171,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":3971,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"spinlock_wait_cycles":18193536,"thread_start_us":156040,"threads_started":2,"wal-append.queue_time_us":19342}
I20260709 13:18:21.789925  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:21.790920  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 656) took 1084 ms. Trace:
I20260709 13:18:21.790983 12934 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:21.792865 13179 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:21.794021  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:21.794221 13299 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:21.742554 13205 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.875149 13205 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.746698 13209 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.875855 13371 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:21.876642 13112 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:21.877069 13209 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.801048 13106 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:21.802783  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:21.802982  8178 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:21.805001  8177 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 13: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:21.806115  8176 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:18:21.818463  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:21.881615 13209 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:21.881925  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 63532.1us
I20260709 13:18:21.882174 13209 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.882737  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:21.883843  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:21.884325 13209 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:21.884589  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 651) took 1196 ms. Trace:
I20260709 13:18:21.884931  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:21.819331  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:21.816813 13263 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:21.891829  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:21.814559  8790 rpcz_store.cc:276] 0709 13:18:20.139256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.139445 (+   189us) service_pool.cc:224] Handling call
0709 13:18:20.139815 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.311865 (+172050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.311897 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.311943 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:20.311993 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.769555 (+1457562us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b540065e854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:21.769603 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.769733 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395149568}
I20260709 13:18:21.827189  8105 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:21.893333  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:21.816550 13253 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.806609 13231 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.832234 13366 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.806699 12748 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.834972 13092 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.863657  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:21.861881  8100 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:21.864729  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:21.820701 13381 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:21.865373 13279 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:21.866307  8104 raft_consensus.cc:2410] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 18 because replica has last-logged OpId of term: 17 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 6.
I20260709 13:18:21.869925 13272 consensus_queue.cc:260] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:21.885574 13205 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:21.885301 13302 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:21.900518 13294 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:21.886426  8182 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:21.818907  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.885057  8181 rpcz_store.cc:276] 0709 13:18:20.687981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.688154 (+   173us) service_pool.cc:224] Handling call
0709 13:18:20.718398 (+ 30244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.419249 (+700851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.884339 (+465090us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b5400329e54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:21.884529 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1566012544}
I20260709 13:18:21.833408  8175 rpcz_store.cc:276] 0709 13:18:20.706921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.708675 (+  1754us) service_pool.cc:224] Handling call
0709 13:18:20.718398 (+  9723us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:20.774737 (+ 56339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.774782 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:20.778952 (+  4170us) log.cc:844] Serialized 52 byte log entry
0709 13:18:20.946445 (+167493us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:20.946507 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.790561 (+844054us) spinlock_profiling.cc:243] Waited 54 ms on lock 0x7b5400248bd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:21.790606 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.790646 (+    40us) raft_consensus.cc:1685] finished
0709 13:18:21.790659 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.790866 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15180,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":124246912,"thread_start_us":124047,"threads_started":1,"wal-append.queue_time_us":341209}
I20260709 13:18:21.879940  8257 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:18:21.881842  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:21.896673  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:21.891247 13261 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:21.809906 13249 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.890856 13112 tablet_bootstrap.cc:492] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:18:21.939051  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:21.841710  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:21.939529  8102 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:18:21.939838  8108 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:21.904143 13366 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.886238  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:21.926826  8174 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:21.912052 13272 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:21.941522  8102 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:18:21.928491  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:21.929877  8786 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:18:21.930155  8252 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:21.931217  8782 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:21.931332  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:21.943104  8249 raft_consensus.cc:2368] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15.
I20260709 13:18:21.932204  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:21.933074  8255 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 6. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 13:18:21.934010  8787 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:21.934286  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:21.936291  8105 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:21.902719 13209 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:21.948673  8788 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:21.969794  8257 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:21.945621  8784 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:21.999408  8108 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:22.010469 13112 tablet_bootstrap.cc:492] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:18:22.011551  8182 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
W20260709 13:18:22.013115 13380 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:18:22.019563  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.022460  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.938042 13371 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.024016 13353 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:22.023888 13371 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:22.024660 13353 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:22.025861 13353 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.027161 13353 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:22.028685 13025 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:21.937085 13279 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.902897 13231 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.945828 13263 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.940883 13249 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:22.034142  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.945609 13294 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:21.901823 13253 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:21.909307 13092 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:22.039871 13366 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:22.023236 12748 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:22.070247  8253 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:22.077364  8788 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:22.037019 13209 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.046681 13025 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:22.098946 13386 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:22.111377 13386 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.111778 13025 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:22.112983  8783 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:22.113190 13025 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:22.092545 13351 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:18:22.113747 13386 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:22.103063  8782 raft_consensus.cc:3055] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:22.105015 13127 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:22.082235 13050 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.092823 13279 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:22.116115 13127 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:22.116822  8782 raft_consensus.cc:740] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:22.117018 13279 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:22.105966 13394 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:22.106788 13371 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:22.105865 13387 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:22.107738 13249 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:22.103968 13263 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:22.118502 13112 ts_tablet_manager.cc:1403] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 2.052s	user 0.056s	sys 0.029s
I20260709 13:18:22.122539 13231 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:22.124337 13370 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.656s	user 0.002s	sys 0.000s
W20260709 13:18:22.125922  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.112483 13209 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:22.117784  8782 consensus_queue.cc:260] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.109860 13366 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.130957 13365 raft_consensus.cc:3055] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:22.134935 13301 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:22.149415  8782 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:22.149482 13366 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.138615 13253 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:22.140605 13092 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:22.117758 13394 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.152017 13366 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:22.149462 13365 raft_consensus.cc:740] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:22.152806 13394 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:22.141919 13386 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:22.146809 12934 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:22.110893 13395 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.114943 13050 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:22.156687  8788 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:18:22.161796 13112 raft_consensus.cc:359] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 11 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:22.248696 13112 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:18:22.249809 13112 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:22.252383 13112 ts_tablet_manager.cc:1434] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.000s
W20260709 13:18:22.210085  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 313243us
I20260709 13:18:22.213059  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:22.213080  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:22.222136  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.157353 13365 consensus_queue.cc:260] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:22.067883  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 47382.2us
I20260709 13:18:22.262545 13365 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:22.096894  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:22.263358  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.156684 12934 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:22.273068  8790 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:18:22.273684  8790 pending_rounds.cc:85] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 11
I20260709 13:18:22.274053  8790 pending_rounds.cc:107] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:18:22.275453 13371 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:22.276443 13371 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:22.280198 13371 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:22.161119 13050 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:22.229592  8108 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:22.274477  8790 raft_consensus.cc:2889] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:22.282351  8100 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
W20260709 13:18:22.283552  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.283609  8108 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:22.158950 13386 consensus_queue.cc:1243] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:22.129158 13387 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.286391  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:22.154311 13393 consensus_queue.cc:1175] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a0f96c12124b4e1a816d9fa970464091" responder_term: 16 status { last_received { term: 14 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:22.157509 13395 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:22.259384  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.270851  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:22.287969  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:22.265569  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:22.287992 13387 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:22.311491  8106 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:22.316677  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:22.317230 13272 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:22.322331  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51883.8us
I20260709 13:18:22.324929 13302 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:22.329559 13272 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.331434  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:22.332576  8254 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:22.332762 13272 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:22.334976  8105 raft_consensus.cc:2410] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:22.336717 13337 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:22.338176  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:22.338467  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:22.338461 13092 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:18:22.345386  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:22.345643  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:22.346077 13092 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:22.346619 13092 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:22.346783  8253 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:22.353765  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:22.354705  8147 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:22.355068  8099 raft_consensus.cc:2410] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:18:22.336866 12886 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:18:22.357184 12567 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:22.357784 12567 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.358319 12567 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:22.359042 13308 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:22.360755  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:22.362566  8254 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 9.
I20260709 13:18:22.365854  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:22.371543  8785 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
W20260709 13:18:22.384814  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.348258 13092 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.391177  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:22.390262  8249 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:22.396450  8250 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:22.397996  8253 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:22.399685 13050 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.400560 13050 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:22.401022  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:22.402928  8256 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:22.407884 13050 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:22.411798  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:22.413808 13343 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:22.414208  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:22.414436 13343 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:22.415199  8787 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 9.
I20260709 13:18:22.416217  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:22.415884 13343 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:22.418462  8785 raft_consensus.cc:2368] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 10. Current term is 11.
I20260709 13:18:22.417999  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:22.416604  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:22.420687  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:22.421744  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:22.423350  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:22.423867 13395 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:22.424057  8789 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:22.425045  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:22.431051  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:22.426229  8790 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:22.430352  8147 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:22.434260  8789 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:22.441049  8787 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:22.444689  8785 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 11 LEARNER]: Advancing to term 13
I20260709 13:18:22.450073  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:22.450268 13294 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.451197  8253 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:22.451130 13294 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:22.452368  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:22.453209  8253 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 12: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:18:22.455722  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.457149  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:22.438563 13050 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:22.476538  8249 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:22.485235  8783 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:22.499730 13050 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.479110 13337 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:22.502801 13050 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:22.509791 13025 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:22.508590 13092 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:22.513017  8254 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:22.507392 13294 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:22.533165  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 94484.1us
I20260709 13:18:22.534235  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:22.536190  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:22.536690  8252 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:18:22.538103  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 107937us
I20260709 13:18:22.541687 12886 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:22.544162  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:22.547686  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:22.548888 13396 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:22.549701 13396 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:22.550113 13249 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:22.550628 13249 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:22.551102 13249 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:22.551214 13396 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:22.553315  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.555894  8256 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:22.549609 13263 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:22.557552 13263 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:22.557974 13263 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:22.559176 13263 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.560923 13263 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:22.565655  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:22.566915 12886 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:22.567442 12886 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:22.567924 12886 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:22.568257  8257 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:18:22.570178  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45889.2us
I20260709 13:18:22.541139  8147 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:22.571959  8107 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:22.571482  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:22.577728 13308 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:22.523428  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:22.589099  8256 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:22.592574  8256 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:22.589262  8257 pending_rounds.cc:85] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 9
I20260709 13:18:22.599877  8257 pending_rounds.cc:107] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:18:22.600225  8257 raft_consensus.cc:2889] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:22.606882  8248 raft_consensus.cc:2410] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:18:22.608609 13394 raft_consensus.cc:3055] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:22.609022 13394 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:22.609925 13246 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:22.610420 13246 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:22.610783 13246 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:22.604640  8251 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:22.616395  8782 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:18:22.616902  8782 pending_rounds.cc:85] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 11
I20260709 13:18:22.617229  8782 pending_rounds.cc:107] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:18:22.617555  8782 raft_consensus.cc:2889] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:22.619192  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:22.620275  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 96967.4us
I20260709 13:18:22.622213 13367 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:18:22.625622  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.627169 13394 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.628837 13394 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:22.630617  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.632361  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.633059  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.636376  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 50048.4us
I20260709 13:18:22.643813  8256 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:22.651500  8252 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:18:22.634254 13050 raft_consensus.cc:2955] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
W20260709 13:18:22.659795  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 110677us
I20260709 13:18:22.663671 13196 raft_consensus.cc:2764] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:18:22.653755 13365 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:22.669747  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 128834us
I20260709 13:18:22.643306 13025 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:18:22.682504  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:22.693473  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.675051 13365 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:22.705507  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:22.706096  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.707118  8182 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:22.707540  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:22.708025  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:22.708504 13309 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:18:22.709159  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:22.710599  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:22.722680  8785 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 13 LEARNER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:18:22.727607  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 223202us
W20260709 13:18:22.733767  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 112556us
W20260709 13:18:22.745285 13402 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:18:22.745420  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:22.737499 13367 raft_consensus.cc:697] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:22.754446  8183 raft_consensus.cc:2410] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:18:22.756723 13302 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:22.757567  8074 leader_election.cc:400] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17.
I20260709 13:18:22.759765  8074 leader_election.cc:400] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15.
I20260709 13:18:22.760056  8074 leader_election.cc:403] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:18:22.761091 13209 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:22.765805  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 89059.7us
I20260709 13:18:22.744956  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:22.739456 13246 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:22.805584  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.752782 12934 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:22.816293  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:22.816718  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 57089.7us
I20260709 13:18:22.792375 13337 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:22.775077 13196 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15.
W20260709 13:18:22.831863  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.826021  8223 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.129:45123 timed out after 1.679s (SENT) [suppressed 18 similar messages]
I20260709 13:18:22.822837 13396 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.839957  8255 raft_consensus.cc:2410] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:18:22.842514 13410 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:22.843576 12934 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:22.844388 12934 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:22.825078 13309 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:18:22.847697  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:22.854110 12567 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.856601 12567 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:22.858382  8181 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 14: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:22.843271 13410 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.845034 12934 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.857246 12567 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:18:22.861863 13263 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:22.889751  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:22.859103 13249 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.906517 13249 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:22.908133  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 49241.7us
W20260709 13:18:22.908537  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.908852 13302 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:22.909785 13302 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.910420 13302 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.911186  8101 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:22.911649  8101 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:22.912844 13302 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:22.903963 12934 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:22.886996 13337 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.862356 13396 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:22.908179  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:22.881836 13411 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.912706  8101 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:22.936897  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.939266  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:22.942325  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:22.943300  8791 raft_consensus.cc:2410] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:18:22.943743  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.943995  8107 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:22.895764 13365 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:22.949836  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:22.951443  8791 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16. Ops: []
W20260709 13:18:22.952296 13407 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:22.952812  8791 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:22.950029  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:22.955222  8786 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:22.958108  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 137840us
I20260709 13:18:22.934358 13249 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:22.953277 13246 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:22.962666  8101 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:22.966761  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.968703  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 60707.5us
I20260709 13:18:22.970202  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:22.970969  8787 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
W20260709 13:18:22.971948 13361 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:22.972092  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:18:22.972944 13414 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:18:22.974277  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:22.974926  8788 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:22.949888 12721 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:18:22.883934 13367 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:22.992679  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.993887  8789 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:22.964630 13302 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.996469  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:22.981009  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:22.935199 13337 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:22.980545 13249 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:23.004096 13249 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:23.009122 13248 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:23.009783  8789 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:23.010527 13410 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:23.009809 13248 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:23.011776 13092 consensus_meta.cc:287] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.003s
I20260709 13:18:23.011984 13248 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.6, Last appended by leader: 6, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:22.996553 13302 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:23.014532 13396 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:23.015017 13302 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:23.017454  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 72541.4us
I20260709 13:18:23.018286  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:23.020167  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:23.000700  8101 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:18:23.021912  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 55678.2us
I20260709 13:18:23.026041  8786 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:22.939986 13411 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.040992 13410 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.041623 13410 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.042018  8004 catalog_manager.cc:5697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 4 to 7, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 7 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:23.043993 13410 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:23.050105 13196 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:23.050721 13196 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:23.051283 13196 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:23.051880  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:23.052277  8788 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:23.054019 13411 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:23.026064 12886 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:23.056854 12886 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:23.057973  8002 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39810 (request call id 294) took 40850 ms (client timeout 15000 ms). Trace:
I20260709 13:18:23.059099 13337 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:23.050945  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:23.065634 13294 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:23.065800  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.066504  8181 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:23.067595  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:23.072046  8254 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:23.073266  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:23.073882  8257 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:23.077524  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.078231  8181 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:23.029458 13092 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:23.087119  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:23.087175  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.088254  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:23.088863  8257 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:23.100455  8180 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14. Ops: []
W20260709 13:18:23.101549  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.078661 13302 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:23.096918  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:23.082378 13092 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.122058 13092 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:23.121672  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.124255  8181 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:23.089727 12886 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:23.115540  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 63789.9us
I20260709 13:18:23.115459  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.111304 13302 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:23.111513  8147 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:23.058389  8002 rpcz_store.cc:269] 0709 13:17:42.207729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.207927 (+   198us) service_pool.cc:224] Handling call
0709 13:18:23.057750 (+40849823us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:18.460075 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:18.531531 (+ 71456us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:18.531573 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:18:18.531614 (+    41us) tablet.cc:662] Decoding operations
0709 13:18:18.532473 (+   859us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:18.532558 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:18.532590 (+    32us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:18:18.533371 (+   781us) tablet.cc:701] Row locks acquired
0709 13:18:18.533398 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:18:18.712345 (+178947us) write_op.cc:270] Start()
0709 13:18:18.737518 (+ 25173us) write_op.cc:276] Timestamp: P: 1783603098696023 usec, L: 0
0709 13:18:18.740810 (+  3292us) op_driver.cc:348] REPLICATION: starting
0709 13:18:18.759319 (+ 18509us) log.cc:844] Serialized 2482 byte log entry
0709 13:18:19.942515 (+1183196us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:20.530055 (+587540us) op_driver.cc:464] REPLICATION: finished
0709 13:18:20.746874 (+216819us) write_op.cc:301] APPLY: starting
0709 13:18:20.748511 (+  1637us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:21.006084 (+257573us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:21.011259 (+  5175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:21.284470 (+273211us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:21.284707 (+   237us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:18:21.284759 (+    52us) write_op.cc:312] APPLY: finished
0709 13:18:21.285023 (+   264us) log.cc:844] Serialized 65 byte log entry
0709 13:18:21.285869 (+   846us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:21.285995 (+   126us) write_op.cc:454] Released schema lock
0709 13:18:21.286041 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:21.288592 (+  2551us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:21.288622 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":127962,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":203846,"apply.run_cpu_time_us":12077,"apply.run_wall_time_us":546579,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29195,"num_ops":6,"prepare.queue_time_us":206940,"prepare.run_cpu_time_us":60679,"prepare.run_wall_time_us":601603,"raft.queue_time_us":258429,"raft.run_cpu_time_us":57385,"raft.run_wall_time_us":231071,"replication_time_us":1786911,"spinlock_wait_cycles":8874368,"thread_start_us":660854,"threads_started":4,"wal-append.queue_time_us":402647,"wal-append.run_cpu_time_us":68003,"wal-append.run_wall_time_us":3123687}]]}
W20260709 13:18:23.127198 13419 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.087s	user 0.003s	sys 0.000s
I20260709 13:18:23.131193 12567 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:23.136435 12567 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:23.137454 12567 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:23.165611 13301 raft_consensus.cc:2764] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:18:23.110399 13337 consensus_queue.cc:1059] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:18:23.131928 13302 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:23.172760  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:23.174273  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:23.176268 13337 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:23.177757  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:23.177989 13099 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:23.178433  8788 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:23.178431 13099 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.149897 13410 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:18:23.204276  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:23.210160  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:23.211920  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:23.212857  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:23.215507  8785 raft_consensus.cc:2410] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:18:23.216485  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:23.202201 13343 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:23.214708 13099 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:23.223521  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:23.249562  8250 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:23.199435 13308 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:18:23.258201  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:23.248625 13246 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:18:23.241966 13343 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:23.262636  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.265887  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.258845 13367 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:23.265671 13432 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:23.273967  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 74218.5us
I20260709 13:18:23.274186 13301 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.274848  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:23.274758 13301 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.275869 13416 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:23.276299 13416 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:23.276352  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:23.276679 13301 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:23.276705 13416 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:23.277781  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:23.303050  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:23.292152  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:23.305382  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.303947  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:23.281555  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 69298.3us
I20260709 13:18:23.307085  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:23.336262  8174 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 14: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:23.298830  8101 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:18:23.359377  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:23.361302  8254 raft_consensus.cc:2410] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:18:23.361951  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:23.290886 13411 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:23.364624  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.281646 13434 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.282799 13431 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:23.365901  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 63233us
I20260709 13:18:23.367604  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.373703  8107 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:23.377681  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.381731  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:23.381886 13343 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:23.364305 13410 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.383277 13343 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:23.383447 13410 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:23.384932  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 82023.2us
I20260709 13:18:23.286356 13426 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:18:23.277990 13432 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.387657 13432 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:23.385782 13371 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:23.388360 13371 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:18:23.392887  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.389341 13371 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.401492  8105 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:23.403508  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:23.401137 13434 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.405575  8072 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:23.408031  8104 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:18:23.409865  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.410701  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:23.411825  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 114159us
I20260709 13:18:23.411937  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.381240 13092 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.414026  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:23.412972  8221 leader_election.cc:336] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.586s (SENT)
I20260709 13:18:23.418052  8221 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:23.408339 13294 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:23.410035 13410 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:23.425917  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:23.426282 13099 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.419261 13396 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:23.432121  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.433102  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:23.433895  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:23.434672  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:23.443323  8100 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:23.435052  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:23.433926  8101 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:23.437100 13092 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:23.439328 13196 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.440565  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:23.445683  8105 raft_consensus.cc:2410] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:18:23.445776 13396 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:23.446233  8103 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:23.422063 12567 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:18:23.446825  8107 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:23.447089  8106 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:23.448027 13092 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:23.448993  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.403131 13426 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 13:18:23.459617  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 52162us
I20260709 13:18:23.460639 13301 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:23.448278  8193 tablet_copy_service.cc:342] P 9bd264598fd2483e9e17674bab9ba4e8: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-fa9dafbde3954b8487327ba47919b4d5 received from {username='slave'} at 127.0.0.1:37206
I20260709 13:18:23.462945  8193 tablet_copy_service.cc:434] P 9bd264598fd2483e9e17674bab9ba4e8: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-fa9dafbde3954b8487327ba47919b4d5 on tablet fa9dafbde3954b8487327ba47919b4d5 with peer 5033fc7e66374940a203908ea8b0078f
W20260709 13:18:23.464874 13441 log.cc:927] Time spent T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:18:23.467217 13196 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:23.468122  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.470561 13099 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:23.471480  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 62093.2us
W20260709 13:18:23.472259  8221 leader_election.cc:336] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.599s (SENT)
I20260709 13:18:23.413017 13431 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.475471 13431 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:23.455633 13092 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.477598 13411 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:23.477926 13092 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:23.478075 13411 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.478368 13301 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:23.478710 13411 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:23.422088 13294 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.480054 13294 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:23.445717 13430 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:18:23.454352 13396 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:23.490624  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:23.477982  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:23.491298  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:23.449146 13434 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:23.493652 13410 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:23.494041 13410 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:23.494410 13410 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:23.506373  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.507526  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:23.515298  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:23.514254  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51876.3us
I20260709 13:18:23.523408  8103 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:23.508322 13301 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:23.527452  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:23.518415 13249 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:23.532927 12567 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.533456 12567 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.516758 13365 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:23.535274 13365 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.535532 12567 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:23.535707 13365 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:23.538195 13410 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:23.527248 13301 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:23.544135 13302 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.526098 13416 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.517370 13367 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:23.547230  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:23.547672 13436 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.552362  8257 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:23.554554  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:23.583573 13449 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:23.556931 13426 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:23.560822  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:23.561753  8105 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:23.562271  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:23.563598  8107 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:23.564100  8181 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
W20260709 13:18:23.569957  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 162971us
W20260709 13:18:23.570792  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 156852us
I20260709 13:18:23.580008  8106 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:23.590029  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:23.605298  8104 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:23.571555 13301 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:23.608201  8103 raft_consensus.cc:2376] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15. Re-sending same reply.
I20260709 13:18:23.610350  8101 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:23.614138 13431 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.614406 13434 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:23.614864 13434 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.614689 13431 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.615278 13434 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:23.615443 13416 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:23.616420 13416 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:23.616735 13396 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:23.637998  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:23.638159 13396 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:23.617048  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 69905.4us
I20260709 13:18:23.639681  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:23.612113 13249 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:23.641652 13249 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:23.642151 13249 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:23.618206  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:23.643103  8256 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:23.641302  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:23.614197 13436 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.643406  8100 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:23.620029 13432 consensus_queue.cc:1059] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:23.620568  8072 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:23.614152 13410 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:23.624297  8074 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:23.629550 13371 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:23.634003 13434 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.635577  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:23.666162  8249 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:23.635640  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:23.647588  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:23.655189  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 127993us
I20260709 13:18:23.662588  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:23.666939  8250 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:23.685158  8104 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:23.669238  8248 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:23.692863  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:23.616757 13431 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:23.708381  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:23.710853  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:23.711623  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.702219  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:23.713367  8101 raft_consensus.cc:2368] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16.
W20260709 13:18:23.718355  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 77153.5us
I20260709 13:18:23.663771 13396 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:23.727524  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 161988us
I20260709 13:18:23.725826  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:23.728871  8256 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:23.730647  8181 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:23.730716  8180 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:23.723768  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.731189  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:23.739171  8254 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:23.732280  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:23.742128  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.733446  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:23.731868  8104 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:18:23.752916  8782 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:23.754257  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:23.755056  8103 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:23.722363 13396 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.756494  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:23.763690  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:23.766175  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.766426  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:23.766844  8175 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:23.767549  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.773182  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:23.774129  8254 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:23.776242  8221 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:23.754400 13196 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:23.777401  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:23.760329 13431 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:23.784560  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.726955 13438 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:18:23.768853 13396 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:23.776998 13337 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:23.797914  8101 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:23.798643 13224 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:18:23.777633 13308 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:23.807464  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:23.786407 13431 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.785247 13448 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:23.805833 13337 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.783260 13025 consensus_queue.cc:1059] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:18:23.809059 13308 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.808698 13456 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.812479 13196 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:23.887938  8256 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:23.893342  8103 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
W20260709 13:18:23.895267  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 169610us
I20260709 13:18:23.821993 13431 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:23.895113  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 131675us
W20260709 13:18:23.906189  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 281947us
I20260709 13:18:23.909349  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.871241 13337 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:23.869118 13457 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:23.870812 13302 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:23.920185  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 112812us
I20260709 13:18:23.924510  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.894059 13308 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:23.821607 13092 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:23.926385  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 146789us
I20260709 13:18:23.885288 13449 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:23.933794  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:23.936594  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:23.936661  8103 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:24.006371  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:23.873485 13365 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:23.921811 13457 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:24.016346  8107 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 15: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:24.016145  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:24.017531  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 255002us
I20260709 13:18:24.020778  8790 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:24.011838  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:24.010162  8791 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:24.026633  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:23.943902 13367 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:24.129710 13472 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:24.130530 13440 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:24.131284 13440 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:24.130661 13472 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.132309 13440 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:24.134140 13465 log.cc:927] Time spent T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
W20260709 13:18:24.097754  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 91609.4us
I20260709 13:18:24.135248  8102 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:18:24.136251  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:24.136567  8102 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:24.137970  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:24.108103 13452 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:18:24.129846  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 122159us
I20260709 13:18:23.945125 13434 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:23.919514 13196 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:24.141218  8102 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 7. Preceding OpId from leader: term: 18 index: 7. (term mismatch)
I20260709 13:18:24.141808  8102 pending_rounds.cc:85] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 6
I20260709 13:18:23.883028 13448 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.142047  8102 pending_rounds.cc:107] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 17.7
I20260709 13:18:24.153923  8102 raft_consensus.cc:2889] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:24.161695  8252 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:24.161880  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:24.162578 13365 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:24.164105 13092 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:24.165325  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:24.165644 13223 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:18:24.166268  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 545757us
I20260709 13:18:24.166756  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:24.167088  8072 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:24.167945  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:24.168210  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:24.150827 13452 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:24.169562 13452 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:24.156338  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:24.108769  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:24.150135  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 219779us
I20260709 13:18:23.944897 13436 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:24.151607  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:24.187191  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:23.945276 13294 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.154585 13457 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:24.009449 13449 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.281544 13472 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:24.304651  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.297747 12753 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.121s
I20260709 13:18:23.915104 13456 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.271759 13474 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:24.297719 13455 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:24.351323 13196 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:24.352733 13396 consensus_meta.cc:287] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.000s
W20260709 13:18:24.355470 13462 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.339s	user 0.000s	sys 0.005s
I20260709 13:18:24.431329 13396 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.433234 13396 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:24.434350 13396 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.434792 13396 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.436739 13396 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:24.437165 13367 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:24.437784 13367 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.439788 13367 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:24.440717 13466 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.290s	user 0.008s	sys 0.000s
I20260709 13:18:24.355962  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:24.357815 13246 raft_consensus.cc:3055] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:24.441735 13246 raft_consensus.cc:740] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:24.443773 13478 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:18:24.443114 13246 consensus_queue.cc:260] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.358434 13446 raft_consensus.cc:3055] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:18:24.358994 13458 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.476s	user 0.000s	sys 0.001s
I20260709 13:18:24.444880 13246 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:24.361411 13301 consensus_meta.cc:287] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.001s
I20260709 13:18:24.363054 13480 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.445691 13301 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:24.363947  8104 consensus_meta.cc:287] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.601s	user 0.006s	sys 0.002s
I20260709 13:18:24.446947  8104 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:24.155786 12567 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:18:24.447784 13301 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:24.448856  8253 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:24.367911 13092 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:24.368300 13434 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:24.451081 13434 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.451495 13434 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.155499 13438 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:18:24.395498 13309 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:18:24.373746  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 217472us
I20260709 13:18:24.374449  8223 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:24.353209 13249 consensus_meta.cc:287] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.711s	user 0.008s	sys 0.002s
I20260709 13:18:24.391537  8176 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:18:24.393528  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 235769us
W20260709 13:18:24.392210  8249 consensus_meta.cc:287] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.000s
W20260709 13:18:24.394878  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 232596us
W20260709 13:18:24.403169  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 236144us
I20260709 13:18:24.457612  8249 raft_consensus.cc:2410] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:18:24.423395 13308 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:24.424984 13448 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:24.426184 13294 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:24.428678 13456 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:24.429487 13455 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:24.411342 13474 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:24.445907 13480 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:24.441764  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 85943.4us
I20260709 13:18:24.369091 13223 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:24.422789 13473 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.463572  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:24.464280  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:24.444890 13446 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:24.454084 13309 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:24.466230  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 91896.1us
I20260709 13:18:24.466734 13367 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:24.516021  8174 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 12: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:24.466430 13249 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.467456  8072 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:24.481910  8149 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:18:24.461791 13411 consensus_meta.cc:287] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.983s	user 0.014s	sys 0.006s
I20260709 13:18:24.493284  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:24.506683 13452 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.465817  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:24.483852 13471 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.295s	user 0.002s	sys 0.007s
I20260709 13:18:24.462329 13301 raft_consensus.cc:2764] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:18:24.511405  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.513269  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:24.483271 13092 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:24.524641  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:24.525343  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 43568.1us
I20260709 13:18:24.544349  8149 leader_election.cc:400] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16.
I20260709 13:18:24.492826 13474 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:24.521483 13448 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.534792  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:24.551162  8255 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 16: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:18:24.547582  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 80183.4us
I20260709 13:18:24.552182  8072 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:24.497614 13436 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:18:24.510156 13456 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:18:24.556095  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:24.556978  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:24.537223 12753 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:24.518141 13410 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:18:24.556135  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:24.544943 13196 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:24.565259  8072 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:24.510453 13473 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.556506  8248 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
W20260709 13:18:24.592223  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 43678.5us
I20260709 13:18:24.547251 13416 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.593910  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:24.596763  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:24.598749  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:24.536914 13411 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:24.602589  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:24.569175 12721 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.612103  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:24.563199 13475 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:24.587471 13367 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:24.604807  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:24.621692  8250 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:18:24.622160  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:24.606274 13396 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:24.564117 13448 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:24.623767  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:24.624064  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 68623.6us
I20260709 13:18:24.625072  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:24.624522 13092 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.602149 13469 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:24.610119 13426 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:24.639451  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:24.615130 13475 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.622855  8255 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:18:24.618367 13432 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.574503 13446 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.625104 13410 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:24.611435 13365 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:18:24.630931 13396 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:24.645135 13431 consensus_meta.cc:287] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.715s	user 0.014s	sys 0.000s
I20260709 13:18:24.642400 13469 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.648939 13426 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:24.663525 13426 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:24.664453 13457 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.674306  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:24.674763 13411 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:24.688561 13308 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:24.688398 13431 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:24.710071  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 70684.2us
I20260709 13:18:24.650746 13410 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.694885 13249 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:24.617779 12721 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.646576 13475 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.708660  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:24.711702  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:24.690733 13337 consensus_meta.cc:287] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.002s
I20260709 13:18:24.640230 12886 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:18:24.659145 13396 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:24.646745 13224 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:18:24.659931 13469 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.660442 13436 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:24.710048 13196 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:24.759797  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 102008us
I20260709 13:18:24.737757 13410 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.758245 13432 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:24.777144 13452 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:24.760915 13449 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:24.762768 13480 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:24.768981 13455 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:24.772346 13249 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:24.758113 13337 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:24.790094  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2939) took 1077 ms. Trace:
I20260709 13:18:24.780866 13436 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.769867 13196 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:24.814549 13436 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.783672 12886 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:24.790895 13248 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.801668  8256 rpcz_store.cc:276] 0709 13:18:23.712543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.901359 (+188816us) service_pool.cc:224] Handling call
0709 13:18:23.901805 (+   446us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:23.932683 (+ 30878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.932724 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:23.933405 (+   681us) log.cc:844] Serialized 78 byte log entry
0709 13:18:24.334031 (+400626us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:24.609045 (+275014us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.763302 (+154257us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.789593 (+ 26291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.789709 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:24.789778 (+    69us) raft_consensus.cc:1685] finished
0709 13:18:24.789798 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.789999 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40138,"prepare.queue_time_us":88260,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":102,"raft.queue_time_us":55969,"raft.run_cpu_time_us":11507,"raft.run_wall_time_us":164358,"thread_start_us":625351,"threads_started":3,"wal-append.queue_time_us":332899}
I20260709 13:18:24.826406  8182 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:24.797385 13249 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:24.800601 13488 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:24.836330  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 179660us
I20260709 13:18:24.837059  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:24.830564 13248 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.818864 12886 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:24.833253 13249 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:24.848781  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:24.800611 13483 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.186s
W20260709 13:18:24.847577  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 76949.2us
I20260709 13:18:24.818856 13443 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.224s
I20260709 13:18:24.836730 13473 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:24.851871  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:24.865541 13486 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:18:24.853521 13488 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:24.913350 13488 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.902647  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:24.906689 13448 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:24.855696 13431 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:24.865855 13500 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.866191 13494 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.880944 13467 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:24.915668  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 63840.2us
W20260709 13:18:24.916414  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 67710.6us
I20260709 13:18:24.860002 13480 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:24.923794  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:24.927582  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:24.927925  8179 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:24.928540  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:24.928810  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:24.928594  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:24.929498  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:24.935076 13475 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.935972  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:24.936347 13438 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:18:24.868012 13491 log.cc:927] Time spent T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:18:24.868603 13493 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:18:24.872300 13492 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:24.913828 13488 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.878908 13436 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:24.872485 13092 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.866037 13490 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:24.973193  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:24.973491  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:24.987056  8100 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:24.856438 13434 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:24.975984  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:24.974638  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:24.943799 13308 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:24.998342 13480 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:24.998893 13480 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 16 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:24.999804 13480 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.927945 12567 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:25.001777 12567 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:25.001592 13502 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:18:24.869601 13309 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:24.966429 13453 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:24.982569  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:24.968350 13438 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:25.051029  8108 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:18:25.057353  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 60567.6us
I20260709 13:18:25.068570  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:25.069229  8255 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:25.074154  8249 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:24.967485 13494 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:25.080469  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:24.987085 12721 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:24.989401 13490 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.100809  8255 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:25.102962  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.103248  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.110582  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.109184  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.103646  8108 raft_consensus.cc:2376] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13. Re-sending same reply.
I20260709 13:18:25.112040  8106 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:25.121126  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.124784  8249 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:25.125792  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:25.004928 13092 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:25.128278  8108 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 15: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:18:25.132637  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.133917  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.002795 12567 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:24.974139 13500 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:25.099006 13452 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.140081 13515 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:25.101151 13490 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:25.143885  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:24.990804 12886 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:25.137651  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.113360 13502 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:25.104141 13449 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.133234  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:24.968991 13467 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:25.054745 13453 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:25.146972  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:25.136341  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.156956  8790 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:25.162807  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:25.165704  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2936) took 1469 ms. Trace:
I20260709 13:18:25.171280  8147 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:25.171839  8099 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:18:25.166129  8254 rpcz_store.cc:276] 0709 13:18:23.691246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.793270 (+102024us) service_pool.cc:224] Handling call
0709 13:18:23.814686 (+ 21416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.435527 (+620841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.435557 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.436037 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:18:24.565630 (+129593us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:24.566023 (+   393us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.566503 (+   480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.691419 (+124916us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b5400197154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:24.691493 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.152881 (+461388us) raft_consensus.cc:1685] finished
0709 13:18:25.160339 (+  7458us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.160502 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8561,"prepare.queue_time_us":942,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":9720,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":151,"spinlock_wait_cycles":1407207808,"thread_start_us":129227,"threads_started":1,"wal-append.queue_time_us":222592}
I20260709 13:18:25.174557  8257 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:18:25.174716  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.175740 12753 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:25.176147 12753 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.176496 12753 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.177919 13495 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.178476 13495 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:25.181034 13495 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:25.184302 13500 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:25.186165 13507 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:18:25.188720  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2940) took 1474 ms. Trace:
I20260709 13:18:25.189118  8252 rpcz_store.cc:276] 0709 13:18:23.714043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.350929 (+636886us) service_pool.cc:224] Handling call
0709 13:18:24.351296 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:24.419869 (+ 68573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.419917 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:24.462191 (+ 42274us) log.cc:844] Serialized 52 byte log entry
0709 13:18:24.708784 (+246593us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:24.741371 (+ 32587us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.741609 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.741678 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.188513 (+446835us) raft_consensus.cc:1685] finished
0709 13:18:25.188531 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.188667 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45595,"prepare.queue_time_us":43833,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":78192,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":7034,"thread_start_us":193757,"threads_started":1,"wal-append.queue_time_us":276056}
I20260709 13:18:25.191118  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:25.188199 12753 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:25.196328 12753 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:25.203061  8107 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:18:25.204419  8107 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:18:25.147462 13452 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:25.206501 13092 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:25.208989  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 55673.7us
W20260709 13:18:25.210204 13509 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:25.210542  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.211390 13434 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:25.138232 13438 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:25.212852 13438 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:25.213608 13502 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:25.216992  8100 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:25.219244 13249 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:25.222792 13467 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:25.156219 12567 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:25.235091  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.235849  8250 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:25.236750  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:25.241953 13337 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:25.243515 13411 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:25.244014 13453 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:25.245976  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:25.247246  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:25.248335  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:25.248692 13494 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:25.163681 13449 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:25.251343 13449 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:25.253230 13452 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:25.254076  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:25.254660  8254 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.256291 13469 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:25.259868 13410 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:25.260821  8099 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:25.260999  8253 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:25.262585  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.263284  8253 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:25.264029  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:25.265020  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:25.268150 13474 consensus_meta.cc:287] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.000s
I20260709 13:18:25.268597 13474 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:25.269750 13475 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:25.273952 13309 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.277963  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.278973  8250 raft_consensus.cc:2410] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:18:25.280439  8104 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:25.282493 13457 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:25.282874  8221 leader_election.cc:336] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.533s (SENT)
I20260709 13:18:25.283352  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:25.285976 13495 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:25.297789 13496 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.298344 13496 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:25.298949  8183 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:25.300292  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:25.300645  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:25.300848 13496 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:25.301355  8108 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:25.302233  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.303015  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:25.304255  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:25.306046 13249 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:25.306102  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.271733 13410 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:25.323019 13410 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:25.323714 13449 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:25.323958  8221 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.325179 13449 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:25.325389  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:25.317672  8107 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:18:25.318109  8181 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:25.326196  8253 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.318486  8791 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:25.309594 13495 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:25.327986 13495 consensus_queue.cc:1243] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:25.319598 13474 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:25.320590 13396 consensus_meta.cc:287] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.004s
I20260709 13:18:25.323412 13410 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:25.332832  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:25.319175  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:25.334764  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:25.333591  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:25.340489  8256 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:25.335722  8108 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:25.340927  8100 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:25.340900  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.320181  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.344230  8174 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:25.346602 13456 raft_consensus.cc:3055] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:25.347040 13456 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:25.354954  8254 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:25.362221  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:25.361626  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:25.364792  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:25.366936  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:25.367674  8788 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:25.369496  8788 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:25.371812  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:25.371806  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:25.358749  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.330564 13196 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:25.382072  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.389840  8254 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:25.389953  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.370739  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:25.345068 13410 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.393785  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.394937  8105 raft_consensus.cc:2410] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:18:25.393071  8100 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:25.395491  8783 raft_consensus.cc:2393] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 16: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:25.349313 13452 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:25.397188  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:25.397397  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:25.398128  8785 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:25.273278 13515 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:25.417070  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 45380.4us
I20260709 13:18:25.418632  8786 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:25.347981 13456 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:25.419621  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:25.427394  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:25.379448 13249 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:25.349089 13396 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:25.427637  8254 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:25.420156  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.429059  8253 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:25.430050  8100 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:25.431141  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:25.433387  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 87869.3us
I20260709 13:18:25.353156 13490 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:25.434198  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.436306  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:25.441296  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.441797  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:25.442931  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.443765  8100 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:25.444948  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.450469  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:25.456332  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:25.462738 12567 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:18:25.466899  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:25.466800  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.467790  8108 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:25.469992  8782 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:25.478034 12567 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:25.474565  8100 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:25.478485 12567 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:25.479336 12567 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:25.480353 12567 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:25.480376  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.447571 13473 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.429296 13308 raft_consensus.cc:697] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:25.484210  8784 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:25.488786  8254 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:25.489786  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:25.490552  8101 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:25.454259 13515 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.449226 12721 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:25.449059 13443 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.504900 13308 consensus_queue.cc:237] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:25.465567 13452 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:25.513590  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:25.513936 13517 log.cc:927] Time spent T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:18:25.461680 13480 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:18:25.510449  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 76306.3us
I20260709 13:18:25.478211 13456 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:25.521257  8100 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:18:25.522055  8101 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:18:25.485378 13474 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:25.523342  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.508399 13249 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:25.526103  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:25.539731  8786 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:25.531140 13490 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:25.533661  8782 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:18:25.536960  8100 pending_rounds.cc:85] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 5
I20260709 13:18:25.511577 13448 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:25.543083  8108 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:18:25.546546  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.569052  8100 pending_rounds.cc:107] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:18:25.574501  8100 raft_consensus.cc:2889] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:25.524304 13475 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:25.535015 13092 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:25.585791 13448 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:25.585976 13092 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:25.588204 13448 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:25.588685 12753 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:25.588920 13092 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:25.524822 13443 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:25.594849 13443 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:25.568858 13469 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:25.541852 13249 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:25.598218 13249 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:25.592049  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:25.601459  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:25.602159  8784 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 10: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:25.603257  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.601153  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:25.607261 13494 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:25.608685  8101 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:25.610702  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:25.611744  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.612393  8102 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:25.605614 13452 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:25.604415 13309 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:25.569851 13495 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:25.617177  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:25.617926  8254 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 15: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:25.617937  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:25.599012 13475 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:25.590241 13396 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:25.613152 13499 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:25.618337  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.600664  8787 raft_consensus.cc:2955] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 13 LEARNER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:18:25.622584  8253 raft_consensus.cc:2410] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:18:25.621582  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:25.518846 12721 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:25.623468  8102 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.625761  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.624888  8254 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:18:25.626184  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:25.630534  8254 pending_rounds.cc:85] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 9
I20260709 13:18:25.630700  8180 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.626801  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:25.627771  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:25.628116  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:25.628095  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:25.630892  8254 pending_rounds.cc:107] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:18:25.632279  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:25.632385  8254 raft_consensus.cc:2889] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:25.633368  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:25.629849  8072 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:25.635673  8782 raft_consensus.cc:2410] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:18:25.637601  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.631423  8182 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:25.647573  8256 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 6. Preceding OpId from leader: term: 18 index: 7. (index mismatch)
I20260709 13:18:25.663333 13499 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:25.663905 13499 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:25.664763 13499 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:25.668934  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:25.532941 13488 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:25.634900 13452 consensus_queue.cc:1059] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 13:18:25.670037  8182 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:25.761413  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:25.700083  8178 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14. Ops: []
W20260709 13:18:25.767066  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.771791  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 138487us
I20260709 13:18:25.779565  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:25.771993  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 146331us
I20260709 13:18:25.767441  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:25.693291  8250 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:25.780601  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.773118  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.773581  8072 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.636368 13416 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:25.783250  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:25.787686  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.788455  8250 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:25.789522  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:25.790084  8181 raft_consensus.cc:2410] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:18:25.790248  8250 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.790895  8105 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:25.783416  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:25.784741 13479 consensus_queue.cc:1059] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:25.634621 13092 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:25.666453 13025 raft_consensus.cc:3055] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:25.802505  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.808604  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.751322  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.646684 13448 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.811389  8107 raft_consensus.cc:2410] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:18:25.803462  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.792712  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:25.666051 13467 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:25.751053 13473 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:25.812626  8256 raft_consensus.cc:2393] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 16: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:25.815817  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.812704  8789 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 16: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:25.813612  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:25.817757  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:25.818624  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:25.785868 13499 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:25.823278  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:25.765331 13248 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:25.830335  8248 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:25.833122  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:25.834182  8108 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 14: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:25.814635  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:25.826920  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.827378  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1470) took 1321 ms. Trace:
I20260709 13:18:25.840907  8257 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:25.836272  8791 rpcz_store.cc:276] 0709 13:18:24.498616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.499538 (+   922us) service_pool.cc:224] Handling call
0709 13:18:24.510549 (+ 11011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.326942 (+816393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.820132 (+493190us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54007201d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:25.820235 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1857468800}
I20260709 13:18:25.835821  8252 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:25.805989 13396 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:25.785398 13475 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:25.845929  8248 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:18:25.806188 13494 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:25.851724  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:25.841130  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:25.849210  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.691080 13434 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.141s
I20260709 13:18:25.811662 13025 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:25.850112  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.828032 13474 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:25.859334  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:25.847409  8248 pending_rounds.cc:85] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 10
I20260709 13:18:25.863744  8248 pending_rounds.cc:107] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:18:25.827168 13490 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:25.864112  8248 raft_consensus.cc:2889] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:25.832993 13502 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:25.862217  8791 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:25.828900 13456 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:25.825413 13467 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:18:25.865818  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.847283 13092 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:25.848244 13452 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.873768  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.851275 13448 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:25.826988 13515 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:18:25.894250  8180 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:25.854203 13449 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:18:25.897850  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:25.897979  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.898427  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:25.899777  8108 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:25.901819  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:25.863349 13474 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.864144 13396 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 16 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:25.906818  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:25.866458 13416 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:25.868151 13490 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.871920 13467 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.897842 13337 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.916128  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:25.922510  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:25.917057  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:25.896719 13494 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:25.912700 13516 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:25.878026 12721 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:25.878085 13502 raft_consensus.cc:697] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:25.922392  8108 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:25.923130  8791 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:25.927449  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:25.915050 13474 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.940364  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:25.918386 13416 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.946376  8180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:25.960047 13416 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:25.960167  8180 raft_consensus.cc:606] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:25.928200 13337 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:25.962257 13530 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:18:25.962718 13337 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:25.940296 13249 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:25.963862  8790 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:25.946200 13494 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:25.959606  8106 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:25.917663 13092 raft_consensus.cc:3055] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:25.961136  8785 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:25.923581 13456 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:25.921085 13490 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.946406 13457 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:25.928517 13480 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
W20260709 13:18:25.986300  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 73239.4us
I20260709 13:18:25.934836 13515 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:25.971838 13092 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:18:26.008323  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 228826us
W20260709 13:18:25.972983 13410 consensus_meta.cc:287] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 13:18:26.015479  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:25.976662 13456 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:18:26.034494  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 260968us
I20260709 13:18:26.032282  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:26.036816  8103 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:26.037770  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 49488.3us
I20260709 13:18:26.017294  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:26.040416  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:26.045380  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:26.006569 13488 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:26.056082 13438 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:26.056644 13438 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:26.035460  8072 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:26.052117  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:25.925889 13025 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:26.057720 13438 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.058841  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:26.059283 13438 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:26.068984 13473 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:26.069622 13473 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:26.070719 13473 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.072736 13473 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:26.014473 13434 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.018147 13516 raft_consensus.cc:697] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:26.028693 13457 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:26.049978 13448 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:26.114326  8103 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
W20260709 13:18:26.116145  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 72124.4us
W20260709 13:18:26.132730  8102 consensus_meta.cc:287] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.001s
I20260709 13:18:26.029819 13410 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.133175  8102 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
W20260709 13:18:26.116744 13537 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:18:26.103600 13434 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.015175 13396 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.167562 13434 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:26.168184 13434 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:26.169893  8106 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:18:26.146549 13536 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:18:26.147433 13249 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:26.152590 13248 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:26.153124  8180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:26.197273  8180 raft_consensus.cc:606] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:26.173833 13542 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:26.153831 13343 consensus_queue.cc:1059] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:26.156062 13309 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:26.158185 13479 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:26.158811 13543 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:26.159500 13516 consensus_queue.cc:237] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:26.117369 13092 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.120719 13457 raft_consensus.cc:697] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:26.162314 13494 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:26.175351  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:26.176614  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 52351.6us
I20260709 13:18:26.184989  8250 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:26.191759  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:26.193104  8101 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:18:26.135020 13533 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.225s	user 0.001s	sys 0.001s
I20260709 13:18:26.036299 13502 consensus_queue.cc:237] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.193866 13196 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:26.225217 13543 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:26.194275 13541 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:18:26.198659 13523 consensus_queue.cc:1059] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:18:26.217163 13410 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:26.217590 13434 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:26.225466  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 366186us
I20260709 13:18:26.200220 13542 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.194090 13448 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:18:26.208513  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 2949) took 1209 ms. Trace:
I20260709 13:18:26.281587  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:26.282857  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1833) took 1063 ms. Trace:
I20260709 13:18:26.284832  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:26.278262  8251 rpcz_store.cc:276] 0709 13:18:24.999537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.003999 (+  4462us) service_pool.cc:224] Handling call
0709 13:18:25.004285 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.075157 (+ 70872us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:25.114829 (+ 39672us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.604356 (+489527us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b18004b87a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec23a 00007fa5a0e56a2a
0709 13:18:26.042053 (+437697us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.046398 (+  4345us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:26.053905 (+  7507us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.054087 (+   182us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:26.054133 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.057692 (+  3559us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.208245 (+150553us) raft_consensus.cc:1685] finished
0709 13:18:26.208273 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.208439 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55153,"prepare.queue_time_us":414829,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":82,"raft.queue_time_us":49654,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":55734,"spinlock_wait_cycles":3322624,"thread_start_us":436033,"threads_started":2,"wal-append.queue_time_us":782964}
I20260709 13:18:26.210212 13416 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:26.138332 13456 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.265868 12567 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:18:26.267688  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 340325us
I20260709 13:18:26.283296  8099 rpcz_store.cc:276] 0709 13:18:25.219265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.261766 (+ 42501us) service_pool.cc:224] Handling call
0709 13:18:25.650973 (+389207us) spinlock_profiling.cc:243] Waited 58.1 ms on lock 0x7b5800002798. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:18:26.281354 (+630381us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b5800002798. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27e9c 00007fa59dd27a5b 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:18:26.282774 (+  1420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147339392}
W20260709 13:18:26.293785  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.295082  8180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:26.295859  8180 raft_consensus.cc:606] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:26.271064 13092 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:26.267863 13543 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:26.302205  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.307363 13457 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.309052 13416 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:26.309854 13456 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:26.311688  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:26.303141  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:26.321811  8101 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:26.360397 13496 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:26.361076 13496 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:26.362231 13496 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:26.363943 13496 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:26.366008 13475 raft_consensus.cc:3055] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:26.366492 13475 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:26.367497 13475 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.368680 13475 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:26.370712 13550 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:18:26.371857 13538 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
I20260709 13:18:26.381290 13223 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:26.381515 13443 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:26.384030  8180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:26.384618  8180 raft_consensus.cc:606] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:26.384941  8180 raft_consensus.cc:614] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:26.386061 13504 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:26.386204  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 83185.9us
I20260709 13:18:26.387004  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:26.388136  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:26.388821 13523 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:26.389467 13523 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:26.389782 13523 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.390102 13523 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:26.390791 13224 raft_consensus.cc:3055] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:26.391160 13224 raft_consensus.cc:740] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:26.391913 13224 consensus_queue.cc:260] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.284825 13542 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:26.393940 13438 consensus_queue.cc:1059] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:26.395175 13505 raft_consensus.cc:3055] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:26.395572 13505 raft_consensus.cc:740] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:26.396418 13505 consensus_queue.cc:260] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.397866 13337 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:26.399633  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:26.401086  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:26.404599  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.398227 13505 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:26.381906 13223 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:26.410892  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 352580us
I20260709 13:18:26.340473 13490 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.411666  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:26.393249 13224 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:26.415953 12567 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:26.416548 12567 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:26.372956 13550 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:18:26.419700  8149 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:26.320844 12753 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:18:26.424189  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 365431us
I20260709 13:18:26.411659  8072 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:26.433550 12567 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.440107  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:26.441524  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:26.443043  8788 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:26.412592 13410 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:26.412361 13416 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:26.447186  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:26.419389 13443 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:26.462379  8180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:26.464907  8180 raft_consensus.cc:606] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:26.442701 13436 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:26.446048 13337 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:26.421273 13474 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.452512 13541 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:26.461269 13467 consensus_meta.cc:287] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 13:18:26.483019  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:26.480072 13555 log.cc:927] Time spent T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:18:26.485639  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:26.489933  8786 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:26.467998 13443 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:26.454574 13410 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:26.494417  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:26.496515  8784 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 13 LEARNER]: Advancing to term 14
I20260709 13:18:26.457415 13416 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:26.502610 12886 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:26.505071 13490 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:26.506064  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:26.507373  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:26.512156 13543 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:26.513293 13434 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:26.513602 13541 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:26.513840 13434 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.514286 13434 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:26.486938 13479 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:26.491670 13436 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:26.543102  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:26.551498  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 44185.2us
W20260709 13:18:26.554282  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 117329us
I20260709 13:18:26.486130 13467 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.573887  8256 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:18:26.459793 13223 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:26.601002  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 291588us
I20260709 13:18:26.601449  8074 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:26.604480  8250 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: [18.7-18.7]
I20260709 13:18:26.567400 13248 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.612042  8253 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:26.607601  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:26.606662 13499 consensus_meta.cc:287] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.772s	user 0.009s	sys 0.003s
I20260709 13:18:26.621956  8250 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:26.617945  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:26.626865  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:26.611817 13558 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:18:26.585824 13426 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:18:26.643528 13543 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:26.609222 13436 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:26.644733  8782 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:26.634950  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:26.622464 13448 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:26.648124  8074 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:26.654579 13547 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:26.640784 13559 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:26.655865 13559 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.656119 13410 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:26.656308 13559 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:26.656773 13410 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.657300 13410 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:26.658195 13567 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:26.658658 13567 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:26.659058 13567 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:26.659649 13410 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:26.664467 13448 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:26.664975 13448 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.619660 13248 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.667733 13248 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:26.668161 13448 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:26.668305  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:26.668746  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:26.669543  8108 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:26.669762 13446 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:26.672392 13543 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:26.673249 13543 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:26.674896 13474 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:26.675938 13416 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:26.676820 13436 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:26.680356 13467 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:26.622977 13443 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:26.683868 13542 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.685153  8101 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 15: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:26.685163  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:18:26.689006  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.702625  8790 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:26.703557  8784 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 14 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:18:26.698813  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 45237.8us
W20260709 13:18:26.645231 13564 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:18:26.639005 13541 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:26.709367  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:26.707626  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:26.710279  8787 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:26.712352  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:26.711508  8147 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:26.614270 13560 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:18:26.728479  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:26.706107 13495 raft_consensus.cc:3055] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:26.728201  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:26.731889 13547 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:26.747479  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 139968us
I20260709 13:18:26.747808  8074 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:26.749507  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:26.749657  8074 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:26.721395 13248 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:26.762344  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1829) took 1449 ms. Trace:
I20260709 13:18:26.735693 13196 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:26.768656  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:26.768814 13196 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:26.769290  8108 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
W20260709 13:18:26.770067  8789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1037) took 1398 ms (client timeout 1642 ms). Trace:
I20260709 13:18:26.770344  8791 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:18:26.770556  8789 rpcz_store.cc:269] 0709 13:18:25.371383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.371518 (+   135us) service_pool.cc:224] Handling call
0709 13:18:26.769844 (+1398326us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54004ac254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:26.769987 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010772736}
W20260709 13:18:26.775635  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:26.776171  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.736760 13495 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:26.778906  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:26.779711  8072 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:26.762743  8183 rpcz_store.cc:276] 0709 13:18:25.302036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.304808 (+  2772us) service_pool.cc:224] Handling call
0709 13:18:25.305142 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.306781 (+  1639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.306828 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:25.941506 (+634678us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b2c000e6688. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:18:25.949886 (+  8380us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.321345 (+371459us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:26.321409 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.321621 (+   212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.738990 (+417369us) raft_consensus.cc:1685] finished
0709 13:18:26.739010 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.751587 (+ 12577us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1214,"raft.queue_time_us":1331,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":85346560,"thread_start_us":330808,"threads_started":1,"wal-append.queue_time_us":488358}
I20260709 13:18:26.786067  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:26.786870  8105 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:26.822284  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:26.823379  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:26.751462 13499 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.758371 13092 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:26.759377 13248 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.826608  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:26.832474  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 47666.5us
W20260709 13:18:26.826561  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 46953.4us
I20260709 13:18:26.828203  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:26.833186  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:26.770891 13196 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:26.772662 13541 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:26.772378 13494 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:26.840334  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.838145  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:26.838217 13590 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:26.743283 13502 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:18:26.840903  8106 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:26.837610  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:26.838893  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:26.777248 13577 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:26.848718  8179 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:26.849329  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:26.751718 13547 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:26.844295 13561 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:18:26.831219 13542 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:26.891644  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:26.894574  8102 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:26.856634  8789 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:26.836584 13248 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:26.867926  8786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48110 (request call id 1484) took 1050 ms. Trace:
I20260709 13:18:26.904858  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:26.850400 12886 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.907323  8786 rpcz_store.cc:276] 0709 13:18:25.817747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.818398 (+   651us) service_pool.cc:224] Handling call
0709 13:18:26.867709 (+1049311us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b540051a4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:26.867860 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541889280}
I20260709 13:18:26.836724 13499 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:26.907524 13475 consensus_meta.cc:287] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.002s
W20260709 13:18:26.939952 13573 log.cc:927] Time spent T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:18:26.940936 13574 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:18:26.941213 13556 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 13:18:26.942852 13579 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:18:26.946314 13571 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 13:18:26.947443 13569 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:18:26.948339 13563 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260709 13:18:26.953625 13565 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:18:26.955179 13590 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:26.959898 13434 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:26.968434 13456 consensus_meta.cc:287] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.003s
I20260709 13:18:26.885145 13581 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:26.972419 13523 consensus_meta.cc:287] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.000s
I20260709 13:18:26.892628 13582 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:26.975087  8106 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:26.977485 13583 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:26.904279 13436 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.905668 13495 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:26.995792 13578 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:26.996316 13410 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:26.997148  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:26.923378 12886 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:26.914541 13308 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.024197  8108 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:26.834352 13543 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:27.049101 13516 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:18:27.029136 13505 consensus_meta.cc:287] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.004s
I20260709 13:18:27.057171  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:27.059152  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:27.059180  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:27.042917 13448 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.856386 13577 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:27.078696  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 81640us
I20260709 13:18:27.083029  8221 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:27.097227  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:27.077960 13582 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.056699 13590 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.060801 13523 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.111362  8221 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:27.091499 13583 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:18:27.129526  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 292027us
I20260709 13:18:27.129477  8221 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:27.054755 13581 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.068320 13436 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.131188  8221 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:27.111347 13495 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:27.126266 13224 consensus_meta.cc:287] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.704s	user 0.013s	sys 0.001s
I20260709 13:18:27.109064 13494 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:27.134228  8103 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:18:27.107585 13556 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:27.121593 13410 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:27.141637  8176 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:27.090461 13308 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.094399 13448 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:27.131374  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:27.127264 13452 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:27.139724  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:27.137367 13456 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:27.145669  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:27.102061 13516 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.151755 13559 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.168238 13577 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:27.169503 13585 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:18:27.169881 12886 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:27.147285 13410 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:27.135877 13589 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:27.192512 13410 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.142891 13583 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:27.192965 13410 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:27.193163 13583 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.193647 13583 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:27.192746 13589 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.143827 13556 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:27.170303 13434 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.172034 13499 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:27.199765  8180 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:27.199916 13559 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.201689  8182 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:27.202808 13556 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.203919 13590 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.205572 13343 raft_consensus.cc:993] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:18:27.205727 13516 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.206112 13343 raft_consensus.cc:1081] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:18:27.207418 13581 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:27.208526  8782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1486) took 1373 ms. Trace:
I20260709 13:18:27.208900  8782 rpcz_store.cc:276] 0709 13:18:25.835460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.836057 (+   597us) service_pool.cc:224] Handling call
0709 13:18:25.836415 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.668392 (+831977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.208304 (+539912us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b5400531954. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:27.208469 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1851525888}
I20260709 13:18:27.210590  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 856) took 1304 ms. Trace:
I20260709 13:18:27.210955  8791 rpcz_store.cc:276] 0709 13:18:25.906389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.953041 (+ 46652us) service_pool.cc:224] Handling call
0709 13:18:26.770126 (+817085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.770810 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.210417 (+439607us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54004ac250. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:27.210536 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878323456}
I20260709 13:18:27.215619  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:27.174466  8183 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:27.174672 13449 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:27.127121 13582 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:27.179147 13308 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:27.182097 13567 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.523s	user 0.014s	sys 0.000s
W20260709 13:18:27.183156  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 43511.9us
I20260709 13:18:27.237883  8221 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:27.183509 13025 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:27.238379 13473 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.238896 13473 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:27.240058  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:27.240865 13473 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.242112  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:27.242338  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:27.242676  8181 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:18:27.243057  8248 raft_consensus.cc:2410] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:18:27.243533  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:27.244415  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:27.244697  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:27.186434 13523 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.245599  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:27.246160  8252 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:27.187098 13452 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:27.173256 13494 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:27.189775 13436 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.171661 13570 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.253360 13570 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.255478 13570 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.148132 13547 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.257368 13582 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:27.226995  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:27.222463 13449 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:27.251672  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:27.225696 13502 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:27.259999  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:27.260775  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:27.265787  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:27.266419  8103 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:27.267166 13440 raft_consensus.cc:3055] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:27.267597 13440 raft_consensus.cc:740] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:27.259353 13494 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.268493 13440 consensus_queue.cc:260] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:27.269757 13494 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:27.272212 13474 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:27.273557  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:27.274822 13248 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:27.275764 13440 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:27.276886 13248 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:27.234741 13457 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.281577  8252 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:27.282529  8250 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:18:27.285899  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.300120  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:27.300918  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:27.302101  8252 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:27.258656 13473 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:27.304747  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 77816.9us
I20260709 13:18:27.261515 13449 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.313922  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:27.314177  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:27.315398  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:27.288595 13581 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:27.248059 13567 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:27.323836  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 50358.6us
I20260709 13:18:27.323776 13604 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:27.330250  8785 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:27.330633  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:27.331622  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:27.331702  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:27.332432  8785 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:27.332407  8784 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:27.334456  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:27.313993 13494 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:27.307848 13596 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.336073  8255 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:27.312700 13599 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:27.312851 13556 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:27.349557 13583 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:27.350304 13556 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:27.350814 13556 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:27.307257  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:18:27.351833  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.347081 13452 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:27.348080  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:27.354357  8786 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:27.296742 13457 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:27.360889  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 53772.6us
I20260709 13:18:27.367790  8785 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:27.335469 13589 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.373339  8252 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:27.379256  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:27.323297 13473 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.380178  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:27.387876  8253 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:18:27.329377 13604 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:27.393137  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:27.391593  8251 raft_consensus.cc:2410] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:18:27.390487  8147 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:27.394692  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:27.395251  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:27.395843  8182 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:27.399490 13490 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:27.400367 13490 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:27.402127  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:27.403403  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:27.404201  8101 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:27.410724 13457 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:27.410880  8179 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:27.411751  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:27.412022  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:27.412472  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:27.417821  8249 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:27.413544  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:27.349344 13596 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.376993 13550 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:18:27.400952 13490 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:27.417924  8256 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:27.376587 13494 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:27.445855  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 55545.7us
I20260709 13:18:27.377054 13504 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.418076  8103 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:27.413249  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:27.394176  8174 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:27.381978 13496 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.444090  8105 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:18:27.449034  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:27.497871 13490 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.493855 13494 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:27.507050  8147 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:27.508771  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 95355.7us
I20260709 13:18:27.499053 13223 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:27.499361  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:27.501294  8251 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:27.454327  8252 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:18:27.505194  8074 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:27.514482  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:27.388365 13473 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:27.545496  8256 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:27.546263  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:27.547259  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:27.553467  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:27.555236  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:27.555506  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:27.449842 13589 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:27.412463 13567 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:27.495123 13550 consensus_queue.cc:1243] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:27.562592  8074 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:27.389357 13456 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 13:18:27.392175 13474 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.155s
I20260709 13:18:27.450667 13583 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:27.565750  8249 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:27.566936  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:27.598620  8182 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.391659 13343 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.157s
I20260709 13:18:27.504823 13469 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:27.510589 13494 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:27.473659 13457 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:27.570823  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 236617us
I20260709 13:18:27.697109  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:27.575991  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:27.594147  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:27.595149  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:27.698091  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:27.597100  8223 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:27.553704 13025 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:27.555073 13416 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:27.553550 13475 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:27.555822 13543 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:27.553884 13582 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:27.590463 13547 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:27.602886  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:27.649492  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:27.560187 13581 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.455427 13410 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:27.556643 13510 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:27.526954 13496 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.527518 13504 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.569963 13590 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:18:27.702528  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 126622us
I20260709 13:18:27.752724  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:18:27.703307  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 106302us
I20260709 13:18:27.705880  8183 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:27.701135 13309 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 16.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:18:27.722033  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.724602 13542 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:27.579493 13589 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.728575 13456 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:27.724043 13567 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.725098 13416 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:27.724929 13516 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.738920 13436 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.784541 13510 raft_consensus.cc:697] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:27.786609  8105 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
W20260709 13:18:27.792630  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 95612.6us
I20260709 13:18:27.705634 13457 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:27.785046  8178 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:27.834235  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:27.776036 13547 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:27.760470 13490 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:27.790179 13475 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.771422 13612 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:27.850925 13617 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:27.775857 13474 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.780756 13456 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.784886 13613 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:27.843199 13543 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:27.897918  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 319326us
I20260709 13:18:27.796904 13416 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:27.788830 13504 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.794729 13590 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:27.876502 13606 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:18:27.881584 13434 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.887130 13410 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:27.772996 13581 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.843676 13547 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:27.844647 13542 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.789652 13479 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:27.796291 13567 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.893777 13456 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:27.928653  8256 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:27.929332  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:27.946730  8105 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:27.930619  8252 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:27.888289 13596 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:27.846446 13516 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.890970 13495 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:27.957983  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:27.958165 13495 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.960168 13495 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:27.960583  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:27.960785  8182 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:27.961735  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:27.962780  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:27.845516 13436 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.891089 13582 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:27.964150  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:27.964401 13582 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.964916  8256 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:27.943713  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:27.901007 13604 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.867097 13475 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.966365  8103 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:27.967458 13475 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.950666  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:27.968640  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:27.970804  8100 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:27.954181  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:27.955269 13556 consensus_meta.cc:287] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.002s
I20260709 13:18:27.955667 13567 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:27.902184 13613 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:27.963771  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:27.965704 13436 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:27.972139  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:27.912696 13490 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:18:27.967914  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:27.893993 13474 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:27.939729 13343 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:27.970074  8105 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:28.096596 13343 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:28.097703 13496 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:28.097550 13343 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.7, Last appended by leader: 7, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:28.098547 13343 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:28.098727 13440 consensus_meta.cc:287] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.823s	user 0.009s	sys 0.002s
I20260709 13:18:27.982206  8099 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:27.968343 13596 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:28.102232  8182 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:27.943936 13547 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:27.933132 13434 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.063089  8256 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:18:28.074249  8100 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
W20260709 13:18:28.076246  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 234956us
I20260709 13:18:27.972186  8252 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:27.874984 13612 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:27.919184 13499 consensus_queue.cc:1059] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:18:28.076977  8181 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:27.918222 13224 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:18:27.912379 13543 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.919339 13590 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:27.950202 13410 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:28.056861 13607 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:18:28.084909  8257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57566
I20260709 13:18:28.088776 13582 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:28.063901 13556 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.091480  8108 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:18:27.967993 13475 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:28.055927  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:27.951134 13542 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.170704  8103 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:28.129292  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:28.127102  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:28.075116 13308 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.011s	sys 0.030s
I20260709 13:18:28.145015  8257 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:28.178900  8257 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:27.951064 13479 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.155831  8104 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:28.150597 13436 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.197974 13436 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:28.200129 13436 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:28.201797 13613 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:28.203356 13499 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.203840 13499 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:28.205842 13499 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:28.206225 12721 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.206734 12721 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.137439 13440 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.207571 13440 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.207888 13523 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:28.160189 13223 consensus_meta.cc:287] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.000s
I20260709 13:18:28.160377 13612 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:28.150636 13410 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:27.944968 13510 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.162786 13556 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:28.145094 13473 consensus_meta.cc:287] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.578s	user 0.005s	sys 0.005s
I20260709 13:18:28.164685 13543 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:28.218107  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 88891.9us
W20260709 13:18:28.137761 13449 consensus_meta.cc:287] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.810s	user 0.011s	sys 0.005s
I20260709 13:18:28.218860 13449 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:28.219851  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:28.221155 13449 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:28.218281 13473 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.222270 13612 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:28.223135  8790 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 11: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:28.223719 13612 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:28.224149 13473 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:28.126827  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:28.186450 13589 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:28.186810 13457 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:28.225993  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 122113us
I20260709 13:18:28.227608 13590 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:28.228121 13590 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:28.228526 13590 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:28.230942 13625 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:28.234086 13474 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:28.235263 13516 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:28.235359  8181 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:28.189035 13479 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:28.188647 13456 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.144454 13567 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.237757 13567 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.240147 13567 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:28.144510 13337 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.240834 13337 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.241823 13449 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:28.242421 13449 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.243230 13337 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:28.244741 13449 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:28.245252 13456 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:28.246042 13581 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:28.247529 13440 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:28.248379  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.210769 13591 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.249234  8248 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:28.249490 13591 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:28.250751  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 679) took 1207 ms. Trace:
I20260709 13:18:28.251480 13591 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:28.251294  8179 rpcz_store.cc:276] 0709 13:18:27.042872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.043584 (+   712us) service_pool.cc:224] Handling call
0709 13:18:28.250524 (+1206940us) spinlock_profiling.cc:243] Waited 65.5 ms on lock 0x7b54002495d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:28.250645 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150631680}
I20260709 13:18:28.169804 13621 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:28.157609 13475 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:28.179747 13308 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.011s	sys 0.030s
I20260709 13:18:28.208478 13523 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:28.218281 13556 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:28.246129  8249 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:28.252663  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.226034 13434 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:28.276383  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.277020  8256 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:28.277868  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.194602 13542 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:28.256538  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:28.138099 13596 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:28.258188  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60806 (request call id 692) took 1009 ms. Trace:
I20260709 13:18:28.263381  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.283217  8181 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:28.286263  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:28.270742  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:28.281649  8253 rpcz_store.cc:276] 0709 13:18:27.248379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.248489 (+   110us) service_pool.cc:224] Handling call
0709 13:18:28.257973 (+1009484us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400196c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:28.258108 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280832256}
I20260709 13:18:28.282733  8248 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:28.292826  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.294903  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:28.295749  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:28.298585  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:28.301981  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:28.302804  8179 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:28.309283  8791 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:28.312450  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:28.313308  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:28.313347  8785 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:28.313974  8182 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:28.312525  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.317593  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.311955  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:28.321791  8789 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:28.323920  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 53244.6us
I20260709 13:18:28.324900  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:28.328873  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:28.327155  8221 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:28.332582  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:28.334668  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:28.335486  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:28.335243  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:28.339491  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.340413  8105 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
W20260709 13:18:28.340983  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 50078.9us
I20260709 13:18:28.342566  8256 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:18:28.342967  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:28.342964  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:28.274937 13456 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.340063  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:28.345929  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:28.349072  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.350039  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:28.354748  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:28.358547  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:28.312495 13473 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:28.312958 13612 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:28.364207  8179 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:18:28.362471  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:28.229318 13590 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:28.348865 13613 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:28.322028 13556 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:28.339310 13542 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:28.338878 13550 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:28.369114  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:28.369071 13446 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:28.383965  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:28.345166 13457 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:28.345510 13434 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:28.350710 13479 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:28.298646 13416 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:28.356588 13604 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:28.321089 13224 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:18:28.362131 13396 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:28.336464 13449 consensus_queue.cc:1059] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:18:28.465894  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.463580 13542 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:28.334754 13629 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:28.346802 13502 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:18:28.264968 13621 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:28.481199  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 97329.5us
I20260709 13:18:28.447108 13223 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:28.369637 13543 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 13:18:28.363860 13456 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:28.463547 13490 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:28.460855 13613 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.467981 13550 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.356751 13624 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:28.489621  8248 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:28.494731 13542 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:28.494596  8783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1509) took 1164 ms. Trace:
I20260709 13:18:28.515046  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.436858 13622 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 13:18:28.515043  8783 rpcz_store.cc:276] 0709 13:18:27.329935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.331740 (+  1805us) service_pool.cc:224] Handling call
0709 13:18:27.332011 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.445351 (+113340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.445397 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:27.445472 (+    75us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:27.445528 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.494311 (+1048783us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400316854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:28.494373 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.494542 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260073216}
I20260709 13:18:28.460716 13343 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:18:28.480038 13434 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.523214 13434 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:28.523439 13410 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:28.392565 13612 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.526342 13612 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:28.500331  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.527339  8105 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:28.528420  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.529270  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.531235  8789 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:28.510774 13550 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:28.485754 13505 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:28.573671 13505 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.574146 13505 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:28.473971 13634 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:28.486418 13396 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.486405 13457 raft_consensus.cc:697] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:28.512302  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.578390  8248 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:28.579485  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.392285 13473 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.577826 13396 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:28.581683  8786 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:28.582774 13473 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:28.503283 13223 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:28.520454 13628 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:18:28.511649 13624 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:28.508550 13613 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:28.534499 13523 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:28.512991 13556 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.537623 13448 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:28.538472 13416 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:28.539238 13475 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:28.539559  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.607700  8101 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:28.607923  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:28.608707  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:28.608980  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:28.540639  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.548048 13547 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.551718 13596 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:28.552628 12721 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:28.553754 13446 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:28.598539 13456 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:28.559922 13621 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:28.564823 13494 consensus_meta.cc:287] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.860s	user 0.006s	sys 0.002s
I20260709 13:18:28.627628 13494 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:28.628116  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.628698  8250 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:28.629552  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.629683 13494 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:28.503659 13629 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.630100  8250 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:28.630942  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.631661 13629 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:28.577713 13634 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.632220 13634 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:28.634284 13625 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:28.634770  8251 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:28.634934 13625 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.636439  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.637017  8251 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:28.515810  8108 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:28.637305 13625 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:28.638084  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.639103  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.640071  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.640596  8108 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:28.580068  8248 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:28.529933  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:28.641888  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 112045us
I20260709 13:18:28.642042  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:28.642647  8248 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:28.644598  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:28.590610 13457 consensus_queue.cc:237] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.647320 13577 raft_consensus.cc:3055] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:28.647728 13577 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:28.591554  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.648474 13577 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:28.594440 13608 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.858s	user 0.003s	sys 0.012s
I20260709 13:18:28.595868  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.656919  8107 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:28.595508 13396 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.588581 13223 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:28.598524  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.599066 13624 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:28.604405  8257 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:28.609824  8105 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:28.663229  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:28.664258  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.614485  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.615658  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.618343  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.620396  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:28.501946  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 143537us
I20260709 13:18:28.666821  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:28.622787 13446 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:28.627099 13469 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.649989  8100 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:28.648434  8102 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:28.650619  8108 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:28.651027  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:28.675709  8101 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:28.652334  8250 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:28.652264  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.676903  8251 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
W20260709 13:18:28.658373  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 295952us
I20260709 13:18:28.679376  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:28.680384  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:28.662117  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.670982  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:28.674026  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:28.674484  8256 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 15: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:28.682773  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:28.684984 13224 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:28.681746  8107 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:28.690527  8256 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: [18.7-18.7]
I20260709 13:18:28.691861  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:28.656374 13543 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.695550  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:28.696157  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:28.696494  8256 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:28.655187 13577 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:28.689335  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:28.699644  8257 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:28.660737 13504 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:28.702134  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:28.707921  8250 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:28.672983 13615 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:28.686381 13469 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:28.688228 13475 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:28.688031 13448 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:28.702560 13589 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.714547  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:28.709216 13499 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:28.746481  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2720) took 1155 ms. Trace:
I20260709 13:18:28.685395 13224 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.752278  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:28.715911  8178 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1840) took 1335 ms (client timeout 1638 ms). Trace:
W20260709 13:18:28.813936  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 99494.5us
I20260709 13:18:28.839195  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:28.740836  8248 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:18:28.707566 13504 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.836218  8180 rpcz_store.cc:276] 0709 13:18:27.591445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.593818 (+  2373us) service_pool.cc:224] Handling call
0709 13:18:28.746269 (+1152451us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b5400247a54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:28.746413 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1823921920}
W20260709 13:18:28.838007  8178 rpcz_store.cc:269] 0709 13:18:27.380592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.380957 (+   365us) service_pool.cc:224] Handling call
0709 13:18:28.715695 (+1334738us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b5400332054. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:28.715836 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896387840}
I20260709 13:18:28.713515 13615 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.898304 13504 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:28.919247 13473 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:28.770795 13603 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:28.753120 13475 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.711087 13440 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.160s
I20260709 13:18:28.920107 13473 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:28.943041  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:29.023187  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.943238  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:28.810007 13448 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:28.944263  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:28.945241  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 2985) took 1007 ms. Trace:
I20260709 13:18:28.832492 13396 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:28.865291 13499 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:29.037464  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 94164.1us
I20260709 13:18:29.037998  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:28.944108  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:29.039067  8783 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:28.832913 13495 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:28.860630 13224 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:29.020138  8255 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:18:28.950691 13475 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:29.020711  8256 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 16. Ops: []
I20260709 13:18:28.833689 13581 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:28.833001 13583 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.859943 13457 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:29.021852  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 269647us
I20260709 13:18:29.024317  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:29.038832 13567 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.090816  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:28.905834 13615 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:29.091261 13567 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.031949  8249 rpcz_store.cc:276] 0709 13:18:27.937670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.940468 (+  2798us) service_pool.cc:224] Handling call
0709 13:18:28.945039 (+1004571us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54000c9c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:28.945186 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660787968}
I20260709 13:18:29.093622 13567 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:29.094204  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:29.095819  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:29.096536  8249 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:28.903116 13625 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:29.097929 13625 raft_consensus.cc:697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:29.099030 13625 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.040479  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:29.041791  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 98626.4us
I20260709 13:18:29.101969  8248 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:28.704221 13543 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.103152 13556 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.103669 13556 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:28.945211 13603 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:29.042729  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:29.034631 13448 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:29.080545  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:29.107879  8788 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:28.812531 13446 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.082011  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:28.864620 13589 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.041559 13499 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:29.087165  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.044492 13396 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:29.104657  8105 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:29.074323 13495 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.136996 13495 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:29.137583 13567 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:29.137632 13547 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:29.138509 13547 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:29.108246 13603 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:29.121948 13446 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:29.113190  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:29.143388  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:29.144856 13542 consensus_meta.cc:287] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.617s	user 0.005s	sys 0.001s
I20260709 13:18:29.145618 13456 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:29.146049 13456 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.146387 13456 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:29.148757 13505 consensus_meta.cc:287] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.574s	user 0.006s	sys 0.000s
I20260709 13:18:29.083190 13449 consensus_queue.cc:1059] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:18:29.149643 13449 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:29.150066 13449 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:29.150452 13449 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:29.153605 13416 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:29.154006 13416 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:29.154520 13473 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.155046 13473 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:29.154794 13416 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.155515 13473 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.156054 13416 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:29.157356  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:29.128268  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:29.084846 13581 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.158913  8254 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
W20260709 13:18:29.159904 13434 consensus_meta.cc:287] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.000s
I20260709 13:18:29.160008  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:29.160348 13434 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.163627 13396 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:29.164145 13396 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.166265 13581 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:29.166765 13496 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:29.168466 13496 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:29.121809 13590 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.170835 13590 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:29.175527 13550 consensus_meta.cc:287] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.000s
I20260709 13:18:29.165181  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:29.087749 13583 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:29.177731 13634 consensus_meta.cc:287] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.001s
I20260709 13:18:29.139091 13547 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:29.118983 13645 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:18:29.134351 13589 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:29.184337  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:29.217079  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 71670.8us
I20260709 13:18:29.219125  8102 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:29.149140 13505 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:29.210853  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 45742.7us
W20260709 13:18:29.118350 13646 log.cc:927] Time spent T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:29.130264  8221 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:29.160826  8254 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:29.132789 13556 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:29.223742  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:29.206689 13543 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.145255 13542 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.173364 13590 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:29.244535  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:29.246143  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 115968us
I20260709 13:18:29.260147  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:29.215775 13473 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:29.129292 13223 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.265272  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:29.214043 13516 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:29.223747 13567 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:29.274562 13567 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:29.275003 13567 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:29.275630 13583 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:29.246598 13589 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:29.276398 13589 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.276829 13589 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:29.269608  8254 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:29.278322 13434 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.254473 13025 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:29.279285 13025 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:29.266628 13590 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:29.281952 13590 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.282500 13223 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.283141 13223 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:29.283483 13223 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:29.216295 13634 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.285750  8106 raft_consensus.cc:2393] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:29.286052 13634 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.285089  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:29.255934  8221 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:29.286278 13590 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:29.292520  8791 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:29.293239 13547 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:29.294305  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:29.291693 13224 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.296949 12567 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:29.273801 13496 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:29.297552 12567 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:29.297935 13496 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.298382 13496 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:29.297256 13224 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.298569 12567 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.302181 12567 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:29.284305 13223 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.305084  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2902) took 1342 ms. Trace:
I20260709 13:18:29.305514  8103 rpcz_store.cc:276] 0709 13:18:27.962743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.967672 (+  4929us) service_pool.cc:224] Handling call
0709 13:18:29.304875 (+1337203us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b54003c32d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:29.304983 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202878336}
I20260709 13:18:29.310850 13542 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.311861 13496 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:29.300891  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 45047.7us
I20260709 13:18:29.332707 13410 raft_consensus.cc:3055] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:29.333175 13410 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:29.334110 13410 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.301342 13596 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:29.214370 13550 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.335492 13596 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:29.336378 13596 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.336827 13550 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:29.300289  8254 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:29.339483 13496 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.315515 13449 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:29.316286 13613 consensus_meta.cc:287] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
I20260709 13:18:29.340447 13613 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.266237 13440 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:29.342517 13613 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:29.267400 13632 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:18:29.264894 13495 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:29.345760 13449 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:29.324015 13567 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.325749 13396 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.331233 13448 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.347148  8099 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:29.347707  8783 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:29.349237  8255 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:18:29.289091  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:29.363021  8102 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:18:29.290474  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:29.367098  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:29.367820  8100 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:29.368899  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:29.371814  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:29.373279  8223 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:29.323906  8790 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48110 (request call id 1510) took 1993 ms (client timeout 1948 ms). Trace:
I20260709 13:18:29.308799 13475 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:29.376576  8790 rpcz_store.cc:269] 0709 13:18:27.330201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.330328 (+   127us) service_pool.cc:224] Handling call
0709 13:18:29.323688 (+1993360us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54004ced54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:29.323825 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050708864}
I20260709 13:18:29.386942  8100 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:29.296844 13603 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.342528 13440 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.398705  8105 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:29.377117 13577 consensus_meta.cc:287] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.671s	user 0.009s	sys 0.000s
I20260709 13:18:29.298669 13505 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:29.389598  8223 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.130:46389 timed out after 1.638s (SENT) [suppressed 4 similar messages]
I20260709 13:18:29.344558  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:29.412649  8001 catalog_manager.cc:5697] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:29.415089 13567 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:29.382225 13449 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:29.407562  8101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.007s	sys 0.007s
W20260709 13:18:29.423595  8101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.007s	sys 0.007s
I20260709 13:18:29.422169  8102 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:29.425845  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:29.428372  8100 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:29.432510  8100 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:29.433247  8174 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.008s	sys 0.007s
I20260709 13:18:29.392073 13495 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:29.436875  8147 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:29.407434 13440 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:29.476248 13624 consensus_meta.cc:287] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.790s	user 0.008s	sys 0.000s
I20260709 13:18:29.476708 13624 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.480530 13589 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.438431 13567 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:29.481863 13567 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.482457 13448 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.375459 13456 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.483793 13567 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:29.484421 13456 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:29.467161 13542 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:29.485057 13542 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.487071 13542 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.467413 13337 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:29.469460 13410 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:29.491066 13475 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:29.493525 13652 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:29.494065 13652 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.495967 13652 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:29.497066 13469 consensus_meta.cc:287] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.000s
I20260709 13:18:29.438359  8788 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:29.339519 13504 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.459849 13495 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.460071 13642 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:29.506011  8783 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:29.504665  8147 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:29.511487  8108 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:18:29.511778  8147 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:29.513862 13496 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:29.514555 13496 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:29.422482 13449 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.518230 13495 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:29.545459 13504 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.522707 13449 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:29.554833 13499 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.558367 13624 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.529277 13603 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.557163 13499 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.519168 13469 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.549762 13504 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.565644  8073 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.020s
I20260709 13:18:29.523108 13523 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:18:29.577608  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 700) took 1277 ms. Trace:
I20260709 13:18:29.577996  8252 rpcz_store.cc:276] 0709 13:18:28.300673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.683111 (+382438us) service_pool.cc:224] Handling call
0709 13:18:28.705219 (+ 22108us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:28.941686 (+236467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.941710 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:28.942189 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.390780 (+448591us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:29.390843 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.390942 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.577345 (+186403us) raft_consensus.cc:1685] finished
0709 13:18:29.577363 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.577542 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":236040,"raft.queue_time_us":240478,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":17062,"spinlock_wait_cycles":70016,"thread_start_us":448173,"threads_started":1,"wal-append.queue_time_us":633768}
I20260709 13:18:29.566907  8001 catalog_manager.cc:5697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 13 to 15, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 15 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:18:29.572917  8251 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.007s	sys 0.015s
W20260709 13:18:29.587616  8251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.008s	sys 0.015s
I20260709 13:18:29.587849  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:29.588363  8073 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.000s	sys 0.021s
I20260709 13:18:29.588605  8783 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 11: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:18:29.572590  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 481871us
I20260709 13:18:29.591692  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:29.595638  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:29.604472  8108 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 15: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:29.597028  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:29.589711  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:29.606709  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:29.608518  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:29.611058  8790 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:29.563056 13615 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.611516  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:29.613265  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 341930us
W20260709 13:18:29.647212  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:29.662014  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55386.8us
I20260709 13:18:29.605556 13634 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:29.605865 13624 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:29.610112 13652 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:29.610028 13416 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:29.572206 13504 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.671684  8147 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:29.708210  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:29.708799  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:29.678681  8248 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.002s	sys 0.023s
I20260709 13:18:29.682478  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:29.724968  8256 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 15: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:29.692152  8788 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:29.693843  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:29.682900  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:29.725764  8248 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.002s	sys 0.024s
I20260709 13:18:29.725941  8100 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:29.727828  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:29.729919  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:29.730536  8782 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:29.630836 13456 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.731959  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:29.734370  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:29.736092  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:29.740005 12567 consensus_queue.cc:1059] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:18:29.768985  8256 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:29.770958  8105 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:29.777477  8099 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:29.780359  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:29.780974  8257 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:29.781973  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:29.782554  8253 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:29.667382 13475 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:29.785117  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:29.690982 13652 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:29.805733  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 416140us
I20260709 13:18:29.798547  8106 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:29.738071 13617 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:29.802276  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 70385.7us
I20260709 13:18:29.841497  8256 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:29.836541  8100 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:29.826604  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:29.825767  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 51502.8us
I20260709 13:18:29.841257  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:29.844580  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:29.845168  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:29.773958 13591 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:29.856065  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:29.846086  8256 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:29.797494 13475 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.858433  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:29.864687  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:29.779193 13589 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:29.773729 13396 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:29.853137 12567 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:18:29.804046 13434 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:29.739753 13309 consensus_queue.cc:1059] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 13:18:29.873421  8253 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:29.876312  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:29.731810 13337 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 13:18:29.697077 13634 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.702993 13624 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.869549 13448 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:29.736582 13416 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.824944 13652 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:29.875264 13475 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:29.881357  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:29.873502  8100 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:29.886152  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:29.839226 13479 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.807190 13659 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:29.857259 13505 raft_consensus.cc:3055] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:29.839815 13457 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:29.781291 13456 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.900254 13589 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:29.843748 13622 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:18:29.899142  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 227530us
I20260709 13:18:29.905609 13448 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:29.874392 13625 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:29.805265 13523 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:18:29.866447 13499 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:29.915484  8253 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:29.844041 13542 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:18:29.889969 13396 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:29.845965 12886 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.911100  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:30.148217  8248 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:29.973771  8257 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:29.880285 13591 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.003785 12567 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:30.019135 13499 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.020433 13469 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:30.015372  8105 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:29.967723 13448 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:29.930783 13631 consensus_queue.cc:1059] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.150s
I20260709 13:18:30.168928  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:30.057390  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:29.895463 13434 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:29.966382 13309 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.185s
I20260709 13:18:29.921809 13505 raft_consensus.cc:740] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:30.188509 13663 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
I20260709 13:18:30.150013  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:30.150878 12567 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:30.190153  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 736) took 1923 ms. Trace:
I20260709 13:18:30.190200 12567 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.191596 12567 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:30.190673  8104 rpcz_store.cc:276] 0709 13:18:28.266811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.266973 (+   162us) service_pool.cc:224] Handling call
0709 13:18:28.267417 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:28.267852 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.267895 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:28.268498 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.310985 (+1042487us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b180025ed00. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:18:29.678285 (+367300us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:29.678346 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.678416 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.189836 (+511420us) raft_consensus.cc:1685] finished
0709 13:18:30.189856 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.190065 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1337,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":52634,"spinlock_wait_cycles":5459200,"thread_start_us":366986,"threads_started":1,"wal-append.queue_time_us":1604896}
I20260709 13:18:30.192476  8782 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:30.192673  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:30.005724  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 129483us
I20260709 13:18:29.942355 13659 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.216648 13659 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:30.218474  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:30.218713 13591 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:30.219166  8248 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:30.165108 13499 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:30.223673 13675 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:30.046454 13396 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:29.919106 13479 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:29.940176 13457 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:30.133123 13337 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:30.177289  8099 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:30.180208  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:30.252123  8105 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 14: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:18:30.180738  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 324601us
I20260709 13:18:30.164824 12721 raft_consensus.cc:1064] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
W20260709 13:18:30.188607 13660 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 13:18:29.967300 13446 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:30.002135 13622 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.263137  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:30.264066  8105 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:30.198443 13615 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:30.214293 13634 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:30.214499 13655 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:30.232076  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:30.250161 13457 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:30.287668  8252 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:30.230469 13410 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.225814 13675 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:30.149485  8253 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:30.184799 13625 raft_consensus.cc:697] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:30.226152 13416 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:30.287899  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:30.294414  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.228936 13504 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:30.297683  8248 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
W20260709 13:18:30.298103  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 442093us
I20260709 13:18:30.296168  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:30.248425 13662 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:30.176517 12886 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.298673  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:30.299242  8248 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:30.295492  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:30.301345  8099 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:30.237061 13499 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.299425  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:30.309469  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:30.251274 13337 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:30.318588  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:30.345116  8105 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 17: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:30.360589  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:30.302781 13662 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:30.341166  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:30.341311  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 45902.1us
I20260709 13:18:30.393294  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:30.333451  8252 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:30.392544  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.393563  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.401707  8248 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:30.403687  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.407825  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.410943 13337 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.412456  8100 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:18:30.413014 13672 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:18:30.413259 13416 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:30.413777 13668 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:18:30.414499 13685 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.418220 13434 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:30.421825  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.424347 13479 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:30.426039 13662 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.350597 13650 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.428864  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2921) took 1210 ms. Trace:
I20260709 13:18:30.428961 13625 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.431923 13624 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:30.291540 13446 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.433979  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.294010 13655 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.434942 13448 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.436084  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2741) took 1387 ms. Trace:
I20260709 13:18:30.313539 13680 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:30.295436 13505 consensus_queue.cc:260] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:30.437578 13495 consensus_meta.cc:287] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.887s	user 0.010s	sys 0.000s
I20260709 13:18:30.437676  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:30.440696  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:30.441615 13496 consensus_meta.cc:287] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.927s	user 0.006s	sys 0.005s
I20260709 13:18:30.563671 13496 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:30.444818 13440 consensus_meta.cc:287] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.968s	user 0.005s	sys 0.005s
W20260709 13:18:30.564812  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 169207us
I20260709 13:18:30.564751 13440 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.566572  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:30.566991 13440 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:30.567389  8791 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:30.446729 13622 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:30.449692 13456 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:30.568145 13456 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:30.568624 13456 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.449994  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:30.452912  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:30.455435 12721 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:30.456789  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 106123us
I20260709 13:18:30.572181  8099 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:30.573539  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:30.458541  8181 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:30.575748  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:30.576508  8181 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:30.321672 13591 raft_consensus.cc:3055] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:30.311620 13615 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:18:30.458261 13449 consensus_meta.cc:287] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.901s	user 0.007s	sys 0.004s
I20260709 13:18:30.462618 13308 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.463908 13469 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.465693 13475 consensus_meta.cc:287] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
W20260709 13:18:30.465756  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.466179  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.466720 13675 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.300676 13410 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.478803 13567 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.483326 13652 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.000s
I20260709 13:18:30.484757  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:30.486642  8101 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 16. Ops: []
I20260709 13:18:30.488224 12886 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:30.490389 13666 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.595s	user 0.003s	sys 0.003s
W20260709 13:18:30.497309 13617 consensus_meta.cc:287] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.633s	user 0.004s	sys 0.005s
I20260709 13:18:30.577265  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.584129 13456 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:30.601269  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:30.602211  8181 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:30.603113  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.501312 13659 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:30.624691 13659 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.625306  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.627351 13659 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:30.497387 13653 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.628374 13653 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:30.502022 13651 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.657s	user 0.005s	sys 0.005s
I20260709 13:18:30.503289  8105 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:18:30.505131 13665 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.555s	user 0.004s	sys 0.003s
I20260709 13:18:30.633880  8255 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:30.506794 13642 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:30.634624 13642 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:30.508880 13499 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:30.512900 13674 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.239s	user 0.001s	sys 0.001s
I20260709 13:18:30.513687  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:30.514024  8106 consensus_meta.cc:287] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.003s
I20260709 13:18:30.636754 13693 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.514786  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:30.637815  8252 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:30.637583 13693 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.638418  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.638906  8252 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:30.639653  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:30.639878 13693 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:30.640272  8252 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:30.633955 13505 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:30.516238 13457 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.643121 13457 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:30.517953 13309 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:30.525067  8001 catalog_manager.cc:5697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 13 to 14, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 14 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:30.644640  8252 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:30.645110  8786 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:30.645155  8252 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:18:30.540761  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.645943  8104 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:30.541213  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:30.542555  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:30.551689  8004 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39810 (request call id 293) took 77977 ms (client timeout 15000 ms). Trace:
I20260709 13:18:30.554471  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.651459  8179 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:30.547183  8102 rpcz_store.cc:276] 0709 13:18:29.218679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.431113 (+212434us) service_pool.cc:224] Handling call
0709 13:18:29.431496 (+   383us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:29.433479 (+  1983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.433518 (+    39us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:29.434331 (+   813us) log.cc:844] Serialized 78 byte log entry
0709 13:18:29.786154 (+351823us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:29.786191 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.786251 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.428635 (+642384us) raft_consensus.cc:1685] finished
0709 13:18:30.428657 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.428807 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1430,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":64819,"thread_start_us":262381,"threads_started":1,"wal-append.queue_time_us":800330}
I20260709 13:18:30.557082  8249 rpcz_store.cc:276] 0709 13:18:29.048412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.106968 (+ 58556us) service_pool.cc:224] Handling call
0709 13:18:29.212092 (+105124us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:29.212459 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.212487 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:29.216922 (+  4435us) log.cc:844] Serialized 52 byte log entry
0709 13:18:29.733752 (+516830us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:29.896068 (+162316us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.896342 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.896445 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.435807 (+539362us) raft_consensus.cc:1685] finished
0709 13:18:30.435837 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.436012 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172744,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":664,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":13958,"thread_start_us":587903,"threads_started":2,"wal-append.queue_time_us":719426}
I20260709 13:18:30.544253 13337 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:18:30.574622 12567 raft_consensus.cc:3055] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:30.652797  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:30.653775  8249 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:30.652819 12567 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:30.544018 13416 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:30.680326  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.681005  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1531) took 1180 ms. Trace:
I20260709 13:18:30.604449 13475 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.605080 13449 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.605437 13469 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.498759  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2918) took 1280 ms. Trace:
I20260709 13:18:30.696475  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 696) took 2405 ms. Trace:
I20260709 13:18:30.605855 13652 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.607220  8256 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:30.696923  8251 rpcz_store.cc:276] 0709 13:18:28.291317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.677716 (+386399us) service_pool.cc:224] Handling call
0709 13:18:28.678116 (+   400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:28.941642 (+263526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.941671 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:28.942189 (+   518us) log.cc:844] Serialized 52 byte log entry
0709 13:18:29.588068 (+645879us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:29.588106 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.588170 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.489100 (+900930us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:30.680235 (+191135us) raft_consensus.cc:1685] finished
0709 13:18:30.680255 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.696407 (+ 16152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":262931,"raft.queue_time_us":267424,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":17931,"spinlock_wait_cycles":123732224,"thread_start_us":645480,"threads_started":1,"wal-append.queue_time_us":736007}
I20260709 13:18:30.700738  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:30.609519 13615 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.610481 13567 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.602674 13617 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:30.611186 13591 raft_consensus.cc:740] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:30.612033  8250 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:30.612089  8178 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:30.613701 13410 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:30.615152  8221 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:30.616994  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:30.617713  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:30.724483  8787 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:30.620664  8789 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 14 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:30.622414  8099 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:30.560472 13680 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.634164 13495 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.636819  8106 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:30.507575  8180 raft_consensus.cc:2368] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 14. Current term is 15.
I20260709 13:18:30.728928  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2925) took 1046 ms. Trace:
I20260709 13:18:30.519411 13396 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.644557  8001 catalog_manager.cc:5697] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.520383 13223 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:30.734499  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:30.733927  8001 catalog_manager.cc:5697] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 11 to 12, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 12 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:30.735106  8099 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:30.735520  8001 catalog_manager.cc:5697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 12 to 14, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 14 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:30.602434 13456 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:30.577596  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 275830us
I20260709 13:18:30.738314  8105 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:18:30.660097  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:30.678915 13446 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:30.603632 13308 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.604394  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:30.681620  8784 rpcz_store.cc:276] 0709 13:18:29.500305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.506471 (+  6166us) service_pool.cc:224] Handling call
0709 13:18:29.506847 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.507162 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:29.507198 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.507758 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.785816 (+278058us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:29.785852 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.785915 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.680725 (+894810us) raft_consensus.cc:1685] finished
0709 13:18:30.680756 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.680924 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":257712,"threads_started":1,"wal-append.queue_time_us":399909}
I20260709 13:18:30.693487  8104 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:30.692169  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2915) took 2048 ms. Trace:
I20260709 13:18:30.643940 13309 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:30.701315  8251 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:30.696674  8103 rpcz_store.cc:276] 0709 13:18:29.217904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.306626 (+ 88722us) service_pool.cc:224] Handling call
0709 13:18:29.306950 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.307160 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:29.665388 (+358228us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.979279 (+313891us) log.cc:844] Serialized 14 byte log entry
0709 13:18:30.496715 (+517436us) spinlock_profiling.cc:243] Waited 43.9 ms on lock 0x7b1800359740. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dcd9c0a 00007fa5a7419219 00007fa59dd61a40 00007fa59dd5c4e4 00007fa59dd5c455 00007fa5a0e44060 00007fa5a0e56716 00007fa5a0e67287 00007fa5a0e67208
0709 13:18:30.498397 (+  1682us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:30.498452 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:30.498502 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.498571 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.498697 (+   126us) inbound_call.cc:177] Queueing success response
0709 13:18:30.514535 (+ 15838us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b1800359740. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
Metrics: {"mutex_wait_us":382581,"prepare.queue_time_us":1324841,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":537056,"raft.run_cpu_time_us":11682,"raft.run_wall_time_us":106230,"spinlock_wait_cycles":117659904,"thread_start_us":653502,"threads_started":2,"wal-append.queue_time_us":609282}
I20260709 13:18:30.707541  8249 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:30.551255 13685 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:30.715958  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:30.553678 13650 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.716593 13697 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:30.722391  8253 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:30.723029  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:30.729840  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:30.730051  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:30.729334  8106 rpcz_store.cc:276] 0709 13:18:29.682036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.682148 (+   112us) service_pool.cc:224] Handling call
0709 13:18:30.728852 (+1046704us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:30.732048  8108 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:30.732498  8183 raft_consensus.cc:2393] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:18:30.650573  8004 rpcz_store.cc:269] 0709 13:17:12.573962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.574538 (+   576us) service_pool.cc:224] Handling call
0709 13:18:30.551616 (+77977078us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:23.223993 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:23.272382 (+ 48389us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:23.272445 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:18:23.272463 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:23.272912 (+   449us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:23.272979 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:23.273015 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:23.273300 (+   285us) tablet.cc:701] Row locks acquired
0709 13:18:23.273352 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:18:23.273546 (+   194us) write_op.cc:270] Start()
0709 13:18:23.273699 (+   153us) write_op.cc:276] Timestamp: P: 1783603103273489 usec, L: 0
0709 13:18:23.273726 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:18:23.274425 (+   699us) log.cc:844] Serialized 541 byte log entry
0709 13:18:23.812818 (+538393us) op_driver.cc:464] REPLICATION: finished
0709 13:18:24.629904 (+817086us) write_op.cc:301] APPLY: starting
0709 13:18:24.644129 (+ 14225us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:24.869640 (+225511us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:24.869761 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:24.870616 (+   855us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:24.870888 (+   272us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:18:24.870939 (+    51us) write_op.cc:312] APPLY: finished
0709 13:18:24.871221 (+   282us) log.cc:844] Serialized 25 byte log entry
0709 13:18:24.978110 (+106889us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:24.987825 (+  9715us) write_op.cc:454] Released schema lock
0709 13:18:25.045196 (+ 57371us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:25.122463 (+ 77267us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:25.126240 (+  3777us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":360560,"reported_tablets":46,"spinlock_wait_cycles":1280,"child_traces":[["op",{"apply.queue_time_us":775598,"apply.run_cpu_time_us":34270,"apply.run_wall_time_us":485019,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":112623,"prepare.run_cpu_time_us":14378,"prepare.run_wall_time_us":212122,"raft.queue_time_us":213647,"raft.run_cpu_time_us":115775,"raft.run_wall_time_us":754139,"replication_time_us":510696,"spinlock_wait_cycles":1408,"thread_start_us":841663,"threads_started":5,"wal-append.queue_time_us":422876,"wal-append.run_cpu_time_us":33569,"wal-append.run_wall_time_us":2315421}]]}
I20260709 13:18:30.736949  8001 catalog_manager.cc:5697] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.737103  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:30.741452  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 81447.9us
I20260709 13:18:30.900084  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:30.901237 13655 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:30.901677  8252 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.902372 13475 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:30.902828  8252 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:30.903184  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.742602  8105 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:30.885475  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:30.814980  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.896797  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3018) took 1214 ms. Trace:
I20260709 13:18:30.906672  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.907115  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:30.907356  8178 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:30.741031  8256 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:30.909955  8256 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:30.803529  8257 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:30.911412  8250 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:18:30.911979  8101 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 19: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:30.830057  8791 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:30.912935  8248 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:30.913266  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:30.780427  8099 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:30.914502  8001 catalog_manager.cc:5697] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:30.915474  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:30.916167  8100 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:30.917505  8787 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:30.905567  8255 rpcz_store.cc:276] 0709 13:18:29.682040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.634921 (+952881us) service_pool.cc:224] Handling call
0709 13:18:30.635235 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.709186 (+ 73951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.709222 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:30.709264 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:30.709308 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.896565 (+187257us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b5400268c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:30.896611 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.896740 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169563520}
I20260709 13:18:30.830412  8223 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:30.921381  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 306327us
I20260709 13:18:30.922178  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:30.922304  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 92001us
I20260709 13:18:30.915887  8001 catalog_manager.cc:5697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 11 to 15, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 15 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:30.922377  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.923717  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.923151  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:30.926344  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:30.927245  8001 catalog_manager.cc:5697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:30.733692 13410 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.893712 13691 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:18:30.828945 13224 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:30.929822  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:30.802693 13659 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.941812  8783 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:30.942277 13676 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:30.942888 13676 raft_consensus.cc:697] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:30.943986 13676 consensus_queue.cc:237] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.896847 13448 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:30.890686 13449 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:30.939146 13496 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:30.908034  8107 rpcz_store.cc:276] 0709 13:18:28.643811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.686923 (+ 43112us) service_pool.cc:224] Handling call
0709 13:18:29.324758 (+637835us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.325212 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.325247 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.325747 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.646520 (+320773us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:29.646560 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.646624 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.416023 (+769399us) raft_consensus.cc:1685] finished
0709 13:18:30.416044 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.655403 (+239359us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b540001b8d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:30.692100 (+ 36697us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1899,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":1466304896,"thread_start_us":320358,"threads_started":1,"wal-append.queue_time_us":934344}
I20260709 13:18:30.983997  8248 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:30.920244 13653 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:30.934054  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.937490  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.994727  8182 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:18:30.837412 13456 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:30.937214  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:30.894034 13495 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:30.939392  8147 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:30.895328 13396 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:30.889812 13469 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:30.891752 13615 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:30.996692 13448 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:31.038321  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 98986.6us
I20260709 13:18:31.038859 13456 raft_consensus.cc:697] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:31.039227 13615 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:31.039914 13456 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.040614 13523 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:31.041999 13523 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:30.886056 13613 consensus_queue.cc:1059] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:18:30.956215 13617 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:30.892827 13629 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:30.931697  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:30.921908 13603 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:30.921793 13693 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:30.923329 13652 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:30.993422  8251 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:30.884507 13680 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:30.926128 13698 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:18:30.830498 13695 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.293s
W20260709 13:18:31.042728  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.004462  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:31.004681  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.017874  8254 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:18:31.023290  8176 raft_consensus.cc:2410] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:18:31.045109  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 107944us
I20260709 13:18:31.001928  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2936) took 1126 ms. Trace:
I20260709 13:18:31.031049 13696 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.929452  8001 catalog_manager.cc:5697] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:31.017155  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2747) took 1241 ms. Trace:
I20260709 13:18:31.020789  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2922) took 1351 ms. Trace:
I20260709 13:18:31.072134 13693 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:31.071797 13603 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:31.118904  8253 rpcz_store.cc:276] 0709 13:18:29.775747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.295857 (+520110us) service_pool.cc:224] Handling call
0709 13:18:31.016863 (+721006us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b5400209c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:31.017074 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973547904}
I20260709 13:18:30.938508 13657 consensus_queue.cc:1059] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:18:31.059828  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:30.922551 13697 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.061559  8248 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:31.062570  8252 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:18:31.124398  8252 pending_rounds.cc:85] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 10
I20260709 13:18:31.077919 13629 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.124692  8252 pending_rounds.cc:107] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:18:31.125021  8252 raft_consensus.cc:2889] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:31.125756  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2749) took 1348 ms. Trace:
I20260709 13:18:31.126102  8252 rpcz_store.cc:276] 0709 13:18:29.777106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.641071 (+863965us) service_pool.cc:224] Handling call
0709 13:18:30.641325 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.901311 (+259986us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b4c004d5240. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f118a20 00007fa59f129a29 00007fa59f0ef644 00007fa59f116f2d 00007fa59f116b93 00007fa5a0e4718b 00007fa5a0e47cb5 00007fa5a0e42f30 00007fa5a0e447de 00007fa5a0e4eb49 00007fa5a0e4f416
0709 13:18:31.125496 (+224185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.125699 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90538752}
W20260709 13:18:31.072919  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 141291us
I20260709 13:18:31.129014  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.130483  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.003947 13457 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:31.075174  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.128144  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:31.078557  8104 rpcz_store.cc:276] 0709 13:18:29.875535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.192410 (+316875us) service_pool.cc:224] Handling call
0709 13:18:31.001693 (+809283us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b540030ded4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:31.001853 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040964352}
I20260709 13:18:31.045744  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2746) took 1271 ms. Trace:
I20260709 13:18:31.015605 13662 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:31.079128  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:30.986707 13496 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:31.018285 13224 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:31.082923 13469 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:18:31.100680 13704 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:30.741366 13591 consensus_queue.cc:260] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.102200  8001 catalog_manager.cc:5697] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:31.106899 13685 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:31.114892 13696 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:30.994445 13410 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.058663 13523 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:31.058908 13499 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:31.018370 13699 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:31.022594 13416 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:31.043435 13615 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:31.017138 13567 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:31.117147  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:31.074358 13642 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.183838  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:31.185034 13642 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:31.185161  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.185698 13696 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:31.005034  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.188776  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.190091  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.191350  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:30.997341 13659 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.064361 13448 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.076332  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.133873  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:31.192899  8251 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
W20260709 13:18:31.193239  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 59473.5us
I20260709 13:18:31.193806  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.134668  8255 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:31.194087 13659 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:31.133741  8257 rpcz_store.cc:276] 0709 13:18:29.774823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.149694 (+374871us) service_pool.cc:224] Handling call
0709 13:18:31.045485 (+895791us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b5400208d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:31.045667 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1411414272}
W20260709 13:18:31.136258  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 57212.1us
I20260709 13:18:31.195508  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:31.196235 13680 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:31.137998  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.136232  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.197481  8252 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:18:31.120570 13693 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:31.121867 13603 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:31.083209 13309 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.148526  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:31.150835  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 379029us
I20260709 13:18:31.194011  8223 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:31.196628  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:31.147049 13704 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:31.201988  8256 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:31.202840  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:31.200544  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:31.152432  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 226611us
I20260709 13:18:31.156077  8248 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:31.135407 13495 raft_consensus.cc:2764] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:18:31.160423  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3020) took 1472 ms. Trace:
I20260709 13:18:31.153630 12567 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.208560 12567 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:31.111212 13695 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.145465 13449 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:31.172640  8181 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:31.143548 13505 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:31.175792  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.183221  8250 raft_consensus.cc:2368] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 14. Current term is 15.
W20260709 13:18:31.055869  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.119098  8108 rpcz_store.cc:276] 0709 13:18:29.669807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.669918 (+   111us) service_pool.cc:224] Handling call
0709 13:18:29.670206 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.918401 (+1248195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.020502 (+102101us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000f3f54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:31.020717 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2440063360}
I20260709 13:18:31.206190  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:31.206542  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:31.209326  8149 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:31.207940  8254 rpcz_store.cc:276] 0709 13:18:29.687994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.636189 (+948195us) service_pool.cc:224] Handling call
0709 13:18:31.017531 (+381342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.077982 (+ 60451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.160097 (+ 82115us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b5400209c50. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:31.160320 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876125440}
I20260709 13:18:31.210476  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:31.196849 13416 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:31.203845 13701 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:18:31.247072  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:31.250715  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.207679 13510 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:31.203764 13469 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:31.203384 13704 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:31.200388 13567 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.215551 13309 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:31.219053 13650 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:31.268076 12886 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:31.270665 13495 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:31.217183  8253 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:31.194029 13448 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:31.289697 13495 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:31.265117  8178 raft_consensus.cc:2410] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:18:31.266834  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:31.196672 13680 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:31.213361 13699 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:31.275663 13469 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.274242 13659 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:31.214674 13690 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.215739 13642 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:31.258383 13308 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:31.268477 13655 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:31.284276  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:31.260569  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.252147  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:31.214685 13496 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.213928 13695 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.270131 13416 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.264266  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:31.290210 13495 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:31.298503 13469 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:31.245745 13224 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.298518 13699 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:31.304877  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.299386 13690 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.278788 13567 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.246065 13449 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:31.290522 13337 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.000s
W20260709 13:18:31.317270  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 65204.7us
I20260709 13:18:31.284962 12886 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:31.261816  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 51413.5us
I20260709 13:18:31.364925  8176 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
W20260709 13:18:31.319722  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.324687 12721 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:18:31.321139  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:31.327466  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 63271.6us
I20260709 13:18:31.374356  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:31.329718 13697 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:31.331792 13416 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:31.332587 13625 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:31.333885 13711 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:31.250216 13523 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.316150 13712 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:31.339792 13685 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.379931 13695 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:31.342712  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.343071  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:31.381567  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:31.319633  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 52922.2us
I20260709 13:18:31.382637  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.371937  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:31.383417  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:31.380656 13591 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:31.380381 13685 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.282037 13615 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.378983  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:31.402132  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.403879  8101 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:31.403995  8100 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:31.278460 13510 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:31.383167  8178 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 11.
W20260709 13:18:31.375732  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.388447  8755 leader_election.cc:400] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 14. Current term is 15.
I20260709 13:18:31.408958  8755 leader_election.cc:403] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:18:31.366109 13699 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:31.391588  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.391597  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.369784 12886 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:31.377174 13629 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:31.417063  8785 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:31.416927  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.416610  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:31.396623  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.398938  8108 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:31.422235  8104 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:31.399379  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.375017 13694 raft_consensus.cc:3055] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:18:31.411142  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.425009  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.426714  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.427670  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:31.428403  8252 raft_consensus.cc:2368] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16.
I20260709 13:18:31.429718  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:31.430588  8255 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 20: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:31.411808  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:31.412204  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.431375  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:31.431950  8251 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:31.413012  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.376466 13657 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:31.410084  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:31.416393  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.432838  8249 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:31.433178  8788 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:31.433766  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.434147  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:31.434315  8249 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:31.435292  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.417003  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.436586  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.436866  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.437737  8099 raft_consensus.cc:2410] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 20 because replica has last-logged OpId of term: 18 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 6.
I20260709 13:18:31.429225  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:31.424580 13702 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 14. Current term is 15.
I20260709 13:18:31.438763  8257 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 19: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:31.439360  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:31.439739  8254 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:31.441191  8782 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:31.421665  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:31.423125  8107 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:31.442552  8248 raft_consensus.cc:2410] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 19 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:18:31.403430 13625 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:31.447808  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.417296  8790 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:31.393373 13696 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:31.377617 13456 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:31.445966  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.449252  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.449893  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.447260  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.452451  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.444901  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:31.454399  8105 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:31.455228  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.453238  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.432468  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:31.456987  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:31.400357 13711 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:31.460353  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.460772  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.439364 13410 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:31.418012 12721 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:31.466089  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:31.420722 13642 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:31.467592  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.467890  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.521230  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.498756  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:31.512784  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.484630  8251 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:31.527582  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:31.520787  8102 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:31.493743  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:31.528365  8255 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:31.501608  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 70521.4us
I20260709 13:18:31.468765  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.530135  8107 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:31.463969  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:31.466197  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.530356  8182 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:31.420228 13416 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.529403  8257 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
W20260709 13:18:31.530468  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.498037  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.501034  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.499406  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.527872  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:31.541296  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.542346  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.542441  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:31.543069  8785 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:31.539749  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:31.443285  8223 connection.cc:256] RPC call timeout handler was delayed by -1.5093793779999487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
I20260709 13:18:31.532300  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.501492  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:31.545152  8784 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:31.533859  8104 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:31.505859  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.519606  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.538667  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.546526  8251 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:31.489004  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2743) took 1077 ms. Trace:
I20260709 13:18:31.539057  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:31.548017  8183 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:31.548609  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2738) took 1138 ms. Trace:
I20260709 13:18:31.548946  8183 rpcz_store.cc:276] 0709 13:18:30.409948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.202602 (+792654us) service_pool.cc:224] Handling call
0709 13:18:31.548551 (+345949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.425338 13694 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:31.381021 13680 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.414501 13632 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.136s
I20260709 13:18:31.447832 13659 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:31.544907  8790 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
W20260709 13:18:31.545291  8223 connection.cc:256] RPC call timeout handler was delayed by -1.4310793780000495s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
W20260709 13:18:31.487416 13709 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:18:31.559504  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:31.588495  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.588722  8255 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:31.589310  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:31.547142  8181 rpcz_store.cc:276] 0709 13:18:30.411376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.424648 (+1013272us) service_pool.cc:224] Handling call
0709 13:18:31.488910 (+ 64262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.550045  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:31.440591 13629 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:31.551481  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:31.591732  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.567200  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.556445  8101 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:31.549562  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:31.444772 13657 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:31.573411  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:31.550407 13416 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.487017 13567 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:31.470180 13653 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:31.576471  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.456785 13718 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:31.465317 13652 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:18:31.605243  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.424921 13699 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.607750  8103 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:31.604549 13457 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:31.608937 13457 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:31.609015  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.609449 13457 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:31.610301  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.610492 13523 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:31.610893  8180 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:18:31.611755  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.612713  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.613961 13653 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:31.578065  8105 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
W20260709 13:18:31.487010 13708 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:18:31.489467 13710 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:31.583954  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:31.560894 12567 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:18:31.586681  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.461910 13696 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:31.589694  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.629652 12567 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.631512 12567 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:31.550009 13448 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:31.499645 13625 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:18:31.595670  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 46239us
I20260709 13:18:31.596753  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.634143  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:31.488801 13685 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:31.565553 13223 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.599538  8249 raft_consensus.cc:2410] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:31.574769  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:31.560701 13595 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.617221  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:31.618600  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.615180 13652 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:31.476249 13456 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.634675  8755 leader_election.cc:400] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 14. Current term is 15.
I20260709 13:18:31.634742  8251 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:31.633705 13448 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:18:31.638324  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 54458.9us
W20260709 13:18:31.694655  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 46839.9us
I20260709 13:18:31.696730  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:31.697011  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.640831  8181 raft_consensus.cc:2393] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 12: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:31.641337  8790 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:31.649106 13678 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:31.487021 12721 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.578037 13642 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:31.696894  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:31.606547 13337 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:18:31.655830  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.600028 13704 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.595176 13510 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.595958 13711 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.632750 13659 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:31.631568 13696 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:31.700047  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 47423.1us
I20260709 13:18:31.793021 13449 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:31.801884 13603 consensus_meta.cc:287] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.590s	user 0.005s	sys 0.005s
I20260709 13:18:31.826249 13499 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:31.647477 13718 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:31.810230  8175 raft_consensus.cc:2410] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:18:31.699939  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.886004  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.700601  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2730) took 1305 ms. Trace:
W20260709 13:18:31.740846  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 44216.2us
I20260709 13:18:31.887168  8182 rpcz_store.cc:276] 0709 13:18:30.394950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.696731 (+1301781us) service_pool.cc:224] Handling call
0709 13:18:31.700487 (+  3756us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:31.887598  8223 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:31.739634  8177 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:31.649127 13694 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:31.890134  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 426223us
I20260709 13:18:31.891913  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:31.892970  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:31.896044  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:31.803599 13309 consensus_meta.cc:287] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.002s
W20260709 13:18:31.732477 13662 consensus_meta.cc:287] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.000s
I20260709 13:18:31.880298  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:31.698411  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 63865.7us
W20260709 13:18:31.859472  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.897115  8255 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:31.898280  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:31.900336  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:31.821777  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 124988us
I20260709 13:18:31.907064  8147 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:31.901732  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:31.703074 13709 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:31.826056 13706 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.789182 13680 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:31.805663 13717 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:31.721324 13690 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:31.890813 13499 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.916150  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:31.652215 13469 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.825238 13652 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:31.748404 13715 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:31.789654 13416 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:31.645180 13702 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.260s
I20260709 13:18:31.905283  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:31.913667  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.925899  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.927906  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.804891 13699 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:31.883556 13337 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:31.729655 13495 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.909238 13567 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:31.951402  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.930924  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:31.910434  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:31.913025 13659 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:18:31.812314 12886 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.903477 13653 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:31.942313  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1848) took 1523 ms. Trace:
I20260709 13:18:31.924559 13717 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:31.908833 13712 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:18:31.971359  8175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2752) took 1231 ms (client timeout 1584 ms). Trace:
I20260709 13:18:31.696296 13223 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.903668 13449 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:31.944809  8179 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:31.932569  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:31.924067 13496 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:31.957805  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.785506 13625 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.959373  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.990989  8099 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:31.699798 13595 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.964166  8149 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:31.737147 13457 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.945324 13685 consensus_queue.cc:1059] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:18:31.963295  8176 rpcz_store.cc:276] 0709 13:18:30.420311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.429769 (+1009458us) service_pool.cc:224] Handling call
0709 13:18:31.927703 (+497934us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b58000d7d98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:18:31.942221 (+ 14518us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64275328}
I20260709 13:18:31.934728 13499 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:31.699311 13657 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.945746 13617 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:31.973528  8250 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:18:31.979318 13591 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:31.734110 13448 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:31.986255  8107 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 14: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:31.961400 13224 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:31.958577  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:31.930203 13655 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:18:31.991624  8181 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 16: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:18:31.992311  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.897141 13603 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:31.968142 13699 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:31.994599  8177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1862) took 1562 ms (client timeout 1647 ms). Trace:
W20260709 13:18:31.975440  8175 rpcz_store.cc:269] 0709 13:18:30.740412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.004413 (+264001us) service_pool.cc:224] Handling call
0709 13:18:31.971094 (+966681us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b540031ecd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:31.971281 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1683824384}
I20260709 13:18:32.021253 13591 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:32.028677  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.981873 13449 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.057183 13224 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.935433 13706 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:32.055442 13615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.029s	sys 0.016s
I20260709 13:18:32.067188 13617 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:32.077862 13655 consensus_queue.cc:1243] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:32.081745  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:31.961623 13632 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:18:32.080657  8177 rpcz_store.cc:269] 0709 13:18:30.432202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.639390 (+207188us) service_pool.cc:224] Handling call
0709 13:18:31.994390 (+1355000us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b5400329954. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:31.994503 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673128192}
W20260709 13:18:32.071316  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 166102us
I20260709 13:18:32.062475  8103 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:32.060433 13675 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:32.087865  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 130160us
W20260709 13:18:32.114638  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 132312us
I20260709 13:18:32.085080 13699 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:32.070874 13702 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:32.120618  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:32.121248  8175 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:32.087157 13591 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:32.122782  8182 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:32.073455 13722 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:32.099458  8784 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:32.108533  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:32.098228 13224 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:32.064284 13657 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:32.115687  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:32.117249  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 184784us
W20260709 13:18:32.093185 13693 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.876s	user 0.008s	sys 0.004s
I20260709 13:18:32.119320  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:32.101023 13615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.029s	sys 0.017s
I20260709 13:18:32.122087  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:32.092504 13449 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:32.070114  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 106044us
I20260709 13:18:32.121793 13699 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:32.150151  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:32.150839  8252 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:32.062033 13337 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:32.134406  8788 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:32.157778  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:32.158329  8788 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:32.134986  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:32.129174 13659 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:32.162403  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:32.162632 13659 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:32.163137 13495 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:32.163568  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:32.163412 13659 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:32.094383 13725 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:18:32.164652  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:32.063373 13717 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:32.165647 13725 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:32.142406  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:32.172068  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:32.172573  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:32.147603  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:32.173390  8257 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:32.174576  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:32.143108  8255 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:32.147660  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:32.172698  8108 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:32.144637  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:32.120564 13702 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.189666  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:32.127089 13730 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:32.198993  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:32.153295  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:32.153571  8251 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:32.161686 13617 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:32.135172  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:32.151816 13693 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:32.167764  8105 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:32.169466  8106 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:32.169565  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:32.139051  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:32.170881  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:32.171087  8102 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:32.124004 13642 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:32.140633  8174 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:32.191054  8223 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:32.197556  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:32.164652 13659 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:32.137504 13704 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:32.227487  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:32.152434  8249 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:32.140033 13685 raft_consensus.cc:3055] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:32.172729 13567 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:32.149535 13653 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:32.171682 13725 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.225283  8787 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:32.189030 13495 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:32.240747  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:32.226807  8175 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:18:32.229014  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 90943.8us
I20260709 13:18:32.241631  8786 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:32.245126  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:32.205226 13469 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:32.229911  8252 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:32.230664  8072 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:32.230919  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:32.194679 13629 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:32.196144 13702 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:32.199402 13715 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:18:32.237017  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.237111  8788 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:32.195989 13456 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:32.238938  8782 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:32.237114  8248 raft_consensus.cc:1217] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 8.8->[9.9-15.13]   Dedup: 10.10->[11.11-15.13]
I20260709 13:18:32.233811 13685 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:32.258551  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2749) took 1519 ms. Trace:
I20260709 13:18:32.259044  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:32.270054  8175 rpcz_store.cc:276] 0709 13:18:30.738848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.170652 (+1431804us) service_pool.cc:224] Handling call
0709 13:18:32.258488 (+ 87836us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:32.271497  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:32.271679  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:32.272421  8175 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:32.232379 12886 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:32.241288 13495 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:32.235826 13642 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:32.240018  8785 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:18:32.268622  8174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2742) took 1857 ms (client timeout 1633 ms). Trace:
I20260709 13:18:32.235546 13730 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:32.264552  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:32.242807 13725 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:32.273808  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 16 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:32.274492  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:32.278189  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.355872  8175 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:32.266731  8248 pending_rounds.cc:85] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 10
I20260709 13:18:32.356454  8248 pending_rounds.cc:107] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:18:32.356880  8248 raft_consensus.cc:2889] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:32.357036  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:32.242300 13223 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:32.226718 13416 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
W20260709 13:18:32.288713  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 43676.4us
W20260709 13:18:32.289579  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 59018.6us
I20260709 13:18:32.367764  8072 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:32.285009  8174 rpcz_store.cc:269] 0709 13:18:30.411104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.604134 (+193030us) service_pool.cc:224] Handling call
0709 13:18:32.268430 (+1664296us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002f8854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:32.268547 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2307371904}
W20260709 13:18:32.263816 13714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.007s	sys 0.014s
W20260709 13:18:32.059693 13650 consensus_queue.cc:1175] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9480609eccc44250a4d7fcc9686e76cf" responder_term: 20 status { last_received { term: 19 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:18:32.363586  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.366751  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 75202.8us
I20260709 13:18:32.369004  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:32.357936  8175 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 11.
I20260709 13:18:32.379676  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:32.367952  8074 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:32.380290  8175 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:32.380373 13738 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.284310 13655 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:32.278788 13457 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:32.286761 13737 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.285576 13736 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:32.376387 13714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.007s	sys 0.015s
I20260709 13:18:32.398474  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:32.402017  8174 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:32.402387  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:32.402643  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2729) took 2008 ms. Trace:
I20260709 13:18:32.403097  8252 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:32.365485 13495 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:32.277926 13510 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:18:32.370929 13567 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.406633  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:32.366328 13734 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:32.365265 13742 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:18:32.405325 13727 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:18:32.484232  8783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1557) took 1094 ms. Trace:
I20260709 13:18:32.401155 13737 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:32.407873 13718 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:32.487105 13495 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:32.493033 13224 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:32.660181 13224 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:32.588310  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 220391us
W20260709 13:18:32.590663  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 222639us
I20260709 13:18:32.592556  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:32.614488  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 205677us
I20260709 13:18:32.403107  8174 rpcz_store.cc:276] 0709 13:18:30.394690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.383932 (+1989242us) service_pool.cc:224] Handling call
0709 13:18:32.401824 (+ 17892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.402420 (+   596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.402592 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:32.414458  8252 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:18:32.626113  8183 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
W20260709 13:18:32.626705  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.496097  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 221714us
I20260709 13:18:32.498075  8782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1066) took 1003 ms. Trace:
I20260709 13:18:32.484783  8783 rpcz_store.cc:276] 0709 13:18:31.389908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.390106 (+   198us) service_pool.cc:224] Handling call
0709 13:18:31.390650 (+   544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.406854 (+ 16204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.406878 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.425828 (+ 18950us) log.cc:844] Serialized 564 byte log entry
0709 13:18:31.903541 (+477713us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:31.903598 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.903691 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.483992 (+580301us) raft_consensus.cc:1685] finished
0709 13:18:32.484013 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.484168 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":477378,"threads_started":1,"wal-append.queue_time_us":567716}
I20260709 13:18:32.690636  8782 rpcz_store.cc:276] 0709 13:18:31.494564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.499114 (+  4550us) service_pool.cc:224] Handling call
0709 13:18:32.497862 (+998748us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54004cf9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:32.497995 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1603968768}
I20260709 13:18:32.498939  8787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1053) took 1083 ms. Trace:
I20260709 13:18:32.691926 13718 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.695006  8787 rpcz_store.cc:276] 0709 13:18:31.415624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.416366 (+   742us) service_pool.cc:224] Handling call
0709 13:18:32.498770 (+1082404us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b540065f4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:32.498881 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1803582848}
I20260709 13:18:32.695519 13718 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:32.646574  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 708) took 1088 ms. Trace:
I20260709 13:18:32.513797 13449 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:32.437323 13457 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:32.476140 13499 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:32.714138  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 710) took 1155 ms. Trace:
I20260709 13:18:32.714674  8181 rpcz_store.cc:276] 0709 13:18:31.558674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.951130 (+392456us) service_pool.cc:224] Handling call
0709 13:18:32.692135 (+741005us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b54002486d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:32.713938 (+ 21803us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69437824}
I20260709 13:18:32.715430 13499 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:32.481667 13567 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:32.716964  8181 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:18:32.526346 13591 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:32.508452 13595 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:32.719089  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:32.411772 13603 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:32.721951 13657 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:18:32.722215  8179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2739) took 2311 ms (client timeout 2013 ms). Trace:
I20260709 13:18:32.722443 13657 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:32.722568 13591 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:32.722718  8179 rpcz_store.cc:269] 0709 13:18:30.410287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.059461 (+649174us) service_pool.cc:224] Handling call
0709 13:18:32.721770 (+1662309us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b5400180954. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:32.722003 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814686592}
I20260709 13:18:32.724195  8175 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:32.724558  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:32.498878 13652 consensus_meta.cc:287] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.000s
I20260709 13:18:32.727694 13652 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:32.728694  8074 leader_election.cc:400] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16.
I20260709 13:18:32.729238  8074 leader_election.cc:403] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:18:32.729040 12886 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:18:32.731554  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:32.732085  8176 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:18:32.732496 12886 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:32.406894 13653 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:32.387769 13655 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.734277 13343 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:18:32.737709 13764 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16.
I20260709 13:18:32.737987 13655 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:32.719116 13567 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:32.523798 13675 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:32.459394 13693 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:32.522596 13694 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:32.492003 13696 consensus_meta.cc:287] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.000s
I20260709 13:18:32.531072 13699 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:32.749339  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 52474us
I20260709 13:18:32.752094 13699 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:32.515129 13717 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:32.510118 13706 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:32.539403 13722 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:32.529518 13725 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:32.758180 13652 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:32.758536 13725 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:32.466764 13726 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:18:32.762147  8104 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:32.481575 13734 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.765282 13734 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:32.765959  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 760) took 1244 ms. Trace:
W20260709 13:18:32.767150  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.748714  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 3042) took 1336 ms. Trace:
I20260709 13:18:32.768110  8250 rpcz_store.cc:276] 0709 13:18:31.410107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.412000 (+  1893us) service_pool.cc:224] Handling call
0709 13:18:32.741302 (+1329302us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b5400268754. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:32.746203 (+  4901us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246055168}
I20260709 13:18:32.370810 13735 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:32.510778 13737 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:32.766451  8100 rpcz_store.cc:276] 0709 13:18:31.521155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.522412 (+  1257us) service_pool.cc:224] Handling call
0709 13:18:31.522739 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.523182 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:31.523213 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.571273 (+ 48060us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.961159 (+389886us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:31.961214 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.961305 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.765313 (+804008us) raft_consensus.cc:1685] finished
0709 13:18:32.765351 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.765700 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16591,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":101,"thread_start_us":355860,"threads_started":1,"wal-append.queue_time_us":500004}
I20260709 13:18:32.381048 13738 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:32.771236  8174 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:32.368557 13740 consensus_queue.cc:1059] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.148s
W20260709 13:18:32.474207 13744 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:18:32.748837 13696 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:32.774168  8179 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: [14.9-17.11]
W20260709 13:18:32.504185 13745 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:18:32.656903  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1854) took 2233 ms. Trace:
I20260709 13:18:32.775678  8180 rpcz_store.cc:276] 0709 13:18:30.423320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.613403 (+1190083us) service_pool.cc:224] Handling call
0709 13:18:32.647885 (+1034482us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b5400332554. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:32.656633 (+  8748us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1302359296}
I20260709 13:18:32.776312 13696 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:32.626910  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 435773us
I20260709 13:18:32.773105  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2744) took 2361 ms. Trace:
I20260709 13:18:32.683815 13659 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:32.684270  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:32.684772 13756 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.688040  8101 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:32.677613 13642 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:32.698113  8182 rpcz_store.cc:276] 0709 13:18:31.558136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.898002 (+339866us) service_pool.cc:224] Handling call
0709 13:18:32.645984 (+747982us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400003054. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:32.646260 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376751872}
I20260709 13:18:32.537514 13702 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:32.697584  8253 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:32.707753  8252 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:18:32.710736  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.719182 13449 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:32.720510 13754 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:18:32.734122  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 703) took 2336 ms. Trace:
I20260709 13:18:32.733173  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1855) took 2302 ms. Trace:
I20260709 13:18:32.737143 13657 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:32.790179 13756 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:32.743186  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2747) took 2324 ms. Trace:
I20260709 13:18:32.793653  8255 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:18:32.512207 13729 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.381s	user 0.000s	sys 0.001s
W20260709 13:18:32.671332 13448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.009s	sys 0.020s
I20260709 13:18:32.777721  8174 rpcz_store.cc:276] 0709 13:18:30.411646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.714356 (+2302710us) service_pool.cc:224] Handling call
0709 13:18:32.714961 (+   605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.771801 (+ 56840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.772709 (+   908us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b54000d75d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:32.772998 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127232384}
I20260709 13:18:32.781781 13659 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.797091  8182 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:32.797215 13659 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:32.797906  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1869) took 1362 ms. Trace:
I20260709 13:18:32.798323  8182 rpcz_store.cc:276] 0709 13:18:31.435900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.796165 (+1360265us) service_pool.cc:224] Handling call
0709 13:18:32.796687 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.797610 (+   923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.797830 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:32.800372  8182 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:32.785342  8176 rpcz_store.cc:276] 0709 13:18:30.430274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.730733 (+2300459us) service_pool.cc:224] Handling call
0709 13:18:32.731446 (+   713us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:32.732696 (+  1250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.733064 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:32.801877  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 117778us
W20260709 13:18:32.802098  8183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 2757) took 1369 ms (client timeout 1808 ms). Trace:
W20260709 13:18:32.802569  8183 rpcz_store.cc:269] 0709 13:18:31.433154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.576232 (+143078us) service_pool.cc:224] Handling call
0709 13:18:32.801901 (+1225669us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400011dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:32.802045 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2314288512}
I20260709 13:18:32.803114  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 711) took 1218 ms. Trace:
I20260709 13:18:32.804137 13702 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:32.804814  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1845) took 2386 ms. Trace:
I20260709 13:18:32.806202 13642 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:32.806286  8179 rpcz_store.cc:276] 0709 13:18:30.418316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.724072 (+2305756us) service_pool.cc:224] Handling call
0709 13:18:32.773616 (+ 49544us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:32.774775 (+  1159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.804564 (+ 29789us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b54000d75d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:32.804721 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112890112}
I20260709 13:18:32.807058  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:32.808446 13685 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:32.793454  8181 rpcz_store.cc:276] 0709 13:18:30.412402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.715981 (+2303579us) service_pool.cc:224] Handling call
0709 13:18:32.716565 (+   584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:32.717421 (+   856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.736779 (+ 19358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:32.803699  8176 rpcz_store.cc:276] 0709 13:18:31.584639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.801868 (+1217229us) service_pool.cc:224] Handling call
0709 13:18:32.802320 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.802723 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.802755 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:32.802810 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:32.802853 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.802911 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.803052 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:32.810067 13738 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:32.813623 13642 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:32.815006  8072 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:32.787979  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2761) took 1353 ms. Trace:
I20260709 13:18:32.818475 13659 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:32.824656  8074 connection.cc:256] RPC call timeout handler was delayed by -1.3747909159999381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3043s for a response
I20260709 13:18:32.825822  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:32.826188  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:32.827491  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:32.787096  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:32.751986  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:32.801141  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 706) took 1243 ms. Trace:
I20260709 13:18:32.854283  8182 rpcz_store.cc:276] 0709 13:18:31.557526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.799229 (+1241703us) service_pool.cc:224] Handling call
0709 13:18:32.799835 (+   606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.800831 (+   996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.801068 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:32.847965  8180 rpcz_store.cc:276] 0709 13:18:31.434148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.777119 (+1342971us) service_pool.cc:224] Handling call
0709 13:18:32.787269 (+ 10150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.787626 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.787656 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:32.787701 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:32.787744 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.787803 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.787906 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:32.785272  8175 rpcz_store.cc:276] 0709 13:18:30.397910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.381020 (+1983110us) service_pool.cc:224] Handling call
0709 13:18:32.381292 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.724737 (+343445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.726890 (+  2153us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54002495d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:32.733987 (+  7097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787347328}
I20260709 13:18:32.861768  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:32.863094  8252 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:32.793283 13756 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:32.878671  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:32.879818  8787 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:32.880573  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 128787us
W20260709 13:18:32.883039  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 96195.8us
I20260709 13:18:32.884171  8223 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:32.884806 13766 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:32.885573 13449 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:32.890854 13449 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.917162  8257 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:32.900607 13449 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:32.920449  8256 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:32.924741 13715 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:32.920657 13718 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:32.932575  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:32.935482  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:32.941026  8223 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:32.942313 13659 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:32.943874 13416 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:32.944419 13416 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.944852 13416 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:32.946146 13655 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:32.948558 13655 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:32.949512  8784 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 12: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:32.951689  8789 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:32.952332  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:32.953356 13715 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:32.955811  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1057) took 1536 ms. Trace:
I20260709 13:18:32.963716  8250 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:32.960188  8789 rpcz_store.cc:276] 0709 13:18:31.416889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.417145 (+   256us) service_pool.cc:224] Handling call
0709 13:18:31.417499 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.951396 (+1533897us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b5400581720. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0dc3dc0 00007fa5a0e4e1c0 00007fa5a0e4f231 00007fa5a0e4bd8f 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c
0709 13:18:32.952168 (+   772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.953141 (+   973us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400580f54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:32.953379 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3330433024}
I20260709 13:18:32.983983  8787 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:32.985639 13657 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:33.002265 13625 raft_consensus.cc:2764] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:18:33.009379  8221 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:33.011927  8223 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:33.013131 13715 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:33.015446 13718 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:33.011224 13749 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:33.023012 13749 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:33.028003 13749 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:33.024756 13657 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:33.035616  8221 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:33.038877 13718 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:33.039567 13749 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:33.046016  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:33.048465 13449 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:33.054945  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:33.055765  8789 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:33.055420 13416 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:33.057801  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:33.058085  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:33.059021  8783 raft_consensus.cc:2393] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:33.061331  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:33.069582  8074 connection.cc:256] RPC call timeout handler was delayed by -1.2905982560000666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
W20260709 13:18:33.067616  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 64802us
I20260709 13:18:33.075181 13693 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:33.075987 13693 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:33.077346 13693 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:33.085785 13775 log.cc:927] Time spent T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:18:33.087343 13416 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:33.095074  8250 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:33.052529 13734 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:33.097573  8789 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:33.098914  8250 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:33.102042 13449 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:33.109709 13734 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:33.119478  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:33.121095  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.122498  8250 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:33.124668  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:33.125869 13449 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:33.161723  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:33.162496  8255 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:33.162992  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:33.165699  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:33.166615  8251 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:33.167575  8178 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1870) took 1731 ms (client timeout 1638 ms). Trace:
W20260709 13:18:33.167958  8178 rpcz_store.cc:269] 0709 13:18:31.436184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.447579 (+ 11395us) service_pool.cc:224] Handling call
0709 13:18:33.167236 (+1719657us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400332054. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:33.167386 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3179524864}
I20260709 13:18:33.174499 13603 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:33.175424 13603 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:33.178368  8253 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:33.181121  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:33.184448  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:33.185209 13706 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:33.185900 13706 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:33.187026 13706 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:33.187718 13457 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:33.188115  8177 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:33.189472 13736 raft_consensus.cc:3055] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:33.189880 13736 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:33.194644  8255 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:33.193619 13449 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.197774 13449 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:33.198704 13343 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.200099 13449 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:33.199358 13343 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:33.191023 13736 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:33.250059 13736 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:33.367115  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 296808us
W20260709 13:18:33.371390  8074 connection.cc:256] RPC call timeout handler was delayed by -1.1933982560001368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
W20260709 13:18:33.371714  8074 connection.cc:256] RPC call timeout handler was delayed by -1.1573982560000786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
W20260709 13:18:33.389606 13781 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:18:33.393356  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:33.394335  8178 raft_consensus.cc:2368] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 15. Current term is 16.
I20260709 13:18:33.396046  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:33.396402  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:33.396847  8178 raft_consensus.cc:2368] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12.
I20260709 13:18:33.397063  8175 raft_consensus.cc:2376] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16. Re-sending same reply.
I20260709 13:18:33.398149  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:33.398958  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:33.399593  8180 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:33.399417  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:33.400637  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:33.400771  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:33.401815  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:33.402467  8175 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
W20260709 13:18:33.402877  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 276265us
I20260709 13:18:33.403147  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:33.402549  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:33.403918  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:33.404500  8180 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:33.402040  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:33.405598  8178 raft_consensus.cc:2410] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:18:33.405934  8223 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:33.408420  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:33.408944  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:33.417913  8223 leader_election.cc:400] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 15. Current term is 16.
I20260709 13:18:33.418241  8223 leader_election.cc:403] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:18:33.419427  8183 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
W20260709 13:18:33.468420  8177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 705) took 1927 ms (client timeout 2249 ms). Trace:
W20260709 13:18:33.469861  8177 rpcz_store.cc:269] 0709 13:18:31.541289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.108271 (+566982us) service_pool.cc:224] Handling call
0709 13:18:33.468105 (+1359834us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400011154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:33.468338 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2381901696}
W20260709 13:18:33.479329  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:33.500072  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:33.515627  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 322317us
I20260709 13:18:33.517763  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:33.516655  8223 leader_election.cc:400] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12.
I20260709 13:18:33.518509  8223 leader_election.cc:403] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:18:33.527683  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 712762us
I20260709 13:18:33.529914  8072 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:33.560940  8251 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:33.568646 13495 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:33.569629 13495 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:33.570061 13495 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:33.570525 13495 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:33.578811 13449 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:33.580669 13449 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.581344 13449 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 15. Current term is 16.
I20260709 13:18:33.582109 13449 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:33.582624 13449 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:33.583745 13449 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:33.590526 13495 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:33.604373 13449 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.605105 13449 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:33.606305  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.607592 13449 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:33.605512 13495 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:33.611382 12886 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.612015 12886 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:33.614069 12886 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:33.614954  8174 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:33.615379 12886 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.615892 12886 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:33.617703 12886 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:33.618196  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1881) took 2088 ms. Trace:
I20260709 13:18:33.618455  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:33.618674  8174 rpcz_store.cc:276] 0709 13:18:31.529580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.796466 (+1266886us) service_pool.cc:224] Handling call
0709 13:18:32.796849 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.615491 (+818642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.617880 (+  2389us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b5400332a54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:33.618106 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1880944384}
I20260709 13:18:33.619982  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:33.620515  8181 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:33.621630  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:33.623785  8181 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 12: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:33.625249  8174 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:33.626047  8181 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:18:33.629834 13783 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.238s	user 0.005s	sys 0.000s
I20260709 13:18:33.694360  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:33.695907  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:33.696501  8254 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:33.697324  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:33.698064  8254 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:33.698930  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:33.700250  8254 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:33.702317  8254 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:33.708446 13754 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:33.709141 13754 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:33.710729 13711 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.711400 13711 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:33.713284  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 272851us
I20260709 13:18:33.713783 13711 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:33.714395 13711 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 11. Current term is 12.
I20260709 13:18:33.714902  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:33.715808 13711 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:33.716403  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:33.717312 13711 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:33.717790 13711 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:33.718225 13711 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:33.731669  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.734920 13343 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:33.736225  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:33.772346  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:33.745529 13657 consensus_queue.cc:1059] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:33.777109 13735 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:33.778517 13735 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.778954 13735 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:33.756036 13711 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:33.757084  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:33.762200  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:33.786391  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 50204.8us
I20260709 13:18:33.782378 13657 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:33.787856 13718 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:33.788367 13718 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:33.788793 13718 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:33.789927  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:33.791734 13717 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:33.792120 13717 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.792021 13657 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:33.792722 13717 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:33.794176  8149 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:33.795249  8253 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:33.796180 13343 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:33.796662 13343 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:33.797609 13343 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:33.798573  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:33.788020  8257 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 12: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:33.801823  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:33.806859 13657 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:33.808516 13749 consensus_queue.cc:1059] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:18:33.813843  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:33.814693  8181 raft_consensus.cc:2393] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:33.816309  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:33.816876  8174 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:33.816968  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:33.819773  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:33.819981 13603 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:33.820425  8178 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:33.813144 13749 raft_consensus.cc:3055] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:33.823980  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:33.824927 13416 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.825587 13416 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:33.826257  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:33.827039  8182 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:33.827814 13416 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:33.831054  8181 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:33.831893  8183 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:33.834800  8174 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:33.837981  8223 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:33.829300 13749 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:33.875854  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:33.877290  8784 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 16: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:33.835882 13603 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:33.877981  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:33.872905 13655 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.884479 13416 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.885070 13657 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:33.878803 13712 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:33.889289  8183 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:33.828758 13735 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:33.918157 13717 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:33.906780 13736 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:33.916376 13718 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:33.897743  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:33.950141  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 148397us
I20260709 13:18:33.907142 13711 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:33.885103 13749 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:33.909782 13791 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.895577 13416 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:33.893858 13603 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:33.912932 13659 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:33.898018 13655 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:33.907004 13657 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:33.936779  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:33.930794 13449 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:33.928447 13685 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:33.998646  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.995198 13712 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:34.007881 13718 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:34.008749 13749 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:34.003414 13736 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.021364 13736 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:34.023223  8783 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:34.027134 13694 raft_consensus.cc:3055] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:34.014775 13735 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:34.027578 13694 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:34.036522 13657 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.7, Last appended by leader: 7, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:34.037570  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:34.038297  8256 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:34.013309 13416 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:34.000900 13791 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:34.062570 13754 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:34.037992 13694 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.071676  8250 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:34.072440 13694 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:34.076233 13791 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:34.076967  8256 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:34.078364  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:34.081027  8182 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:34.083906 13766 raft_consensus.cc:697] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:34.086108  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:34.087410  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:34.088698  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:34.006172 13449 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.091130 13738 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.091741 13738 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.092367 13449 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:34.093278 13717 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:34.093670 13696 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:34.099399  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:34.100445  8255 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 15: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:34.094102 13696 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:34.104712 13696 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:34.104095 13653 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:18:34.111615  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 116697us
I20260709 13:18:34.111809  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:34.103790  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:34.114880 13603 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:34.115540  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:34.116765  8789 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.023s	sys 0.018s
W20260709 13:18:34.117070  8789 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.023s	sys 0.018s
I20260709 13:18:34.112533  8180 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:34.120510  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:34.108727 13642 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:34.125826  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:34.126940  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:34.127663  8183 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:18:34.125007  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:34.123837  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:34.116637  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:34.130865  8176 raft_consensus.cc:2368] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14.
I20260709 13:18:34.134254 13655 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:34.134721  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 604912us
I20260709 13:18:34.134274 13724 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:34.136783 13724 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.125857 13717 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:18:34.139123  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:34.140041  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:34.140651  8177 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:34.143714 13724 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:34.144281  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:34.132661 13694 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:34.145167 13694 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.145617 13694 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:34.150431  8147 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:34.150993 12721 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:34.156435  8223 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:34.153162 12721 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:34.160440  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:34.165726 13732 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.166247 13732 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:34.168286 13732 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:34.168766 13737 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:18:34.169885 13495 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:34.171319  8099 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:34.171640 13712 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:34.172065 13712 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.172389 13712 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:34.173316  8104 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:34.125960 13735 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:34.171238  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:34.131563 13749 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:34.154320 13715 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:34.181401 13735 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.160787 13659 raft_consensus.cc:2764] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:18:34.153975 13457 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.180918  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:34.085019 13766 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.192683  8105 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:34.190713  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 54613.8us
I20260709 13:18:34.130972 13711 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:18:34.177572 13718 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.164911 12721 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.205911  8100 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:34.208720 13712 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:34.163400 13734 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.188031 13749 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.181391 13495 raft_consensus.cc:697] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:18:34.216882  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 137736us
I20260709 13:18:34.223361  8177 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:34.197772 13735 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:34.200866 13715 raft_consensus.cc:697] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:34.211994 12721 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:34.265064  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:34.211333 13732 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.276932 13495 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.281137 13659 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:34.282114  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:34.283740 13735 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:34.284020  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:34.285118  8108 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:18:34.304111  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 103982us
I20260709 13:18:34.253402 13685 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.291702  8101 raft_consensus.cc:2368] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:18:34.254756 13749 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:34.299764  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:34.300001 13655 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:34.301501  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 162509us
I20260709 13:18:34.304977  8103 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 13: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:34.236109 13642 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
I20260709 13:18:34.252655 13738 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:34.211539 13718 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:34.308387  8105 raft_consensus.cc:2410] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:18:34.264401 13653 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:34.256857 13734 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:34.205790 13457 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.339334  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:34.339389  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:34.341984  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:34.342092  8103 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 13: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:34.331420  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:34.340123  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.313548 13625 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:18:34.312209 13696 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.452510 13696 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:34.336688 13732 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.435205 13343 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:34.435693  8001 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36106 (request call id 203) took 11871 ms (client timeout 15000 ms). Trace:
I20260709 13:18:34.448794 13718 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:34.436985  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 95074.7us
I20260709 13:18:34.426720  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:34.398496  8106 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:34.426187  8102 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:34.408118 12886 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.344408  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:34.384373  8149 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:34.409045  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 65152.6us
I20260709 13:18:34.466701  8108 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:34.467953  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:34.414060  8204 debug-util.cc:398] Leaking SignalData structure 0x7b080014d340 after lost signal to thread 7005
I20260709 13:18:34.473114  8105 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
W20260709 13:18:34.473745  8204 debug-util.cc:398] Leaking SignalData structure 0x7b080022f980 after lost signal to thread 8040
I20260709 13:18:34.474090  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:34.475123  8204 debug-util.cc:398] Leaking SignalData structure 0x7b0800109500 after lost signal to thread 8132
I20260709 13:18:34.475409  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:34.475721  8204 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba800 after lost signal to thread 8133
I20260709 13:18:34.476125  8105 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
W20260709 13:18:34.477097  8204 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4ec0 after lost signal to thread 8207
I20260709 13:18:34.477577 13696 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:34.477031  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:34.478348  8204 debug-util.cc:398] Leaking SignalData structure 0x7b0800358880 after lost signal to thread 8281
I20260709 13:18:34.478228 13696 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:34.478734  8204 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9060 after lost signal to thread 8282
I20260709 13:18:34.478823  8105 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
W20260709 13:18:34.480050  8204 debug-util.cc:398] Leaking SignalData structure 0x7b080036fc80 after lost signal to thread 8823
W20260709 13:18:34.480350  8204 debug-util.cc:398] Leaking SignalData structure 0x7b08002f1260 after lost signal to thread 8824
W20260709 13:18:34.480719  8204 debug-util.cc:398] Leaking SignalData structure 0x7b08002433c0 after lost signal to thread 13224
W20260709 13:18:34.481146  8204 debug-util.cc:398] Leaking SignalData structure 0x7b0800202e80 after lost signal to thread 13617
W20260709 13:18:34.481854  8204 debug-util.cc:398] Leaking SignalData structure 0x7b080034fe00 after lost signal to thread 13728
W20260709 13:18:34.482141  8204 debug-util.cc:398] Leaking SignalData structure 0x7b08003deb60 after lost signal to thread 13731
I20260709 13:18:34.487496  8108 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:34.464517 12886 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:34.513612  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 56629us
I20260709 13:18:34.514367  8101 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:34.518406  8787 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:34.364748 13754 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:34.453153 13694 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:34.335172 13685 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.492398  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:34.332913 13659 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.384950 13642 consensus_queue.cc:1243] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer 5033fc7e66374940a203908ea8b0078f log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:18:34.332732 13655 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.456610 13603 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.529277  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:18:34.550237  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.554821  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:34.555505  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:34.531137  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:34.531654  8788 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:34.434876 13680 consensus_queue.cc:1059] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.174s
I20260709 13:18:34.532095 13740 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:18:34.488996 13625 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:18:34.582808  8784 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:34.461952 13699 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:34.535295  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 169722us
I20260709 13:18:34.494153 13734 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:34.564097  8108 raft_consensus.cc:2368] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:18:34.532310 13416 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:34.580801  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:34.529277 13754 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:34.426447 13715 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:34.588369 12886 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:34.514101 13736 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
W20260709 13:18:34.597175  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 212865us
I20260709 13:18:34.513159 13343 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:34.608130  8149 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:34.615077  8223 leader_election.cc:400] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14.
I20260709 13:18:34.616763  8223 leader_election.cc:403] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:18:34.621548  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 129057us
I20260709 13:18:34.622537 12886 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:34.624276  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:34.628193  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:34.585367 13657 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:34.632781  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:34.632921  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:34.586790 13495 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:34.601045 13718 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.606002 13754 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.641316  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:34.614509 13712 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:34.631748  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:34.633725  8108 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:34.582785 13799 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:34.650707 13799 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:34.613988 13711 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:34.589118 13735 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:34.621842  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:34.635263  8107 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:34.583772 13603 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.630062 13694 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:34.661077  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:34.662070  8255 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:34.665241  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:34.635605 13495 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:34.456965  8001 rpcz_store.cc:269] 0709 13:18:22.527378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.527684 (+   306us) service_pool.cc:224] Handling call
0709 13:18:34.364088 (+11836404us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:31.447193 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:31.701413 (+254220us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:31.737211 (+ 35798us) write_op.cc:435] Acquired schema lock
0709 13:18:31.737231 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:31.738299 (+  1068us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:31.738356 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:31.738382 (+    26us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:18:31.739290 (+   908us) tablet.cc:701] Row locks acquired
0709 13:18:31.739305 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:18:31.739479 (+   174us) write_op.cc:270] Start()
0709 13:18:31.739605 (+   126us) write_op.cc:276] Timestamp: P: 1783603111739427 usec, L: 0
0709 13:18:31.739629 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:18:31.740526 (+   897us) log.cc:844] Serialized 4750 byte log entry
0709 13:18:32.543388 (+802862us) op_driver.cc:464] REPLICATION: finished
0709 13:18:32.552392 (+  9004us) write_op.cc:301] APPLY: starting
0709 13:18:32.552519 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:32.931248 (+378729us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:32.937615 (+  6367us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:33.074816 (+137201us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:33.173677 (+ 98861us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:18:33.173729 (+    52us) write_op.cc:312] APPLY: finished
0709 13:18:33.174280 (+   551us) log.cc:844] Serialized 113 byte log entry
0709 13:18:33.178652 (+  4372us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:33.178960 (+   308us) write_op.cc:454] Released schema lock
0709 13:18:33.179046 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:33.179663 (+   617us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:33.179703 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2007466,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":8740,"apply.run_cpu_time_us":25458,"apply.run_wall_time_us":627096,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54263,"num_ops":12,"prepare.queue_time_us":121253,"prepare.run_cpu_time_us":24117,"prepare.run_wall_time_us":1012746,"raft.queue_time_us":63684,"raft.run_cpu_time_us":3753,"raft.run_wall_time_us":8493,"replication_time_us":803543,"thread_start_us":800585,"threads_started":4,"wal-append.queue_time_us":659467,"wal-append.run_cpu_time_us":10868,"wal-append.run_wall_time_us":1770467}]]}
I20260709 13:18:34.672593  8177 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:34.682169  8103 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:18:34.683151  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:34.683053  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:34.667990 13712 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:34.684309  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:34.618897 13699 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.682530  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:34.668254 13448 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:34.698994  8255 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
W20260709 13:18:34.700388  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 65001.6us
I20260709 13:18:34.697983  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:34.701701  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 79313.9us
I20260709 13:18:34.702091  8103 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:34.702224  8256 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:34.702523  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:34.670670 13495 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:34.697037  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 82171.7us
I20260709 13:18:34.682789 13680 raft_consensus.cc:3055] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:34.685214 13812 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:34.691469 13625 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:34.707755  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:34.705533  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:34.644389 13718 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:34.710840 13655 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:34.711077 13659 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:34.721354  8101 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:34.724864  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:34.729897 13718 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:34.733810  8253 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:34.671527 13808 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:18:34.704972 13740 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:18:34.723075 13804 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:18:34.719102 13812 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.707419 13798 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.739611  8100 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:34.742446  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:34.758119  8102 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:34.739569  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:34.707113 13680 raft_consensus.cc:740] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:34.718029 13732 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:34.759017  8256 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:34.743163 13685 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:34.739972 13814 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.774645  8253 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
W20260709 13:18:34.759276 13807 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:18:34.760383  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:34.761584 13724 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:34.779834 13815 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.781849  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:34.782094 13815 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.782570  8102 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:34.783464  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:34.783972  8102 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:34.784253 13815 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:34.749974 13818 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:34.774643 13798 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.763828  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:34.764803  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:34.740522 13711 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:34.806034 13816 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.806855 13718 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.806602 13816 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.807452 13820 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:34.808931 13816 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:34.810202 13799 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:34.763506 13749 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:34.812132 13806 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.188s	user 0.002s	sys 0.000s
I20260709 13:18:34.812664 13749 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:34.813611  8249 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:34.780189  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:34.799497 13798 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:34.781581 13724 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:34.805709 13817 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.807397 13718 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.785888 13814 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.822772  8107 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:34.756645 13449 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:34.849968  8783 raft_consensus.cc:2410] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:18:34.756640 13812 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.853751  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:34.854496  8105 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:34.846956  8103 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
W20260709 13:18:34.795890 13801 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 13:18:34.855451  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 136034us
I20260709 13:18:34.845777 13818 raft_consensus.cc:697] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:34.852804 13740 raft_consensus.cc:697] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:34.727380 13625 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.862572  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:34.863888  8255 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:34.865324  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:34.866655  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:34.866153  8103 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:34.872160  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:34.872772  8103 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:34.874110  8103 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:34.862056 13818 consensus_queue.cc:237] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.885885 13696 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:34.886296 13822 log.cc:927] Time spent T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:18:34.888441 13805 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:18:34.892311 13788 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:34.892959 13814 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:34.862208 13817 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.893530 13814 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:34.891208 13740 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.895603 13817 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:34.916674  8099 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:34.902661 13711 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:34.922034 13711 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:34.885885 13819 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:18:34.939906  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:34.898222 13732 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:34.948971  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:34.950196  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 191963us
W20260709 13:18:34.999868  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 60083us
I20260709 13:18:35.003026  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:35.009970  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 61105.7us
I20260709 13:18:35.012290  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:35.012928  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:35.022414 13416 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:35.022953 13416 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.023658 13416 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:35.024128 13821 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:18:35.022878 13808 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:35.030884  8103 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:18:35.031227  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:35.032425 13416 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.032611  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:35.035130  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:35.036190  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:35.037246  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:35.037804  8101 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:35.041595 13828 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:35.042342 13828 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.045032 13828 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:35.046741 13416 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:35.047480 13734 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:35.048067  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.050216 13457 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:34.916877 13724 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:35.051345 13343 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:35.053774 13699 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:35.056634  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 171229us
I20260709 13:18:35.096362  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:35.096539  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:35.058158  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 55208.4us
I20260709 13:18:35.097146  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:35.097539  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:35.098959  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:35.060034  8105 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:18:35.062623  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:35.062964 13798 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:35.066269  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:35.070775  8102 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:35.051342  8256 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:34.998868 13817 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:35.075845  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:35.115494  8181 raft_consensus.cc:2393] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 19: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:35.115940  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:35.076083  8179 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:18:35.078651 13812 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.126344 13625 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:35.126914 13812 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:35.093267 13732 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:35.127743 13732 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:34.919023 13680 consensus_queue.cc:260] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:35.129837 13732 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:35.130138 13680 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:35.130951  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:35.082384 13800 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:35.084532  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:35.003412 13603 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:35.150609  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.088706  8101 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:35.093232  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:35.011399 13791 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:35.094761  8253 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:18:35.097476  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:35.113569  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:35.097738  8180 raft_consensus.cc:2376] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15. Re-sending same reply.
I20260709 13:18:35.081631 13811 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.142823 12886 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:18:35.145388  8174 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:35.143273  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:35.149744  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:35.141314  8106 consensus_meta.cc:287] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.675s	user 0.008s	sys 0.000s
I20260709 13:18:35.161092  8106 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:35.167881  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:35.170418  8175 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:35.170611  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:35.114302 13694 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:35.114569 13815 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:35.142421 13810 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:35.174682  8105 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:35.176728  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:35.177335  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:35.147902 13800 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:35.177558  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 46718.2us
I20260709 13:18:35.179562  8106 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:35.142628 13735 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:35.186604  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:35.187433  8183 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:35.167625 13642 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:35.193660  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:35.196877  8108 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:35.114498 13734 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:35.116345 13495 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.210770  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:35.200651  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:35.198490 13712 consensus_meta.cc:287] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.002s
I20260709 13:18:35.212973 13712 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 13. Current term is 14.
I20260709 13:18:35.131583 13817 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.213766  8105 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:35.214965 13817 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:35.215227  8105 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:35.216032 13810 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:35.217002 13810 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.220466  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:35.213254  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:35.192181 13800 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:35.183830 13718 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:35.209719  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 62799.4us
I20260709 13:18:35.222718  8248 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:35.183275 13694 raft_consensus.cc:697] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:35.213214 12721 consensus_meta.cc:287] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.902s	user 0.005s	sys 0.005s
I20260709 13:18:35.269567  8100 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
W20260709 13:18:35.273686  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 261475us
I20260709 13:18:35.274466  8223 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:35.171801 13811 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.196239 13735 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.238018  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:35.278683  8783 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:35.279538  8102 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:35.263633  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:35.277915  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:35.282230  8784 raft_consensus.cc:2410] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:18:35.230098  8174 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:18:35.286966  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:35.289366 12886 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:18:35.296765  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 96220.4us
I20260709 13:18:35.273545 13659 raft_consensus.cc:2764] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:18:35.297178 12886 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:35.316203  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:35.322818  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:35.324045  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:35.326110  8784 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:35.270478 13815 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:18:35.333276  8149 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:35.309945 13449 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:35.342509  8103 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 7. Preceding OpId from leader: term: 20 index: 8. (index mismatch)
I20260709 13:18:35.273869 12721 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:35.346236  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:35.348680  8099 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:35.327934 13814 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:18:35.356406 13836 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:18:35.381690  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:35.382606  8789 raft_consensus.cc:2410] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:18:35.383466  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:35.340683 13799 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:35.365938 13449 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:35.366395 13734 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:35.389389  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:35.401873  8788 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:35.339424 13642 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:18:35.408179  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:35.386700 13800 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:35.411417 13754 consensus_meta.cc:287] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.744s	user 0.011s	sys 0.000s
W20260709 13:18:35.416141  8755 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.129:45123 timed out after 1.637s (SENT) [suppressed 19 similar messages]
I20260709 13:18:35.418143  8181 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:18:35.418886  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:35.419492  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:35.421144 13823 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.371s	user 0.004s	sys 0.000s
I20260709 13:18:35.421504  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:35.384505 13495 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:35.404665 13696 raft_consensus.cc:2764] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:18:35.405046 13802 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:35.446242  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 80002.1us
I20260709 13:18:35.451442 13810 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:18:35.452031  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:35.452919  8102 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:35.454200  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:35.455817 13788 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:35.435278 13754 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:35.457782 12721 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:35.459388 13754 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:35.459728  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:35.461114 13800 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:35.461159 13799 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:35.462061 13799 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:35.462494 13799 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:35.462697  8782 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:35.465832  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:35.466393  8105 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:18:35.470242 13799 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.482057 13799 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:35.346836 13694 consensus_queue.cc:237] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.491639  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:35.494439  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:35.495103 13735 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:35.445663 13802 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.496261 13802 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:35.498835 13811 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:35.509450 13724 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:35.520025  8104 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:35.521560  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:35.522347  8100 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:35.531214  8105 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:35.536303  8099 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:35.521301  8783 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:35.553834  8100 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:35.541098  8108 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:35.551867  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:35.565109  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:35.570849  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 154728us
I20260709 13:18:35.571264  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2987) took 1120 ms. Trace:
I20260709 13:18:35.572705  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 774) took 1275 ms. Trace:
I20260709 13:18:35.573113  8104 rpcz_store.cc:276] 0709 13:18:34.297219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.931743 (+634524us) service_pool.cc:224] Handling call
0709 13:18:34.951765 (+ 20022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.520457 (+568692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.569377 (+ 48920us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54000f4454. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:35.572647 (+  3270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1306008448}
I20260709 13:18:35.571657  8106 rpcz_store.cc:276] 0709 13:18:34.450528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.299060 (+848532us) service_pool.cc:224] Handling call
0709 13:18:35.324140 (+ 25080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.504951 (+180811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.504984 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:35.505026 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:35.505060 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.571059 (+ 65999us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54003f2d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:35.571102 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.571211 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415324416}
W20260709 13:18:35.576752  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.544960 13814 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:35.578253  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:35.580371 13815 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.600996 13735 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:35.601135 13815 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:35.602128 12721 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:35.602681 12721 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:35.604733  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.555166 13448 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:18:35.603600 12721 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.603659 13815 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:35.576049 13811 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:35.567044 13724 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:18:35.582170 13812 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:35.612107  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:35.613929  8104 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
W20260709 13:18:35.617185  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 46980.6us
I20260709 13:18:35.614509 13724 consensus_queue.cc:1243] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:35.610383 13754 consensus_queue.cc:1059] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:18:35.617581 13812 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:35.625737 13811 raft_consensus.cc:697] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:35.648664  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:35.656086  8149 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:35.659271 13844 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:18:35.660916 13833 log.cc:927] Time spent T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.460s	user 0.004s	sys 0.003s
I20260709 13:18:35.649829 13814 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.669552 13449 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.672302 13449 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:35.673946  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.683369 13812 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.690214  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3089) took 1003 ms. Trace:
I20260709 13:18:35.690887  8249 rpcz_store.cc:276] 0709 13:18:34.686930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.815539 (+128609us) service_pool.cc:224] Handling call
0709 13:18:34.815847 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.816067 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:34.928656 (+112589us) log.cc:844] Serialized 14 byte log entry
0709 13:18:35.058815 (+130159us) log.cc:844] Serialized 14 byte log entry
0709 13:18:35.686760 (+627945us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b18003acd20. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dcd9c0a 00007fa5a7419219 00007fa5a4d2058f 00007fa59dd5f571 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd
0709 13:18:35.689671 (+  2911us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:35.689756 (+    85us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:35.689837 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.689936 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.690131 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":733979,"prepare.queue_time_us":108981,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":97,"raft.queue_time_us":16316,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":51005312,"thread_start_us":181776,"threads_started":2,"wal-append.queue_time_us":213857}
I20260709 13:18:35.696713 13828 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:35.697288 13828 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.698930 12886 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:35.699532 12886 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.699954 12886 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:35.714745  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:35.715466  8786 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:35.716652 13798 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.717259 13828 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:35.717360 13798 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:35.720494 13798 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:35.726241 13718 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:35.726701 13718 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:35.727106 13718 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:35.729703 13680 raft_consensus.cc:3055] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:35.730332 13680 raft_consensus.cc:740] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:18:35.725193  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 450780us
I20260709 13:18:35.733839  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:35.734690  8784 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:18:35.733191  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:35.743619  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 86683.8us
I20260709 13:18:35.748451  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 777) took 1450 ms. Trace:
I20260709 13:18:35.748904  8101 rpcz_store.cc:276] 0709 13:18:34.298096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.204987 (+906891us) service_pool.cc:224] Handling call
0709 13:18:35.205278 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.205498 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:35.328102 (+122604us) log.cc:844] Serialized 14 byte log entry
0709 13:18:35.581569 (+253467us) log.cc:844] Serialized 14 byte log entry
0709 13:18:35.747947 (+166378us) log.cc:844] Serialized 14 byte log entry
0709 13:18:35.748123 (+   176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:35.748169 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:35.748217 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.748281 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.748395 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134404,"prepare.queue_time_us":74017,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":309350,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":258,"thread_start_us":326218,"threads_started":2,"wal-append.queue_time_us":266655}
I20260709 13:18:35.657570 13625 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:35.753526  8223 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:35.770933  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:35.786041  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 147776us
I20260709 13:18:35.790177  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:35.792161  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 724666us
I20260709 13:18:35.680971 13811 consensus_queue.cc:237] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.767482 13749 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:35.797833  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:35.798406  8248 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:35.779978 13715 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:35.781097 13625 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.801728  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:35.804903  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:35.807173  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2978) took 1515 ms. Trace:
I20260709 13:18:35.792104 13495 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:18:35.809674  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 58913.6us
I20260709 13:18:35.819403  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:35.819871  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:35.831426  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:35.832093  8249 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:35.820598  8254 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
W20260709 13:18:35.809114  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 111027us
I20260709 13:18:35.799465 13749 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:35.835683  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:35.821457  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:35.791776 13416 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:18:35.807587  8107 rpcz_store.cc:276] 0709 13:18:34.291762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.870152 (+578390us) service_pool.cc:224] Handling call
0709 13:18:34.874017 (+  3865us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:34.878076 (+  4059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.878114 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:34.896158 (+ 18044us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.055348 (+159190us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:35.055391 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.055459 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:35.580230 (+524771us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:35.803173 (+222943us) raft_consensus.cc:1685] finished
0709 13:18:35.803194 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.807112 (+  3918us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":445,"raft.queue_time_us":1746,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":3626,"spinlock_wait_cycles":24821376,"thread_start_us":158821,"threads_started":1,"wal-append.queue_time_us":282309}
I20260709 13:18:35.832437 13734 raft_consensus.cc:2764] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:18:35.838802  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:35.839147  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:35.839520  8785 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:35.767488 13680 consensus_queue.cc:260] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:35.840983 13680 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:35.842648 13802 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:35.804713 13625 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:35.852276  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:35.854558  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:35.856725  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:35.859272  8181 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:35.859844  8254 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: [17.10-19.11]
I20260709 13:18:35.863116  8174 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:35.863663  8248 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 16: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:35.863756  8102 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:35.801620 13828 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:35.868468  8755 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:35.869642  8074 connection.cc:256] RPC call timeout handler was delayed by -1.6347998839999036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 13:18:35.872874  8074 connection.cc:256] RPC call timeout handler was delayed by -1.1181998839999778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 13:18:35.873049  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:35.873262  8074 connection.cc:256] RPC call timeout handler was delayed by -1.0398998839998512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
I20260709 13:18:35.854651 13802 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:35.846871 13749 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:35.860719 13416 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:35.894773  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:35.876837 13846 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.244s	user 0.004s	sys 0.000s
I20260709 13:18:35.903363 13416 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.903875 13416 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:35.873080  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:35.873147  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:35.907537  8254 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:35.897240  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:35.901686  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:35.907142  8176 raft_consensus.cc:2376] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16. Re-sending same reply.
I20260709 13:18:35.805140 13696 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:18:35.801522 13838 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 13:18:35.921811 13715 raft_consensus.cc:697] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:35.923142 13715 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:35.925989 13416 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:35.917867 13828 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:35.926756  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:35.927562  8107 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:35.940759  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 66840.1us
I20260709 13:18:35.947419  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:35.926754 13831 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:36.000700 13874 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:35.943521 13828 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:35.937419 13865 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:35.997004 13734 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:36.052517  8254 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 6. Preceding OpId from leader: term: 20 index: 8. (index mismatch)
W20260709 13:18:36.036502 13859 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:18:36.068972  8174 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: [14.9-18.11]
I20260709 13:18:36.070340  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:36.042953 13838 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:36.084679  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 156088us
I20260709 13:18:36.109396  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:36.053825  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 104407us
I20260709 13:18:36.068528 13495 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:36.064922 13874 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:36.131366  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 326512us
I20260709 13:18:36.134698  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:36.136905  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:36.138137  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:36.138676  8099 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:36.145145  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:36.146673  8253 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:36.151789  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:36.152060  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:36.151942  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:36.152900  8257 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:36.157728  8104 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:36.172209  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:36.177917 13860 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 13:18:36.177996  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:36.178814  8176 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
W20260709 13:18:36.179423 13858 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
W20260709 13:18:36.180661 13854 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
I20260709 13:18:36.146461 13732 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:36.129459 13875 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:36.183754  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:36.186785  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:36.189453  8253 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:36.193655  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:36.194645  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:36.188964  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:36.190634  8784 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:36.181783  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1913) took 1201 ms. Trace:
I20260709 13:18:36.196192  8103 rpcz_store.cc:276] 0709 13:18:34.980293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.369896 (+389603us) service_pool.cc:224] Handling call
0709 13:18:35.370292 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:35.380296 (+ 10004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.380337 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:35.388582 (+  8245us) log.cc:844] Serialized 52 byte log entry
0709 13:18:35.652340 (+263758us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:35.652386 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.652451 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.181583 (+529132us) raft_consensus.cc:1685] finished
0709 13:18:36.181606 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.181731 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":15657,"thread_start_us":217737,"threads_started":1,"wal-append.queue_time_us":379357}
I20260709 13:18:36.197903  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:36.194784  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:36.198988  8107 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:36.199810  8180 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:36.113006 13838 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.201033  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:36.201576  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:36.162763 13448 raft_consensus.cc:2764] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:18:36.202463  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:36.205163  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:36.210028  8183 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:36.210335  8253 raft_consensus.cc:2368] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16.
I20260709 13:18:36.194298  8179 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
W20260709 13:18:36.216707 12886 consensus_meta.cc:287] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.000s
I20260709 13:18:36.221609  8103 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:36.194510 13875 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.229701  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:36.198612 13603 raft_consensus.cc:2764] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:18:36.231120  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.203588 13734 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:36.251801  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.252236  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.232118  8147 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:36.221028 13448 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:18:36.227563  8181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:36.255895  8181 raft_consensus.cc:606] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:36.237300  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:36.252904  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 351310us
I20260709 13:18:36.238482  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:36.198061 13724 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:18:36.241607 13862 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 13:18:36.241482  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:36.263764  8107 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:36.242193 13449 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:36.242936 13715 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:36.240844  8257 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:36.191385 13802 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.254069  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:36.193342 13495 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:36.251801  8221 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:36.267314  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:36.270205 13715 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:36.270027  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:36.270725  8253 raft_consensus.cc:2410] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:18:36.254741  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:36.272719  8786 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:36.272886  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:18:36.292111  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 92289.6us
I20260709 13:18:36.294003  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:36.268774 13718 consensus_meta.cc:287] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.000s
I20260709 13:18:36.292002 13802 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.315056  8257 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:36.334142  8256 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:36.334319  8178 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:36.314960 13715 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:36.231528 13875 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:36.217149 12886 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.264403 13699 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:18:36.298733  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:36.299108 13625 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.345881  8102 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:36.299558 13880 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:18:36.300187 13877 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:36.294150 13449 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.306146  8249 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:36.292975  8099 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:36.401257 13877 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:36.403586 13877 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:36.404459 13749 consensus_meta.cc:287] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.511s	user 0.004s	sys 0.004s
I20260709 13:18:36.406318 13838 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:36.336373 13718 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.265630  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:36.410624 13802 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:36.410758  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 145223us
I20260709 13:18:36.411564  8253 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:36.412053 13718 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:36.412503 13680 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:36.412890 13680 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.413213 13680 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:36.330226 13884 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:36.294616 13815 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:36.419126  8183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:36.419495  8783 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 18: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:18:36.325488 13888 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.151s	user 0.002s	sys 0.000s
I20260709 13:18:36.317329  8255 raft_consensus.cc:2368] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16.
W20260709 13:18:36.253722 13857 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 13:18:36.337001  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:36.268451 13754 consensus_queue.cc:1059] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:18:36.374724  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3085) took 1710 ms. Trace:
I20260709 13:18:36.379094  8103 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:36.384827  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:36.304988 13659 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:36.397193 12886 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:36.310433  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 58708.3us
I20260709 13:18:36.446914  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:36.448253  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 63669.9us
W20260709 13:18:36.448005  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 111079us
I20260709 13:18:36.413524  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:36.454663  8784 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:36.415149  8253 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:36.421222  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:36.424270  8099 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:36.454854  8074 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:36.404919 13749 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:36.456257  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:36.457618  8099 raft_consensus.cc:2376] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15. Re-sending same reply.
I20260709 13:18:36.458717  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:36.451517  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:36.428077  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:36.460656  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:36.459376  8099 raft_consensus.cc:2368] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:18:36.437943  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:36.462808  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:36.463579  8108 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:36.464951 13894 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:18:36.469594 13625 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:36.470206 13625 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:36.472096  8784 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:36.473373  8147 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:36.446993  8252 rpcz_store.cc:276] 0709 13:18:34.664685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.666081 (+  1396us) service_pool.cc:224] Handling call
0709 13:18:34.672383 (+  6302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:34.806329 (+133946us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:34.857120 (+ 50791us) log.cc:844] Serialized 14 byte log entry
0709 13:18:35.806074 (+948954us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.834489 (+ 28415us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.834689 (+   200us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:35.834725 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.374164 (+539439us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b5400071054. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:36.374231 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.374295 (+    64us) raft_consensus.cc:1685] finished
0709 13:18:36.374415 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.374619 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":632365,"prepare.queue_time_us":73788,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":639174,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":2234,"spinlock_wait_cycles":289105664,"thread_start_us":371250,"threads_started":3,"wal-append.queue_time_us":308379}
I20260709 13:18:36.474395 13724 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:36.475014  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:36.475656  8252 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:36.477674 12886 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:36.478207 12886 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.478492 12886 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:36.477785  8005 catalog_manager.cc:5697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 7 to 12, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 12 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:36.477685 13856 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:18:36.482820 13800 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:36.483160  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:36.483336 13800 raft_consensus.cc:697] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:36.484404 13800 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.418480 13874 consensus_queue.cc:1059] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:18:36.486281  8104 raft_consensus.cc:2368] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:18:36.489354  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:36.491811 12886 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:36.492223  8249 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:36.445048 13815 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:36.496345 13889 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:36.493778 13788 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:18:36.496786 13717 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:36.497272  8149 leader_election.cc:400] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16.
I20260709 13:18:36.497093 13737 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:36.448376 13659 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:36.458999 13448 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:36.502321 12886 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:36.506914  8183 raft_consensus.cc:606] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:36.507419  8183 raft_consensus.cc:614] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:36.499897  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 45156.3us
I20260709 13:18:36.456312  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:36.539423  8101 raft_consensus.cc:2376] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16. Re-sending same reply.
I20260709 13:18:36.505192  8005 catalog_manager.cc:5697] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 1 to 7, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 7 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.545421 12886 raft_consensus.cc:993] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:18:36.546192 12886 raft_consensus.cc:1081] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:18:36.546972 12886 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:36.559772 13699 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:36.559984  8221 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:36.561124 13699 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:36.561574 13699 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:36.562438 13699 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.564077 13828 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:36.563666 13699 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:36.565024  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:36.569199 13718 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:36.575134  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 137186us
I20260709 13:18:36.577792  8221 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:36.580156  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:36.582202  8108 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
W20260709 13:18:36.533527 13857 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:18:36.590979  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:36.591430  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:36.592479  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:36.446151 13893 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.113s
I20260709 13:18:36.593950 13893 consensus_queue.cc:1243] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:18:36.593369  8251 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 16: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:36.600958  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:36.602581  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:36.603544  8251 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 16: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:36.604421  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:36.606809 13882 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.440s	user 0.002s	sys 0.000s
I20260709 13:18:36.608656  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3013) took 1147 ms. Trace:
I20260709 13:18:36.609020  8106 rpcz_store.cc:276] 0709 13:18:35.460891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.575473 (+114582us) service_pool.cc:224] Handling call
0709 13:18:35.599502 (+ 24029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.787184 (+187682us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:35.890160 (+102976us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.127390 (+237230us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.145885 (+ 18495us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.146124 (+   239us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:36.146188 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.146280 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.606222 (+459942us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:36.608258 (+  2036us) raft_consensus.cc:1685] finished
0709 13:18:36.608352 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.608593 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":562355,"prepare.queue_time_us":19580,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":182681,"raft.run_cpu_time_us":394,"raft.run_wall_time_us":16563,"spinlock_wait_cycles":34792320,"thread_start_us":252872,"threads_started":2,"wal-append.queue_time_us":248442}
I20260709 13:18:36.610127 13680 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.612416 13680 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:36.614306 13754 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:36.614697 13754 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:36.617192  8223 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:36.586567 13874 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:36.586925 13870 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:18:36.585315 13448 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:36.588722  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:36.605299  8251 raft_consensus.cc:2393] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:36.627053  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:36.628765  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:36.634111  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:36.485970 13895 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.121s
I20260709 13:18:36.651708  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:36.652366  8108 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:36.647564  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:36.646576  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:36.647773  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:36.649516  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:36.619513 13718 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:36.661782  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:36.663211  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:36.665587  8106 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:36.645671 13893 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:36.646937 13696 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.669987  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:36.647188 13625 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:36.673720  8178 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:36.669160  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:36.693763  8791 raft_consensus.cc:2376] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18. Re-sending same reply.
I20260709 13:18:36.668394 13495 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:36.660511 13680 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:36.695510  8100 pending_rounds.cc:85] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 12
I20260709 13:18:36.650718 13877 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:36.659618 13895 consensus_queue.cc:1243] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:36.685359  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:36.698189  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:36.688669  8108 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
W20260709 13:18:36.698854  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 152132us
I20260709 13:18:36.665006 13718 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:36.703365  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.718995  8149 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:36.718942  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:36.690773 13724 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:36.720924  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:36.724061  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:36.684806 13865 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:36.699715 13625 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.715469  8100 pending_rounds.cc:107] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:18:36.734524  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:36.735803  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:36.653476 13448 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:36.770017  8255 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 20: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:36.771733  8251 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:36.760691  8100 raft_consensus.cc:2889] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.766250  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:36.697220 13495 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.768832  8252 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:36.726879 13718 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:36.736824 13871 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.009s	sys 0.023s
W20260709 13:18:36.784957 13871 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.009s	sys 0.024s
I20260709 13:18:36.736009 13896 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:36.786485 13724 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:36.770466 13717 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:36.738593 13895 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:36.789920 13448 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:36.791519  8255 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:36.741564  8005 catalog_manager.cc:5697] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 6 to 9, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 9 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:36.726003 13732 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:36.737493 13449 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:36.697796 13696 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:36.717773 13711 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:18:36.766835 13893 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.779517 13495 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:36.776515 13734 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:36.780575 13828 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:36.725466 13905 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.161s
W20260709 13:18:36.810192 13898 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
W20260709 13:18:36.800369 13870 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:18:36.814317  8251 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:36.771739 13625 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:36.832737  8005 catalog_manager.cc:5697] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 6 to 10, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 10 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.814523  8250 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:18:36.820425 13901 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:18:36.809513 13900 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:18:36.808516 13906 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:18:36.807057 13848 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:36.821980 13732 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.826428 13749 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:36.825306 13717 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:36.715667 13815 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.807654 13869 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.261s
W20260709 13:18:36.854161  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 203306us
I20260709 13:18:36.798585 13812 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:18:36.864483  8251 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:36.900812  8755 leader_election.cc:400] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:18:36.901197  8755 leader_election.cc:403] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:36.904587  8786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 902) took 1079 ms. Trace:
I20260709 13:18:36.834975 13893 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.905146  8786 rpcz_store.cc:276] 0709 13:18:35.825374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.826114 (+   740us) service_pool.cc:224] Handling call
0709 13:18:35.826515 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.333791 (+507276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.903608 (+569817us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54004ced54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:36.904504 (+   896us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023045888}
I20260709 13:18:36.913921  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3001) took 1780 ms. Trace:
I20260709 13:18:36.899986 13905 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.900493 13853 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:36.916498  8249 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
W20260709 13:18:36.906124 13875 consensus_meta.cc:287] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.001s
I20260709 13:18:36.914494  8105 rpcz_store.cc:276] 0709 13:18:35.133653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.550899 (+417246us) service_pool.cc:224] Handling call
0709 13:18:35.571855 (+ 20956us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.744143 (+172288us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:35.744475 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.199146 (+454671us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b1800100000. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dcd9c0a 00007fa5a7419219 00007fa59dd61a40 00007fa59dd5c4e4 00007fa59dd5c455 00007fa5a48443c7 00007fa5a0e569a7 00007fa5a0e660bf 00007fa5a0e66038
0709 13:18:36.199400 (+   254us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.199537 (+   137us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.206311 (+  6774us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.206490 (+   179us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:36.206551 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.206643 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.913616 (+706973us) raft_consensus.cc:1685] finished
0709 13:18:36.913659 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.913839 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":213029,"prepare.queue_time_us":403318,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":6898,"raft.queue_time_us":228994,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":10785,"spinlock_wait_cycles":35010944,"thread_start_us":50147,"threads_started":1,"wal-append.queue_time_us":133156}
W20260709 13:18:36.919284  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 135967us
I20260709 13:18:36.866391 13732 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:36.922004  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 155842us
W20260709 13:18:36.919011 13811 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.003s	sys 0.010s
I20260709 13:18:36.931651  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:36.932330  8106 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:36.935325  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:36.924806 13811 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.003s	sys 0.010s
I20260709 13:18:36.918447 13853 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:36.952500  8106 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:36.955551  8107 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:36.957871 13853 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:36.946130 13717 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.922075 13875 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.965974 13875 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:36.943183 13921 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:36.966835 13921 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:18:36.969250  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 68583.9us
W20260709 13:18:36.971441 13884 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.002s
I20260709 13:18:36.972122 13884 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:36.920471 13905 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.977995 13932 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.979676 13893 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:36.980315 13893 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:18:36.985793 13925 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:18:36.990427 13718 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.981133 13932 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:36.995231  8755 leader_election.cc:400] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:18:37.010056  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:37.020378  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:37.000938  8253 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:36.968852 13896 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:37.023875 13932 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:37.023931 13893 raft_consensus.cc:2764] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
W20260709 13:18:37.024816 13929 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:18:37.024731  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:37.025873 13893 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:37.026422 13893 raft_consensus.cc:697] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:18:37.027590 13715 consensus_meta.cc:287] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.692s	user 0.005s	sys 0.005s
I20260709 13:18:37.027323 13893 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:37.031069  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:37.032930  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:37.028030 13715 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.028448  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:37.029201 13905 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:37.029423  8782 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: [15.12-17.13]
I20260709 13:18:37.030001  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:37.029718 13921 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:37.038640  8252 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:37.041349  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:37.042768  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:37.017715 13696 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:37.084499 13896 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:37.085608  8072 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:37.087055 13896 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:37.033097 13932 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:18:37.089910  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:37.091421  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:37.092079  8104 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
W20260709 13:18:37.092257 13889 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.000s
I20260709 13:18:37.092793 13889 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:37.093267  8106 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:37.095059  8255 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:18:37.097659 13715 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:37.114375 13799 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:37.114873 13799 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:37.115852 13799 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.038265 13495 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.120433  8102 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:37.163769  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:37.188756  8102 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:18:37.229476  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 65794.8us
I20260709 13:18:37.230592  8074 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:18:37.233315  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 192301us
I20260709 13:18:37.161018 13921 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:37.163894 13896 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:37.138983 13868 raft_consensus.cc:3055] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:37.117399 13799 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:37.044901 13925 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.191s
I20260709 13:18:37.162416 13495 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:37.154017 13891 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:37.247746  8102 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.237252 13696 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:37.265199 13923 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:18:37.239583 13922 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:37.254179 13868 raft_consensus.cc:740] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:18:37.283529  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.132185 13930 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.142s
I20260709 13:18:37.268477 13891 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:37.261945 13448 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:18:37.285665 13922 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:37.233304 13625 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:37.330132  8254 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:37.326041 13891 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.335494 13891 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:37.337586 13892 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.338128 13892 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.340080 13892 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:37.334730  8789 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:37.341128  8255 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:37.344973  8180 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:18:37.345201  8179 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:37.346565  8181 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:18:37.346976  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.347536  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.348534  8182 raft_consensus.cc:2410] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:18:37.348748  8251 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:37.349490  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.349666  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:37.350090  8183 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:37.350410  8250 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:37.350529 13694 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.351330  8178 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:18:37.353189  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 112035us
I20260709 13:18:37.355796  8175 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:18:37.321061 13896 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:37.356729 13448 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:37.357015  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:37.351035 13694 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.355736 12721 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:18:37.347805  8179 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:18:37.363799  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.364990  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.372331  8787 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:18:37.341565 13495 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.376904 12721 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:37.377394 12721 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:37.377732 13625 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:37.268643 13895 consensus_queue.cc:1175] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a0f96c12124b4e1a816d9fa970464091" responder_term: 19 status { last_received { term: 19 index: 12 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:37.378225 12721 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:37.378945 13936 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:37.379423 12721 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:37.342057 13718 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:37.357268 13448 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.388016  8255 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:37.389562  8257 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: [17.10-19.11]
I20260709 13:18:37.394748  8251 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:18:37.403304  8105 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:37.406862  8106 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:37.408308 13922 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:37.389129  8256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57566
I20260709 13:18:37.414096  8256 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:37.414649  8256 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:37.326853 13868 consensus_queue.cc:260] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:37.419847 13868 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:37.396827 13791 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:18:37.393321 13735 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:37.424667 13735 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.433017  8784 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
W20260709 13:18:37.434804  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:37.439250  8223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.010s	sys 0.002s
I20260709 13:18:37.439390 13448 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:37.439675  8223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.010s	sys 0.002s
I20260709 13:18:37.439944 13448 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:37.440550 13448 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.442907 13659 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.444149 13659 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:37.439971  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 768627us
I20260709 13:18:37.449550  8223 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:37.450810  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:37.451853  8106 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:37.455719  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.455945  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.456382  8180 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:37.456446  8179 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:37.458112  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:37.465402  8223 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:37.467518 13712 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:37.468195 13712 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:37.469319 13712 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:37.390064 13495 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.488517 13495 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:37.478590  8105 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:37.481806 13863 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:18:37.482268  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.465415 13921 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:37.503675  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.483955 13694 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:37.499749  8256 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:37.484474  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.457557 13718 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:37.493196  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:37.504765  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:37.452989 13892 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:37.506078  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:37.507097  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:37.507390  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:37.504935  8178 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:18:37.534052  8183 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:37.533910  8182 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:37.535880  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.533461 13921 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:37.538479  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:37.539613  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:37.540596  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:37.532509 13718 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.542791 13718 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:37.496277 13893 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:37.546072 13893 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:37.548110 13863 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:37.548501 13715 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:37.548650 13893 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:37.549222 13828 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:37.549089 13715 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.549758 13828 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.551224 13715 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:37.551748 13828 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:37.552121  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:37.549105 13863 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:37.552896  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.554126  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:37.554690 13828 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:37.555785 13930 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:37.553262 13921 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:37.556537  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:37.536540 13448 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:37.557453  8099 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:37.560555 12721 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.560377  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.566495 12721 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.563359  8256 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:37.564677  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:37.573298  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:37.574517  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:37.575008 12721 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:37.575361  8105 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:18:37.578961  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:37.586426  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 221272us
I20260709 13:18:37.556624 13869 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:37.588474  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.596712  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.596807  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.601565  8180 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:37.621876  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.623023  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:37.587750 13732 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:37.569406 13715 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:18:37.632349  8107 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:18:37.597750 13933 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:37.570282 13892 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.635425  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.584460 13931 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:37.637657  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.638957  8105 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
W20260709 13:18:37.654853 13881 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 1.354s	user 0.008s	sys 0.000s
W20260709 13:18:37.655503 13934 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.346s	user 0.000s	sys 0.002s
I20260709 13:18:37.656546  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3105) took 1791 ms. Trace:
I20260709 13:18:37.657902  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 792) took 1006 ms. Trace:
I20260709 13:18:37.658210 13892 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:37.658273  8100 rpcz_store.cc:276] 0709 13:18:36.651101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.654123 (+  3022us) service_pool.cc:224] Handling call
0709 13:18:36.684757 (+ 30634us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:36.906494 (+221737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.906539 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:36.907972 (+  1433us) log.cc:844] Serialized 52 byte log entry
0709 13:18:37.034355 (+126383us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:37.091182 (+ 56827us) log.cc:844] Serialized 14 byte log entry
0709 13:18:37.091540 (+   358us) log.cc:844] Serialized 14 byte log entry
0709 13:18:37.091693 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.091763 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.654872 (+563109us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:37.657711 (+  2839us) raft_consensus.cc:1685] finished
0709 13:18:37.657733 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.657848 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58027,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":6075,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":5271,"spinlock_wait_cycles":23147392,"thread_start_us":222903,"threads_started":2,"wal-append.queue_time_us":344238}
I20260709 13:18:37.663277  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2790) took 1114 ms. Trace:
I20260709 13:18:37.663816 13696 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:37.666175  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2780) took 1213 ms. Trace:
I20260709 13:18:37.663691  8252 rpcz_store.cc:276] 0709 13:18:36.548671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.777215 (+228544us) service_pool.cc:224] Handling call
0709 13:18:36.777932 (+   717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.045274 (+267342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.663034 (+617760us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54002805d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:37.663215 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599059328}
I20260709 13:18:37.669462  8182 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:37.656998  8248 rpcz_store.cc:276] 0709 13:18:35.865836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.866266 (+   430us) service_pool.cc:224] Handling call
0709 13:18:35.894851 (+ 28585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.895180 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.895288 (+   108us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.926202 (+ 30914us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.052283 (+126081us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:36.052322 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.052399 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.654118 (+1601719us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:37.656218 (+  2100us) raft_consensus.cc:1685] finished
0709 13:18:37.656244 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.656482 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":145884,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":4654,"spinlock_wait_cycles":16122112,"thread_start_us":125662,"threads_started":1,"wal-append.queue_time_us":298850}
I20260709 13:18:37.666639  8253 rpcz_store.cc:276] 0709 13:18:36.452827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.461124 (+  8297us) service_pool.cc:224] Handling call
0709 13:18:37.665391 (+1204267us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b5400268254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:37.666108 (+   717us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108696832}
I20260709 13:18:37.639760 13933 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.647007 13931 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.679055  8787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1088) took 1031 ms. Trace:
I20260709 13:18:37.679656  8787 rpcz_store.cc:276] 0709 13:18:36.647709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.648243 (+   534us) service_pool.cc:224] Handling call
0709 13:18:36.663612 (+ 15369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:37.372828 (+709216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.678666 (+305838us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b54005226d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:37.678971 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1628059904}
I20260709 13:18:37.554921 13880 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:37.671860 13922 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.679718 13696 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:37.703051  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 121358us
W20260709 13:18:37.707079  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 151798us
W20260709 13:18:37.707530  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 116504us
I20260709 13:18:37.708786 13495 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:37.709649  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:37.710830 13865 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:37.708786  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:37.712153  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:37.713420 13863 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:37.714440 13863 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.714911  8100 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:18:37.682080 13933 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:37.717998  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.717998  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:37.719313  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:37.681929 13931 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:37.692082 13880 consensus_queue.cc:1243] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:37.721717  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:37.762873  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:37.763208  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:37.763605  8787 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:37.766806  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:37.767573  8791 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:37.742847  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:37.726500  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.739763  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:37.747133  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:37.753599  8101 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:37.746011  8177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:37.756613  8782 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:37.717567  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.781783  8180 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:37.757756  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:37.720125 13922 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.687793 13895 consensus_queue.cc:1059] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:18:37.759200 13848 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:37.810356 13848 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:37.810400 13895 raft_consensus.cc:3055] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:37.811017 13895 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:37.811888 13895 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:37.813144 13895 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:37.813759 13889 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:37.814975 13945 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:18:37.815316  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 57642.3us
I20260709 13:18:37.789479 13921 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:37.816222 13891 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:37.816648 13891 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.816988 13891 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:37.819540  8782 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:37.791185 13930 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:37.768359 13863 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:37.798928 13865 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.825691 13865 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.826238  8149 leader_election.cc:400] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16.
I20260709 13:18:37.827800 13865 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:37.827564 13889 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:18:37.799193  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 77548us
I20260709 13:18:37.828543 13853 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:37.829295  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:37.830042  8252 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:37.831285  8221 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:37.832106  8183 pending_rounds.cc:85] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 8
I20260709 13:18:37.832427  8183 pending_rounds.cc:107] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:18:37.832647  8183 raft_consensus.cc:2889] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:37.832868  8102 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:37.832726  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:37.800813 13343 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:37.802081  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:37.803493  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:37.839661  8253 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:37.691586 13718 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:37.815829 13945 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:37.800935 13954 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:37.834092  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:37.834195  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:37.855425  8101 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:37.834904 13930 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:37.835510 13657 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:37.711541 13495 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.127s
I20260709 13:18:37.782335  8180 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:37.840157  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 70219.2us
I20260709 13:18:37.844058  8221 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:37.746438 13896 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:37.871307  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.880507 12721 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:37.783718  8100 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
W20260709 13:18:37.865829  8249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60806 (request call id 755) took 1316 ms (client timeout 1540 ms). Trace:
W20260709 13:18:37.882599  8249 rpcz_store.cc:269] 0709 13:18:36.555858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.591167 (+ 35309us) service_pool.cc:224] Handling call
0709 13:18:37.865585 (+1274418us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54000c9c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:37.865730 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681565952}
I20260709 13:18:37.838689 13865 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:37.877281  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:37.841183 13799 consensus_meta.cc:287] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
I20260709 13:18:37.877363  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:37.721081 13696 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:37.880846  8180 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:37.843221 13945 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:37.848203 13880 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:37.894903  8180 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:37.898384  8102 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:18:37.899163 13642 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:18:37.901372  8177 raft_consensus.cc:606] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:37.901824  8177 raft_consensus.cc:614] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:37.863562 13711 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:18:37.868577 13810 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:18:37.896220 13930 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:37.903966 13947 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:18:37.903654 13735 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:37.954085 13923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.020s	sys 0.017s
I20260709 13:18:37.900205 13732 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:37.987999 13896 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:38.037165 13895 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:38.037817 13895 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:38.000483 13923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.020s	sys 0.017s
I20260709 13:18:38.021466 13711 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:38.043699 13896 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.065691 13448 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:38.055059 13954 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.066256 13718 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:38.066440 13963 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:18:38.067854  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:38.069681 13943 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.489s	user 0.005s	sys 0.006s
W20260709 13:18:38.069813 13971 log.cc:927] Time spent T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:18:38.071910 13954 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:38.069890 13711 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:38.099911  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 911) took 1070 ms. Trace:
I20260709 13:18:38.100502  8789 rpcz_store.cc:276] 0709 13:18:37.029020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.032172 (+  3152us) service_pool.cc:224] Handling call
0709 13:18:37.032466 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.342554 (+310088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.099612 (+757058us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400730354. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:38.099838 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":694677760}
W20260709 13:18:38.130180  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 221520us
I20260709 13:18:38.159907  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:38.168988  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:38.110592 13896 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:38.182753  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:38.185784  8176 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:18:38.186296  8176 pending_rounds.cc:85] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 9
I20260709 13:18:38.186554  8176 pending_rounds.cc:107] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:18:38.186821  8176 raft_consensus.cc:2889] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:38.162576 13659 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.170754 13712 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:38.172741 13895 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:38.250515  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 383027us
W20260709 13:18:38.258716  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 273961us
W20260709 13:18:38.266155  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 422175us
I20260709 13:18:38.267262  8106 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:38.168957 13732 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:38.272286  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:38.272783  8221 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:38.274215  8107 raft_consensus.cc:2410] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:18:38.258716 13850 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:18:38.285290  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:38.281386  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.063979 13945 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:38.251133 13659 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:38.272256 13976 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.290089  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.293514  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:38.307755  8180 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
W20260709 13:18:38.309938  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.281524 13817 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:38.269665 13788 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:18:38.281239 13712 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:38.320182  8149 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:38.327633 13712 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:38.308688 13696 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:38.322796 13737 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:38.311422 13923 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 13:18:38.356871  8791 consensus_meta.cc:287] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.588s	user 0.013s	sys 0.008s
I20260709 13:18:38.358232  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:38.359714  8791 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:38.289487 13850 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:38.362844  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 86225us
I20260709 13:18:38.365926  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:38.366818  8100 raft_consensus.cc:2410] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:18:38.366919  8249 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 11. Current term is 12. Ops: []
W20260709 13:18:38.353627 13931 consensus_meta.cc:287] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.000s
I20260709 13:18:38.291584 13754 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:38.362828 13891 consensus_meta.cc:287] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.545s	user 0.003s	sys 0.015s
I20260709 13:18:38.315488 13976 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:38.347533 13977 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:38.373131  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:38.355008 13711 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:38.377061  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:38.360455 13717 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
W20260709 13:18:38.363620 13848 consensus_meta.cc:287] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.011s
I20260709 13:18:38.401079  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:38.441802  8248 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:38.401257  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:38.401101  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:38.403069  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:38.414016 13972 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:18:38.339257 13817 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:18:38.416359 13754 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:38.427467  8791 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:38.428988  8257 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:18:38.357312 13810 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:18:38.376048 13931 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:38.460613  8108 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:38.461338  8107 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:38.416760 13891 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:38.470574  8786 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:18:38.482300  8100 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:38.462802 13735 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:18:38.480990 13970 log.cc:927] Time spent T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:18:38.439693 13977 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:38.514092 13983 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:18:38.516525  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.517617 13659 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:38.520237 13850 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:38.521342 13891 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:38.522486 13984 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:18:38.525398 13931 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:38.529119 13863 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.707s	user 0.006s	sys 0.004s
I20260709 13:18:38.529759 13863 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:38.520898 13735 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:38.532413 13863 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:38.529112 13977 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:38.538985 13735 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:38.542079 13976 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:38.543341 13933 consensus_meta.cc:287] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.800s	user 0.009s	sys 0.001s
I20260709 13:18:38.543785 13933 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:38.546084  8785 raft_consensus.cc:2393] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:38.546978 13711 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.547534 13711 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:18:38.447115 13848 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:38.551126 13848 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:38.481299 13817 consensus_queue.cc:1243] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 5033fc7e66374940a203908ea8b0078f log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:38.553941  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:38.557976  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:38.566529  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.569591  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:38.571964  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:38.574546  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:38.575333  8104 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:38.581007  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:38.593030  8101 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:18:38.559094 13853 consensus_meta.cc:287] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.730s	user 0.019s	sys 0.005s
I20260709 13:18:38.601063  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:38.602741  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:38.573239 13891 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.611243  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:38.573840 13659 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.575834 13817 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:38.578879 13977 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.592434 13863 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:38.605541 13711 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:38.599522 13988 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:38.629734  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:38.595486 13495 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:18:38.626829 13933 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:38.616979 13891 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:38.652922  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:38.620980 13659 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:38.627372 13977 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:38.635531 13896 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:38.664151 13977 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:38.665354 13896 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:38.641342 13848 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:18:38.672618 13659 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:38.674961 13891 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:38.641585 13880 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:38.639521 13712 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:38.640777 13811 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:38.683920 13880 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:38.685037 13880 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:38.641018 13735 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 13:18:38.691831 13920 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 1.753s	user 0.004s	sys 0.004s
I20260709 13:18:38.683552 13863 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:38.698972 13863 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:38.699111 13892 raft_consensus.cc:3055] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:38.699570 13863 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:38.699738 13892 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:38.696439 13712 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:38.702116 13712 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:38.705716  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.695084 13921 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.710371 13921 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:38.716202 13966 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.716792 13966 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:38.718480 13711 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:38.719192 13966 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:38.729069 13812 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:38.730608 13812 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:38.730762 13913 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:38.734898  8252 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:38.737818  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:38.739976 13732 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:38.741292 13724 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:38.741811 13724 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:38.742736 13724 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:38.745828  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:38.746753  8182 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:38.745828  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:38.751138  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:38.753686  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:38.756699 13724 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:38.758949 13961 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.714s	user 0.001s	sys 0.011s
I20260709 13:18:38.762080  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:38.762905  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:38.765196  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:38.766705  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:38.768725  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:38.773151  8180 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:38.763952  8176 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:38.789741  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:38.790601  8178 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:38.790753  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:38.793532  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:38.795769  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:38.796058  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:38.798036  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:38.802361  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:38.806910  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:38.813189  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:38.814024  8100 raft_consensus.cc:2393] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 14: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:38.700987 13892 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:38.819801  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:38.818912  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:38.813710  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:38.823544  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:38.824142  8791 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
I20260709 13:18:38.824599  8784 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 13:18:38.824945  8784 pending_rounds.cc:85] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 14
I20260709 13:18:38.824980  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:38.825729  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:38.825286  8784 pending_rounds.cc:107] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:18:38.826792  8784 raft_consensus.cc:2889] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:38.800616 13874 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:38.831691  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.841748  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:38.815335 13694 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.818974 13933 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:38.849206  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 80578.1us
I20260709 13:18:38.851800 13495 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:38.852223 13874 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:38.851742 13735 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:38.854581 13694 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:38.841995 13913 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.862032 13892 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:38.868968  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:38.819505 13931 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:18:38.879818 13694 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:38.883549  8785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1090) took 1260 ms. Trace:
I20260709 13:18:38.884161  8785 rpcz_store.cc:276] 0709 13:18:37.622634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.622761 (+   127us) service_pool.cc:224] Handling call
0709 13:18:38.883229 (+1260468us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54005802d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:38.883426 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2120490880}
I20260709 13:18:38.861297 13863 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:38.887341 13863 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:38.887531 13945 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:38.891004  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51044 (request call id 56) took 1145 ms. Trace:
I20260709 13:18:38.891561  8177 rpcz_store.cc:276] 0709 13:18:37.745750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.745884 (+   134us) service_pool.cc:224] Handling call
0709 13:18:38.890694 (+1144810us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400329954. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e46853 00007fa5a5e1460a 00007fa59f39a7d4 00007fa59f39a762 00007fa59f39a691 00007fa59f39a60c 00007fa59f3998c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:38.890878 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271380352}
I20260709 13:18:38.893358 13732 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:38.893957 13732 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:38.896401 13732 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:38.816918 13988 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:18:38.865715 13853 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:38.866660 13933 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:38.867282 13603 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.870187 13734 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.905270  8176 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
W20260709 13:18:38.923379  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 54491.8us
I20260709 13:18:38.925565  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:38.875440 13495 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:38.906083 13732 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:38.915241 13933 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:38.908715 13952 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:38.987900  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 195338us
I20260709 13:18:38.937724 13735 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:38.876188 13913 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:38.936491 13966 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.990888  8176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:38.992027  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:38.995334  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:38.956452 13828 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.299s	user 0.039s	sys 0.103s
W20260709 13:18:38.993038  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 164087us
I20260709 13:18:38.994721 13732 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:38.992902  8176 raft_consensus.cc:606] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:38.916846 13853 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.006668  8072 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:39.014581  8785 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:38.936566 13603 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:38.958567 13979 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:39.015456  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:39.012115  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:38.940230 13891 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:38.991358 13735 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.941138 13734 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.024049 13891 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.025858 13734 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:39.026450 13734 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:39.026932 13891 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:39.024061 13735 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:38.996346 13659 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:39.006336 13828 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.358s	user 0.039s	sys 0.103s
I20260709 13:18:39.000828 13896 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:39.003979 13966 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:39.042137 14011 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:18:39.017614 13986 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:39.079082  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:39.079977  8103 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:39.047116 13913 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:39.059219 13603 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:39.060820 13712 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.062845 13880 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.021961 13448 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:39.017833 13977 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:39.075709  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 60349.2us
I20260709 13:18:39.072315 13896 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:39.082264 14009 log.cc:927] Time spent T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:18:39.082912 13966 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:39.082758 14027 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:39.099326 13448 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.121814 13448 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:39.085058 13986 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.085984  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:39.088115 13921 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:39.031965 13985 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:18:39.090636  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:39.124480  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.124687 13986 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:39.092139  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.092710  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:39.098258  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:39.099931  8072 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:39.075736 13495 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.079763 13799 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:39.096577 13724 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:39.068805 13659 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.107245  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:39.144964  8174 raft_consensus.cc:606] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:39.107861 13732 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:39.112432 13933 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.113664 13712 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:39.120638  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1929) took 2939 ms. Trace:
I20260709 13:18:39.101775 13977 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.103816 13896 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:39.138939  8072 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:39.141676  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:39.017418 13952 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.153221  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:39.153482  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:39.153710  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:39.159633  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:39.150853  8102 rpcz_store.cc:276] 0709 13:18:36.181676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.348940 (+167264us) service_pool.cc:224] Handling call
0709 13:18:36.400139 (+ 51199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.120292 (+720153us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b54003c94a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0dc3dc0 00007fa5a0e4e1c0 00007fa5a0e4f231 00007fa5a0e4bd8f 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c
0709 13:18:37.832524 (+712232us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b58008189d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0da80aa 00007fa5a0e2a447 00007fa5a0e42fe7 00007fa5a0e447de 00007fa5a0e4eb49 00007fa5a0e4f416 00007fa5a0e4bd8f 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4
0709 13:18:37.898871 (+ 66347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.120347 (+1221476us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54001653d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:39.120545 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1674149888}
I20260709 13:18:39.156911  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:39.130453 13945 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:39.134425 13799 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:39.164312  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:39.143417 13966 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:39.165726  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:39.168139  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.173699 13863 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:39.174542 14026 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:39.163477  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:39.175374 13659 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:39.159617 13732 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:39.156502 13977 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:39.178138 13642 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:39.146060 13986 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.180080  8783 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
W20260709 13:18:39.182132  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 159536us
I20260709 13:18:39.146169 13987 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:39.243127  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 73465.9us
I20260709 13:18:39.145040 13724 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.247550  8072 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:39.147138 13891 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.089s
W20260709 13:18:39.248059 13925 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.015s	sys 0.015s
I20260709 13:18:39.253355 13986 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.258275 13642 raft_consensus.cc:697] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:39.259264 13642 consensus_queue.cc:237] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.242690 13921 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:39.261463  8252 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:39.261282 13921 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.263661 13921 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:39.236033 13659 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.238165 13952 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:39.253806 13448 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.182201 13945 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:39.351434 14016 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:18:39.318809  8104 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:39.254721 13815 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:39.352703  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:39.264209  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:39.354175  8252 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
W20260709 13:18:39.286980  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 130117us
I20260709 13:18:39.364048  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:39.278759  8256 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:39.366181  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:39.366488  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:39.247509 13966 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:39.256512 13925 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.016s	sys 0.016s
I20260709 13:18:39.281543 13946 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:39.371261  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:39.374061 13952 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.374614  8074 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:39.376670 13986 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:39.274012 13735 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.401052 13788 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:39.402077  8177 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:39.401731 13788 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:39.402630 13974 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 1.204s	user 0.002s	sys 0.004s
I20260709 13:18:39.369952 13659 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.386382  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:39.404209 13788 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:39.387118  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:39.388233  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:39.390389  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:39.405956 13977 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.408195 13977 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:39.252381 13987 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.408929 13659 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:39.374514 13724 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:39.400192 13952 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.410550  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:39.411346 13952 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:39.406302  8784 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:39.409000 13987 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:39.412964  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:39.416596  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:39.417451  8782 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 18: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:39.419279  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:39.419942  8790 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:18:39.394229 13946 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.362313 13828 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:39.420811 13946 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:39.421329  8179 raft_consensus.cc:1217] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Deduplicated request from leader. Original: 12.8->[14.9-18.11]   Dedup: 18.11->[]
I20260709 13:18:39.422957  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:39.423733  8176 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:39.420935  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 1942) took 1589 ms. Trace:
I20260709 13:18:39.425742  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:39.281769 13933 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:39.353246 13815 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.429481  8179 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: [14.9-18.11]
I20260709 13:18:39.426837  8181 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:39.435299  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:39.425338  8183 rpcz_store.cc:276] 0709 13:18:37.831077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.831529 (+   452us) service_pool.cc:224] Handling call
0709 13:18:37.831877 (+   348us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:18:37.833369 (+  1492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.833395 (+    26us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:18:37.839527 (+  6132us) log.cc:844] Serialized 104 byte log entry
0709 13:18:37.995585 (+156058us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:38.158286 (+162701us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.159605 (+  1319us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.159866 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.159985 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.174753 (+1014768us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b48001e0258. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a5d75aa1 00007fa5a5d6cb37 00007fa5a5d6c9ca 00007fa5a5e6426f 00007fa5a5e63f37 00007fa5a5e7855c 00007fa5a5e78508 00007fa5a5e78488 00007fa5a5e78443 00007fa5a5e776ec 00007fa5a4da1a96
0709 13:18:39.402001 (+227248us) spinlock_profiling.cc:243] Waited 60.2 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:39.420664 (+ 18663us) raft_consensus.cc:1685] finished
0709 13:18:39.420687 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.420852 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68402,"prepare.queue_time_us":23452,"prepare.run_cpu_time_us":247,"prepare.run_wall_time_us":6604,"raft.queue_time_us":500,"raft.run_cpu_time_us":4285,"raft.run_wall_time_us":1018602,"spinlock_wait_cycles":172626432,"thread_start_us":104958,"threads_started":1,"wal-append.queue_time_us":200305}
I20260709 13:18:39.369637  8256 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 18: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:39.431296  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:39.430716  8072 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:39.444705  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:39.445402  8174 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:39.428819 13923 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:39.392673 13966 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.421008 13828 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:39.460124  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:39.460494 14028 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 13:18:39.460875  8099 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:18:39.461671 13966 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:39.466239  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:39.466895  8784 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:39.471171  8255 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:39.471726  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:39.440850 13659 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:39.469182  8072 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:39.479764  8176 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:39.483974  8252 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:39.484405  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:39.474346  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:39.486990  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:39.452541 13977 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:39.451664 13986 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:39.469604 14035 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:39.508970 13952 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:39.487962 13966 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:39.516376  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:39.420782 13987 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.482336 13718 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.494688 13659 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.517560  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:39.578394  8108 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:39.514737 13896 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.544003 13828 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.494117 13977 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.496506 13923 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:39.526857  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.612522  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:39.588704 13448 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:39.547803 13694 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:18:39.597239 14035 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:39.503451 13603 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:39.597754 13966 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.602360 13987 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:39.521746  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:39.624832  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:39.602821 13718 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.596663  8176 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:18:39.604774 13952 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:39.657220  8176 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:39.598264 13659 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:39.599431  8106 raft_consensus.cc:2368] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13.
I20260709 13:18:39.628412  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:39.628624  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:39.659493  8178 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:39.630013  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 108345us
I20260709 13:18:39.631008 13954 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:39.631318 13814 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:39.614089 13880 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:39.624032 13603 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:18:39.643175 14038 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:18:39.610029 13977 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:39.598218 13896 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:39.616050 13923 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.629817  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:39.620814 13828 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:39.619969 13945 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:39.672531  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:39.670259 13814 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.675802 14002 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:39.624943 13966 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:39.681339  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:39.624171 14035 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:39.702922  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:39.704792 12721 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:39.707294  8108 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:39.708238 13754 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:39.715014 13975 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.715834  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:39.723966 13922 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:39.727701  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:39.667155 13946 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:39.737277  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.726533 13799 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.684010 13603 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:39.770972  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:39.794984  8249 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:39.771714  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:39.781775  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:39.782838  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:39.796805  8106 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:39.706306 14019 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:18:39.744843 13923 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:39.734551 13735 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:39.785446  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:39.820432 14019 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:39.779109 13815 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:39.793108  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:39.812628 12721 raft_consensus.cc:3055] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:39.788934 13754 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:39.827502 12721 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:39.781699 13814 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:39.797519 13986 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:39.828544 12721 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.841886 12721 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:39.841953  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:39.845505  8107 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:39.846781  8099 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22. Ops: [21.10-21.10]
W20260709 13:18:39.813388  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 201046us
W20260709 13:18:39.848245  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.850090  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:39.850764  8783 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:39.852821  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:39.790601 13975 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.856796  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:39.862828  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:39.856544  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:39.834326 14019 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:39.850507 13799 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:39.850315 13880 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.879066  8106 raft_consensus.cc:2410] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:18:39.794682 13952 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.875480  8108 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:39.866103 13874 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:39.861459 13448 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.877784  8249 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:39.873039 13863 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:39.875938 13896 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:39.866868 13988 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:39.861119 13933 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:39.908784 13896 raft_consensus.cc:697] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:39.908944  8147 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:39.909569 13988 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:39.910235 13863 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:39.913857 14019 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.851140 13986 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.920476  8147 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:39.921002 12721 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:39.860486 13930 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:18:39.904175 13954 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:39.944336 14002 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:39.945313 13896 consensus_queue.cc:237] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.960377  8174 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:39.964398  8181 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
W20260709 13:18:39.966181  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 45776.4us
I20260709 13:18:39.967213  8147 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:39.898310 13880 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.906397 13874 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.975566  8786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 914) took 2207 ms. Trace:
I20260709 13:18:39.978967  8786 rpcz_store.cc:276] 0709 13:18:37.762613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.763828 (+  1215us) service_pool.cc:224] Handling call
0709 13:18:37.764108 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.472233 (+708125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.970215 (+1497982us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b54004ced54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:39.970432 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1624193280}
I20260709 13:18:39.979290  8178 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:39.906078 13717 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:18:39.962210 13718 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:39.915004 13448 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:39.898702 13754 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.984175 12721 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:39.981858  8178 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:39.975415 13642 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:39.925546 13933 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.978261 13863 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:39.939324 13988 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:39.999650  8108 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:40.004070 13810 raft_consensus.cc:2955] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Committing config change with OpId 14.12: config changed from index 9 to 12, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:18:40.014393  8074 leader_election.cc:336] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Timed out: RequestConsensusVote RPC to 127.6.214.131:45561 timed out after 1.650s (SENT)
I20260709 13:18:40.014541 13880 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:40.016247 13448 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:40.016752  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.017180 14048 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.169s	user 0.001s	sys 0.001s
I20260709 13:18:40.018199  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:40.019058  8176 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
W20260709 13:18:40.018541 14042 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.411s	user 0.002s	sys 0.000s
W20260709 13:18:40.022035 14051 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:18:40.025089  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.027698 14035 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:40.031108  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.031998 13986 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:40.033818 13718 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:40.034369 13718 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:40.036419 13718 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:39.999719 13642 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:40.039085 13642 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:40.040196 14053 log.cc:927] Time spent T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:18:40.045444 14018 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.888s	user 0.001s	sys 0.001s
I20260709 13:18:40.046216  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2787) took 2093 ms. Trace:
I20260709 13:18:40.046509 14027 raft_consensus.cc:993] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:18:40.047086 14027 raft_consensus.cc:1081] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Signalling peer 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:18:40.046640  8179 rpcz_store.cc:276] 0709 13:18:37.953034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.985616 (+ 32582us) service_pool.cc:224] Handling call
0709 13:18:39.421196 (+1435580us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:39.434242 (+ 13046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.046028 (+611786us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54000d75d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:40.046157 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3300639104}
I20260709 13:18:39.984912 14019 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:40.050041  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:39.979646 13603 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:40.060158  8147 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:40.063558 14027 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:40.063884 14035 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:40.061790  8147 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:40.072022 13988 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:40.074460 13933 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:40.077957 13923 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:40.080718 13923 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:40.058396 14052 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:18:40.083422 13603 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:40.006875 13863 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:40.049119 13946 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:40.101595 14047 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:18:40.139420  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:40.148250  8249 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 15: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:40.140573  8248 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:18:40.140656  8253 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:40.141038  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.141363  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:40.141283  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:40.142156  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.142179  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.151180  8252 raft_consensus.cc:2376] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18. Re-sending same reply.
W20260709 13:18:40.127120 14046 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 13:18:40.160864  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 116639us
W20260709 13:18:40.163199  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 300428us
I20260709 13:18:40.147518 13717 raft_consensus.cc:2764] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:18:40.146961 13975 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:40.169477  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.182626  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.192747  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:40.194097  8251 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 15: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:40.199873  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.208527 13966 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:40.209806 13874 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:40.210660 13814 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:40.195104 13863 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:40.213145  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.213553  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.245374  8101 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:40.223795 13853 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:40.225809  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:40.226370 13828 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:40.230266  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:40.231130 14055 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:18:40.237357  8149 leader_election.cc:400] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13.
I20260709 13:18:40.237417  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:40.238153  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:40.243681  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:40.199546 13718 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.222682  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:40.246865  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 184970us
I20260709 13:18:40.245296  8255 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:18:40.249571  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:40.252851  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:40.263486  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:40.264454  8101 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:40.265419  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:40.269421  8105 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:40.270068  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:40.270957  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.271809  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.272792  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:40.275426  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:40.276346  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:40.276748  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:40.277019  8176 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:40.278280  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:40.279608  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.269948  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:40.282083  8785 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: [15.12-17.13]
I20260709 13:18:40.284399  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.284590  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:40.285771  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.287117  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.256532 13987 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.253103 13985 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:40.256245 13933 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:40.262429 14060 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.313262  8252 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:18:40.298202  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.300952 13711 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:40.344779  8790 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:40.283052 13863 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:40.298974  8786 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:18:40.296171  8784 raft_consensus.cc:2955] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 9 to 12, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:40.319836  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:40.320710  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:40.256491 14064 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:40.302034  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.302237  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.302445  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.358495  8250 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 20: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:40.307540  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:40.310035  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.297611  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.359825  8249 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:40.302770  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:40.329146  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:40.297926 13988 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:18:40.365675  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 58213.5us
W20260709 13:18:40.366918  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.368084  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:40.368630  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.364266  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:40.361055  8251 raft_consensus.cc:2376] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18. Re-sending same reply.
I20260709 13:18:40.356745  8248 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:40.361339  8177 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:40.373800  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:40.378923  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.389588  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:40.391319 13966 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:40.301014 13975 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.392079 13975 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:40.393877  8103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:18:40.394373 13975 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:40.394498  8103 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.395167  8103 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:40.395272 14064 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:40.397742 13986 consensus_queue.cc:1059] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:18:40.401023 13977 consensus_meta.cc:287] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.657s	user 0.003s	sys 0.009s
I20260709 13:18:40.356273 13711 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:40.301687 13853 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:40.402740 13853 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:40.403162 13853 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:40.403220 13814 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:40.294315 14063 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:40.405817 14063 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:40.407438 13874 raft_consensus.cc:3055] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:40.407859 13874 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:40.343513 13933 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:40.408746 13874 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:40.410980 13933 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:40.413848  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:40.417321  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.419584  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:40.420295  8102 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:40.269269 13718 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:40.423846  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:40.423591  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:40.411820  8103 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:40.427881  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 62332us
I20260709 13:18:40.412317 13976 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:40.439224  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:40.412370 13946 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:40.440382  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:40.441740  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:40.445624  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:40.446254  8177 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:40.446174  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:40.306640 13865 consensus_queue.cc:1059] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.117s
I20260709 13:18:40.447252  8176 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:40.448925  8103 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:40.422536 13966 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:40.453989  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:40.331398 13987 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:40.454553  8177 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:40.452021  8257 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:40.341653 13712 consensus_queue.cc:1059] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:18:40.427013 13448 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:40.460791  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.424109 13988 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:40.469987  8176 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:40.453204 13930 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:40.442337 14035 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:40.454869  8177 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:40.414489 13977 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:40.478685  8785 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:40.346902 14060 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:40.477200  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.333541 13985 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:40.481166  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:40.481617  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:40.477089  8177 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:40.485822  8177 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:40.515396  8104 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:40.475675 13930 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.516657  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:40.475178 14027 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:40.531674  8256 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:40.490916 13712 raft_consensus.cc:3055] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:40.493800 13933 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:40.632149  8177 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
W20260709 13:18:40.634001 14075 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 13:18:40.638276 14074 log.cc:927] Time spent T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:18:40.560715 13802 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:40.639710 13802 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:40.640422 13985 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:40.640702 13802 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:40.567943 13712 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:40.642601 13712 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:40.648080 13977 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:40.649528 14054 log.cc:927] Time spent T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:18:40.637620 13988 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:40.489400 13603 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:18:40.658161 13603 consensus_queue.cc:1243] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:40.658438 13987 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:40.524751 13930 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:40.649351 14073 log.cc:927] Time spent T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
W20260709 13:18:40.790249  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.791406  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 351150us
W20260709 13:18:40.792599  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 311045us
I20260709 13:18:40.793198  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:40.800355  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:40.568015 13799 consensus_queue.cc:1059] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.200s
I20260709 13:18:40.814770 13712 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:40.814363 13718 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:40.801082  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:40.790647  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.803843  8787 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:40.819078  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.814893 14060 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:40.804859 13987 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:40.820544  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:40.826458 13987 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 18 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:40.826654 13925 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:40.801043  8103 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:40.834324  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.833804  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:40.835047 13933 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:40.855347  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:40.857743  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:40.864506  8103 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:18:40.847322 14068 raft_consensus.cc:3055] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:40.849396 13694 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:40.876078 13694 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:40.876976 13694 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:40.863788 13933 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:40.891341 14078 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:40.891999 14078 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:40.892482 14078 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:40.865717 13987 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:40.862741 13925 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:40.897660  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:40.872125 13863 consensus_meta.cc:287] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.002s
I20260709 13:18:40.906180  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:40.873792 14068 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:40.931885  8252 raft_consensus.cc:2410] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:18:40.900911 14060 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:40.865147 14025 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
W20260709 13:18:40.963150  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 60140.4us
I20260709 13:18:40.931371 13896 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:40.901649 13923 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 13:18:40.934967 13718 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.974424  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3092) took 1211 ms. Trace:
I20260709 13:18:40.929993 13976 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:40.984351  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:40.937793 13865 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:40.985554  8784 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:40.977044  8100 rpcz_store.cc:276] 0709 13:18:39.763411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.943616 (+180205us) service_pool.cc:224] Handling call
0709 13:18:39.974668 (+ 31052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.974940 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:39.984992 (+ 10052us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.903043 (+918051us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b1800400c00. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5c455 00007fa5a0e44060 00007fa5a0e56716 00007fa5a0e67287 00007fa5a0e67208
0709 13:18:40.973857 (+ 70814us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.974107 (+   250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:40.974150 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:40.974198 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.974258 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.974370 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11086,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":30922,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"spinlock_wait_cycles":4427520,"thread_start_us":70403,"threads_started":1}
W20260709 13:18:40.987077 13853 consensus_meta.cc:287] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.000s
I20260709 13:18:40.987527 13853 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:40.978569 13976 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:40.991798 13976 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:40.993521 13930 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:40.997927 13977 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:40.998543 13977 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:40.999083  8074 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.131:45561 timed out after 2.083s (SENT) [suppressed 15 similar messages]
I20260709 13:18:41.000669 13977 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:41.000964  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.001772  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.001511 14068 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.002497  8256 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:41.002862 14068 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:41.003508  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.004374  8256 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:40.965819 14082 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.006666  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:41.005194  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:40.968763 14035 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:40.995766 13930 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:40.974932 13966 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.016640  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:41.021478  8789 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:41.025473  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:41.026208  8784 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:41.037407  8784 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:41.014633 13853 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:41.039767 14081 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:18:40.981909 13718 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.043499 13966 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.017279 13865 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:40.965760 14060 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:41.048678  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:41.050966  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.051111  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:41.001525 13896 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:18:41.049408  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 74059.6us
I20260709 13:18:41.052837  8785 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 16: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:41.052453  8784 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
W20260709 13:18:41.061836  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.064090  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 65032.6us
I20260709 13:18:41.057343  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:41.020938 14082 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.047472 13923 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:41.066457  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:41.072695  8789 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:41.053696 13896 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:41.073884  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:41.074584  8784 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:41.074730  8788 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:41.073302  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:41.081723  8256 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:41.084808  8784 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:41.054831 13878 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.091069  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:41.070456 13799 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:41.029328 14035 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.093412  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.094852  8221 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:41.094929  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.103123  8105 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 10.
I20260709 13:18:41.096267  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:41.098071  8072 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:41.105393  8755 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:41.098464  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.098798  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.099270  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.106652 14085 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:41.107228  8176 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:41.110494  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:41.105567  8072 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:41.106822  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:41.112576  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:41.115757 13946 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:18:41.116333 14014 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:41.087031 14089 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:41.117484 14089 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.118019 14089 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:41.123731 14082 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:41.125756 14035 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.126585 13865 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.128239  8103 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:41.115670  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.131450  8221 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:41.134672 14090 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:41.135744 13880 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:41.136612 13799 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:41.137778 13799 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:41.109100 13712 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:41.092517 13878 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.144625 13878 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:41.145027 13712 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:41.109688 13977 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:41.145880 13712 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:41.146889 13718 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.082599 13923 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.148928 14060 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:41.129119 13945 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.149994 13945 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.150553 13923 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.152840 13945 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.153805  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:41.154767  8250 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:41.155527 13966 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.157702 14035 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:41.158190 14035 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.158653 14035 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:41.160027 14063 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.161652 13977 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:41.089769 14078 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.162572  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 1958) took 1394 ms. Trace:
I20260709 13:18:41.161672 14083 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.163764 14083 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.164158 14078 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:41.165071  8785 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:41.162964  8174 rpcz_store.cc:276] 0709 13:18:39.768673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.817359 (+ 48686us) service_pool.cc:224] Handling call
0709 13:18:41.162386 (+1345027us) spinlock_profiling.cc:243] Waited 64.7 ms on lock 0x7b54002f9c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:41.162512 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148823808}
W20260709 13:18:41.166055  8104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 3082) took 1684 ms (client timeout 1931 ms). Trace:
W20260709 13:18:41.166535  8104 rpcz_store.cc:269] 0709 13:18:39.481790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.486715 (+  4925us) service_pool.cc:224] Handling call
0709 13:18:41.165833 (+1679118us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003f3254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:41.165971 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2321221376}
I20260709 13:18:41.168105  8099 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
W20260709 13:18:41.168195  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 61459.2us
I20260709 13:18:41.168973  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:41.173071  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.132233  8072 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:41.172612 14082 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:41.178586  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.179857 13976 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.180939  8107 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:41.182087 14078 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:41.184019 13976 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.185120 13735 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:41.173791  8784 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:41.186658  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:41.179857  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:41.192798  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.194207  8174 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:18:41.195771  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 63600us
I20260709 13:18:41.208423 13957 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:41.208847  8104 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 8. (term mismatch)
I20260709 13:18:41.209231  8104 pending_rounds.cc:85] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 7
I20260709 13:18:41.209499  8104 pending_rounds.cc:107] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 13:18:41.198879 13954 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.210215 13954 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:41.211766  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:41.212734 13954 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:41.213021  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:41.213377 13659 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:41.214056 13659 raft_consensus.cc:697] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:41.209988  8104 raft_consensus.cc:2889] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.215059 13659 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.221606 13495 raft_consensus.cc:3055] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:41.222218 13495 raft_consensus.cc:740] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:41.223343 13495 consensus_queue.cc:260] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.233690  8250 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:41.234464  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:41.235345  8256 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 16: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:41.236203  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.239228  8250 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:41.240483  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:41.236459  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.237396  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:41.241852  8256 raft_consensus.cc:2376] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16. Re-sending same reply.
I20260709 13:18:41.242528  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.242640  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:41.242879  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.243409  8257 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:41.243721  8256 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:41.243957 13966 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:41.244247  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:41.244571  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.244668 13966 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:41.244856  8257 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:41.245549  8256 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 20: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:41.246356  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.247160  8256 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:41.249979 14063 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.250617 14063 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:41.250887  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:41.251475 13954 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.252068 13874 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:41.252313 14036 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:41.252724 14095 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.253007 14063 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:41.252005 13954 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.237838  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:41.265316  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 50436.3us
I20260709 13:18:41.258900  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:41.260418  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:41.284152  8254 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:41.258105  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.285606  8252 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
I20260709 13:18:41.288573  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:41.269230  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.290086  8177 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:41.295028  8255 raft_consensus.cc:2410] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:18:41.296591  8174 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:41.296875  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.302292  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.304029 14091 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:41.172808 14083 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.306686  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2813) took 1029 ms. Trace:
I20260709 13:18:41.308804  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:41.308928  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.307086  8255 rpcz_store.cc:276] 0709 13:18:40.278193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.237510 (+959317us) service_pool.cc:224] Handling call
0709 13:18:41.306630 (+ 69120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:41.309906  8106 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:41.292474 14078 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:41.326031  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:41.292963 13933 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.185732 13735 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:41.329025  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:41.329741  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:41.330314  8255 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:41.301273 13724 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:41.262512 14036 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:41.322237  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.307444  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:41.347841  8177 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:41.348340  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.345367  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.334867  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.349455  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:41.350029  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.350693  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.247902  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.312141  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.351436  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.341878  8257 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:41.296229 14090 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.346022  8787 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:18:41.354182  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:41.354837  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.310674 14063 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.359918  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:41.366700  8254 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:18:41.367962  8254 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:41.368468  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2831) took 1062 ms. Trace:
I20260709 13:18:41.368746  8254 rpcz_store.cc:276] 0709 13:18:40.305616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.367395 (+1061779us) service_pool.cc:224] Handling call
0709 13:18:41.367659 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.368269 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.368424 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:41.369117 13880 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.359377  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.369776 13880 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.370445  8257 raft_consensus.cc:2410] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:18:41.370565 14060 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.370967  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2808) took 1098 ms. Trace:
I20260709 13:18:41.371295  8257 rpcz_store.cc:276] 0709 13:18:40.272813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.359125 (+1086312us) service_pool.cc:224] Handling call
0709 13:18:41.370913 (+ 11788us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:41.371100 14060 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.253312 14095 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:41.373364  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:41.374799  8100 raft_consensus.cc:2955] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 9 to 12, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:41.378432  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3180) took 1034 ms. Trace:
I20260709 13:18:41.378906  8254 rpcz_store.cc:276] 0709 13:18:40.344303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.377685 (+1033382us) service_pool.cc:224] Handling call
0709 13:18:41.377959 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.378131 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.378154 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.378194 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:41.378223 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.378286 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.378380 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:41.380123 13735 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:41.380542  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3181) took 1036 ms. Trace:
I20260709 13:18:41.380978  8254 rpcz_store.cc:276] 0709 13:18:40.344564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.379789 (+1035225us) service_pool.cc:224] Handling call
0709 13:18:41.380049 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.380217 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.380250 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.380287 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:41.380325 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.380380 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.380495 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:41.382442  8254 raft_consensus.cc:2955] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 9 to 12, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:41.383548  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:41.384115  8789 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:41.357724 13754 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:41.385516 14090 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:41.357702  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:41.329560 14078 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.355491  8177 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:41.346778  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:41.398005  8106 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:41.397953  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.326026 14019 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.354557  8174 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:41.357345  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.403982  8101 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:41.357667  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:41.404845  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.358772  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2820) took 1056 ms. Trace:
I20260709 13:18:41.352005  8105 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:41.405804  8256 rpcz_store.cc:276] 0709 13:18:40.302698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.247674 (+944976us) service_pool.cc:224] Handling call
0709 13:18:41.358714 (+111040us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:41.382469  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:41.406788  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.407263  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3183) took 1042 ms. Trace:
I20260709 13:18:41.407601  8256 rpcz_store.cc:276] 0709 13:18:40.364913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.406506 (+1041593us) service_pool.cc:224] Handling call
0709 13:18:41.406770 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.406966 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.406989 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.407028 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:41.407062 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.407118 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.407217 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:41.392750  8255 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:18:41.408895  8256 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:41.395532  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.275992 13896 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.397019  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.402424  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:41.409559  8252 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:41.418941  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.419207  8256 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:41.421337  8106 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:41.358021  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:41.415279 14019 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:41.424085 14019 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:41.409729  8101 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 22: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:41.419863 14036 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:41.426119 14036 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:41.426403  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.426939 14036 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:41.402638  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:41.356938 13925 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:41.421411  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2819) took 1119 ms. Trace:
I20260709 13:18:41.428642 13724 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:41.428599  8250 rpcz_store.cc:276] 0709 13:18:40.302436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.387916 (+1085480us) service_pool.cc:224] Handling call
0709 13:18:41.421347 (+ 33431us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:41.429569  8105 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22. Ops: [21.10-21.10]
I20260709 13:18:41.413362  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:41.429898 13724 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:41.430292 13724 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.430665 13724 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:41.431001 13896 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.431371 13865 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:41.431757 13865 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.432091 13865 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:41.370456 13718 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.356223 13946 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:41.404834 14078 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:41.444298  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:41.445883 13603 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:41.446493 13925 raft_consensus.cc:697] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 16 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:18:41.448182 14066 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.922s	user 0.001s	sys 0.012s
I20260709 13:18:41.442454  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:41.456390  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:41.457595  8791 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:41.415675 14086 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:41.347272 13933 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.343546 14089 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:41.396893 14063 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:41.516489  8786 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:41.461812 13603 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.477595 13712 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:41.477718 13878 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:41.477595 14086 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.498193 13966 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:41.504220 13957 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:41.452113 13718 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:41.522845 13603 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:41.541266  8101 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:41.530967 14086 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:41.527861 13878 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.557574  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:41.582667 13659 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:41.586719 13659 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:41.587631 13659 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:41.589829 13724 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.592628  8106 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:41.549196 13878 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:41.603236  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:41.603907  8791 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:41.539436 13925 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.616328  8783 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:41.596096 13724 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.562788 13966 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:18:41.597894 13712 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:41.617352 13985 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.636164 13933 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:41.636662 13985 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.636247  8791 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:41.650343  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:41.550729 13946 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:41.657939  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 96943.5us
W20260709 13:18:41.665870  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.587707 13711 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:41.655270 13896 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:41.661068 13865 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:41.670677  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3182) took 1314 ms. Trace:
I20260709 13:18:41.675029  8254 rpcz_store.cc:276] 0709 13:18:40.356106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.381911 (+1025805us) service_pool.cc:224] Handling call
0709 13:18:41.382147 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.382330 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:41.405825 (+ 23495us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.606540 (+200715us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.669204 (+ 62664us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.669287 (+    83us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:41.669370 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.670400 (+  1030us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.670585 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7911,"prepare.queue_time_us":115758,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":84366,"spinlock_wait_cycles":9309952,"thread_start_us":254537,"threads_started":4,"wal-append.queue_time_us":148844}
I20260709 13:18:41.677834  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:41.678612  8254 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:41.680076 13718 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:41.680919 14114 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:41.681349 13712 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:41.672360 14103 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:18:41.671911 14106 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:18:41.695926 13603 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.701862 13603 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:41.712239  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.713934  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.670987 13896 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:41.717805  8176 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:41.718415 13896 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.719364  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:41.720451  8177 raft_consensus.cc:2410] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:18:41.721979  8174 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:41.723711  8183 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:41.725037  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.726627  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.694021 14089 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:41.728490  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.729317  8249 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:41.732024  8249 pending_rounds.cc:85] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 11
I20260709 13:18:41.732331  8249 pending_rounds.cc:107] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:18:41.732640  8249 raft_consensus.cc:2889] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.701884 14064 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.738334 14063 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:41.740067  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:41.741022  8785 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:41.741590 14089 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:41.742389 14089 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:41.742715 14089 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:41.743503 14089 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.745046  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.746446 14090 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:41.747242  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:41.747529  8783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48096 (request call id 918) took 1472 ms (client timeout 1734 ms). Trace:
W20260709 13:18:41.748019  8783 rpcz_store.cc:269] 0709 13:18:40.275578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.276064 (+   486us) service_pool.cc:224] Handling call
0709 13:18:41.747367 (+1471303us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540046dcd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:41.747469 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2912669440}
I20260709 13:18:41.749164  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:41.749734 12721 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:18:41.750134  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.751243  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.751502 13954 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.752305 14089 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:41.754231  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:41.755592  8253 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 17. Ops: []
I20260709 13:18:41.756026 13933 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:41.755625 13603 raft_consensus.cc:2764] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:18:41.757579 14082 raft_consensus.cc:3055] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:41.750241 12721 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.757951 14082 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:41.758786 14082 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.759776 12721 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.753227 13865 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:41.760753 14027 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:41.761202 14027 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:41.762346 14027 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.763725 14027 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:41.765724 14035 consensus_meta.cc:287] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.001s
I20260709 13:18:41.766184 14035 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.767215  8103 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:41.770408 13880 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.770661 14035 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:41.771850 12721 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:41.749969  8175 raft_consensus.cc:2376] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15. Re-sending same reply.
I20260709 13:18:41.778048  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1962) took 2143 ms. Trace:
I20260709 13:18:41.778503  8108 rpcz_store.cc:276] 0709 13:18:39.634355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.897480 (+263125us) service_pool.cc:224] Handling call
0709 13:18:39.898372 (+   892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.009207 (+110835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.777824 (+1768617us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54001685d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:41.777992 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232136064}
I20260709 13:18:41.783356 14078 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.784601  8788 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:18:41.787434  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:41.791369  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.792631  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:41.763893 14082 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:41.799239  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.804177  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 175801us
I20260709 13:18:41.801369 14078 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:41.799160  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:41.806633  8784 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:41.805275  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:41.809798  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:41.813023  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.816926  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.817756  8108 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:41.820516  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.823521  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.829638  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.836598  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:41.837900  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.839545  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.840809  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.845173  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:41.850095  8784 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:41.852304  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:41.859578  8254 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:18:41.861228  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:41.864336  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:41.864941  8108 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:41.869506 13923 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:41.872355  8108 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
W20260709 13:18:41.873540  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.873960  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:41.882174  8183 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:41.882349  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.877745  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:41.884294  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.885214  8252 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:41.888279  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.892850  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:41.896880  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.901161  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:41.854846 14064 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:41.881379 14035 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:41.880712 13659 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:41.910184  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:41.854489 13966 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.909902  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:41.880301 14100 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:18:41.914707  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:41.905077 13603 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:41.895088 13925 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.912932  8183 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:41.916530  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:41.838184 14036 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:18:41.907204 14064 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.881206 14086 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.944907  8784 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:41.917737 14035 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.948472  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:41.950103  8256 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:41.939255 13812 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:41.936514 13659 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:41.975651  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:41.939105 13603 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:41.959421 13946 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.162s
I20260709 13:18:41.945216 13986 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:41.987394 13603 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:42.117753 13986 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:42.118119 13889 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.118734 13986 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.118182 13659 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.122244  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:42.123477  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:41.985615 14035 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:42.127218 13874 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.127743 13874 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:41.974429 13812 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.129711 13812 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:42.127645 13791 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.135790 13791 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.137535 13448 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:42.138242 13791 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.140120  8252 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
W20260709 13:18:42.142900  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.138082 13448 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:42.151360  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.957389 14064 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:41.936856 13966 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.233058  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:41.957185 14113 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:42.274173  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 395480us
W20260709 13:18:42.307591  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 449908us
I20260709 13:18:42.242585  8256 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:41.955842 13925 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:42.185140 14107 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:18:42.312641  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:42.313359  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.185389 14102 log.cc:927] Time spent T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 13:18:42.314080  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:42.316022  8256 raft_consensus.cc:2410] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:18:42.315928  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 784) took 1160 ms. Trace:
I20260709 13:18:42.316685  8250 rpcz_store.cc:276] 0709 13:18:41.155986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.276875 (+1120889us) service_pool.cc:224] Handling call
0709 13:18:42.315280 (+ 38405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.315522 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.315558 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:42.315617 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:42.315664 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.315736 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.315860 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:42.317168  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:42.320140  8256 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:42.188446 13923 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:42.322842  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:42.330310  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:42.354985  8256 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: [16.11-18.12]
I20260709 13:18:42.267884 14113 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:42.355759  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:42.118759 13889 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.357057  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:42.268383 14100 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:42.358609  8252 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:42.361730  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:42.365880 13603 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.369201  8074 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:42.376108  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:42.367959 14113 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:42.383998  8256 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:18:42.387367 13878 consensus_meta.cc:287] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.783s	user 0.011s	sys 0.000s
I20260709 13:18:42.373044 14100 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:42.450143  8100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.006s	sys 0.011s
I20260709 13:18:42.452610  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3111) took 1096 ms. Trace:
I20260709 13:18:42.455397  8100 rpcz_store.cc:276] 0709 13:18:41.356056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.374270 (+ 18214us) service_pool.cc:224] Handling call
0709 13:18:41.374518 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.374695 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:41.412064 (+ 37369us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.939727 (+527663us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.452126 (+512399us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:42.452202 (+    76us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:42.452270 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.452371 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.452537 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":141965,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":36399,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":8295,"spinlock_wait_cycles":4804480,"thread_start_us":1026025,"threads_started":3,"wal-append.queue_time_us":321643}
I20260709 13:18:42.437548 14130 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:42.471601  8788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 929) took 1170 ms. Trace:
I20260709 13:18:42.443945 14086 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:42.451077 13923 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:42.476658  8252 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:42.397604 13642 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:18:42.472098  8788 rpcz_store.cc:276] 0709 13:18:41.300836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.300984 (+   148us) service_pool.cc:224] Handling call
0709 13:18:41.305282 (+  4298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.785007 (+479725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.471284 (+686277us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54004ea054. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:42.471532 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101766400}
W20260709 13:18:42.467270 14027 consensus_meta.cc:287] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.703s	user 0.014s	sys 0.000s
I20260709 13:18:42.458745 13896 raft_consensus.cc:2764] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:18:42.402608 13878 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.494632 14085 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:42.491218 13889 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:42.495389 14085 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.501950 14085 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.502650 13603 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.502965  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3189) took 1698 ms. Trace:
I20260709 13:18:42.550417  8255 rpcz_store.cc:276] 0709 13:18:40.804463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.421064 (+616601us) service_pool.cc:224] Handling call
0709 13:18:41.451884 (+ 30820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.546459 (+ 94575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.546492 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.546544 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:41.546582 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.502714 (+956132us) spinlock_profiling.cc:243] Waited 94.4 ms on lock 0x7b5400386b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:42.502764 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.502902 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217021184}
I20260709 13:18:42.504206  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3115) took 1068 ms. Trace:
I20260709 13:18:42.552501  8106 rpcz_store.cc:276] 0709 13:18:41.435808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.435955 (+   147us) service_pool.cc:224] Handling call
0709 13:18:41.455337 (+ 19382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.593094 (+137757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.503463 (+910369us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54000f4e54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:42.504018 (+   555us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b54000f4e50. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:42.504150 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359271040}
I20260709 13:18:42.506145 13694 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:42.506871 14100 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.507544 13966 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:42.509451 14082 consensus_meta.cc:287] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.701s	user 0.004s	sys 0.006s
I20260709 13:18:42.510181 14035 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.496786 13812 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.511195 13874 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.514833 13878 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:42.517611 14071 raft_consensus.cc:993] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:18:42.518249 14113 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.521512  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:42.526171  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:42.533522  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:42.555691  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 179637us
I20260709 13:18:42.581847  8103 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:18:42.559751  8100 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:42.560361  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:42.582507  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:42.569332  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:42.583380  8107 raft_consensus.cc:2410] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:18:42.583616  8105 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:42.492820 13448 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.532236 14135 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.556097 13925 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:42.581943  8108 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:42.591295  8181 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:42.558025  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:42.586658  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 65263us
W20260709 13:18:42.595666  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.596510  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:42.597527  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:42.603658  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:42.605531  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.610773  8108 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 11.
I20260709 13:18:42.575969 14134 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:42.570547 14027 consensus_queue.cc:1059] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:18:42.623003  8105 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:18:42.586374 13889 raft_consensus.cc:1081] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Signalling peer 9480609eccc44250a4d7fcc9686e76cf to start an election
W20260709 13:18:42.634188 14138 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:42.641505 14082 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:42.641535  8791 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:42.643457 14035 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.643702  8785 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:42.579723 14100 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:18:42.645186 14113 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:42.611176 14071 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:42.645936  8787 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:42.646198  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:42.646279  8783 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:42.646481 13812 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.647147  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:42.647603  8789 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:42.647892 13966 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.611521 14139 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:42.636761 14142 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:42.633739 13878 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.625111 14134 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.649017  8790 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:42.641286 14131 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.191s	user 0.000s	sys 0.002s
I20260709 13:18:42.780536 14104 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.649611 13717 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:42.650370 13986 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:42.675536 14064 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:42.680908 14089 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.928s	user 0.012s	sys 0.000s
W20260709 13:18:42.682528  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 150900us
I20260709 13:18:42.681186 13495 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:42.689324 14027 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:42.711021 14137 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:42.820087 14137 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:42.820900 14141 log.cc:927] Time spent T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.180s	user 0.000s	sys 0.002s
I20260709 13:18:42.741853 14095 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:42.817163 14134 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.755359 14060 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:42.762631 14083 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.822192 14137 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.604588 14135 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.780488 14082 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.823792 14135 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:42.823875 14082 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.795862 14142 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.799715 14104 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.809522 14027 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.792627 14076 consensus_queue.cc:1059] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:18:42.794633 14122 consensus_queue.cc:1059] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:18:42.817286 14064 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:42.819590 14127 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.459s	user 0.004s	sys 0.000s
I20260709 13:18:42.822146 14083 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.825868 14104 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:42.825505 14142 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:42.826464 14104 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:42.827005 14104 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:42.827394 14083 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:41.247875  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:42.700435  8100 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:42.648082  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:42.777763  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:42.723410  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1958) took 3090 ms. Trace:
I20260709 13:18:42.706195  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 3114) took 1280 ms. Trace:
I20260709 13:18:42.715831  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3096) took 2325 ms. Trace:
I20260709 13:18:42.772620  8103 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:42.693598  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:42.865350  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 217162us
I20260709 13:18:42.875772  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:42.754858  8177 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:42.793301  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:42.865998  8099 rpcz_store.cc:276] 0709 13:18:39.633252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.872181 (+238929us) service_pool.cc:224] Handling call
0709 13:18:41.167876 (+1295695us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.168582 (+   706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.723165 (+1554583us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003f3250. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:42.723340 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2925470080}
I20260709 13:18:42.880268  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:42.880872  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:42.755650  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:42.763746  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.791929  8255 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:18:42.883854  8255 pending_rounds.cc:85] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 13
I20260709 13:18:42.883713  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:42.884336  8255 pending_rounds.cc:107] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:18:42.884727  8255 raft_consensus.cc:2889] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:42.770471  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 458693us
I20260709 13:18:42.887488  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:42.781909  8175 raft_consensus.cc:3055] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:42.792843  8256 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:42.888497  8175 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:42.888620  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:42.890053  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:42.890640  8175 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.891808  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:42.750082  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3179) took 2406 ms. Trace:
I20260709 13:18:42.893965  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:42.894317  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 788) took 1727 ms. Trace:
I20260709 13:18:42.778759  8252 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:42.894860  8249 rpcz_store.cc:276] 0709 13:18:41.167145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.731419 (+564274us) service_pool.cc:224] Handling call
0709 13:18:41.731784 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:41.733373 (+  1589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.733413 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:41.782121 (+ 48708us) log.cc:844] Serialized 52 byte log entry
0709 13:18:41.913037 (+130916us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:41.946108 (+ 33071us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.960041 (+ 13933us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.960244 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.960320 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.677893 (+717573us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b1800078340. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:18:42.710586 (+ 32693us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b1800078340. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:18:42.816901 (+106315us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b1800078340. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:18:42.893689 (+ 76788us) raft_consensus.cc:1685] finished
0709 13:18:42.893739 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.894109 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":312557,"prepare.queue_time_us":316874,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":1945,"raft.queue_time_us":34993,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":291,"spinlock_wait_cycles":75322880,"thread_start_us":130549,"threads_started":1,"wal-append.queue_time_us":174347}
I20260709 13:18:42.757817  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:42.898329  8182 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:42.899170  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2805) took 2627 ms. Trace:
I20260709 13:18:42.899629  8253 rpcz_store.cc:276] 0709 13:18:40.272025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.272498 (+   473us) service_pool.cc:224] Handling call
0709 13:18:40.289652 (+ 17154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.756169 (+1466517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.898621 (+1142452us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54004137d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:42.898973 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3370882304}
I20260709 13:18:42.754899  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:42.866719  8102 rpcz_store.cc:276] 0709 13:18:40.390515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.447074 (+ 56559us) service_pool.cc:224] Handling call
0709 13:18:40.452810 (+  5736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.791196 (+1338386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.791226 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.791267 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:41.791299 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.715506 (+924207us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54003f2854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:42.715567 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.715753 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3077625088}
W20260709 13:18:42.904511  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.893301  8256 raft_consensus.cc:2410] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:18:42.869728  8107 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:42.866703  8106 raft_consensus.cc:2393] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:42.893855  8257 rpcz_store.cc:276] 0709 13:18:40.344010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.371974 (+1027964us) service_pool.cc:224] Handling call
0709 13:18:41.372241 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.372420 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:41.605651 (+233231us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.971611 (+365960us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.729231 (+757620us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b1800465ac0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dcd9c0a 00007fa5a7419219 00007fa5a4d2058f 00007fa59dd5f571 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd
0709 13:18:42.749694 (+ 20463us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:42.749746 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:42.749794 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.749862 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.750013 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":809951,"prepare.queue_time_us":303964,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":1979,"raft.queue_time_us":780493,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":21361,"spinlock_wait_cycles":299001216,"thread_start_us":548194,"threads_started":2,"wal-append.queue_time_us":512556}
I20260709 13:18:42.865935  8105 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:42.772159  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:42.785236  8782 raft_consensus.cc:2410] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:18:42.799702 13717 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.915498  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:42.916342  8782 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:42.787166  8786 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:42.917405 13717 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:42.917846 13659 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:42.918414 13717 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:42.918704 13659 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.919524  8786 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:42.919359 13717 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.748840 13711 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:42.923777 13717 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.924106 13694 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:42.924512 13717 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.786768  8791 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:42.925395 13717 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.926843 13659 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.927502 13659 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:42.927770  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:42.928381 13717 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.928550  8252 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:42.868613  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1989) took 1037 ms. Trace:
I20260709 13:18:42.866396  8101 rpcz_store.cc:276] 0709 13:18:41.425357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.426168 (+   811us) service_pool.cc:224] Handling call
0709 13:18:42.705953 (+1279785us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540043bcd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:42.706114 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262558080}
I20260709 13:18:42.929797 13810 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.929932  8104 rpcz_store.cc:276] 0709 13:18:41.831395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.831527 (+   132us) service_pool.cc:224] Handling call
0709 13:18:41.831904 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.832164 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.832200 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.832761 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:18:42.279832 (+447071us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:42.279873 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.279956 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.867873 (+587917us) raft_consensus.cc:1685] finished
0709 13:18:42.867924 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:42.868310 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":385130,"threads_started":1,"wal-append.queue_time_us":519872}
I20260709 13:18:42.931468  8101 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:42.804454 13853 raft_consensus.cc:3055] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:42.749305 13985 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.932174 13724 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:42.932281 13853 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:42.780261 13865 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.800647 13986 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.933185 13724 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.935525 13865 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.933545 14035 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:42.938529 13986 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.938678 14027 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.937058 13880 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:42.939841 14036 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:42.939777 13880 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.929932 12721 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.941044 14036 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.942284 12721 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.944926 12721 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:42.930917 13810 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.946126 14089 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.947139 14089 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.794219 13966 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.797178 13878 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.864638  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:42.950232  8099 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:42.935074 14064 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:42.951627 14064 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.952473 13878 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.955178  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:42.955250 14064 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:42.956377  8785 raft_consensus.cc:2393] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 16: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:42.934629  8104 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:42.933058  8101 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:42.928166 13659 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.882671  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:42.933586 14068 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:42.959203 14035 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:42.959486 14068 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.962078  8253 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:18:42.966084 14089 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:42.967331  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:42.968196  8251 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:42.970299  8175 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:42.971015 13966 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:42.976089 14149 consensus_queue.cc:1059] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:42.827600 14104 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.978147 14135 raft_consensus.cc:3055] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:42.978600 14135 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:42.979072 14100 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:42.979892 14100 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:42.980113 14135 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.934589 13853 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.963361 13865 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:42.994141 14094 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:42.995994  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:42.997331 13878 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.997991  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:42.998090 13878 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.000765 13878 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.001539 12721 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:43.003034 12721 raft_consensus.cc:3055] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:43.003446 12721 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:43.003810 13880 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:43.004699 14060 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:18:43.004582 12721 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.009333 14134 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.010279 14134 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.011051  8782 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:42.953188  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:43.012650  8783 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:43.013285 14027 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:43.014413 14104 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:43.014204 14027 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.016366 13659 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.017588 13853 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:43.017807 14082 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.018807 14082 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:42.893234  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.016994 14027 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:42.939849 13724 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.034844 13717 raft_consensus.cc:3055] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:43.035336 13717 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:43.036382 13717 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.042253 12721 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:43.045564  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 170066us
I20260709 13:18:43.046612  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:43.048594  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.049396 13659 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:43.050033 13659 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:43.051306 13659 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.053802 13946 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:43.054869 13946 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:18:43.058087  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 169908us
I20260709 13:18:43.059062  8223 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:43.059351  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.059768  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.060653  8181 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:18:43.060901  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.061776  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.062054 13880 raft_consensus.cc:2764] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:18:43.062551  8178 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:43.062804 13878 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:43.063122 13880 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:43.063319 13878 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:43.063526 14060 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:43.064616 13878 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.066105  8257 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:43.067107 14082 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.067570  8103 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:43.067517 14068 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:43.077612  8252 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:43.080250  8253 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:43.023932 14134 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:43.061233  8223 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:43.048069 13717 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:43.027186 14036 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:43.082492  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 55508.9us
I20260709 13:18:43.081166  8175 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:43.091823  8105 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:43.110810 14100 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.122205  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:43.122960  8790 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:43.126703 14060 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:43.127389 14060 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:43.129108  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.141182  8182 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
W20260709 13:18:43.099402 13791 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:18:43.149080  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:43.150008  8107 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:43.151197  8106 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:43.151260  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:43.152793  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 56415.7us
I20260709 13:18:43.154336 14036 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:18:43.158939  8005 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39814 (request call id 280) took 59943 ms (client timeout 15000 ms). Trace:
I20260709 13:18:43.166077  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.165936  8006 catalog_manager.cc:5697] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:43.173820  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.174832  8248 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
W20260709 13:18:43.175776  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.145735 13810 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.147054 14060 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:43.179713  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:43.183784 13810 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.184587 13810 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:43.187901  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.191418 14095 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:43.204281  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.205163  8249 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
W20260709 13:18:43.207597  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.208353 14133 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.208938 14133 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.210366 13810 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.211520 14133 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:43.159471  8005 rpcz_store.cc:269] 0709 13:17:43.215501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.216475 (+   974us) service_pool.cc:224] Handling call
0709 13:18:43.158627 (+59942152us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:37.359743 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:37.380490 (+ 20747us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:37.380539 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:18:37.380556 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:37.381217 (+   661us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:37.381286 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:37.381312 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:18:37.381808 (+   496us) tablet.cc:701] Row locks acquired
0709 13:18:37.381859 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:18:37.382019 (+   160us) write_op.cc:270] Start()
0709 13:18:37.382160 (+   141us) write_op.cc:276] Timestamp: P: 1783603117381954 usec, L: 0
0709 13:18:37.382179 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:18:37.445939 (+ 63760us) log.cc:844] Serialized 1701 byte log entry
0709 13:18:38.191447 (+745508us) op_driver.cc:464] REPLICATION: finished
0709 13:18:38.626720 (+435273us) write_op.cc:301] APPLY: starting
0709 13:18:38.634948 (+  8228us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:38.690422 (+ 55474us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:38.690519 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:38.693089 (+  2570us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:38.693313 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:18:38.693366 (+    53us) write_op.cc:312] APPLY: finished
0709 13:18:38.693641 (+   275us) log.cc:844] Serialized 49 byte log entry
0709 13:18:38.752655 (+ 59014us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.755435 (+  2780us) write_op.cc:454] Released schema lock
0709 13:18:38.767969 (+ 12534us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:38.816985 (+ 49016us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.819018 (+  2033us) write_op.cc:454] Released schema lock
0709 13:18:39.262659 (+443641us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b540006a9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4932a 00007fa5a0dcef14 00007fa5a0dceec3 00007fa5a0dcee38 00007fa5a0dcedf3 00007fa5a0dce0dc 00007fa5a0df7e16 00007fa5a0ddfcbb 00007fa5a0dca39d 00007fa5a0dcdd75
Metrics: {"mutex_wait_us":16607,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":362901,"apply.run_cpu_time_us":8059,"apply.run_wall_time_us":181431,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20839,"num_ops":4,"prepare.queue_time_us":334085,"prepare.run_cpu_time_us":32084,"prepare.run_wall_time_us":389826,"raft.queue_time_us":330039,"raft.run_cpu_time_us":25709,"raft.run_wall_time_us":1155837,"replication_time_us":785920,"spinlock_wait_cycles":60350336,"thread_start_us":897308,"threads_started":4,"wal-append.queue_time_us":295579,"wal-append.run_cpu_time_us":62005,"wal-append.run_wall_time_us":1964809}]]}
W20260709 13:18:43.237221  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 120333us
I20260709 13:18:43.168217  8006 catalog_manager.cc:5697] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 8 to 10, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 10 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:43.226845 14135 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:43.251276  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:43.251514  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:43.253708  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.256466  8147 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:43.259577  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:43.260486  8790 raft_consensus.cc:2410] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:18:43.261257  8791 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:43.267645  8252 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:18:43.270645  8257 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:43.274534  8253 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:43.274783  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:43.273577  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 212459us
I20260709 13:18:43.275476  8101 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
W20260709 13:18:43.281558  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 183196us
I20260709 13:18:43.280855 13951 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:43.296173  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:43.299934  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:43.302271  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:43.301887  8106 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:43.295295 13951 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.301739  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:43.261303  8103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:18:43.306964  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:43.308308  8103 raft_consensus.cc:476] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Not starting forced leader election -- already a leader
I20260709 13:18:43.305459  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:43.311875  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:43.297503  8006 catalog_manager.cc:5697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 9 to 15, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 15 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:43.314281  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.316702  8104 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:18:43.309906 13951 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:43.320320 12721 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.325918  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.326874  8099 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:43.326817  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.328450  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.331284  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.333312 14133 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:43.333762  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.334362  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.331954  8257 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:43.325827 14118 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:43.335819 14118 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.339076 14118 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:43.342826  8254 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:18:43.343677 13712 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.344204 13712 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:43.345748  8250 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:18:43.346978  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:43.346741  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 59471.9us
I20260709 13:18:43.347685  8256 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:18:43.351861  8788 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:43.356109  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.325212 13878 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:43.359424 12721 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:43.363189  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 62461.6us
I20260709 13:18:43.358275  8006 catalog_manager.cc:5697] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 8 to 13, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 13 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:43.359112 13659 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:43.366503 14133 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.366272 12721 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:43.366465  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.359130 13878 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.367753  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.372071  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.374423  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:43.368803 13659 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:43.373457 13878 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:43.375629 14036 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:43.386781  8147 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:43.369060 14133 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.388615 13711 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:43.369861 13810 consensus_queue.cc:1059] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:18:43.381361 14134 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:43.389820 14068 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:43.379766 13495 consensus_meta.cc:287] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.548s	user 0.006s	sys 0.011s
I20260709 13:18:43.402482 14133 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:43.405277  8254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 3195) took 1522 ms (client timeout 1639 ms). Trace:
W20260709 13:18:43.405754  8254 rpcz_store.cc:269] 0709 13:18:41.883447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.887327 (+  3880us) service_pool.cc:224] Handling call
0709 13:18:43.405077 (+1517750us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54001e5354. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:43.405202 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3342567808}
I20260709 13:18:43.406737  8255 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:43.400199 14068 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.407565 14068 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:43.413877 13712 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:43.423905 14068 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:43.439203 14158 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.125s	user 0.000s	sys 0.002s
I20260709 13:18:43.440761  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:43.442643 14133 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:43.442919  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:43.443153 14133 raft_consensus.cc:697] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:43.443879 14134 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:43.444272 14134 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.444136 14133 consensus_queue.cc:237] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.444654 14134 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:43.445094 14082 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:43.446346 13986 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:43.448820 14036 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.450820 14036 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.453038 14036 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:43.458518  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 93062.1us
I20260709 13:18:43.460103  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.461042 14036 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:43.445506  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:43.463536  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 72189.1us
I20260709 13:18:43.461665  8006 catalog_manager.cc:5697] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 9 to 13, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 13 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:18:43.463586  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 93742.9us
I20260709 13:18:43.472851 14068 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:43.473891  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:43.478078  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:43.481551  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.480370 14036 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.484685 14036 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:43.486838 14036 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.486963  8223 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:43.465539 14082 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:43.482034  8006 catalog_manager.cc:5697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 11 to 15, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 15 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:43.467183 13810 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:43.492286 14036 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:43.495134 13495 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:43.497835  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.505986  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 60597.8us
I20260709 13:18:43.506124  8006 catalog_manager.cc:5697] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 7 to 12, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 12 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
W20260709 13:18:43.504393 14163 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:18:43.517918  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.524667  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:43.524662 13853 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.527101 13853 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:43.525378  8791 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:43.522202  8006 catalog_manager.cc:5697] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:43.536336  8006 catalog_manager.cc:5697] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:43.537912  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:43.540001  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 53202us
I20260709 13:18:43.538487 13659 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.542305 14134 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.544528  8006 catalog_manager.cc:5697] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:43.533967 13810 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:43.552182  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 157811us
I20260709 13:18:43.553779  8223 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:43.546387 13717 raft_consensus.cc:3055] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:43.544860 14036 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:18:43.547276 13853 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.551775 13986 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:43.560757  8785 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:43.557250  8006 catalog_manager.cc:5697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 8 to 13, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 13 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:43.555847 13717 raft_consensus.cc:740] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:43.563725 13495 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:43.566954 13495 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.567302 13495 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:43.557916 13659 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:18:43.569568 14135 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:43.573680  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.563122 13951 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.576910 14135 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.574954 14036 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:18:43.582000 14133 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:43.591799 14100 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:18:43.593345  8791 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:43.582455 14068 consensus_queue.cc:1059] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:18:43.594933 14068 consensus_queue.cc:1243] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer 5033fc7e66374940a203908ea8b0078f log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:43.597283  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.598124  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:43.598982  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.599462  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.599840  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:43.600090  8255 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:43.600451  8182 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:43.600581  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.602195  8174 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:43.603533  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:43.605316  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.605273  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.606091  8254 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:43.606999  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.607547  8249 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:43.608429  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.609573  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.610258  8178 raft_consensus.cc:2368] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19.
I20260709 13:18:43.611635 13717 consensus_queue.cc:260] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.613039 13717 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:43.613602 13853 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.614179 13853 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:43.616390 13853 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.617444 13810 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.600193  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.618281  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:43.618490  8177 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:43.619269 13712 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:43.620774  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:43.621752 13712 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:43.622146  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.623104  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:43.623858 13712 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:43.620817  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.588624  8006 catalog_manager.cc:5697] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:43.626112 14135 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:43.669031  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 43869.5us
I20260709 13:18:43.670078  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:43.670949 13712 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:43.671991  8182 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:43.671893 13878 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.672536  8223 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:43.673040  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:43.673154 13951 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:43.675014  8176 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:43.674144  8147 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:43.682439  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.682374  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.682796  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.683233  8250 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:43.683425  8253 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:18:43.684211  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.684402  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.682467  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.678048  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.685067  8248 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:18:43.685606  8249 raft_consensus.cc:2410] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 23 because replica has last-logged OpId of term: 21 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 9.
W20260709 13:18:43.687731  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 59124.7us
I20260709 13:18:43.690191  8006 catalog_manager.cc:5697] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 10 to 17, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 17 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.691603 13711 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:43.692121  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.692773  8177 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:43.693651 14036 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:18:43.694535 14166 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:18:43.694217 14036 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:43.697299  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.698427  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.698927  8176 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:18:43.695359 13853 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:43.699810  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.712584 14036 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.713156 13853 raft_consensus.cc:697] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:43.714615  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:43.714542 13853 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.715502 14149 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:43.715910 14149 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.716266 14149 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:43.716570  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:43.717317 13951 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:43.719875 13951 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:43.720726  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:43.721392 13951 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:43.721757 13951 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:43.722638  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:43.698225 14133 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:43.723709 14133 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.722647 13951 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:43.724072 14133 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:43.724747 13951 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:43.725068 14149 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:43.735204 14149 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.728120 14135 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:43.696420 14134 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.729158  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:43.730433 13495 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.731200  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.727743  8182 raft_consensus.cc:2410] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 23 because replica has last-logged OpId of term: 21 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 9.
I20260709 13:18:43.754070  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:43.755860 12721 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:43.756273 12721 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:43.756770 12721 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:43.761559 13878 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:43.756049  8006 catalog_manager.cc:5697] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: config changed from index -1 to 9, term changed from 6 to 13, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to <none>, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 13 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
W20260709 13:18:43.766441  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.767123  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 94695.3us
I20260709 13:18:43.763492 14100 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:18:43.770995 13951 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:43.779197 13986 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:43.779853 13986 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:18:43.791059  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 88227.9us
I20260709 13:18:43.793591 14100 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:43.795631  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:43.796603 14118 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:43.797290  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:43.797070 13712 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:43.753684 14036 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:43.804589 14036 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:43.800643  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.805451 13951 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:43.806542  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.806497 13951 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:43.807444 13659 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:43.808185 13659 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:43.810356  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.795667  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:43.780870 13986 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.811775  8108 raft_consensus.cc:2410] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:18:43.797145 14118 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:43.803999 13495 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:43.806770 14036 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.800215  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:43.813190 14036 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:43.813287 14118 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:43.813894 14149 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:43.814085  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:43.814307 14149 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.814754 14149 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:43.815558  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:43.804826  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.801949  8006 catalog_manager.cc:5697] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 10 to 17, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 17 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:43.820055  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:43.826529 14068 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:43.826905  8108 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:43.833565  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:43.834610 12721 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:43.832741  8006 catalog_manager.cc:5697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:43.836346  8175 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:43.837857  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.839540 12721 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:43.840111  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:43.840737  8176 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:43.832129 13712 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:43.845499  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:43.846107  8182 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:43.846648  8177 raft_consensus.cc:2410] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:18:43.831933 13810 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:43.856880  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:43.856088  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.865283  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.862071  8107 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:43.871129  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.874037  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:43.862071  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:43.875396  8103 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:43.879287  8182 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:18:43.881130 13878 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:43.881541  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:43.882476  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 85281.1us
I20260709 13:18:43.882676  8108 raft_consensus.cc:2410] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:18:43.884896  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.885767  8257 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:18:43.887871  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:43.891184  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:43.891971  8101 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:43.893755  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:43.894033  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.894330  8251 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:43.895329  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.896430  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:43.897173  8250 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:43.893518  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:43.853916 13810 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.903244  8255 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:43.885275  8248 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:43.912770  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:43.917639 14133 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:43.919708  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:43.920033  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 88406us
I20260709 13:18:43.920472  8108 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:43.917150  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:43.925827  8223 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:43.928198  8106 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:43.929051  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:43.929330  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:43.929678  8105 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:43.927515  8791 raft_consensus.cc:2393] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:43.930106  8101 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:43.911150 13810 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:43.933416  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 52001.8us
I20260709 13:18:43.934505  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.928201 13791 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:18:43.954003  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.961275  8107 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:43.961895  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:43.941761 14134 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:43.967768  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:43.943020 13495 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:43.975289 13754 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:43.976436 13754 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:43.977051  8149 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.978266  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.978828 13791 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:43.979424  8251 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:43.982584  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:43.963295 14082 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:43.991470  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 50495.9us
I20260709 13:18:43.972671 13878 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:44.000985  8105 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:43.989529 13712 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:44.004132 14178 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:18:44.009868  8103 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:43.991500 14135 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:44.001663 13878 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.994787 14094 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:44.018147  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 50453.7us
I20260709 13:18:44.027486  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:44.029666 14104 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:44.017580 13717 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:44.024672  8101 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:44.025188 13878 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:44.044886  8250 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:44.038692  8108 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:18:44.054924  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:44.066349  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:44.067099  8178 raft_consensus.cc:2376] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17. Re-sending same reply.
I20260709 13:18:44.068104  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:44.068868  8182 raft_consensus.cc:2368] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18.
I20260709 13:18:44.029757 13712 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:18:44.081070  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:44.081070  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:44.095762  8250 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:44.096835  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:44.098095  8251 raft_consensus.cc:2410] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:18:44.103099  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:44.103832  8250 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:44.103143  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:44.104596  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:44.105464  8101 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:44.105506  8178 raft_consensus.cc:2368] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17.
I20260709 13:18:44.106251 14104 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:44.106853 14104 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:44.107863 14104 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:44.109133 14104 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:44.104612  8177 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:44.110409  8099 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:44.111303  8256 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:44.113037  8182 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:44.057812 14133 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:44.097261  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 49566.8us
I20260709 13:18:44.113623  8250 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:44.096796 13495 raft_consensus.cc:2764] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:18:44.120666  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:44.121611 13717 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:44.122414 13717 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.121563 14094 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:44.123096 14094 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:44.125725 13717 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:44.131201  8791 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:18:44.133191 14068 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:44.125350 14094 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:44.075161 13951 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.142251 13951 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:44.156149 13717 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:44.158298  8250 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:44.162245 13951 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:44.163573 13878 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:44.165405  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:44.166787  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:44.167021  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:44.167750  8174 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:18:44.167994  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:44.220672  8176 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:44.168197  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:44.168908  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:44.169399  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:44.169596  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:44.226722 13878 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:44.169880  8177 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:44.170780  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:44.229568  8101 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:44.170840  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:44.231020  8181 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:18:44.171424  8180 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:44.171293  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:44.172890  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:44.173599  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:44.235169  8099 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:18:44.174026 14149 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:44.181851  8108 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:18:44.179723  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 223951us
I20260709 13:18:44.237546  8149 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:44.238806  8182 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 21: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:44.239193  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:44.239560  8074 leader_election.cc:400] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19.
I20260709 13:18:44.239974  8074 leader_election.cc:403] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:44.213418  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.240484 13659 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:44.241492  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:44.242129 13659 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19.
I20260709 13:18:44.219820  8102 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:18:44.242395 14172 raft_consensus.cc:2764] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:18:44.244132 13791 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:44.244719 13791 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:44.245229 13791 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:44.246457 12721 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:44.246923 12721 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:44.247340 12721 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:44.247521  8104 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 19: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:44.241036  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:44.251775  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:44.256115  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:44.237599 14149 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:44.259689 14149 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:44.260898  8074 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:44.262727  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:44.263578 13711 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:44.263974 13659 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:44.264591 13659 raft_consensus.cc:697] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:44.249811 13712 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.265630 13659 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:44.266090 13712 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:44.268419 13712 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:44.206485 13495 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.269785 14172 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:44.270282 14172 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:44.270670 14172 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:44.271212 13810 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:44.271818 13717 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:44.273633  8175 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:44.269851 13495 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:44.274602 14149 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:44.275334  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:44.280153 14180 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:44.280591 14180 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:44.280969 14180 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:44.264195 13711 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:44.261026 14036 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:44.295603  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:44.303429  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:44.311148  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 342167us
I20260709 13:18:44.311293  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:44.312186  8175 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:18:44.317112  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:44.314291  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:44.317993  8178 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:44.323832 13495 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:44.337349 13791 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:44.309994 13810 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:44.337898 13985 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:44.341356  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:44.341799  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:44.348665  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 107749us
I20260709 13:18:44.350991  8175 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:44.352321  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:44.356070  8176 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:18:44.354540  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:44.361629 13495 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.363030  8223 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:44.362102 13495 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:44.322620 13878 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:18:44.364023  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:44.365679  8182 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:44.365674  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:44.371833 12721 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:44.353750 13985 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.353502 14036 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:44.380370  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:44.381592  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:44.382331 13495 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:44.382807 13495 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:44.358002 14134 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:18:44.386224  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:44.384392  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:44.376739 13711 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:44.405520 13711 consensus_queue.cc:1059] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:44.405676  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:44.406637 13853 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:44.407050 14068 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:44.375800 13985 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:44.406566 13711 raft_consensus.cc:3055] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:44.364573 14104 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:18:44.403479 12721 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:44.383746 14175 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:44.401904 13495 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:44.382861 13659 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:44.374085 13712 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:18:44.409646  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:44.459767  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 78317.1us
I20260709 13:18:44.460506  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:44.457122 13495 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.461418 13495 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:44.381927 14133 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:18:44.464673  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:44.466667  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 64981.8us
I20260709 13:18:44.455109 14184 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:44.454067 13711 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:44.477089  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:44.477658  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:44.459033 14175 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:44.480561  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:18:44.489333  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 125527us
I20260709 13:18:44.490581  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:44.494522  8785 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:44.458379 13986 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:44.497320  8788 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:44.463536 13791 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:44.504650  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:44.501524  8099 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:18:44.473030 14188 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:44.494792 14193 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:18:44.509478  8782 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:18:44.480479 14185 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:44.510644  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:44.466342 13853 raft_consensus.cc:697] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:44.511945  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:44.503728  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:44.510814  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:44.495296 14175 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:44.489102 14118 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:44.477993 14184 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:44.548950  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:44.554725  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 86269.5us
I20260709 13:18:44.503666 13659 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:44.570365  8223 leader_election.cc:400] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18.
I20260709 13:18:44.570791  8223 leader_election.cc:403] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:44.519098  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:44.494508 14036 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:44.510087 14188 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:44.548899 14194 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:18:44.545025  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:44.546106  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:44.545748  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:44.547233 14198 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:44.579245  8099 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
W20260709 13:18:44.556214 14190 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:18:44.544549 14191 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:44.548708 13853 consensus_queue.cc:237] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:44.561139  8788 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:44.563444 13711 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:44.564505 14197 raft_consensus.cc:3055] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:44.555223 14118 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.530221  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:44.547480  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:44.570822 13495 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:44.489476 14100 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:18:44.580062 14104 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18.
I20260709 13:18:44.530177 14134 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:44.556069 14184 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:44.504199 13986 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:44.611872  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 65843us
I20260709 13:18:44.570585 13659 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:44.572717  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:44.632195  8253 raft_consensus.cc:2368] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
I20260709 13:18:44.575011 14188 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:44.621745 14149 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.631414 13810 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:44.655835  8102 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:44.626434 14197 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:18:44.664758  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.660836  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:44.663753  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 186187us
I20260709 13:18:44.665351  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:44.667050  8108 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:44.666209  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 110706us
I20260709 13:18:44.668382  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:44.641268 13495 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:44.661911  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:44.632607 14118 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:44.626148 13791 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:44.658298 13659 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:44.682936 13810 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:44.685102 14178 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.686651  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:44.662452 13711 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:44.718612  8102 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:18:44.631807 14068 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:44.716234  8257 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:44.673033  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:44.720244  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51236.3us
I20260709 13:18:44.718173  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:44.637133 14191 raft_consensus.cc:697] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:44.655407 14134 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:44.725862 13495 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:44.735859  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 67585.3us
I20260709 13:18:44.737098  8223 leader_election.cc:400] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17.
I20260709 13:18:44.725528  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:44.744930  8104 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:44.664428 14149 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:44.690217 13951 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:44.746716  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:44.718559 13810 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:44.696424 13791 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:44.754154  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:44.721057 14185 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:44.755183 12721 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:44.757246 12721 raft_consensus.cc:697] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:44.717401 13985 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:44.761278  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:44.763931 13495 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:44.764065  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:44.764335 13495 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:44.764734 13495 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:44.765208  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:44.765738  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:44.764750  8784 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:44.766605  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:44.765213  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:44.753794 14135 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:44.771009  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:44.773794 12721 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:44.756515 13791 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:44.779574  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:44.734496 14175 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:44.783044  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:44.756945 14185 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:44.785117  8105 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:44.762223  8108 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:44.785164  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:44.734383 14178 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:44.785863 13495 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:44.788498  8257 raft_consensus.cc:2393] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:44.785759  8181 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:44.791245  8253 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:18:44.734179 14068 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:44.777680 14135 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.758550 14210 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:44.808656  8221 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:44.816033 13495 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:44.820098  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:44.820696  8255 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 18. Current term is 19. Ops: [18.14-18.14]
W20260709 13:18:44.822986  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 61803.1us
I20260709 13:18:44.809012  8253 pending_rounds.cc:85] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 10
I20260709 13:18:44.828090  8253 pending_rounds.cc:107] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:18:44.788266 14185 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:44.855139  8183 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:44.828437  8253 raft_consensus.cc:2889] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:44.830216  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:44.842047 14203 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.846298 13986 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:44.890506  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 60367.8us
I20260709 13:18:44.889142  8104 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 22: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:44.892315  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:44.895041 13495 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:44.895619 13495 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:44.896034 13495 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:44.825682 14135 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:44.903880 14220 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:44.905953  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 152999us
I20260709 13:18:44.906252 14224 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:44.755636 14197 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:44.847199 14209 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:44.842103 14100 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:18:44.930989  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.863938  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:44.853657 14104 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
W20260709 13:18:44.957358  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 201424us
I20260709 13:18:44.933027 14197 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:44.963277  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 99455.8us
W20260709 13:18:44.954699 14180 consensus_meta.cc:287] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.003s
I20260709 13:18:44.965651 13495 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:44.899504 14203 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:44.978523  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 86309.1us
I20260709 13:18:44.981575 13495 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:44.936074 14100 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:44.990141 14196 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:44.857656 14191 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:44.998121 14172 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.727s	user 0.014s	sys 0.000s
W20260709 13:18:45.013409  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 95375.7us
W20260709 13:18:45.016400  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 48130.8us
W20260709 13:18:45.009038 14215 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.184s	user 0.001s	sys 0.001s
I20260709 13:18:44.979244 14180 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:45.057057  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 44795.9us
I20260709 13:18:45.066946  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:45.071009 12721 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:45.071488 12721 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.071885 12721 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:45.020138 13985 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:45.078025 14203 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:45.070535 14208 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 13:18:45.080461  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 233616us
I20260709 13:18:45.099646  8072 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:45.057101  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:45.079504  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 67040.4us
I20260709 13:18:45.102341  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:45.107537  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 50498.7us
I20260709 13:18:45.110649 13495 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:45.113137  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 46309.6us
I20260709 13:18:45.058655 14188 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.119719  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:45.118037  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:45.130137  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:45.130923  8177 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:45.131454  8181 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:18:45.057853 14172 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.123245  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:45.138831  8223 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:45.138296 13495 consensus_queue.cc:1059] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:45.114791 14175 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:45.144974  8099 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:45.109700 13712 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:18:45.142560 13951 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:45.221743 12721 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.257782 14236 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:45.132916 13717 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
W20260709 13:18:45.271310  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 131440us
I20260709 13:18:45.261372 13985 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:45.266681 13711 consensus_meta.cc:287] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.011s
W20260709 13:18:45.276894  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 177364us
W20260709 13:18:45.290798  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 182078us
I20260709 13:18:45.291923  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:45.293874 12721 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:45.220247 14206 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.272s
I20260709 13:18:45.303872 13711 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:45.317642 13951 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:45.318265 14226 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:18:45.325207 14184 consensus_meta.cc:287] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.664s	user 0.005s	sys 0.006s
I20260709 13:18:45.326740 14236 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:18:45.328593 13791 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.521s	user 0.005s	sys 0.005s
W20260709 13:18:45.347695  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 54214.7us
W20260709 13:18:45.348067  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 56274.7us
W20260709 13:18:45.335052 14234 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 13:18:45.334944 14228 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:18:45.357205 14250 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:45.358074 14248 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:45.357980  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:45.358517 14248 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:45.358897 14248 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:45.355099 14226 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:45.339512 13711 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:45.355037 14184 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.339458 14229 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:45.368479 14226 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:45.381906 14235 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:18:45.381165 14243 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:45.348999 13951 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:45.418365  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 154233us
W20260709 13:18:45.374603 13659 consensus_meta.cc:287] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.653s	user 0.004s	sys 0.007s
I20260709 13:18:45.378086  8108 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:45.327361 14231 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.240s
I20260709 13:18:45.378356 14229 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:45.435277 14229 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:45.388440 13754 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:45.437844  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 164403us
I20260709 13:18:45.364269 13791 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.375708 13711 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:45.366554 14247 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.181s
W20260709 13:18:45.371773 14118 consensus_meta.cc:287] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.650s	user 0.006s	sys 0.003s
W20260709 13:18:45.380409 14244 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:18:45.452006  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:45.449085  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:45.456960  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:45.453862 13985 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:18:45.459730  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:45.463029 14227 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.404s	user 0.002s	sys 0.000s
I20260709 13:18:45.463157 14134 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:45.463713 14134 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:45.464610  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:45.464798 14133 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:45.466521 14255 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:18:45.465526  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:45.376897 14236 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:45.469872 14255 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:45.473737  8149 leader_election.cc:400] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
I20260709 13:18:45.474109  8149 leader_election.cc:403] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:18:45.474771  8149 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:45.451850 14231 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:45.371913 14240 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.109s
I20260709 13:18:45.445916 14246 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.434280 13659 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.457881 14250 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.486805 13985 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.505590  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:45.472651 14206 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:45.504604 13985 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:45.516836  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:45.517719  8790 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:45.490145 14134 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
W20260709 13:18:45.524932 14245 log.cc:927] Time spent T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:18:45.506644 13791 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:45.526252 14254 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.527798  8107 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:45.456063 14118 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.510344 14196 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:45.538532  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 181839us
I20260709 13:18:45.541810 14251 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:45.542004 14253 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:45.542690 14253 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.544927 14253 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:45.541810 14207 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:45.542131 14242 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 13:18:45.552198 13810 consensus_meta.cc:287] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.794s	user 0.008s	sys 0.004s
I20260709 13:18:45.552687 13810 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.553458 14207 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
I20260709 13:18:45.556028 14253 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:45.556591 14253 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:45.557147 14197 consensus_meta.cc:287] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.588s	user 0.005s	sys 0.004s
I20260709 13:18:45.557746 14199 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:45.559109 13659 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:45.522253 14231 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:45.571859  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 60668.8us
W20260709 13:18:45.573377  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 122798us
I20260709 13:18:45.527045 14178 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:45.574370  8248 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 21: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:45.598076  8104 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:18:45.603230  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:45.604357  8101 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:45.604792  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:45.606669  8221 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:45.517607 14246 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:45.613161  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:45.614224  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:45.616474  8102 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:45.619975  8103 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:45.622844  8180 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:45.594472 14199 raft_consensus.cc:697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:45.518558 14250 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.624835  8106 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:45.606256 14185 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.716s	user 0.007s	sys 0.006s
I20260709 13:18:45.628346  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:45.632992  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:45.633669  8182 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:18:45.631263  8784 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:45.636874  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:45.630119  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:45.638150  8221 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:45.530094 14254 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.645973  8791 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:18:45.605058 14133 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:18:45.569624 14196 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:45.643226 13711 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:45.655404  8100 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 19: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:45.657840  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:45.658671  8104 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:45.653913  8221 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:45.651762  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:45.680594  8223 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:45.667279  8785 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:18:45.693194 14271 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:18:45.694418 14271 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:45.695343 14257 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:45.695998 14262 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:45.696682 14262 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:45.697580 14279 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:45.699436 14262 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:45.700031 14265 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:45.700158 14259 consensus_queue.cc:1059] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:18:45.701623 14259 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:45.702059 14259 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:45.704062 14252 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:45.704617 14252 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:45.704836  8782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1146) took 1048 ms. Trace:
I20260709 13:18:45.705114 14252 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:45.705299  8782 rpcz_store.cc:276] 0709 13:18:44.656169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.656319 (+   150us) service_pool.cc:224] Handling call
0709 13:18:44.660991 (+  4672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.753299 (+ 92308us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:44.864984 (+111685us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.120231 (+255247us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.120436 (+   205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:45.120497 (+    61us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:45.120558 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.464549 (+343991us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b48000606d8. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a5d75aa1 00007fa5a5d6cb37 00007fa5a5d6c9ca 00007fa5a5e6426f 00007fa5a5e63f37 00007fa5a5e7855c 00007fa5a5e78508 00007fa5a5e78488 00007fa5a5e78443 00007fa5a5e776ec 00007fa5a4da1a96
0709 13:18:45.704607 (+240058us) spinlock_profiling.cc:243] Waited 92 ms on lock 0x7b54005226d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:45.704648 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.704751 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12423,"prepare.queue_time_us":47183,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":4137,"raft.queue_time_us":192589,"raft.run_cpu_time_us":4042,"raft.run_wall_time_us":504246,"spinlock_wait_cycles":228880000,"thread_start_us":326197,"threads_started":3,"wal-append.queue_time_us":88394}
I20260709 13:18:45.712415  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:45.660629 13985 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:45.695094 14271 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:45.724623  8102 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:18:45.725255 12721 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.726480 12721 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:45.640966 14185 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:45.680243 14226 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:45.683701 13712 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:45.679271 14197 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:18:45.743906  8103 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:45.735378 13711 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:45.765079  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 113801us
I20260709 13:18:45.766950  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:45.767325  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:45.767830  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:45.768114  8106 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:18:45.768504  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:45.769259  8102 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 21: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:45.741088 14251 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:45.776347  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:45.812156 12721 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:45.812268 14266 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:18:45.814229 14282 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:45.736313 14226 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.752300  8182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:45.817696 13810 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:45.817809  8182 raft_consensus.cc:606] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:45.754313 14253 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:45.749356 14262 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:45.817718  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:45.823760  8104 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:45.722009 14199 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:45.846257  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 78503.6us
I20260709 13:18:45.777805 13711 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.841984 13712 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:45.849543  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:45.853018  8104 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:18:45.855563 14250 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:45.845177 14197 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:45.874432  8102 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:45.822196 14251 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:45.838284 14262 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:45.909930  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:45.913208  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:45.915360  8182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:51044
W20260709 13:18:45.909338 14248 consensus_meta.cc:287] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.549s	user 0.015s	sys 0.005s
I20260709 13:18:45.917906  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:45.914579 14257 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:45.922595 14284 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:18:45.922935 14257 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:45.922981  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:45.923625 14257 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:45.924791 14271 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:45.924507 14257 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:45.937810 14135 consensus_meta.cc:287] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.015s	user 0.006s	sys 0.008s
W20260709 13:18:45.937989  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 88755.1us
I20260709 13:18:45.918967 14291 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:45.914599 13659 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.919196 14191 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:45.921547 14295 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:45.941998  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:45.940084 14135 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.942045 14291 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:45.945000 13659 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:45.945082  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:45.939574 14254 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:45.938895 14236 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:45.953780 14294 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:18:45.953925 14272 consensus_queue.cc:1059] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:18:45.953787  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:45.956223 14252 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:45.938452 14271 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:45.958775 14094 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.978219 14251 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:45.978531 14094 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:45.980170 13659 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:45.972012 14236 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.980641 14094 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:45.981068 14236 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:45.959635 13711 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:45.981824  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:45.982514  8101 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:18:45.983254 14252 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:45.939808 14196 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:46.017664 14188 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:46.020669  8149 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.129:45123 timed out after 1.604s (SENT) [suppressed 9 similar messages]
I20260709 13:18:45.951359  8104 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:45.963076 14291 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.964310 14180 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:45.957906 14295 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:45.943678 14185 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:45.926783 14248 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:45.977795 14082 raft_consensus.cc:3055] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:45.959311 13712 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:45.960311 14281 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:45.988729 14226 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:45.989029 14246 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:45.992322 14118 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:45.947901 14259 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.041837  8785 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:45.972795 14133 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:46.044939 14133 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.047686 14295 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:45.994302 14287 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:45.994297 14236 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.050048 14248 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:46.050879 14236 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:45.999369 14262 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:46.004750  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:46.051592  8790 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:18:46.051846  8249 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:46.006484 14300 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.007038 14184 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:46.052711 14300 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.027254 14233 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:18:46.054836 14233 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:46.055069 14300 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:46.055403 14233 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:18:46.009091 14229 consensus_meta.cc:287] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.000s
I20260709 13:18:46.056242 14229 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.058917 14239 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:46.059337 14239 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:46.059465  8255 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:46.056685 14233 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.060232 14239 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.060930 14233 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:45.960641 14135 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:46.010195  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:46.062333 14229 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:46.010995  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:46.063807  8252 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:46.012255  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:46.013921 14172 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:46.015827 14294 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:46.016323 14271 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.017895  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3164) took 1406 ms. Trace:
I20260709 13:18:46.067271  8099 rpcz_store.cc:276] 0709 13:18:44.611104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.611348 (+   244us) service_pool.cc:224] Handling call
0709 13:18:44.628983 (+ 17635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.219926 (+590943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.017583 (+797657us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b540001b8d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:46.017779 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179947264}
I20260709 13:18:46.028110  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:46.031248  8103 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:18:46.029156  8221 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:46.035296  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.036062  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:46.035024  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:46.038640  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.070921  8786 raft_consensus.cc:2393] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 19: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:46.038803  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.030036 14082 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:46.024236 14149 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:46.031586 14252 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:46.036832 13712 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.043852 14249 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.030407 14196 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:46.038646 14104 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:46.055721 14231 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:46.065037  8256 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:18:46.070847  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:46.047825 14133 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:46.078763 12721 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:46.106644 12721 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.087234  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:46.107143  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:46.066875 14206 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:46.109227  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:46.121563  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:46.122282  8101 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:46.110633  8176 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:18:46.108979 14196 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.114143 14271 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:46.115144 14270 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:46.117513 14104 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.077503 14229 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:46.119839 14231 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:46.076548 13853 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.109285  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:46.120887 14206 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.128086  8176 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:18:46.099998 14300 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:46.129225  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:46.131228  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:46.226387  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 95251.4us
W20260709 13:18:46.089720  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 60635.5us
I20260709 13:18:46.265250 13495 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:46.265906 13495 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:46.107122 14197 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:46.273918  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:46.272671  8248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 3239) took 1773 ms (client timeout 1825 ms). Trace:
I20260709 13:18:46.291411  8257 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:18:46.282166  8248 rpcz_store.cc:269] 0709 13:18:44.499789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.501566 (+  1777us) service_pool.cc:224] Handling call
0709 13:18:46.272412 (+1770846us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001e6c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:46.272596 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417037696}
W20260709 13:18:46.315088  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 84285.4us
I20260709 13:18:46.102531 14252 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.134006 14231 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.129335 14229 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:46.330134  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 309465us
I20260709 13:18:46.101315 14294 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.271301 14295 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.276253 14209 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:46.345811  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:46.349068  8175 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:46.213907 14118 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.120s
I20260709 13:18:46.358706 14279 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.360687 12721 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:46.482034  8251 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.025s	sys 0.053s
I20260709 13:18:46.334240 14231 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:46.388120  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:46.391736 14304 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:46.269559 14082 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:46.392197  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.391983  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:46.392498 14301 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:46.393218 14299 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:46.393750 13711 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:46.394871  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:46.102763 14249 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.479276 14300 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.350550 14295 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.135037 14270 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.338064 14229 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:46.479354  8257 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:46.479991  8182 raft_consensus.cc:606] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Received request to transfer leadership to TS 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:46.352411  8176 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:46.350664 14191 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:46.531531  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:46.482672  8251 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.026s	sys 0.053s
I20260709 13:18:46.482575  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:46.533077  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:46.533692  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:46.348762 14209 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.483791  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:46.493125  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.388994 13951 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:46.494546  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 106644us
I20260709 13:18:46.540251  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:46.275672 13853 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.499441  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:46.543360  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3233) took 2067 ms. Trace:
I20260709 13:18:46.543161  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:46.505313  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:46.505326  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:46.498097 14250 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:46.500226 14257 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:46.500829 14118 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:46.545061  8176 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:46.548529  8180 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 19: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:46.503388 14253 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:46.550117  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:46.550280  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:46.551172  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:46.551751  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:46.547634 13951 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:46.554272 14307 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:18:46.556740 14314 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.558216 13712 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:46.539945 14191 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.505609 13711 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.568639  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:46.492098 14279 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.541940 14209 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:46.584314  8253 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:46.539943 14036 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.500526 14301 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.587532  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.597908  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:46.544242  8251 rpcz_store.cc:276] 0709 13:18:44.475961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.477069 (+  1108us) service_pool.cc:224] Handling call
0709 13:18:44.494758 (+ 17689us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:44.510447 (+ 15689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.510479 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:44.549451 (+ 38972us) log.cc:844] Serialized 78 byte log entry
0709 13:18:44.741918 (+192467us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:44.903116 (+161198us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.842190 (+939074us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b18000506e0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa5a09f44bc 00007fa59dd4248b 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5c455 00007fa5a0e44060 00007fa5a0e56716 00007fa5a0e67287
0709 13:18:45.909029 (+ 66839us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.532503 (+623474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.532613 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.542980 (+ 10367us) raft_consensus.cc:1685] finished
0709 13:18:46.542998 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.543308 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22896,"prepare.queue_time_us":190895,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":5949,"raft.queue_time_us":121848,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":14025,"spinlock_wait_cycles":7986304,"thread_start_us":1034126,"threads_started":5,"wal-append.queue_time_us":219023}
I20260709 13:18:46.496098 14197 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.498917 14304 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.615782  8181 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:18:46.584988  8106 raft_consensus.cc:2368] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17.
I20260709 13:18:46.618953  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:46.626067 14305 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:18:46.626392  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:46.634161  8099 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:46.627157  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:46.615532 14172 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:46.628111 14301 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:46.619539 14226 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:18:46.629616 14206 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:46.658975 14270 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:46.619112 14118 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.535020 14300 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.661705 14300 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:46.663111  8249 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:46.665238 14304 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:46.569681 14196 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:46.637094  8101 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:46.637944  8108 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:46.615511 14314 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.649744  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:46.650298 14191 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:46.649139 14172 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:46.653623 14309 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:18:46.514137 14299 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.655416 14279 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:46.656041 14252 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:46.656912  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:46.596491 14135 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:18:46.633139 14036 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.658787 14249 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:46.620383 13853 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:46.563784 14257 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:46.620261 14253 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.568363 14104 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:46.583329 14262 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:46.675002  8253 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:46.676072  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:46.714612  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:46.676684  8183 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.000s
I20260709 13:18:46.677354  8099 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:46.715440  8183 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:46.678094  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.686573  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:46.688333  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:46.597622 14207 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:18:46.716554  8788 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:46.565913 14250 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.703843 14135 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:46.692323  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:46.698107  8106 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:46.703270  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:46.709529 14257 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:46.716732  8251 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:46.716809  8108 raft_consensus.cc:2368] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
I20260709 13:18:46.637225 13791 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:46.701853 14252 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.695168  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:46.674247  8177 consensus_meta.cc:287] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.001s
I20260709 13:18:46.738432  8177 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:46.726951 14207 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:46.740372  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:46.713876 14262 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:46.738386  8783 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:46.748029  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.722098 14135 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:46.750429  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:46.731063 13853 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:46.739656 13791 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.730849 13754 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:46.758498  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:46.759658  8251 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 21: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:46.739557 14207 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:46.771783  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:46.770634 12721 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:46.754174 14262 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:46.771737  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:46.773445  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:46.774962 12721 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:46.777499  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.759102 13853 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.762681 14279 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:46.784024  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.784303 14250 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:46.785037 14295 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:46.785989 13951 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:46.786358 14230 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:46.786770 14230 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:46.787077 14172 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:46.787673 14226 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:46.788143 14226 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.788532 14226 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:46.789508 13791 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:46.791780 14233 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.730s	user 0.011s	sys 0.000s
I20260709 13:18:46.785096 14100 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:46.795001 14253 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:46.797312 12721 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.799597 14207 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.800487  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.800808 14207 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:46.801873  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.802300  8786 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:46.803092 14314 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:46.803936  8786 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:18:46.804569 14299 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:46.805604  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:46.745159 14252 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.806001 14036 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:46.771267 13754 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.807565 14315 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:46.787696 14230 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:46.784343 14279 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.811223 14230 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:46.812592 14279 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:46.813336 14252 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:46.805615 14135 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.815791  8099 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:46.814380  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.827613 14294 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:46.819677 14209 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:46.805727 13853 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:46.803018  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.823668 14082 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:46.809131 13754 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:46.820670  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.821201  8102 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:46.832399  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.830056  8251 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:46.848758  8106 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
W20260709 13:18:46.841212  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.826730  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.850018  8782 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:46.765623 14104 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:46.799396 14231 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:46.847231  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 75538.6us
I20260709 13:18:46.830667  8099 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:46.851606  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.852473  8786 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:46.855849  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:18:46.868230  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.913128  8147 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:46.915717  8256 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:46.915932  8106 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:46.946473  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:46.835767 14135 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:46.960446  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.967718  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:46.968298  8254 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 18: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:46.969129  8251 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:46.971127  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 2008) took 1376 ms. Trace:
I20260709 13:18:46.971509  8100 rpcz_store.cc:276] 0709 13:18:45.594900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.595051 (+   151us) service_pool.cc:224] Handling call
0709 13:18:46.970925 (+1375874us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b54000fb4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:46.971049 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83852160}
I20260709 13:18:46.978929  8785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1158) took 1153 ms. Trace:
I20260709 13:18:46.979465  8785 rpcz_store.cc:276] 0709 13:18:45.825081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.837549 (+ 12468us) service_pool.cc:224] Handling call
0709 13:18:45.837857 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.050006 (+212149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.978600 (+928594us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400750154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:46.978832 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466428672}
W20260709 13:18:46.982156 14290 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 1.074s	user 0.011s	sys 0.007s
W20260709 13:18:46.993976  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.994956  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1156) took 1291 ms. Trace:
I20260709 13:18:46.995406  8791 rpcz_store.cc:276] 0709 13:18:45.703444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.703579 (+   135us) service_pool.cc:224] Handling call
0709 13:18:45.703911 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.704231 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.704257 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.704719 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.773003 (+ 68284us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:45.773055 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.773137 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.981498 (+1208361us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:46.994599 (+ 13101us) raft_consensus.cc:1685] finished
0709 13:18:46.994625 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.994895 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1065,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":3274112,"thread_start_us":67880,"threads_started":1,"wal-append.queue_time_us":138588}
I20260709 13:18:46.997961  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:46.999425  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:47.001754 14260 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:47.012300 14260 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:47.012704 14260 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:47.010033 14239 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:47.014564 13791 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:47.015061 13791 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:47.015513 13791 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:47.019251 14209 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:47.021504 14231 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:47.023623 14229 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:47.024035 14260 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.024976  8252 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:46.946432 14104 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:47.028043 14104 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:46.847818 14199 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.181s
I20260709 13:18:46.850090 13951 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.180s
W20260709 13:18:47.033046  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 66216.1us
I20260709 13:18:47.034008  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:47.035409  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:47.043143  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.031488 14259 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:47.062191  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.071452  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:47.057130 14240 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:47.053855 14319 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:47.059008 13951 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:47.011529 13853 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.077013 14226 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.114053 14260 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:47.114450 14226 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:47.080719 14232 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:47.101785  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.111281 12721 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:47.120767 12721 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:47.131980  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 218986us
I20260709 13:18:47.056824 14318 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:18:47.134743  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:47.138355  8791 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:47.139889  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:47.093262 14319 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:47.130292 14232 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.092447 14279 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 13:18:47.154832 14319 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:47.152874 14229 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:47.143867 14260 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:47.155563 14240 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:18:47.173202  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 317469us
I20260709 13:18:47.181708  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:47.185206 14308 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.500s	user 0.000s	sys 0.009s
I20260709 13:18:47.169160 14232 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:47.175976 12721 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:47.117726 13951 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.170348 13878 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:47.180820 14240 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:18:47.192303  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 115484us
I20260709 13:18:47.211436  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:47.212671 13853 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:47.213521  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:47.214093  8252 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:47.203341 13878 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.216536 13878 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:47.213333 14240 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:47.218079 14240 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:47.227028 14324 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:47.207332 14326 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 13:18:47.234752 14306 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.833s	user 0.000s	sys 0.012s
I20260709 13:18:47.240269 13711 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:47.211516  8791 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:47.243343 14262 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.247164  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:47.248539  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:47.250259 13951 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:47.205703 14321 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:18:47.192425 14257 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.186709 14260 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.258733  8147 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:47.266357  8176 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:18:47.268780  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 231711us
I20260709 13:18:47.275103  8788 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:47.278992  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:47.270979 13951 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:47.295603  8177 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:47.316620  8176 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:47.319303  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:47.320158  8181 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:18:47.325752  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:47.327210  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:47.328310  8252 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:47.330016  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:47.330865  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 147672us
I20260709 13:18:47.335223  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:47.340538  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:47.349642  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:47.351200  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:47.353538  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:47.356081  8257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60806 (request call id 825) took 1354 ms (client timeout 1602 ms). Trace:
I20260709 13:18:47.356556  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:47.356508  8257 rpcz_store.cc:269] 0709 13:18:46.001417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.009932 (+  8515us) service_pool.cc:224] Handling call
0709 13:18:47.355926 (+1345994us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54002ae9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:47.356027 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527461760}
I20260709 13:18:47.358366  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:47.374756  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:47.357839  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:47.359408  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:47.384954  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.339732 14256 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:47.339937 14326 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.339565 13951 raft_consensus.cc:697] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:47.406759  8104 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:47.416942  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:47.288445 14255 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 13:18:47.374091 14279 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.360455 14331 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:47.454382  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:47.456946  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:47.462960  8103 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:47.457388 14255 raft_consensus.cc:3055] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:47.457823  8174 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:47.456971  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:47.458556  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:47.420189  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:47.419719  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.461019  8177 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:18:47.393054 14318 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:47.399263 14256 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:18:47.514626  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 56150.9us
W20260709 13:18:47.526999  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.573778  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:47.576951  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:47.382064 14199 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.135s
I20260709 13:18:47.582283  8149 leader_election.cc:400] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
W20260709 13:18:47.584532  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 67288.8us
I20260709 13:18:47.585282  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:47.465418 14255 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:47.509645 13711 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:47.599255  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:47.600196  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.429090 14262 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:47.434383 14257 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:47.399806 14321 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 20.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.194s
W20260709 13:18:47.587109 14259 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.004s
I20260709 13:18:47.640316 13495 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:47.641220  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:47.573318 13810 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:47.416674 14094 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.194s
I20260709 13:18:47.655422  8252 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:47.612689  8251 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:47.466954 14279 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:47.667062  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 246943us
I20260709 13:18:47.664915  8103 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:18:47.668377  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:47.426898 14326 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:47.510671 14331 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.658911  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:47.688835 13495 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:47.675029  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:47.610667 14184 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:47.670871  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:47.685786  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.690747  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.693539  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:47.588429 14333 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.697324  8255 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:47.638592 14172 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:47.701767  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:47.650326 14328 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:47.702732  8256 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:47.707185  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:47.707306  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:47.708516  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:47.708956  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:47.711526  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:47.715263  8102 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:47.717551  8099 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:47.725823  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:47.726749  8221 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:47.639873 13711 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.611546 14319 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:47.731839  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:47.735844  8251 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:47.741950  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:47.747591  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:47.748221  8256 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:18:47.749039  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:47.749583  8256 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:47.750218  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:47.744699  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:47.754397  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:47.755133  8251 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:47.752195  8250 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:47.761036 13495 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:18:47.734632 14240 consensus_meta.cc:287] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.005s
W20260709 13:18:47.766707 14334 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:18:47.766712  8254 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:18:47.770485  8254 pending_rounds.cc:85] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 10
I20260709 13:18:47.770877  8254 pending_rounds.cc:107] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:18:47.771210  8254 raft_consensus.cc:2889] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:47.777592 13791 consensus_meta.cc:287] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.762s	user 0.012s	sys 0.000s
I20260709 13:18:47.778059 13791 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:47.782040 14338 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:18:47.785962 14339 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:18:47.726804 14260 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:47.734709 14296 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:47.788172  8183 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:18:47.786064 14335 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:47.776257  8256 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:18:47.795207  8255 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:18:47.786643 14036 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.725693 14172 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:47.721421 14255 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.799731  8256 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:47.840366 14255 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:47.841609 14262 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.842348 14262 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.844918 14262 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:47.786964 14271 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.670338 13951 consensus_queue.cc:237] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.845932 14271 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:47.801148 14350 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:47.849711 14206 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:47.850274 14206 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:47.829267  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.851249 14206 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:47.851871  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3258) took 1368 ms. Trace:
I20260709 13:18:47.801472 14279 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:47.852303  8248 rpcz_store.cc:276] 0709 13:18:46.483420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.497644 (+ 14224us) service_pool.cc:224] Handling call
0709 13:18:46.505863 (+  8219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.707626 (+201763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.707676 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:46.707722 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:46.707757 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.851625 (+1143868us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54002aeed4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:47.851675 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.851800 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463372544}
I20260709 13:18:47.801714 14326 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:47.802098 14348 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:47.669896 14256 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.853969 13985 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:18:47.819295  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.854619  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:47.823201  8251 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:18:47.834657 14331 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:47.839313 14319 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:47.853793  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:47.728350 14328 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:47.888176  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51044 (request call id 60) took 1940 ms. Trace:
I20260709 13:18:47.890518  8182 rpcz_store.cc:276] 0709 13:18:45.915041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.915199 (+   158us) service_pool.cc:224] Handling call
0709 13:18:47.854439 (+1939240us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4c002b0f40. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f118a20 00007fa59f129a29 00007fa59f0ef644 00007fa59f116f2d 00007fa59f116b93 00007fa5a0e46c92 00007fa5a0e4684a 00007fa5a5e1460a 00007fa59f39a7d4 00007fa59f39a762 00007fa59f39a691
0709 13:18:47.855477 (+  1038us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b540031e2d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e46853 00007fa5a5e1460a 00007fa59f39a7d4 00007fa59f39a762 00007fa59f39a691 00007fa59f39a60c 00007fa59f3998c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:47.855564 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1331593216}
I20260709 13:18:47.720068 14333 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:47.793555 14240 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:47.798099 14259 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.852327 14206 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:47.911747 13495 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:47.917523 13495 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:47.902853 14240 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:47.944065  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 358835us
I20260709 13:18:47.945310  8149 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:47.932835  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:47.799324 14036 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.962215  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:47.961016 13495 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:47.893864 14257 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:18:47.969852 14321 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:47.970912  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:47.971629  8174 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:47.913800 14259 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:47.960333 14240 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:47.974491  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:47.975212  8174 raft_consensus.cc:606] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:47.975582  8174 raft_consensus.cc:614] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:47.978844 14250 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:47.979005 14226 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:47.979400 14250 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:47.969072 14328 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:47.981151  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:47.982228  8174 raft_consensus.cc:606] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:47.982846  8174 raft_consensus.cc:614] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:47.980428 14250 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:47.990562 14321 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:47.990973 13711 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:47.994807 14296 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:47.997923  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:47.933251 14232 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.740s	user 0.012s	sys 0.000s
I20260709 13:18:47.998696  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:47.999306  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:48.004969  8179 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:48.001677  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 271801us
I20260709 13:18:48.008628  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.014226  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.017561  8176 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:48.024571  8257 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:48.012699  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:48.000277 14328 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:48.032094  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.032793  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:48.034250  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 307565us
I20260709 13:18:48.036860  8221 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:48.051738  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:48.053361 14319 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:48.054500 14036 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:48.054616  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:48.055565 14036 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:48.055707 14094 raft_consensus.cc:993] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:18:48.056835 14226 raft_consensus.cc:1081] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Signalling peer 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:18:48.013494 14232 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:48.059696  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.060746 14232 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:48.061246  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:48.061611  8100 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 19: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:48.062842  8176 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:48.064154 14296 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:48.065342 14296 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:48.065780 14296 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:48.066804 14296 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:48.072477  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:48.075265 14291 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.075536  8223 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:48.076304 13711 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:48.078351 14296 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:48.078771 14259 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:48.080782  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3269) took 1396 ms. Trace:
I20260709 13:18:48.082226  8179 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:18:48.082919 13495 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:48.145772  8254 rpcz_store.cc:276] 0709 13:18:46.684591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.970321 (+285730us) service_pool.cc:224] Handling call
0709 13:18:46.970663 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.771788 (+801125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.080490 (+308702us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b540030cfd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:48.080713 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817079168}
I20260709 13:18:48.146564 13495 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:48.147096 13495 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:48.083333  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 46548.6us
I20260709 13:18:48.148017  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:48.086242 14199 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:48.087793 14250 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:48.035241 14328 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:48.092468  8791 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:48.052176 14262 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:48.050856 14100 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:48.103957 14333 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:48.107328 14172 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:48.110554  8178 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:48.111425  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.142993 14271 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:48.061359  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:18:48.190637  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 129359us
I20260709 13:18:48.115097 14344 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:48.115329 14118 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:48.116163  8788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1708) took 1383 ms. Trace:
I20260709 13:18:48.124166 14240 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:48.126080  8250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 3257) took 1645 ms (client timeout 1768 ms). Trace:
W20260709 13:18:48.130645  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.146232  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3177) took 1549 ms. Trace:
I20260709 13:18:48.191874  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:48.150801  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:48.114048 14184 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:18:48.153555  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 85881.8us
W20260709 13:18:48.111855  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.145449 13810 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:48.207928  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:48.208899  8789 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 19: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:48.200515  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:48.193847  8788 rpcz_store.cc:276] 0709 13:18:46.732769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.732925 (+   156us) service_pool.cc:224] Handling call
0709 13:18:46.733220 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.278564 (+545344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.115900 (+837336us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54007201d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:48.116101 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1245607808}
W20260709 13:18:48.194811  8250 rpcz_store.cc:269] 0709 13:18:46.481160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.481375 (+   215us) service_pool.cc:224] Handling call
0709 13:18:48.125899 (+1644524us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400412dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:48.126018 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2561758976}
I20260709 13:18:48.195957  8105 rpcz_store.cc:276] 0709 13:18:46.596355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.598081 (+  1726us) service_pool.cc:224] Handling call
0709 13:18:46.598413 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.755021 (+156608us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:47.131625 (+376604us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.703752 (+572127us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.733075 (+ 29323us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.733240 (+   165us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:47.733602 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.145942 (+412340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.146012 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.146053 (+    41us) raft_consensus.cc:1685] finished
0709 13:18:48.146065 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.146180 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":439626,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":1120,"raft.queue_time_us":240752,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":21764,"thread_start_us":1467783,"threads_started":5,"wal-append.queue_time_us":504282}
I20260709 13:18:48.203497  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:48.206342 13495 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:48.149950 14199 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:48.179961 14253 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:18:48.221130  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.220988  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:48.222100  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:48.223256  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:48.223459  8783 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:48.222802  8784 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
W20260709 13:18:48.209462 14358 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:48.200204 14255 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:48.197870 14344 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:48.288643  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:48.288022  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.255388  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.301270  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:48.258139 13495 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:48.260610  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 60177.2us
I20260709 13:18:48.308395  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:48.254943  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:48.310349  8108 raft_consensus.cc:2410] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 18 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:18:48.320952  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.320835  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.322285  8179 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:48.322283  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.186177 14262 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:48.226521 14210 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:48.324436  8073 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.000s	sys 0.023s
I20260709 13:18:48.325148  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:48.217589 14355 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:48.326723  8181 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 21: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:48.289839 14259 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:48.331825  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.361274  8101 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:48.247582 13711 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:48.332206  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.302232 14100 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:48.386840  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:48.365552  8073 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.000s	sys 0.025s
I20260709 13:18:48.390295  8107 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:48.367238  8105 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:48.226048 14118 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:48.338858  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 358190us
I20260709 13:18:48.379642  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:48.381775  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2884) took 1058 ms. Trace:
I20260709 13:18:48.400252  8100 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.400826  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:48.314244 14253 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:48.356019 13985 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.011s	sys 0.017s
I20260709 13:18:48.332139  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:48.332391 14203 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:48.315696 14255 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:48.398957  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 248219us
I20260709 13:18:48.321285 14172 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:48.406443  8176 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:48.410900  8102 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:48.374462 14259 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.411026  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:48.415323  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:48.426869  8108 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:48.427271  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:48.427417  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 351984us
I20260709 13:18:48.429787  8101 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:48.387264 14100 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.434056  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:48.431383  8223 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:48.428172  8107 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 22: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:48.368656 14210 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:48.432986 14369 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:48.433290  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:48.429673 14259 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:48.410295 13985 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.011s	sys 0.018s
I20260709 13:18:48.437022  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:48.496294  8105 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:18:48.500423  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 63486us
I20260709 13:18:48.498103 14302 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:48.497749 14271 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:48.501914  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:48.504176  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:48.504853 14302 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:48.506554 14302 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:48.506950 14302 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:48.507324 14302 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:48.425953 13951 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:48.425740 14255 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:48.511315  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:48.545984 13495 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:48.468971 14358 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:48.547821  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:48.411273 14094 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:18:48.469687 14100 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:48.575049  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.596081  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 162849us
I20260709 13:18:48.565080  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:48.574380  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:48.587312  8105 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
W20260709 13:18:48.578917  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.412165 14118 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:48.606549  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:48.601116  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 53370.6us
I20260709 13:18:48.512367 14355 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:48.387888 14184 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:48.408211 13711 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:48.607184  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:48.608150  8176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:48.372105 14199 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.8, Last appended by leader: 8, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:48.603048  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 47308.5us
I20260709 13:18:48.600107  8101 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:48.613708  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:48.630962  8105 raft_consensus.cc:2410] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:18:48.512416 14256 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:48.543944 14364 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:48.638595 14364 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:48.622881  8176 raft_consensus.cc:606] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:48.434154 14172 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:48.618645  8107 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
W20260709 13:18:48.619771  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.660972  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:48.655397 12721 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:48.661649  8251 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:18:48.662654  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:48.608454 14327 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:48.623904  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:48.625960 14240 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:48.637565 14333 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:48.602281 14253 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:48.596462 13951 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:48.681350  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:48.681583  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 83907.8us
I20260709 13:18:48.666270  8105 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:48.619706 13495 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.684736 13495 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:48.559540 14203 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:18:48.637960 14354 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:48.676023  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:48.677502  8250 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:18:48.675725  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:48.681084  8248 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:48.749405  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.751024  8250 pending_rounds.cc:85] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 8
I20260709 13:18:48.499423 14344 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:48.756179  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:48.757282  8257 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:48.751397  8250 pending_rounds.cc:107] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:18:48.750432  8254 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:48.758013  8101 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:18:48.758873  8250 raft_consensus.cc:2889] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:48.761361  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:48.759869  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:48.767779  8256 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 16: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:18:48.768519  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.771596  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:48.772471  8248 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 19: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:48.706529 14333 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:48.773995  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.775013 14378 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:48.781219  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:48.731930 14240 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:48.775368 14379 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:18:48.775535  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:48.787149  8256 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:48.433882 14336 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.151s
I20260709 13:18:48.776988 13495 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:48.748283 14354 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:48.777702 14256 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:48.778115 14363 log.cc:927] Time spent T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:18:48.778971 13985 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:48.776117 13951 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:48.807616  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:48.808463  8248 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:48.787304  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:48.809247 14378 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:18:48.809943 14367 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:18:48.810382 14378 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:48.811878  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3275) took 1409 ms. Trace:
W20260709 13:18:48.811038  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.814044  8257 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 18. Current term is 20. Ops: [18.14-18.14]
I20260709 13:18:48.814327 13711 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:48.702705 14253 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:48.815956  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 56215us
I20260709 13:18:48.816696 14253 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:48.769954 14262 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:48.817636 14226 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:48.818178 14226 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:48.819113 14226 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:48.820238 14250 consensus_meta.cc:287] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.640s	user 0.004s	sys 0.006s
I20260709 13:18:48.820995  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:48.821955 13791 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:48.824966  8248 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:48.826915  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:48.828310  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:48.830051  8791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:48110
I20260709 13:18:48.830617  8791 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:48.830978  8791 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:48.832240  8105 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:48.812260  8255 rpcz_store.cc:276] 0709 13:18:47.402408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.799820 (+397412us) service_pool.cc:224] Handling call
0709 13:18:47.800204 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.911209 (+111005us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:47.953167 (+ 41958us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.254064 (+300897us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.304754 (+ 50690us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.304906 (+   152us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:48.304952 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.305017 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.811655 (+506638us) raft_consensus.cc:1685] finished
0709 13:18:48.811679 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.811818 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48179,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":163053,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":165,"thread_start_us":284703,"threads_started":1,"wal-append.queue_time_us":458813}
I20260709 13:18:48.835043  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:48.836362  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:48.837811  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:48.839167  8255 raft_consensus.cc:2410] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:18:48.857220  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:48.858180  8104 raft_consensus.cc:2410] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:18:48.863190  8255 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:18:48.865324  8255 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:48.868670  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:48.869467  8106 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 18: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:48.867220  8147 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:48.866673  8791 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:48.871984  8783 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
W20260709 13:18:48.838871  8149 connection.cc:256] RPC call timeout handler was delayed by -1.3468099589997564s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
I20260709 13:18:48.890683  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:48.897964  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.898473  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:48.901286  8174 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 22: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:48.908541  8791 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:48.882266 14369 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:18:48.921521  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 297686us
I20260709 13:18:48.824252 14256 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:48.922349  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:48.920528  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:48.923084  8257 raft_consensus.cc:2376] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17. Re-sending same reply.
W20260709 13:18:48.924391  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 258364us
W20260709 13:18:48.922447  8100 consensus_meta.cc:287] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.001s
I20260709 13:18:48.927194  8100 raft_consensus.cc:2410] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:18:48.919129  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 312746us
W20260709 13:18:48.925348  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.917737 14377 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:18:48.906669 14381 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.930474  8072 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:48.931957  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:48.932044  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:48.933597  8257 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
W20260709 13:18:48.939070  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.954064  8223 connection.cc:256] RPC call timeout handler was delayed by -1.5889898939999512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
I20260709 13:18:48.953984 14381 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:48.956069 14381 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:48.956233  8223 leader_election.cc:400] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17.
I20260709 13:18:48.956549  8223 leader_election.cc:403] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:48.956768  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.929569 14359 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.940538  8174 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:18:48.921669 14369 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:18:48.942162 14370 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:18:48.942840 14250 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.945384  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3279) took 1541 ms. Trace:
I20260709 13:18:48.977043  8249 rpcz_store.cc:276] 0709 13:18:47.404358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.813067 (+408709us) service_pool.cc:224] Handling call
0709 13:18:47.813364 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.207575 (+394211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.207609 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.219737 (+ 12128us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.434251 (+214514us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:48.434292 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.434356 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.945128 (+510772us) raft_consensus.cc:1685] finished
0709 13:18:48.945155 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.945321 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38290,"raft.queue_time_us":92114,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":391806,"threads_started":2,"wal-append.queue_time_us":619756}
I20260709 13:18:48.979096  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:48.979658  8249 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:48.980669  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:48.981256  8181 raft_consensus.cc:3055] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:48.981567  8181 raft_consensus.cc:740] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:48.945457 14172 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:48.982374  8100 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:18:48.982249  8181 consensus_queue.cc:260] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:48.983017 14344 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.983223  8181 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:48.948642 14385 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:48.986575 14256 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:48.962895 13495 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17.
I20260709 13:18:48.965284  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.972172  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:48.972342  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.989929  8183 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
W20260709 13:18:48.972779 14375 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:18:48.972975  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:48.973980 14271 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:48.935309 14253 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:48.949730 14382 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.240s	user 0.001s	sys 0.001s
I20260709 13:18:48.991158  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.991477  8181 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:49.103232  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:49.060302  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.969398 14369 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:48.962720 13711 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:48.924371 14333 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:49.048910  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:49.174396  8257 raft_consensus.cc:2410] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:18:49.022226 14354 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:49.037715 14364 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:49.023033 14291 consensus_meta.cc:287] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.878s	user 0.008s	sys 0.004s
I20260709 13:18:48.975970 14359 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:49.154780  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.022861  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:48.994844 14250 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:49.023738  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.191556  8177 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:49.025861  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.013726 14210 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:49.096573 14384 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.299s	user 0.001s	sys 0.001s
W20260709 13:18:49.048036  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.096904 14239 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:49.047995 14336 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.215291  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:49.051045 14257 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:49.172407  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.054786  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:48.969986 14381 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.187s
W20260709 13:18:49.178524  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 287208us
I20260709 13:18:49.152748 14135 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:49.184128 14118 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:49.210899 14296 consensus_meta.cc:287] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.061s	user 0.009s	sys 0.004s
W20260709 13:18:49.186009  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.047287 14100 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:49.245847  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:49.248771  8103 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:48.400179  8252 rpcz_store.cc:276] 0709 13:18:47.323826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.761808 (+437982us) service_pool.cc:224] Handling call
0709 13:18:47.780451 (+ 18643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.780676 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:47.781034 (+   358us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.144616 (+363582us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.364030 (+219414us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.378797 (+ 14767us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.378868 (+    71us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:48.378927 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.380177 (+  1250us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.381712 (+  1535us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11136,"prepare.queue_time_us":16773,"prepare.run_cpu_time_us":145,"prepare.run_wall_time_us":3676,"raft.queue_time_us":131022,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":22677,"thread_start_us":573860,"threads_started":2,"wal-append.queue_time_us":333903}
I20260709 13:18:49.156410 14172 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:49.201157  8253 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:18:49.166110 14271 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:49.037345 14255 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:49.213696  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.260417  8251 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:49.162578  8175 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:49.219383  8249 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:49.222517  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:49.223755  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:49.224025  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:49.266419  8255 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:49.267666  8785 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:49.180708 13711 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.225871  8178 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:49.272271  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.226720 14388 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:49.231295 14347 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.228839  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:49.233453  8257 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:49.231137  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:49.238586  8182 raft_consensus.cc:2410] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:49.230837 14135 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:49.245847  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:49.250735  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:49.254856  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.263837  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 311206us
I20260709 13:18:49.226893 14372 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.231743 14256 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.263818  8790 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:49.229138 13985 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.227035 14387 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.227077 14257 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:49.278056  8106 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:18:49.213765 14239 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.275107  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 2029) took 1052 ms. Trace:
I20260709 13:18:49.300298  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:49.301188  8181 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:49.303067  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 74312.8us
I20260709 13:18:49.305207 12721 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:49.305708 12721 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:49.306164 12721 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:49.227159 14336 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:49.249862 14294 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:49.284590  8253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 3265) took 2611 ms (client timeout 1611 ms). Trace:
I20260709 13:18:49.286165  8072 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:49.322305  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.334336  8253 rpcz_store.cc:269] 0709 13:18:46.667239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.714262 (+ 47023us) service_pool.cc:224] Handling call
0709 13:18:49.278118 (+2563856us) spinlock_profiling.cc:243] Waited 2.49 s on lock 0x7b5400267d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:49.278259 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5716913920}
W20260709 13:18:49.334863  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 48844.2us
I20260709 13:18:49.336539  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:49.262130 14100 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:49.298156  8252 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:49.300587  8103 rpcz_store.cc:276] 0709 13:18:48.222547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.222992 (+   445us) service_pool.cc:224] Handling call
0709 13:18:49.274839 (+1051847us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b540036f6d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:49.275046 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204833664}
I20260709 13:18:49.224952  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:49.309674  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 377770us
I20260709 13:18:49.283159  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:49.337805  8177 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:49.341663  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:49.321902  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:49.345595 14399 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.350726 14399 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:49.353092 14399 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:49.360293  8180 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 19: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:49.360566  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:18:49.396862  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 437195us
W20260709 13:18:49.411741  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 65833.5us
I20260709 13:18:49.309046 14239 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:49.427389  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 66891.1us
I20260709 13:18:49.412612  8072 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:49.430975  8074 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:49.401902  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55185.1us
I20260709 13:18:49.433790  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.286978 14184 consensus_queue.cc:1059] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.119s
I20260709 13:18:49.441602  8181 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:18:49.441958  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.443189  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.360780 14381 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:49.435236  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.288122 14372 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:49.296500 13985 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.350028 14207 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:49.360595 14328 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:49.293121 14256 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.287554 14347 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:49.447777 14302 consensus_meta.cc:287] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.940s	user 0.012s	sys 0.002s
I20260709 13:18:49.459949  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.473455  8107 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 19: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:49.473212 12721 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.460119  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.434830 14354 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:49.461880  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:18:49.444936 14259 consensus_meta.cc:287] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.900s	user 0.011s	sys 0.002s
I20260709 13:18:49.466264  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.346144 14344 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 13:18:49.443274 14172 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:49.345970 14210 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:49.417307 14253 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:49.454630  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.360610 14294 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:49.479143  8178 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:49.484229  8790 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:49.450824 14296 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:49.532205 14296 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:49.535065 14296 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:49.481174 14207 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:49.537328 14336 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:49.491061 13791 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:18:49.538988 14255 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:49.445847 14321 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:18:49.542333 14372 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:49.460855 14364 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:18:49.461177 14399 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:49.547717  8103 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:49.457937 14118 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:49.490650  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:49.300338 14387 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.472641 14374 raft_consensus.cc:3055] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:49.559510 14374 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:49.559327 14118 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.488368 14172 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.497824 14400 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:49.501361 14403 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:18:49.503892 14347 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:49.348440 14257 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.506453 14256 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:49.507579 14250 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:49.514405 13711 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:49.453009 14393 consensus_queue.cc:1059] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:18:49.520646 14135 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.460707 14291 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
W20260709 13:18:49.527805  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.530222 13985 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:49.530820 14199 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:49.535595 14359 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:49.492278  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:49.552511  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 61914.8us
I20260709 13:18:49.566407 14364 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.554117  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:49.606032  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:49.558297  8783 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:18:49.559052 14387 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:49.562989  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 338296us
I20260709 13:18:49.287513 14388 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.571631  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:49.488812 14354 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:49.517026 14271 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.576367  8002 catalog_manager.cc:5697] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 10 to 13, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 13 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:49.566221 14210 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:49.560614 14374 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.491652 12721 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:49.575093 14172 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:49.537019 14207 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.488624 14259 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.575003 14400 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.577216 14296 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.484186 14302 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:49.612399  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:49.612924 13495 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:49.618885  8147 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:49.576869 14378 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:18:49.610947 14294 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:49.639158  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 167598us
I20260709 13:18:49.622951 14240 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.624853 14403 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:49.605638 14336 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:18:49.623520 14118 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:49.645383  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:49.649420  8254 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:49.612138 14392 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:18:49.650211  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:49.645781  8250 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:49.632438 14400 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:49.658944  8755 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:49.651537  8223 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:49.651772 14387 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:49.613639 14364 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.665385  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:49.655052 14240 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:49.667011 14398 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:18:49.649010 14403 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:49.668391 14403 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:49.668641 14240 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:49.669751  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.670037 14415 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:49.670632  8183 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:49.671211 14415 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:49.671603 14415 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:49.672502 14415 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.660192 13951 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:49.674053 14415 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:49.675413  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:49.676684 14406 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:49.658342 13985 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:49.677894 13985 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:49.678544 13985 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:49.681692 14118 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:49.662338 14256 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:49.682299 14118 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.682920 14118 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:49.686275  8108 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:49.643802 14294 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:49.677932 14406 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:49.649009 14374 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:49.691042  8105 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:49.692956  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:49.694391  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:49.676585 14354 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.695459  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:49.699002  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.699532  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.699746  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.640074 14296 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.718886  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:49.719527  8256 raft_consensus.cc:2376] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17. Re-sending same reply.
I20260709 13:18:49.689179 14255 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:49.691486 14387 raft_consensus.cc:697] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:49.713402  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:49.736370  8252 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:49.689937  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:49.716423  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:49.712342  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:49.738755  8257 raft_consensus.cc:2410] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:18:49.691324 14386 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:49.697832 14406 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:49.715724  8107 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
W20260709 13:18:49.741184  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 51318.2us
I20260709 13:18:49.742007  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:49.742707  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:49.745028 13495 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:49.747666  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.749852  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.754328  8107 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:49.755697 14368 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:49.756521 14365 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:18:49.756963  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.757761  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.759505  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.760214  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.760597  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.698473 14294 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.733681 14255 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:49.760882  8101 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:18:49.761358  8107 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:49.761562  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.761621 14414 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:49.774734  8099 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:49.765466  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.768348  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:49.775341  8180 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:49.769766  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.771210  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.743556 14406 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:49.771916  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.777212  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.744083 14381 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:49.779349  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:49.780196  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.780851  8174 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 22: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:49.784310  8104 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:49.784915  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.779186 14414 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:49.789680  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:49.792049  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:49.797096  8253 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:49.796424  8177 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 21: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:49.797022  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:49.799549  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:49.800520  8100 raft_consensus.cc:2410] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:49.804244  8223 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:49.807425  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 64800.9us
I20260709 13:18:49.762493 14262 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:49.809077  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:49.809813  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:49.811153  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:49.774709 14255 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:49.812296  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:49.822031  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:49.802435 14414 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:49.867102 14291 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:49.867550 14291 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:49.867904 14291 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:49.830796  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.830538  8100 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:49.841696 14302 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:49.842115 14369 consensus_meta.cc:287] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.652s	user 0.013s	sys 0.000s
I20260709 13:18:49.829188 14387 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.849969  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:49.850761 14294 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:49.852828 14239 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:49.820016 14262 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:49.856612 14403 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:49.857656  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.858556  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.858851 14172 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.862118 14406 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:49.862799 14250 raft_consensus.cc:3055] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:49.853713 14118 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.864775  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2909) took 1204 ms. Trace:
I20260709 13:18:49.831087 14381 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:18:49.871182  8257 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:18:49.819486 14388 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:49.878934  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 74769.2us
I20260709 13:18:49.911825  8103 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:18:49.913668  8178 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:18:49.875653  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:49.917080  8108 raft_consensus.cc:2410] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:18:49.892455 13495 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:49.895756  8254 rpcz_store.cc:276] 0709 13:18:48.660611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.758663 (+ 98052us) service_pool.cc:224] Handling call
0709 13:18:48.772951 (+ 14288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.657544 (+884593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.864527 (+206983us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b5400091ad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:49.864709 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2015160576}
I20260709 13:18:49.910943  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:49.914912  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:49.921471  8074 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:49.922828  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:49.923702  8257 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:18:49.930796  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:49.895258 14359 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:49.933015  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 57468.2us
I20260709 13:18:49.940909  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:49.887706 14250 raft_consensus.cc:740] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:49.934607  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:49.936902  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.829195 14423 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.091s
I20260709 13:18:49.938437  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:49.966699  8180 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:18:49.941633  8257 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:49.909709 14256 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:49.939630  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:49.926940 14294 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:49.955039  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:49.875365 14369 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.935460 14374 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.944227  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:49.888073 13985 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:49.970739  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:49.975185 13495 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:49.987053 13495 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:49.975096  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 44404.3us
I20260709 13:18:49.935355 14240 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:49.932539 14328 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:49.921593 14302 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
W20260709 13:18:50.012189  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 68042.1us
I20260709 13:18:49.945339 14407 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:49.966187 14365 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:50.073946  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:50.074813  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:49.969586 14226 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:50.085577 14406 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:50.087144 13985 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:50.076821  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:50.077724  8785 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:50.080420  8791 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:49.972563 14333 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:49.978542 14294 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:50.097077  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 142195us
I20260709 13:18:50.097980  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:50.076455  8253 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:49.947965 14359 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.102425  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:50.120733  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:50.122579  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 48732.8us
I20260709 13:18:50.123764  8791 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:50.121598  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:50.124946  8221 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:50.125330  8183 raft_consensus.cc:2410] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:49.990206 14354 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:50.088737 14364 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.126574  8221 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:50.100067  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:50.123046  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:50.122291  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:50.130105  8180 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:18:50.130420  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 159774us
I20260709 13:18:50.082036 14368 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:50.131270  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:50.078527 14407 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:49.981062 14210 consensus_queue.cc:1059] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.120s
I20260709 13:18:50.082809 14381 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.138036  8221 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:50.141305  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:50.107620 14294 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:49.994226 14374 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.122237 14406 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:50.107252 14365 raft_consensus.cc:697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 14 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:50.151600  8107 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:50.151710  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:50.153564 14381 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.159670  8182 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:50.160765 14172 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.162120 14333 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:50.163633  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:50.164134 14354 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:50.203609 14399 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:50.204210 14399 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.204563 14354 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.205693 14406 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.206199 14406 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.206804  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:50.164338 14336 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:50.167109 14369 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.168092 14400 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.127579 13791 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:18:50.169188  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:50.143486 14407 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:50.231173  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:50.129194 14344 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:50.119900 13985 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:18:50.172254  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:50.251256  8253 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:50.173213  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:50.254467  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.256024  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.256752  8183 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:18:50.165714  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:50.175760 14415 raft_consensus.cc:993] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:18:50.177415  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:50.258929 14415 raft_consensus.cc:1081] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Signalling peer 9480609eccc44250a4d7fcc9686e76cf to start an election
I20260709 13:18:50.259081  8252 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:18:50.178386 14403 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:50.179786 14118 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.180620  8221 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:50.085248 14226 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.261261 14239 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:50.262491 14226 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.203517 14381 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:50.209569  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:50.214085  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:50.264125  8251 raft_consensus.cc:2368] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
W20260709 13:18:50.264281  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55533.7us
I20260709 13:18:50.078696 14262 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.180474 14430 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.269831 14430 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.271063 14374 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:50.271883 14374 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:50.272547 14430 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:50.169663 14210 consensus_queue.cc:1243] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:50.204599 14399 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:50.243059 14406 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.231470 14364 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:18:50.238090 14414 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.244540 14255 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:50.280402  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 99868.4us
I20260709 13:18:50.288729  8221 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:50.220402 14393 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:50.226261 14302 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:50.283254  8099 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:18:50.233094 14199 consensus_meta.cc:287] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.000s
I20260709 13:18:50.284585  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:50.284955  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 234495us
I20260709 13:18:50.296897  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:50.278167 14386 consensus_meta.cc:287] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:18:50.283119 14118 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:50.282227 14437 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:50.288775 14378 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:50.290896 14253 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:50.310771  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:50.315333  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.297019 14393 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:50.296314 14302 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:50.302668 14386 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:50.341149 14442 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.325944  8183 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:50.341780 14442 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.342626  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.344110  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.344293 14442 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.336197 14291 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.346079  8253 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:50.348112 13711 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:50.348533 13711 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:50.349769 14291 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.339083 14255 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:50.340552 14359 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.319878 14253 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:50.352228 14253 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.353673 14253 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:50.358462 14118 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:50.359181 14118 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:50.359510 14118 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:50.359841 14118 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:50.340447 14336 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:50.363663  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.369547  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:50.362017  8105 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:18:50.368837  8784 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:50.374109  8791 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:50.305928 14436 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:50.378295  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.378750  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:50.376813  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:50.381654  8099 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:50.384011  8176 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:18:50.317886 14439 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:50.367846 14393 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:50.399920  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:50.368613 14359 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:50.406980  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:50.407804  8791 raft_consensus.cc:2393] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:50.394446 14407 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.408933  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:50.409524  8183 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:50.411957  8783 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:50.416273  8790 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:50.416558  8183 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:50.418083  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:50.418789  8183 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:50.419682  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:50.420339 14271 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:50.421645  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.421871  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:50.422253 14414 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:50.422470  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.423262  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.424572  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.426262  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.427587  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.428997 14445 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.302378 14365 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.429093  8179 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:18:50.438946  8179 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:50.445613  8790 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:50.449477  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:50.425200  8175 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:50.393673 14442 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:50.398391 14439 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.405094 14240 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:50.432637 14203 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:18:50.469177  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 180535us
I20260709 13:18:50.480333  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:50.435025  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 138228us
I20260709 13:18:50.425216  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:50.431313 14259 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.482015  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:50.482306  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:50.349347 13711 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.483031  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:50.436398  8147 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:50.488354  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 52035.2us
I20260709 13:18:50.485299  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:50.459746 14255 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:50.490859  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:50.452301 14359 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.487151  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:50.489239  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:50.490583  8785 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:50.493101 13711 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:50.509866 14438 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:18:50.510552 14440 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:50.511250 14443 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:50.467307 14442 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.512149 14255 raft_consensus.cc:697] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:50.513316 14255 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.515017 14442 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.516383 14259 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:50.517118 14448 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:50.523000  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:50.525244 14442 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:50.524570  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:50.429879 14294 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.494455 14239 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:18:50.501688 14418 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:18:50.467106 14439 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:50.477277 14203 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:50.493794 14207 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:50.507330 14359 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:50.434207 14302 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.487712 14403 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:50.553946 14403 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.554350 14403 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:50.554962  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 2038) took 1632 ms. Trace:
I20260709 13:18:50.555331  8176 rpcz_store.cc:276] 0709 13:18:48.922245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.922387 (+   142us) service_pool.cc:224] Handling call
0709 13:18:50.554754 (+1632367us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54000122d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:50.554885 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3113288960}
I20260709 13:18:50.494870  8100 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:50.429569 14445 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.559470 14445 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:50.529879 14400 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.521283 14393 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.562589 14393 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:50.538055  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 49490.3us
I20260709 13:18:50.564173 14336 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:50.564754 14336 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.566157  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:50.567134 14359 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:50.568037 14400 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.568439 14359 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:50.568518 14400 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:50.570940 14421 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.488s	user 0.002s	sys 0.000s
I20260709 13:18:50.571158 14400 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.572494 14368 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:50.542953 14262 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:50.575246  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3284) took 1746 ms. Trace:
I20260709 13:18:50.575686  8250 rpcz_store.cc:276] 0709 13:18:48.828724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.850289 (+ 21565us) service_pool.cc:224] Handling call
0709 13:18:48.885214 (+ 34925us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.657370 (+772156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.575027 (+917657us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b5400196c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:50.575190 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1748569472}
I20260709 13:18:50.578166  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 2044) took 1136 ms. Trace:
I20260709 13:18:50.578581  8102 rpcz_store.cc:276] 0709 13:18:49.441618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.441736 (+   118us) service_pool.cc:224] Handling call
0709 13:18:50.577552 (+1135816us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54001b9754. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:50.578103 (+   551us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258377600}
I20260709 13:18:50.590178  8099 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:50.575693  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:50.601083 14253 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:50.602267 14135 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:50.568460 14259 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:50.550000 14442 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:50.532446  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 45369.7us
I20260709 13:18:50.544512  8223 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:50.618474  8254 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 21: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:50.550541 14207 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:50.549324 14257 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:50.619139  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 519146us
W20260709 13:18:50.619333  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 74913.2us
I20260709 13:18:50.620437  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:18:50.623705  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.623879  8790 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:50.626012  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.627537  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:50.630508 13495 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:50.631002 13495 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.633468  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:50.634263  8790 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:18:50.634326  8072 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:50.635325  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:50.635767  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:50.636008  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:50.620657  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:50.636565  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:50.636641  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:50.636605  8253 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:18:50.639464  8176 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:50.640048  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:50.636647  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:50.639873  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:50.642601  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:50.643148  8791 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:50.645483 12721 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:50.646251 13495 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.662601  8755 leader_election.cc:400] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:18:50.684077  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:50.686434  8252 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:50.648401  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:50.651806  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:50.664324  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:50.652567  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:50.738515 14450 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.739101 14450 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.744333  8252 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:18:50.746366  8178 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:50.747517  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:50.748216  8106 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:50.629134 14239 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.753326 14184 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:50.747648  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:50.753719 14239 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.753861 14184 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.754719  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.755870 14239 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:50.755923 14184 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:50.685638 14256 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:50.756829 14256 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.686561  8755 leader_election.cc:403] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:50.689236  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:50.758658  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 117634us
I20260709 13:18:50.652149  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:50.686852 12721 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:18:50.690136  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.687309  8099 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:50.626758 14259 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:50.736171  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:50.703523  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 58633us
I20260709 13:18:50.737059  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:50.738020 14207 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.746519 14294 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:50.688637  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:50.770959  8250 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:50.772096  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:50.772629  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:50.772758  8791 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:50.760488  8253 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:50.762616  8175 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:50.774013  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:50.764990  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.775516  8183 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:50.638152 14400 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.773250  8790 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
I20260709 13:18:50.687250  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:50.776621 13495 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:50.777041  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 89872.4us
W20260709 13:18:50.776839  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 112575us
I20260709 13:18:50.778955  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:50.757174 14256 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:50.781071  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:50.646014 14445 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:50.637548 14449 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:50.646246 14443 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:50.786459  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:50.788220  8252 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:50.784200  8789 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:50.790021  8249 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:50.685979 14172 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:50.791105  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.796171  8176 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:50.633507 14368 consensus_queue.cc:1059] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.148s
I20260709 13:18:50.797720  8252 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:50.798805  8252 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:50.801476  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:50.801757  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:50.802086  8107 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:50.802989  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:50.803187  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:50.803438  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:50.803791  8107 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:50.803993  8106 raft_consensus.cc:2376] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21. Re-sending same reply.
I20260709 13:18:50.804880  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:50.805470  8102 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:50.806442  8248 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:50.741330 14450 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.826910  8250 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:18:50.646541 14210 consensus_queue.cc:1059] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.145s
I20260709 13:18:50.829828  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:50.778982 14262 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:18:50.686349 14199 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:18:50.831013  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:50.831769  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:50.832296 12721 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:50.844429 12721 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.832253  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:50.839926 13495 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.847324 13495 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.849172 14347 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.792850 14344 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:50.792001 14445 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.690142 14374 consensus_queue.cc:1059] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.119s
I20260709 13:18:50.859681  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:50.868790  8249 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
W20260709 13:18:50.861150  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.861804  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:50.862416 13495 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:50.862937  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:50.863561  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:50.863899 14336 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.784109 14239 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:18:50.864984  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:50.787391 14118 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.866437  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:50.784386 14381 consensus_queue.cc:1059] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:18:50.783033 14400 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.897207  8223 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:50.898048  8107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5"
dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:18:50.898772  8107 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:50.898849  8102 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:18:50.863958  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:50.899169  8107 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:50.899267  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:50.883427  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:50.899791  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:50.883106 14399 consensus_meta.cc:287] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.597s	user 0.003s	sys 0.007s
I20260709 13:18:50.900681  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:50.886638  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:50.901820  8250 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:50.865705  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:50.877935 12721 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.889515  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:50.902756  8782 raft_consensus.cc:2410] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 21 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:18:50.903007  8101 raft_consensus.cc:2368] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21.
I20260709 13:18:50.872795 14445 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:50.882750 14135 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:50.874152 14344 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:50.831025 14403 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.899116  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:50.878999  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:50.910574  8251 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:50.910907 13495 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:50.911329  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:50.911569  8249 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:50.913810  8223 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:50.915153  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:50.916046 14449 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:50.916541 14449 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:50.916651  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:50.917034 14449 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:50.918026 14450 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:50.918503 14450 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.918987 14450 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:50.921799 13495 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:50.922638 13495 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:50.923029 13495 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:50.923442 13495 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:50.925084  8099 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 19: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:50.926317  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:50.872428 14347 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.932582  8107 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.900458  8105 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:50.908960  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3217) took 1227 ms. Trace:
I20260709 13:18:50.937419  8103 rpcz_store.cc:276] 0709 13:18:49.681800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.684296 (+  2496us) service_pool.cc:224] Handling call
0709 13:18:49.684655 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:49.912375 (+227720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.908718 (+996343us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540030ded4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:50.908907 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521680768}
W20260709 13:18:50.938705  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.934485  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:50.906932  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:50.906635 14364 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:50.944929 12721 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:50.890532 14100 consensus_queue.cc:1059] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:18:50.906666 14199 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:50.912915 14344 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:50.965653 14440 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.966337 14440 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:50.967059 14347 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:50.947222  8249 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:50.955626 13495 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.961306 14381 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:50.935520 14135 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:50.963747  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2920) took 1086 ms. Trace:
I20260709 13:18:50.906788  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:50.965745 14199 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.969885  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.977135  8254 rpcz_store.cc:276] 0709 13:18:49.881878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.918625 (+ 36747us) service_pool.cc:224] Handling call
0709 13:18:50.963567 (+1044942us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b5400267d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:50.963686 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1492367104}
I20260709 13:18:50.973908  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:50.979369  8103 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:50.975126  8787 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:18:50.980258  8787 pending_rounds.cc:85] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 12
I20260709 13:18:50.980564  8787 pending_rounds.cc:107] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:18:50.980902  8787 raft_consensus.cc:2889] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:50.971657  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:50.970989  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:50.982538  8179 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:50.964003 14442 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:50.977722  8174 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:50.988026  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.989364  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.970768  8250 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:50.991472  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:50.975939 13495 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:50.993402  8179 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:50.941545 14294 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:50.907234 14399 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:50.994556  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:50.996965  8176 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:50.997753  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:50.945181 14435 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:50.976207 14452 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:18:51.002740  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:50.976081 14425 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:51.004518  8179 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:50.976131 14381 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.012252  8149 leader_election.cc:400] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21.
I20260709 13:18:51.012247  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:51.013739  8255 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:50.986704 14199 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:51.014153  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:51.017496  8149 leader_election.cc:403] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:18:50.993151 14412 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:51.017586  8254 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:50.997339 14374 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:51.022302  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 170861us
I20260709 13:18:51.021114  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:51.029492  8176 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 12.
I20260709 13:18:51.030886  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:51.034538  8174 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:51.018558  8223 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:51.006295 14294 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:51.038182  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:51.019655 13495 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:51.067337 13495 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.067881 13495 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:51.018350 14454 raft_consensus.cc:3055] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:51.040977  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:51.069451  8249 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:18:51.044863  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 180982us
I20260709 13:18:51.019106 14381 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:51.046875 14392 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:51.047117  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:51.083833  8177 raft_consensus.cc:2376] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21. Re-sending same reply.
I20260709 13:18:51.053443 14378 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:51.020453 14442 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:51.003222 14347 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:18:51.001036 14446 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:18:51.035140 14374 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.060957  8179 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:18:51.030279 14425 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:51.004046 14439 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.086069  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:51.088557  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:51.043253  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:51.000141 14336 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:18:51.081664 14423 raft_consensus.cc:3055] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:51.096665  8249 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:51.115581  8782 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14. Ops: []
W20260709 13:18:51.099653  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 56507.5us
I20260709 13:18:51.087952 14400 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:51.117090  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:51.117863 13495 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.089015 14442 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.087522 14454 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:51.175297  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 163231us
I20260709 13:18:51.176851  8256 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:51.180437 14442 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:51.084688 14135 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.097657 14378 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 18 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:51.116328 14172 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:51.095069 14462 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21.
I20260709 13:18:51.199542  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:51.204167 14259 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:51.206089 14464 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:18:51.354322 14257 consensus_queue.cc:1059] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:51.355669 14257 raft_consensus.cc:3055] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:51.356137 14257 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:51.358698 14407 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:51.360404 14240 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:51.360800 14240 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:51.361586 14240 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.313333 14458 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:51.210132 14393 raft_consensus.cc:3055] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:51.213526 13711 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:51.214438  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:51.379415  8105 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
W20260709 13:18:51.220800  8182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 2055) took 1457 ms (client timeout 1531 ms). Trace:
W20260709 13:18:51.380282  8182 rpcz_store.cc:269] 0709 13:18:49.763107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.763253 (+   146us) service_pool.cc:224] Handling call
0709 13:18:51.220554 (+1457301us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54002f9254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:51.220718 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883757952}
I20260709 13:18:51.224351  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:51.226739 14459 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:18:51.228734 14439 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:51.383184 14374 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:51.382978 14449 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.232733  8099 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 18. Ops: []
I20260709 13:18:51.233719 14425 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.8, Last appended by leader: 8, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.242470 14344 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.246970  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:51.251075  8178 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:51.385142  8177 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:51.310616  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:18:51.311005  8223 leader_election.cc:336] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Timed out: RequestConsensusVote RPC to 127.6.214.130:46389 timed out after 1.531s (SENT)
I20260709 13:18:51.392108  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1174) took 1317 ms. Trace:
W20260709 13:18:51.311290  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 194258us
W20260709 13:18:51.201566 14433 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:18:51.114552 14423 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:51.315129  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:51.315303  8147 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:51.138216 14354 raft_consensus.cc:3055] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:18:51.325531  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.345707 14172 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.125555 14466 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.220s
I20260709 13:18:51.337211 14378 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.349304  8103 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:51.353155 14296 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:51.352862 14259 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.205806 14250 consensus_queue.cc:260] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.375067 14393 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:51.284262 13495 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:51.406251  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 95288.3us
I20260709 13:18:51.406080  8784 rpcz_store.cc:276] 0709 13:18:50.074560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.075353 (+   793us) service_pool.cc:224] Handling call
0709 13:18:50.093820 (+ 18467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.375881 (+282061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.391872 (+1015991us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54004ac254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:51.392039 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617420672}
I20260709 13:18:51.344890 14210 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.386147 14344 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:51.199195 14118 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:51.385130 14449 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:51.367206 14399 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:51.412595  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:51.442067  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 126848us
W20260709 13:18:51.442097  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 127042us
I20260709 13:18:51.350026  8755 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:51.477351  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:51.391466 14440 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:51.179626 14454 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.125902 14294 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.390316 14458 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:51.441185 14172 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:51.357234 14257 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.439074 14354 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:18:51.530890  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 118414us
I20260709 13:18:51.590255  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:51.590456  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 92811.1us
I20260709 13:18:51.475329 14336 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:51.591900  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:51.389688 14450 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:51.533349  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 183398us
I20260709 13:18:51.588632 14250 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:51.595556  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:51.480700 14387 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.546628 14371 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:51.599511  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:51.390151 13711 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.597508  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:51.601225  8221 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:51.601513  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:51.586539 14392 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:51.604622  8072 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:51.547254 14239 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:51.549036 14440 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:51.633322  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:18:51.621483  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 90330.8us
I20260709 13:18:51.620409  8102 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:18:51.621820  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:51.629087  8174 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:51.629731  8105 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:51.630518  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:51.631072  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:51.631459  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:51.632020 13495 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:51.492964 14210 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.634321  8072 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:51.586899 14118 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.647293  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:51.647958  8182 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:18:51.648389  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:51.635548  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:51.634658  8248 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:51.635982  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:51.650678  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:51.669303  8790 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:51.652192  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:51.550765 14458 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:51.646986  8103 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:51.651767 14439 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:51.680054 14439 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:51.680467 14439 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.680806 14439 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:51.682531 14259 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:51.651839 14449 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.683377 14449 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.686890  8789 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:51.687793 14210 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:51.689553 13711 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:51.634558 14371 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.690636 14371 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:51.600023 14344 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 13:18:51.652535 14418 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:18:51.694778 14450 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:51.695358 14207 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:51.695446  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:51.696363  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 60872us
I20260709 13:18:51.697613  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:51.698127 14446 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:51.698544 14446 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:51.698913 14446 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:51.624200 14387 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.702287 14387 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:51.635329 14435 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:51.702930 14435 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:51.703277 14435 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:51.703394  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:51.705060  8257 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:51.705771 14422 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:51.706208 14333 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:51.706939 14333 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:51.707830 14364 consensus_meta.cc:287] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.759s	user 0.006s	sys 0.004s
I20260709 13:18:51.708259 14364 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:51.655593 14461 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:51.709684  8253 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:51.709802 14461 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:51.651908 14392 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.710901 14461 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.651595 14253 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:18:51.659668 14476 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:18:51.590009 14423 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.622000 14296 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:18:51.663273 14199 consensus_meta.cc:287] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.000s
I20260709 13:18:51.663442  8104 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
W20260709 13:18:51.679333 14256 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.883s	user 0.007s	sys 0.005s
I20260709 13:18:51.617790 14425 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:51.709918 14418 raft_consensus.cc:3055] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:51.657804  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:51.620016 14399 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:51.716693  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:51.718988  8257 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:51.711948 14392 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:51.748931  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:51.758872  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:51.759282  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2926) took 1126 ms. Trace:
I20260709 13:18:51.756603 14422 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:51.759717  8255 rpcz_store.cc:276] 0709 13:18:50.633342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.633469 (+   127us) service_pool.cc:224] Handling call
0709 13:18:50.736823 (+103354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.017445 (+280622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.759050 (+741605us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b5400089dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:51.759224 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619102592}
I20260709 13:18:51.760453 14422 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.760927 14422 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:51.738154 14210 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:51.630367 14184 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:18:51.729954  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 95694.7us
I20260709 13:18:51.734185 14239 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:51.664685 14354 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.761698  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2927) took 1128 ms. Trace:
I20260709 13:18:51.765247  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:51.765775  8256 rpcz_store.cc:276] 0709 13:18:50.635048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.635181 (+   133us) service_pool.cc:224] Handling call
0709 13:18:50.684989 (+ 49808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.181731 (+496742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.761462 (+579731us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b5400268254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:51.761645 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130754432}
I20260709 13:18:51.736877 14400 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:51.677609 14118 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.723635 13495 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:51.729321 14255 consensus_queue.cc:1059] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:18:51.761710 14387 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:51.728897 14440 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:18:51.652876 14393 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:51.765007 14381 consensus_meta.cc:287] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.675s	user 0.001s	sys 0.010s
I20260709 13:18:51.740483 14199 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.748247 14372 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:18:51.762283 14449 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:51.743883 14418 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:51.764742 14399 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:51.798010 13810 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:18:51.783654 14445 consensus_meta.cc:287] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.851s	user 0.009s	sys 0.002s
I20260709 13:18:51.744657 14256 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.801573  8149 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:51.805014  8783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1172) took 1731 ms. Trace:
W20260709 13:18:51.805543  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.784134 14400 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:51.765601 14239 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.809320  8783 rpcz_store.cc:276] 0709 13:18:50.073977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.076526 (+  2549us) service_pool.cc:224] Handling call
0709 13:18:50.096385 (+ 19859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.412390 (+316005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.804699 (+1392309us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400521a54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:51.804927 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725260544}
I20260709 13:18:51.770486 14184 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.806540 14344 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:18:51.768411 14210 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:51.831162  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.831857  8108 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:51.807757 14393 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:51.831553  8104 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 899) took 1755 ms (client timeout 2105 ms). Trace:
I20260709 13:18:51.798836 14253 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:51.861907  8787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1756) took 1503 ms. Trace:
I20260709 13:18:51.831957 13951 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:51.814114 14207 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:51.862730  8786 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: []
W20260709 13:18:51.863730 14481 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:18:51.865170  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:51.866560 14256 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:51.867298 14118 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:51.867502 14418 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:51.868427 14478 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 13:18:51.869184  8104 rpcz_store.cc:269] 0709 13:18:50.076334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.151435 (+ 75101us) service_pool.cc:224] Handling call
0709 13:18:51.831376 (+1679941us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000f4954. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:51.831495 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3374232832}
W20260709 13:18:51.854022  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 88879.2us
I20260709 13:18:51.870474 12721 raft_consensus.cc:3055] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:51.903101 12721 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:51.871544  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2930) took 1235 ms. Trace:
I20260709 13:18:51.795847 14381 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.902683  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:51.820070 14199 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:51.882611 13951 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:51.896521  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 248188us
I20260709 13:18:51.912801  8221 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:51.903898  8251 rpcz_store.cc:276] 0709 13:18:50.636036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.636357 (+   321us) service_pool.cc:224] Handling call
0709 13:18:51.871325 (+1234968us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400092ed4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:51.871468 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628356864}
I20260709 13:18:51.876737  8787 rpcz_store.cc:276] 0709 13:18:50.358842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.358975 (+   133us) service_pool.cc:224] Handling call
0709 13:18:50.359466 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.981401 (+621935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.861591 (+880190us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b540051a4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:51.861834 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1402441472}
I20260709 13:18:51.811918 14445 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.878989 14400 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:51.829775 14239 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:51.880621 14440 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:51.886613 14207 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.907822  8072 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:51.914235  8221 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:18:51.914295  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 101347us
W20260709 13:18:51.918699  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.918993  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.921656  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:51.922269  8251 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
W20260709 13:18:51.906032 14414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.001s	sys 0.014s
I20260709 13:18:51.827822 14446 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.925326  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:51.923971 12721 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.880412 14442 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.938966  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:51.882911 14371 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.939404  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:51.939735  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:51.913524 14466 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:51.953629  8782 raft_consensus.cc:2368] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18.
I20260709 13:18:51.952361  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:51.954030  8787 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:51.926343 14207 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:51.915894 14118 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:51.927783 14418 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:51.940022 14414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.002s	sys 0.015s
I20260709 13:18:51.961480  8252 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:51.961683  8249 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:51.957716  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:51.958632  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:51.926755 14436 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:51.948278 14392 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:51.967701 14392 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.952158 14239 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:51.968092 14392 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:51.968222 14239 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.968736 14239 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:51.964447  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:51.950304 14412 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:18:51.966727 14344 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.972906 14344 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.925544 14399 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:51.975478 14344 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:51.991030  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 50494.2us
I20260709 13:18:51.980162  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:51.993749  8256 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 21: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:51.995827 14399 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:51.996400 14399 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.996814 14399 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:52.002897 14458 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.005126 14458 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:52.006018 14210 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:51.939590 14253 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.009922 14491 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:51.927578 14440 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:52.010237 14490 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:51.955649 14466 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:51.926175 14439 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.927219 14400 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:51.935432 14333 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
W20260709 13:18:52.006101 14487 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:18:51.936079 14199 consensus_queue.cc:1059] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:18:52.026870  8252 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:52.017325  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:52.008956 14255 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:18:52.040493  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:52.030049 14458 raft_consensus.cc:3055] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:52.048480 14458 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:52.015522 14466 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:52.058615  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.048059  8255 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:18:52.090413  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 169786us
I20260709 13:18:51.957082 14492 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 13:18:52.102981  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:52.045338  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 51235.5us
I20260709 13:18:52.046281 14440 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:52.102065 14458 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.111002 14371 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.112562  8787 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:18:52.112810 14442 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:52.113547 14460 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:18:52.089852 14435 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.115396 14435 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:52.115694 14423 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.116521 14184 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.117599 14446 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:52.118251 14493 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:18:52.118423 14381 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:52.120086 14400 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.015201 14422 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.122242 14422 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:51.976588 13951 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.123140 13951 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.124228  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3234) took 1214 ms. Trace:
I20260709 13:18:52.124608  8108 rpcz_store.cc:276] 0709 13:18:50.910190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.910331 (+   141us) service_pool.cc:224] Handling call
0709 13:18:51.831502 (+921171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.844704 (+ 13202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.124033 (+279329us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54000f4950. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:52.124171 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2117763840}
W20260709 13:18:52.125496 14344 consensus_queue.cc:1175] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a0f96c12124b4e1a816d9fa970464091" responder_term: 18 status { last_received { term: 17 index: 14 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:52.127579  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:52.128201 14172 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.536s	user 0.006s	sys 0.003s
I20260709 13:18:52.128249  8253 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:52.128865 14172 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.136219  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:52.152385  8100 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:52.150410 14418 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.138906  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:52.165119  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:52.135610  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:52.167953  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:52.165910  8108 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:18:52.171494  8102 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:52.140259 14484 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:18:52.148046 14482 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.619s	user 0.004s	sys 0.000s
I20260709 13:18:52.177466  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:52.139552 14439 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.145870 14440 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:52.182417  8784 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:18:52.179107  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:52.168061 14458 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:52.189378 14253 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:52.189947 14253 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.192014 14253 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:52.193634 14386 raft_consensus.cc:3055] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:52.194048 14386 raft_consensus.cc:740] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:52.194983  8250 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 18. Ops: []
I20260709 13:18:52.194870 14386 consensus_queue.cc:260] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.196444  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:52.138940 14239 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.189572  8106 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:52.174518 14418 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:52.215538  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.167093 14412 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:18:52.216046  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:52.205495 14495 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:52.183434  8105 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:52.216216  8100 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:52.236423  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:52.236960  8102 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:52.239907  8104 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:52.240553  8253 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:18:52.234087  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:52.183516  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.231767 14333 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:52.243073  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.235718 14440 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:52.241142 13951 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:52.254199  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:52.239090 14371 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:18:52.232123 14392 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.257205  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:52.235409 14399 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.269827  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:52.249763 14440 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:52.273063  8072 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:52.279250  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:52.280561  8072 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:52.246469 14473 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:18:52.249063 14333 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.290133  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:52.280422 14440 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:52.291190  8099 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:52.246647 14495 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.285281 14359 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:52.298409 14359 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:52.298848 14359 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:52.299248  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.299535 14333 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:52.299784  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.302186 14479 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.302809  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:52.303514  8099 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:52.304380  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:52.304865  8099 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:52.306985  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:52.307711  8788 raft_consensus.cc:2368] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16.
I20260709 13:18:52.308271 14359 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:52.309870 14502 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:18:52.309814 14239 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:52.311331  8006 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39810 (request call id 296) took 29698 ms (client timeout 15000 ms). Trace:
I20260709 13:18:52.312902  8002 catalog_manager.cc:5697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 15 to 18, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 18 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:52.313889 14495 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:52.314781  8002 catalog_manager.cc:5697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:52.315584 14506 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:50.249497  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:52.316859 14321 raft_consensus.cc:3055] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:52.317220 14321 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:52.318018 14321 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.319352 14321 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:52.320420  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 73258.4us
I20260709 13:18:52.287973 14172 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:52.295277 14468 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.979s	user 0.000s	sys 0.004s
I20260709 13:18:52.330814  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:52.321656  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:52.326260  8107 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.326987  8099 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:18:52.328334  8002 catalog_manager.cc:5697] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 11 to 15, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 15 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:52.333636  8002 catalog_manager.cc:5697] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 11 to 14, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 14 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:52.334385  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.335474  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:52.336040  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:52.337051  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:44078 (request call id 3230) took 1434 ms. Trace:
I20260709 13:18:52.337262  8174 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 20 index: 8. Preceding OpId from leader: term: 21 index: 9. (index mismatch)
I20260709 13:18:52.338446  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:52.333570 14199 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:52.339373 14412 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:52.339176 14199 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.340030  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:52.339303  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.336050  8178 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:52.342702 14418 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:52.327060 14439 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:52.344998  8178 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:52.344612 14203 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.345863 14203 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.346062  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.347463  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:52.348047  8178 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:18:52.348778 14399 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:52.349287  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.349841  8178 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:52.350513  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3236) took 1437 ms. Trace:
I20260709 13:18:52.350868  8101 rpcz_store.cc:276] 0709 13:18:50.913576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.913675 (+    99us) service_pool.cc:224] Handling call
0709 13:18:50.914042 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:50.914427 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.914453 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:50.915109 (+   656us) log.cc:844] Serialized 52 byte log entry
0709 13:18:51.064315 (+149206us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:51.064362 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.064435 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.269119 (+1204684us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:52.350134 (+ 81015us) raft_consensus.cc:1685] finished
0709 13:18:52.350157 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.350366 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":70,"spinlock_wait_cycles":8407808,"thread_start_us":148792,"threads_started":1,"wal-append.queue_time_us":202270}
I20260709 13:18:52.352660 14207 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.345327 14439 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.356688  8183 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:18:52.357965 14439 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.353714 14473 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:52.358865 14336 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:52.358732 14473 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.359269 14336 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:52.359896  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:52.331868 14446 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.354462  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.341317 14199 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.302726 14479 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.363410 14479 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.355113 14466 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.364112 14257 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:52.337972 14471 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:52.360996 14446 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.365715 14471 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.367383 14446 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:52.367583 14497 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.360s	user 0.003s	sys 0.000s
I20260709 13:18:52.367918 14471 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.368095  8175 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:52.369184 14466 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:52.369626 14473 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.360080 14336 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.370478 14336 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:52.360502  8181 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:52.361390  8174 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:52.337463  8107 rpcz_store.cc:276] 0709 13:18:50.897776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.897902 (+   126us) service_pool.cc:224] Handling call
0709 13:18:52.325772 (+1427870us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b4c002a94c0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f118a20 00007fa59f129a29 00007fa59f12a13f 00007fa59f0ee2ab 00007fa59f11bf3c 00007fa59f11c3fe 00007fa59f3a988b 00007fa5a0da8495 00007fa5a0df930f 00007fa5a0e43a55 00007fa5a5e13cd0
0709 13:18:52.332604 (+  6832us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37842816}
I20260709 13:18:52.354838 14207 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:52.311760  8006 rpcz_store.cc:269] 0709 13:18:22.613107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.613634 (+   527us) service_pool.cc:224] Handling call
0709 13:18:52.311234 (+29697600us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:44.383897 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:44.568194 (+184297us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:44.568254 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:18:44.568277 (+    23us) tablet.cc:662] Decoding operations
0709 13:18:44.571790 (+  3513us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:44.571880 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:44.571911 (+    31us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:18:44.844053 (+272142us) tablet.cc:701] Row locks acquired
0709 13:18:44.844108 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:18:44.844294 (+   186us) write_op.cc:270] Start()
0709 13:18:44.844479 (+   185us) write_op.cc:276] Timestamp: P: 1783603124844224 usec, L: 0
0709 13:18:44.844503 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:18:44.845499 (+   996us) log.cc:844] Serialized 6362 byte log entry
0709 13:18:45.694736 (+849237us) op_driver.cc:464] REPLICATION: finished
0709 13:18:45.940418 (+245682us) write_op.cc:301] APPLY: starting
0709 13:18:45.950916 (+ 10498us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:46.115753 (+164837us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:46.115879 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:46.789857 (+673978us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:46.790299 (+   442us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:18:46.790352 (+    53us) write_op.cc:312] APPLY: finished
0709 13:18:46.790818 (+   466us) log.cc:844] Serialized 148 byte log entry
0709 13:18:47.079811 (+288993us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:47.112452 (+ 32641us) write_op.cc:454] Released schema lock
0709 13:18:47.145140 (+ 32688us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:47.186182 (+ 41042us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:47.188571 (+  2389us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":160430,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":219909,"apply.run_cpu_time_us":124561,"apply.run_wall_time_us":1246726,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70975,"num_ops":16,"prepare.queue_time_us":348873,"prepare.run_cpu_time_us":32480,"prepare.run_wall_time_us":572271,"raft.queue_time_us":200428,"raft.run_cpu_time_us":21841,"raft.run_wall_time_us":167226,"replication_time_us":850064,"thread_start_us":925106,"threads_started":5,"wal-append.queue_time_us":479727,"wal-append.run_cpu_time_us":30983,"wal-append.run_wall_time_us":2730341}]]}
I20260709 13:18:52.374302  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:52.335032  8002 catalog_manager.cc:5697] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:52.379541  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:52.384090  8002 catalog_manager.cc:5697] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:52.373409  8223 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:52.386520  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:52.388633  8002 catalog_manager.cc:5697] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 12 to 16, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 16 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:52.385661 14271 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:18:52.389591  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 67937.5us
I20260709 13:18:52.392379  8002 catalog_manager.cc:5697] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 9 to 16, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 16 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:52.394502  8002 catalog_manager.cc:5697] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 15 to 16, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 16 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:52.395130  8107 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 20 index: 8. Preceding OpId from leader: term: 21 index: 9. (index mismatch)
I20260709 13:18:52.396003  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:52.397775  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.398463  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:52.397874  8002 catalog_manager.cc:5697] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 10 to 17, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 17 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:52.395823  8223 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:52.389966 14271 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:52.399662  8002 catalog_manager.cc:5697] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 13 to 17, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 17 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:52.401567  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:52.402251  8181 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:18:52.401006 14271 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:52.404649 14392 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.391085 14439 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:52.409996 14440 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.412035 14440 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:52.413144  8782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48096 (request call id 981) took 1209 ms. Trace:
I20260709 13:18:52.413528  8782 rpcz_store.cc:276] 0709 13:18:51.203935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.310348 (+106413us) service_pool.cc:224] Handling call
0709 13:18:52.412924 (+1102576us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54005c8d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:52.413069 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249098624}
I20260709 13:18:52.413851 13810 raft_consensus.cc:3055] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:52.414250 13810 raft_consensus.cc:740] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:52.415014 13810 consensus_queue.cc:260] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.416124 13810 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:52.418589 14403 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:52.421916 14435 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:52.422297 14359 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.422325 14435 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:52.423739 14435 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.424397  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2081) took 1435 ms. Trace:
I20260709 13:18:52.424779  8177 rpcz_store.cc:276] 0709 13:18:50.989156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.084607 (+ 95451us) service_pool.cc:224] Handling call
0709 13:18:51.085706 (+  1099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.407008 (+321302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.424151 (+1017143us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400011dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:52.424313 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":689780224}
I20260709 13:18:52.434464  8174 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:18:52.424733 14435 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:52.443293  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:52.441388  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 43651.2us
I20260709 13:18:52.435504  8002 catalog_manager.cc:5697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:18:52.444535  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 48801.5us
I20260709 13:18:52.444566  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:52.452363  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.453804  8223 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:52.446996 14439 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:52.459643  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:52.458730 14378 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:52.463060 14442 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:52.463356 14240 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.463567 14442 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:52.464541 14442 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.466967 14407 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.467533 14407 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.469672 14407 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:52.466930 14328 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:52.474225 14378 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:52.474960  8147 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:52.475234 14378 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.456590  8178 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:18:52.454197 14207 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:52.478871  8782 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:52.479816  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:52.481142  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:52.501865  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:52.487529  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:52.501008  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:52.505401  8787 raft_consensus.cc:2368] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16.
I20260709 13:18:52.506071  8785 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:52.506186  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:52.484968  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:52.481763  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:52.502099  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:52.447350  8002 catalog_manager.cc:5697] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 9 to 12, term changed from 13 to 16, leader changed from <none> to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130), 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:52.475852 14378 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.513998 14445 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:52.515110 14386 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:52.516688  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 2077) took 1315 ms. Trace:
I20260709 13:18:52.482780  8147 leader_election.cc:400] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16.
I20260709 13:18:52.525656  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:52.517825  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:52.518617  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:52.519286  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:52.519399 12721 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:52.519984  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.475847 14321 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:52.529018  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:52.528421  8106 rpcz_store.cc:276] 0709 13:18:51.200881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.224104 (+ 23223us) service_pool.cc:224] Handling call
0709 13:18:52.516490 (+1292386us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54003c3554. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:52.516630 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1849362688}
I20260709 13:18:52.482836  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:52.476739 14328 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:52.522812  8786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1180) took 1751 ms. Trace:
I20260709 13:18:52.524204  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:52.524767  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.543215  8788 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 16: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:52.525336  8223 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:52.526686  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:52.534832  8104 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:52.544570  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:52.528923  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 52366.8us
I20260709 13:18:52.535328  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.521291  8181 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:18:52.536640  8002 catalog_manager.cc:5697] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 10 to 12, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 12 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:52.535601  8789 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:52.540120  8786 rpcz_store.cc:276] 0709 13:18:50.771622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.773307 (+  1685us) service_pool.cc:224] Handling call
0709 13:18:50.773651 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.884529 (+1110878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.522604 (+638075us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54004cf9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:52.522761 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2504246144}
I20260709 13:18:52.547228  8252 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 15: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:52.504068 14207 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.547715  8002 catalog_manager.cc:5697] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:52.549583 14414 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:18:52.553930  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.562857  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:52.531469 14449 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:52.537093 14374 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:52.556466  8147 leader_election.cc:400] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16.
I20260709 13:18:52.556975 14412 consensus_queue.cc:1059] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:52.553061 14199 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:52.561110  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.565804  8106 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:52.574254  8177 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:52.561039  8002 catalog_manager.cc:5697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:18:52.569885 14414 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:52.570731  8101 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:52.527413 14443 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:52.571395  8147 leader_election.cc:403] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:18:52.571734  8180 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.531998 14436 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:52.587337  8791 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:52.591126  8178 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:52.587826  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.541241 14302 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:52.591715  8181 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:52.594447  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.597646  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:52.596007  8102 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:18:52.571272 14207 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:52.600066  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.603018  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:52.604174  8179 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:52.605098  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:52.605664  8179 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:52.609061  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:52.609368  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:52.609934  8782 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:52.529963 14471 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:18:52.602350  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:52.612214  8074 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.130:46389 timed out after 1.572s (SENT) [suppressed 30 similar messages]
I20260709 13:18:52.612929  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:52.608184  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:52.613379  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:52.614356  8101 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 18: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:52.615072  8788 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 20: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:52.616771  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:52.617301  8787 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.613098 14378 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:52.619616  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:52.579262 14443 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.619524  8149 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:52.621017  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 64691.6us
I20260709 13:18:52.619522  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:18:52.624465  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.629040  8782 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:52.624953  8786 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 20: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:52.625042  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:52.590375 14450 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.632671 14450 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.634585 14135 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:52.635076 14135 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:52.590193 14436 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.635679 14135 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:52.635794 14436 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:52.637828 14414 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.638614 14473 consensus_queue.cc:1059] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:52.630234  8783 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 16: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:52.620021 14328 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.635105 14450 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.630183  8147 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:52.640635  8181 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:52.601275 14374 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:52.666450  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:52.666782  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 54589.2us
I20260709 13:18:52.667173  8250 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
W20260709 13:18:52.646945  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 102097us
I20260709 13:18:52.618353 14203 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:52.664141 14519 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.664882  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:52.675522  8252 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 18: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:52.668803  8250 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:52.677680  8177 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:18:52.615721 14336 raft_consensus.cc:3055] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:52.670279  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:52.650279  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.671509  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:52.682407  8257 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.588045 14199 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.574744 14449 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:52.673779  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.691640  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:52.671216  8147 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:52.692538  8252 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:52.692855  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:52.693866  8104 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:52.695060 14407 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:52.697640 14392 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:52.698546 14392 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:52.698904 14392 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:52.702361  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.681224 14336 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:52.683457  8256 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 21: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:52.684592  8787 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:52.686424  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:52.688136  8791 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:52.641544 14378 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.640358 14443 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:52.693176  8147 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:52.704499  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:52.665220 13951 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16.
I20260709 13:18:52.677722 14412 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:52.706774  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.707721  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:52.708706  8180 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:52.715147  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 867) took 1083 ms. Trace:
I20260709 13:18:52.717965  8249 rpcz_store.cc:276] 0709 13:18:51.632162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.632401 (+   239us) service_pool.cc:224] Handling call
0709 13:18:51.651154 (+ 18753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.962068 (+310914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.714931 (+752863us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54001e6254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:52.715097 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713768704}
I20260709 13:18:52.715631  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:52.722880  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:52.703657 14450 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.725096  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.700448 14328 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:52.726854  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:52.728724 14454 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:52.703747 14371 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:52.733485  8181 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:52.730103 14347 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:52.734293 14418 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:52.725378 14399 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:52.680320 14473 consensus_queue.cc:1175] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9480609eccc44250a4d7fcc9686e76cf" responder_term: 20 status { last_received { term: 19 index: 12 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:52.738876  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:52.786074  8183 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:52.787081  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:52.739384  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.787902  8180 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:52.731796 14257 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:52.791780  8177 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 16: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:52.714488 14388 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 13:18:52.742547 14514 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:52.691792 14519 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.750514  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:52.783003  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.791633 14250 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:52.746398  8257 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:52.814611 14250 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.814821 14519 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.815058 14250 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:52.793327  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 44208.6us
I20260709 13:18:52.817559  8180 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:18:52.730257 14100 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:52.796110 14449 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.781179 14371 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.800217 14271 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.716357 14378 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:52.802569  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.802536 14199 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:52.780301 14440 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:52.723245 14262 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:18:52.824268 14371 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:52.810451  8107 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:52.752164 14423 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.810743 14135 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.819314  8180 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:18:52.793680  8791 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:52.752518 14442 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.818936  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:52.822826  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 72399.1us
I20260709 13:18:52.724107 14207 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.791370 14359 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:52.830588  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:52.747812 14450 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.716135 14516 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:18:52.835937  8178 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:52.841121  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:52.835983  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:52.838428  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:52.843389  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:52.844517  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:52.844741  8787 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:52.826349 14388 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:52.828163 14440 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.859104  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:52.860826 14466 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.832283 14255 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:52.747550 14336 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.793807 14374 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.822113 14506 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:18:52.840011 14400 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:52.855406 14449 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:52.840507 14442 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.856119 14407 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.855845 14519 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:52.834952 14423 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.856001 14172 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:18:52.870289 14466 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.855391 14359 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.860877 14458 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:52.826916 14436 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.869498 14255 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:52.832295 14443 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:52.862267 14440 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:52.876137 14240 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:52.861413 14445 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:18:52.861245 14203 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:52.924530 14203 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 16 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:52.925406 14255 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.925784 14203 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.926753 14255 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.870589 14414 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 13:18:52.930480 14518 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:18:52.930768 14378 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:52.904603 14449 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:52.901219 14523 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:18:52.919574  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 76264.6us
I20260709 13:18:52.897279 14400 raft_consensus.cc:697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:18:52.934481  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 74244us
I20260709 13:18:52.935539  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:52.934019  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 74995.5us
I20260709 13:18:52.871028 14403 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:18:52.900974 14407 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.953661 14271 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.954353 14135 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:52.956199  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 321891us
I20260709 13:18:52.938591  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:52.940965  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.958106  8149 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:52.958603 14328 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:52.959527 14328 raft_consensus.cc:3055] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:52.959903 14328 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:52.961927 14517 log.cc:927] Time spent T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:18:52.960822 14328 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:52.964641 14328 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:52.964668 14520 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:18:52.963691 14359 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:52.970010 14436 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:52.971359 14442 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:52.974941 14207 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:52.975733 14449 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:52.975908 14294 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.976213 14449 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.976632 14449 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.977608 14271 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:52.980712 14523 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:52.981317  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:52.945545 14378 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:18:52.983436 14378 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:52.983845 14378 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:52.984669 14257 raft_consensus.cc:3055] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:52.933552 14240 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:52.982573  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:52.987636  8175 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:18:52.986033  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:52.988871  8178 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 22: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:18:52.975615  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 431546us
I20260709 13:18:52.995347  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:52.996384  8257 raft_consensus.cc:2393] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:18:53.004446  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 46423.3us
I20260709 13:18:53.006729  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:53.015782  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 79205.7us
W20260709 13:18:53.017584  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 82143.9us
I20260709 13:18:53.017971  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:53.018602  8178 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
W20260709 13:18:53.020892  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.020980  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:53.021749  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:53.022795  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:53.022930  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:53.024387  8257 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:53.025832  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:53.026468  8104 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:53.027675  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:53.028306  8102 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.028465  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:53.029250  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:53.030078  8107 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 22: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:52.985172 14257 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:53.029892  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:53.030658  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:53.035028  8180 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.035534  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:53.031713  8149 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:53.038115  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:53.038712  8182 raft_consensus.cc:2376] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22. Re-sending same reply.
I20260709 13:18:53.040933  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:53.041733  8249 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:52.946066 14450 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:53.046053  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:53.047547  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:53.049177  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:53.044166  8107 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:53.060930  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:53.057996  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:53.017138 14344 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:52.984769 14378 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.026427 14262 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.068655  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:53.031133 14321 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:53.033001 14271 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:53.057814 14386 consensus_meta.cc:287] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.005s
I20260709 13:18:53.102885  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:53.104038  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:53.134203  8100 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.037345 14435 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:53.111336  8180 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:53.112191  8257 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:18:53.142402  8253 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:53.063457 14372 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:53.118707  8181 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:18:53.121459  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:53.153739  8256 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:53.042311 14399 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:18:53.135625  8108 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:53.155632  8784 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:53.033162 14302 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
I20260709 13:18:53.144479  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:53.145702  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:53.113656 14354 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:53.134163  8249 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:52.976567 14294 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.167670  8253 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:53.181654  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:53.132400 14271 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.112346 14321 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:53.182744  8108 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:53.151892  8102 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:53.181810  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:53.162748 14524 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:18:53.193567  8107 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:53.131251 14450 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:53.157930 14458 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:53.160926 14526 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.160147 14378 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:53.164563 14372 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:53.240053  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.214160 14321 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:53.162192 14435 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:53.225507  8254 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:18:53.251672  8254 pending_rounds.cc:85] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 11
I20260709 13:18:53.252025  8254 pending_rounds.cc:107] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:18:53.252281  8254 raft_consensus.cc:2889] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:53.253227  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 195282us
I20260709 13:18:53.214664  8249 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:53.201944 14271 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:53.120435 14262 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.217289  8253 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:18:53.264775  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:53.265790  8253 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:53.244884  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:53.267140  8248 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 18: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:53.227481  8256 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:18:53.256507  8181 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:18:53.227854 14423 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:53.195384 14519 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:53.222784  8221 leader_election.cc:400] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18.
I20260709 13:18:53.260264  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:53.276177  8221 leader_election.cc:403] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:18:53.277298  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 70290.7us
I20260709 13:18:53.238837 14450 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:53.229125 14458 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:53.161345 14400 consensus_queue.cc:237] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.224630 14531 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:53.258929 14466 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:53.279083  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:53.268487  8253 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:18:53.279968  8100 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:53.281697  8108 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:53.282976  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:53.290553  8248 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:53.268653 14443 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:53.213760 14257 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.293133 14523 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18.
I20260709 13:18:53.243346 14526 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.275220 14442 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:53.293767 14519 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:53.226052 14240 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.313380 14407 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:53.326735 14100 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:53.353915 13810 consensus_meta.cc:287] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.937s	user 0.013s	sys 0.002s
I20260709 13:18:53.313212 14450 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.352679 14443 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:53.355768 14544 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.317186 14372 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.347146 14442 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.338451 14531 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.378713 14294 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:53.380355 14531 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:53.381779 14336 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:53.382845 14449 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:53.384223 14530 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:18:53.384986 14449 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:53.386813 14526 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:53.346276 14435 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:53.375326 14371 consensus_meta.cc:287] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.000s
I20260709 13:18:53.375063 14392 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.389611 14392 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:53.391573 14534 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:18:53.353143 14458 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.370182 14519 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:53.377696 14454 consensus_meta.cc:287] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.002s
I20260709 13:18:53.369660 14544 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.384894 14440 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.401695 14544 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:53.409310 14529 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:18:53.411567 14533 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:18:53.441793  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.323383  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:53.446965  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 123408us
I20260709 13:18:53.449191  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:53.458438  8176 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
W20260709 13:18:53.471908  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 192798us
I20260709 13:18:53.478749  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:53.479211  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.478076  8250 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:53.521212 14336 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.522502 14336 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.531108  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 3259) took 1049 ms. Trace:
I20260709 13:18:53.531919  8105 rpcz_store.cc:276] 0709 13:18:52.481064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.481423 (+   359us) service_pool.cc:224] Handling call
0709 13:18:53.530447 (+1049024us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b540043bcd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:53.530804 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1550668672}
I20260709 13:18:53.543715  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:53.544250  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:53.546940  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:53.549139  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:53.550304  8174 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:53.553643 14454 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.554495 14454 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.556813  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:53.557979  8181 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:53.559127 14549 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:53.381739 14321 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.562645  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:53.565711  8103 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:53.566720 14516 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:53.567698 14516 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.568382  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 2090) took 1232 ms. Trace:
W20260709 13:18:53.569979  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.570814 14491 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:53.573753 14528 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:53.574478  8223 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:53.575824 14262 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:53.544566  8784 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1191) took 1288 ms (client timeout 1662 ms). Trace:
W20260709 13:18:53.581964  8784 rpcz_store.cc:269] 0709 13:18:52.255820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.255974 (+   154us) service_pool.cc:224] Handling call
0709 13:18:53.543965 (+1287991us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b5400520154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:53.544224 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035605760}
I20260709 13:18:53.582451 14549 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:53.583046 14549 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.583292 14450 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:53.486523  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:53.549466  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 96849.7us
I20260709 13:18:53.394824 14371 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.583411 14549 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.588867 14516 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:53.589474  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:53.590121  8183 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:53.562892 14442 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:53.587453  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.568866  8176 rpcz_store.cc:276] 0709 13:18:52.335688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.338236 (+  2548us) service_pool.cc:224] Handling call
0709 13:18:53.568072 (+1229836us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000127d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:53.568271 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2573276544}
I20260709 13:18:53.606300  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2938) took 2568 ms. Trace:
I20260709 13:18:53.549355 14440 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:53.608108 14506 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:53.611725 14336 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:53.606856  8254 rpcz_store.cc:276] 0709 13:18:51.037276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.037422 (+   146us) service_pool.cc:224] Handling call
0709 13:18:51.037804 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.252762 (+2214958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.600397 (+347635us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b54002af3d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:53.606055 (+  5658us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5030307200}
I20260709 13:18:53.589411 14545 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:53.620968  8107 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:53.627748  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:53.622455 14321 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:53.624516  8103 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 912) took 1868 ms (client timeout 2082 ms). Trace:
W20260709 13:18:53.629676  8103 rpcz_store.cc:269] 0709 13:18:51.750567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.750749 (+   182us) service_pool.cc:224] Handling call
0709 13:18:53.604594 (+1853845us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54003f3c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:53.619229 (+ 14635us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4152497408}
I20260709 13:18:53.629784 14458 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:53.630616 14354 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:53.624673 14371 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:53.641960  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:53.647855 14250 consensus_meta.cc:287] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.832s	user 0.004s	sys 0.023s
I20260709 13:18:53.635366 14506 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.648481 14250 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:53.649516  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 72926.6us
I20260709 13:18:53.650497  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:53.651630 14250 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:53.652415  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:53.653637 14442 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:53.653650 14302 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:53.654409 14302 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.654801 14302 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.658780  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:53.660485  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:53.661396  8183 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:53.664186  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:53.666649  8101 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22. Ops: [21.9-21.9]
I20260709 13:18:53.668083 14454 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:53.639184  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:53.648844 14506 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.679143 14435 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:18:53.679224  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 46003us
I20260709 13:18:53.679957 14435 raft_consensus.cc:697] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:53.680763  8784 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 14. Current term is 15. Ops: []
W20260709 13:18:53.681663  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.683826 14257 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:53.687139  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:53.687515 14506 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:53.688288 14545 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.691033 14545 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:53.691671  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:53.692440  8103 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:18:53.693084  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:53.695443  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:53.696260  8178 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:53.701717 14458 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:53.703013 14458 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:53.703536 14458 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:53.673746 14250 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:53.707525 14403 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:53.714955  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:53.714169  8149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.006s	sys 0.010s
W20260709 13:18:53.717281  8149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.006s	sys 0.011s
I20260709 13:18:53.705720 14435 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.716701 14506 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:53.722456  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:53.723908 14506 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:53.723055  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:53.724454 14506 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:53.724747  8789 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.725934  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:53.726850  8788 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 16: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:53.724207  8787 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:53.727828 14336 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.728525 14336 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.704993 14458 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.729112 14347 consensus_queue.cc:1059] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:53.730185 14458 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:53.730262 14347 raft_consensus.cc:3055] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:53.730818 14336 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:53.731011 14347 raft_consensus.cc:740] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:53.731938  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:53.732161 14347 consensus_queue.cc:260] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.739797  8789 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
W20260709 13:18:53.718914  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 654175us
I20260709 13:18:53.752058  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:53.753316  8786 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:53.753793  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:53.754279 14347 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:53.754637  8254 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
W20260709 13:18:53.755410  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.714507 14271 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.761613 14442 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:53.763698 14271 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:53.765631  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:53.765928 14400 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.766655 14400 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.767462  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:53.767678  8255 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:53.768455  8782 raft_consensus.cc:2410] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:18:53.768908 14400 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:53.771718  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:53.771983  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:53.772354  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:53.773088  8257 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:18:53.773140  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:53.774037  8256 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:53.757126  8074 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:53.750641  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 67448.7us
I20260709 13:18:53.775609  8783 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:18:53.715567 14250 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.804252  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:53.807937  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:53.809718  8176 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:53.817741  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:53.804020  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:53.805097 14255 consensus_meta.cc:287] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.878s	user 0.019s	sys 0.000s
I20260709 13:18:53.829386  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:53.818569  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:53.789944 14400 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:53.832142  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:53.786803 14271 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:53.833633  8785 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:53.832800  8786 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:53.784266 14549 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.842264  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:53.839643  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:53.789031 14302 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.857548  8783 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:53.854283  8782 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
W20260709 13:18:53.858901  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 101983us
I20260709 13:18:53.861696 14302 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:53.859122 14436 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:53.864992  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:53.866091 14386 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:53.874138 14328 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.874804 14328 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.875653  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:53.856199 14271 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.878010 14442 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:53.878659 14442 raft_consensus.cc:697] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:53.878908 14545 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:53.879752 14271 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:53.880223 14203 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:53.880573 14545 consensus_queue.cc:1059] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:53.882203 14527 raft_consensus.cc:3055] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:53.882691 14527 raft_consensus.cc:740] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:53.883139 14294 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.851394 14240 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:53.883956 14294 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.883978 14527 consensus_queue.cc:260] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.886602 14527 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:53.887063 14250 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:53.888836  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:53.892609  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:53.854820  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:53.895422  8251 raft_consensus.cc:2410] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:18:53.865020 14436 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.901762 14545 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:53.902349 14545 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.902778 14545 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:53.903061 14549 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:53.904241 14568 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:18:53.908944 14255 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:53.904311 14294 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:53.856760  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:53.909448 14255 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:53.916229  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 59438.5us
I20260709 13:18:53.877187 14328 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:53.916301 14255 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.884090 14240 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:53.929183  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:53.929659  8147 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:53.963464  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:53.957410  8179 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:53.966223  8176 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:53.966470 14545 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:53.968853 14545 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:53.970240 14240 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:53.971702  8254 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:53.974139  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:53.975796 14571 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
W20260709 13:18:53.977847 14562 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.104s	user 0.000s	sys 0.002s
I20260709 13:18:53.947860  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:53.980407  8183 raft_consensus.cc:2410] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:53.981274 14527 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:53.981783 14527 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.982151 14527 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:53.985576  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:53.984491  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:53.987706 14257 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:53.988188  8147 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:53.989267 14257 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:53.989271 14471 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:53.990552 14471 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:53.990749 14328 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:53.990962 14471 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:53.991321 14328 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.991881 14328 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.996634  8783 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
W20260709 13:18:53.974391 14565 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.147s	user 0.003s	sys 0.000s
I20260709 13:18:53.996544  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:53.999598  8791 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:53.997180  8783 pending_rounds.cc:85] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 12
I20260709 13:18:54.000475  8783 pending_rounds.cc:107] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 17.13
W20260709 13:18:53.977027  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 127409us
I20260709 13:18:54.023679 14294 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.024413 14294 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.000830  8783 raft_consensus.cc:2889] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:54.025187  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:54.026645 14294 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:54.027223 14294 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:54.029322  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 228136us
I20260709 13:18:54.036891  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:54.037801  8251 raft_consensus.cc:2410] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:18:54.046329  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.879752 14442 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.041124 14545 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:54.099123  8149 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:54.054121  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:54.042327 14336 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:54.067922  8255 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:18:54.069909 14378 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.730s	user 0.006s	sys 0.011s
I20260709 13:18:54.073388  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:54.073328 14506 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.074162 14446 consensus_queue.cc:1059] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:54.139281 14454 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:54.139825 14454 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:18:54.140897  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 67579.3us
I20260709 13:18:54.076246 14255 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.027683 14294 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.143292 14255 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:54.143359 14294 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:54.143729 14439 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:54.144093 14294 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:54.144403 14549 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 20.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:54.144876 14294 consensus_queue.cc:1243] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:54.086480 14392 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:54.145131  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:54.088662 14359 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:54.091854 14527 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.091615  8256 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:54.039966 14436 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:54.132956  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:54.112399  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:54.110263  8255 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:54.155463  8788 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:54.116415 14386 consensus_queue.cc:1059] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:18:54.136485 14371 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:54.137456  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:54.175073  8183 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:54.164142  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:54.137651 14199 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:18:54.178695  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:54.179674  8106 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:54.145869 14392 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.163615  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:54.175012 14240 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:54.184901  8174 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:54.180953  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:54.181100  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:54.171624  8221 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:54.181531  8100 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:54.180442 14545 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.205570  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:54.192415  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:54.170023 14294 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:54.169957 14336 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:54.216315  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:54.212141  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:54.224875  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 155538us
I20260709 13:18:54.220042  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:18:54.236078  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 53789.9us
I20260709 13:18:54.240373  8104 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:54.245056  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:54.245810  8181 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:18:54.246061 14527 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:54.246793  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:54.238030  8785 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
W20260709 13:18:54.169057  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 115263us
I20260709 13:18:54.247900  8255 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.225962 14458 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.140972 14454 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.146004 14359 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.211369 14371 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:54.223170 14294 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:54.252280 14255 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.281876  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:54.284826  8101 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:54.252729 14378 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:54.289373  8179 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:54.290285  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:54.292135  8786 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:54.292744 14443 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.247543 14347 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.226157 14545 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.293833  8106 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:54.292632  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:54.299710  8107 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 19: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:54.307300  8255 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:54.309207  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:54.310835  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:54.312880  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 211281us
I20260709 13:18:54.313505  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:54.314700  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:54.315424  8102 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:54.316174 14454 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:54.321239  8104 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:18:54.325516 14250 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:54.327139  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:54.288695 14392 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:54.339641  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:54.339308 14294 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 21.9, Last appended by leader: 9, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.349036  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:54.349769  8788 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:54.317569 14443 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.354894  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:54.359674  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:54.357295  8182 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
W20260709 13:18:54.361824  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 52716.9us
I20260709 13:18:54.322413 14302 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:54.334127 14442 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:54.295903 14255 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.293673 14458 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.368120  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:54.335637 14354 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:54.370962  8107 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22. Ops: [21.9-21.9]
I20260709 13:18:54.299682 14347 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.342165 14378 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.352473 14557 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:54.369213 14516 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:54.426985  8105 raft_consensus.cc:2410] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:18:54.362694 14392 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:18:54.398002 14257 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.398321 14506 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:54.435063  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:54.401672 14516 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:54.436199  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 143691us
I20260709 13:18:54.400431 14302 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:54.457552  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 91538us
I20260709 13:18:54.380635 14336 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.423543 14354 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.440510 14516 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:54.428783 14442 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:18:54.441315 14257 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.434196 14378 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.425207 14371 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.488098  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:54.497485  8179 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:18:54.499490  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 131465us
I20260709 13:18:54.500301  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:54.501107  8177 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:18:54.488363 14393 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:54.499100  8221 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:54.465629 14471 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.467181 14519 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.131s
I20260709 13:18:54.481097 14506 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 13:18:54.514335 14576 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.171s	user 0.000s	sys 0.003s
I20260709 13:18:54.567490 14240 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:54.517997 14392 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:54.571650 14392 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.519678 14354 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:54.574914  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:54.521593 14545 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:54.522759 14378 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:54.524364 14257 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:54.583420 14590 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:54.583899 14590 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:54.584275 14590 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:54.586849 14294 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:54.589558 14439 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:54.593066  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:54.593631  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:54.504357 14359 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:54.531143 14572 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 13:18:54.531540 14566 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:18:54.534171 14471 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:54.535003  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:54.521545 14347 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:54.536231  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:54.537019  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.538786  8183 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
W20260709 13:18:54.540367 14328 consensus_meta.cc:287] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.548s	user 0.013s	sys 0.000s
I20260709 13:18:54.540431  8102 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:54.541723 14393 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:54.542431 14442 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:54.543709  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:54.544229  8174 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:54.548118 14528 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:54.548504  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:54.549244  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:54.549968  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:54.551098  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:54.552933 14574 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:18:54.541338  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:54.540735 14443 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:54.560286  8101 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
W20260709 13:18:54.561983  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.562067  8175 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:54.563455 14454 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.567952  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:54.581137  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:54.593766  8107 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:54.530649 14588 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:54.594786  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:54.629895  8255 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:18:54.668519  8250 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:54.668898  8788 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:54.669284  8251 raft_consensus.cc:2393] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:54.631278  8248 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
W20260709 13:18:54.671391  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 127760us
I20260709 13:18:54.672430  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:54.676504 14443 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:54.677280  8147 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:54.677138 14443 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.679399 14443 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:54.687526 14392 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:54.691516 14393 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.695633  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:54.697899  8099 raft_consensus.cc:2410] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:54.671864  8255 pending_rounds.cc:85] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 9
I20260709 13:18:54.631271 14328 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.610020 14545 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:54.710937  8255 pending_rounds.cc:107] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:18:54.712666  8255 raft_consensus.cc:2889] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:54.715381  8181 raft_consensus.cc:2393] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 19: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:54.699524 14354 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:54.695663 14347 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.697721 14528 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:54.702342 14257 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:54.711124 14199 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:54.743672  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 243455us
I20260709 13:18:54.731412  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:54.744139  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:54.744887  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:54.700814 14506 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:54.735980 14545 raft_consensus.cc:697] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:54.736236 14442 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.740758 14587 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:18:54.698459 14454 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.748556  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:54.745393  8177 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:54.728641 14446 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:54.741384 14549 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:18:54.752877  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:54.749935  8250 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:54.753084  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:54.752722 14591 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:54.750164 14443 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:18:54.755273  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 261489us
I20260709 13:18:54.756289 14372 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:54.745393  8255 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:54.759444 14372 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.759943 14439 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:54.760015 14372 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:54.631608 14471 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.754441  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:54.630636 14458 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:54.763284 14471 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.739010 14588 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:54.765981 14588 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.767019  8179 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:54.768698 14588 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:54.770272  8251 raft_consensus.cc:2410] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:54.769382 14588 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:18:54.772109  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 49381.1us
I20260709 13:18:54.773849 14471 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:54.775764 14588 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:54.776527 14588 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.783308 14588 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:54.777791 14471 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.779341 14458 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:54.785612 14471 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.787755  8254 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:54.727541 14240 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:18:54.748790 14257 raft_consensus.cc:697] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 18 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:54.828804  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:54.739673 14347 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.836418  8174 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:18:54.754042 14302 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:54.840061  8248 raft_consensus.cc:2368] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19.
I20260709 13:18:54.845279 14328 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:54.846021 14328 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.846092 14531 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.846545 14328 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.846962 14531 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.850135  8221 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:54.749899 14378 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:18:54.749286 14199 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.757882 14506 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.787379 14442 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.854511 14527 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.866719 14347 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:54.871111 14199 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:54.838040 14516 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.759251 14446 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.877224  8221 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:54.849663 14443 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.884714  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:54.885669  8788 raft_consensus.cc:2393] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:54.885797 14443 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:54.863765 14393 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:54.866349 14328 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:54.886535 14257 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.887737 14531 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:54.890983 14454 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:54.898150 14527 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.881910  8221 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:54.833598 14591 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:54.838642 14372 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.901162  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:54.864957 14302 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:54.905507  8256 raft_consensus.cc:1240] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:54.906167  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:54.907977  8790 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:18:54.906188  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:54.914103 14592 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:54.915895 14442 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:54.873986 14545 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:54.918663 14372 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:54.920217 14506 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:54.922260 14591 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:54.923696 14516 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:54.927019 14255 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:54.912993  8099 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:18:54.929289  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:54.930999  8790 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:54.932552  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:54.933893  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:54.939687 14262 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:54.940126 14262 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.940508 14262 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:54.946738 14577 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.507s	user 0.004s	sys 0.000s
I20260709 13:18:54.948613  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 2968) took 1175 ms. Trace:
I20260709 13:18:54.948959  8252 rpcz_store.cc:276] 0709 13:18:53.773159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.782430 (+  9271us) service_pool.cc:224] Handling call
0709 13:18:53.824621 (+ 42191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.880659 (+ 56038us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:53.880689 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.881284 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.252547 (+371263us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:54.252588 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.252659 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.946305 (+693646us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b2400395798. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dbe59c4 00007fa59dbe3acb 00007fa59dd9edc9 00007fa59dd9ea55 00007fa59dd9e09d 00007fa5a09d010e 00007fa5a09e788c 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221
0709 13:18:54.948158 (+  1853us) raft_consensus.cc:1685] finished
0709 13:18:54.948177 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.948412 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13196,"raft.queue_time_us":25265,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"spinlock_wait_cycles":76171008,"thread_start_us":370801,"threads_started":1,"wal-append.queue_time_us":507110}
W20260709 13:18:54.953152  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.960920  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:54.963188 14527 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:54.970657  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:54.964776 14302 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:54.966781 14203 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.979310  8790 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
W20260709 13:18:54.987932  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 74402.7us
I20260709 13:18:54.990736  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:54.995102  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:54.989938  8147 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:54.996475  8175 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 24: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:54.975564 14250 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:54.980151 14393 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:54.976891 14302 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:55.006222  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 124515us
I20260709 13:18:55.007658  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:55.008854  8221 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:55.009850  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:55.011294  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:55.012373  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:55.017333  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:55.019861 14436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.011s	sys 0.015s
I20260709 13:18:55.004273 14250 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:55.030568 14607 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.022722 14378 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:18:55.034240 14581 log.cc:927] Time spent T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.562s	user 0.002s	sys 0.004s
I20260709 13:18:55.020879 14271 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:55.034672 14436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.011s	sys 0.015s
I20260709 13:18:55.038408 14601 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:55.015970 14302 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:55.005817 14393 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:55.046268  8175 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:55.038873 14516 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:55.052631  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.063859  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:55.064996  8254 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:55.067708  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:55.068531  8248 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:55.070071 14598 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:18:55.071046 14491 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:55.071449 14491 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:55.073144  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:55.073369  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:55.074178 14600 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:55.074753  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.074852 14601 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:55.074934 14257 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:55.018872 14591 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:18:55.076004 14601 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.077335 14257 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:55.077911  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.078080  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.078510  8253 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:18:55.078286 14257 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.078753  8249 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:18:55.046186 14378 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.080880 14378 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:55.082257  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:55.084054 14528 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:55.084478 14516 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:55.086704  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:55.087643  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:55.047237 14250 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:55.097675  8254 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:18:55.090473  8251 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:18:54.999306 14203 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.103144  8248 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:18:55.103511 14596 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.104190 14596 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.106032  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:55.106866 14596 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:55.107219  8149 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:55.107424 14600 raft_consensus.cc:2764] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:18:55.108235 14600 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:55.108500  8149 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:55.109370 14602 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:55.101611 14294 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.114193 14294 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:55.092778 14516 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.116971 14294 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:55.119040  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:55.131727  8255 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:55.122277 14584 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.651s	user 0.001s	sys 0.002s
I20260709 13:18:55.064357 14393 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:55.138518 14271 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:55.139084 14271 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:55.095781  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:55.132895  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:55.143383  8790 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
W20260709 13:18:55.129781 14590 consensus_meta.cc:287] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.545s	user 0.013s	sys 0.000s
I20260709 13:18:55.151952 14590 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:55.154119  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:55.154487 14471 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:55.144706 14446 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:55.098968 14607 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.150367 14203 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:55.150218 14600 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:55.150806 14372 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:55.155398  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:55.173381 14607 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:55.175870  8785 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:55.174503 14372 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.176535 14372 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:55.178112  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:55.174839  8177 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 14: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:55.175160  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:55.155534 14378 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.156159 14262 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:55.159071 14593 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.403s	user 0.000s	sys 0.002s
I20260709 13:18:55.160025 14250 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.154016 14590 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:55.141225 14271 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:55.148047  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:55.203003  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:55.205984  8789 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:55.208877  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:55.210464  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:55.210824  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.211417  8248 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:18:55.213440  8149 leader_election.cc:400] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19.
I20260709 13:18:55.213937  8149 leader_election.cc:403] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:18:55.216287 14262 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:55.221755  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:55.223557  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:55.228538  8255 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:18:55.173767 14203 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.222524  8783 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:18:55.230960  8787 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 21: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:55.224283  8176 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
W20260709 13:18:55.233623  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 86187.1us
I20260709 13:18:55.199896 14600 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:55.239188  8252 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 22: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:55.241895  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.246430  8254 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:55.242551  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.234762  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:55.175261 14591 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.243337  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:55.244400  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.245114  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.247978  8255 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:55.251812  8248 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:55.245255  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:55.244131 14393 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:55.205282 14435 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:55.247318  8257 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
W20260709 13:18:55.256397  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.258608  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.218318 14588 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:55.257902  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.235421 14271 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:55.236506 14371 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19.
I20260709 13:18:55.280813  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 938) took 1131 ms. Trace:
I20260709 13:18:55.281243  8103 rpcz_store.cc:276] 0709 13:18:54.149842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.163081 (+ 13239us) service_pool.cc:224] Handling call
0709 13:18:54.204597 (+ 41516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.204821 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.204849 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.258140 (+ 53291us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.440962 (+182822us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:54.440996 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.441058 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.121662 (+680604us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:55.272114 (+150452us) raft_consensus.cc:1685] finished
0709 13:18:55.272136 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.280724 (+  8588us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76495744,"thread_start_us":144222,"threads_started":1,"wal-append.queue_time_us":197604}
I20260709 13:18:55.283105  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.270246  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.270536  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.271080  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.285918  8251 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:55.271350  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.273798  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:55.275004 14591 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:55.287539  8100 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:55.286751  8253 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:55.294600  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:55.295326  8257 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:55.275944 14378 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:55.275813 14588 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:55.248165 14458 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.276736  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.246224 14203 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.247601 14240 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.331218  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:55.331063 14240 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:55.332131  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:55.251140 14328 consensus_queue.cc:1059] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:18:55.333269 14294 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:55.333698 14294 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.333599 14328 raft_consensus.cc:3055] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:55.334440 14294 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:55.334517 14328 raft_consensus.cc:740] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:55.335004  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:55.336262  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:55.335798 14328 consensus_queue.cc:260] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:55.336858  8178 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:55.255961 14600 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.311957 14271 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:55.314088  8105 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:55.286885  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.288156  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.292508  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.302436  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.303224  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.303426 14250 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:55.303265 14439 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:55.383685 14439 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:55.311157  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.385509  8248 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 22: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:55.322072  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:55.323254  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 2118) took 1103 ms. Trace:
I20260709 13:18:55.325644 14458 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:55.386775  8181 rpcz_store.cc:276] 0709 13:18:54.219807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.246514 (+ 26707us) service_pool.cc:224] Handling call
0709 13:18:55.323000 (+1076486us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b5400003054. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:55.323181 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054713728}
I20260709 13:18:55.339627  8108 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:55.338040  8178 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:55.339952  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.341101  8107 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:55.342552  8249 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:55.344666  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.372445  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:55.373682  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.351725  8255 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 18: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:55.353789  8101 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:18:55.352905  8106 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:18:55.352624  8103 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:55.402083  8099 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:18:55.403139  8250 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:18:55.420285 14386 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.421162 14386 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:55.425267  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 52904us
I20260709 13:18:55.337414 14328 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:55.345665 14440 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:18:55.435788  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.437350 14549 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:55.437929 14549 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.441262 14491 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:55.442416 14491 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:55.448220  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 65762us
I20260709 13:18:55.462229  8251 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:55.443583 14607 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:55.464624  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:55.466997  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:55.466609  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.467041  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.444502 14440 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:55.478418  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:55.478974  8100 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:55.450507 14336 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:55.489486  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:55.484083  8250 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:55.340772 14271 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:55.500742  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.502246  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.482731 14600 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:55.467855 14607 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.502895  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:55.529726  8177 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:18:55.502941  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.531620  8788 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 13.
I20260709 13:18:55.534410  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.535120  8106 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:18:55.463357 14199 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:55.538668  8103 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:55.531878  8105 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:55.539181  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:55.541754  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:55.542857  8177 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:18:55.449877 14435 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.477263 14255 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:55.478166 14519 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:55.539288 14528 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.562392 14528 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.575076  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 2116) took 1370 ms. Trace:
I20260709 13:18:55.576735  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:55.577327  8179 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:55.537949 14607 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:55.577450  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 105786us
I20260709 13:18:55.575479  8174 rpcz_store.cc:276] 0709 13:18:54.204190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.216006 (+ 11816us) service_pool.cc:224] Handling call
0709 13:18:55.565723 (+1349717us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54003408d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:55.575012 (+  9289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700228992}
I20260709 13:18:55.580083  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.582016  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:55.502992 14336 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.551762 14403 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:55.606428  8100 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:18:55.609603  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:55.611080  8104 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:55.578028 14454 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:55.587899 14531 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:55.575887 14519 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:55.553467 14199 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:55.595309 14591 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:55.608026 14458 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:55.610002 14557 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:55.611784 14393 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:55.611538 14588 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:55.660027  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.632457 14587 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.647957 14602 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:55.688994  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 107062us
I20260709 13:18:55.612185 14302 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.732230  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:55.732882  8104 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:55.746558  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:55.670449 14255 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:55.650175 14454 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.648723 14403 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.790040  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:55.785039  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:55.792321  8250 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:55.666628 14557 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:55.781477 14631 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.791015 14471 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:55.812600  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:56.202277  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 389747us
I20260709 13:18:56.203146  8072 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:55.817634 14519 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:55.819216 14528 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:55.819761 14403 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:55.790505 14393 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:56.205834 14393 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.208339 14393 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:55.827334  8176 consensus_meta.cc:287] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.016s
I20260709 13:18:56.208954  8176 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:18:55.810854 14602 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:56.209623 14602 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.210062 14602 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:55.843281 14336 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:55.848165 14372 consensus_meta.cc:287] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.671s	user 0.015s	sys 0.006s
I20260709 13:18:56.211846 14372 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.213090  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 2136) took 1042 ms. Trace:
I20260709 13:18:56.213563  8176 rpcz_store.cc:276] 0709 13:18:55.170360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.273197 (+102837us) service_pool.cc:224] Handling call
0709 13:18:56.213010 (+939813us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:56.214123 14372 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:55.856154 14557 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:56.214602  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:56.216447  8176 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:18:55.863601 14625 log.cc:927] Time spent T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:18:55.864243  8183 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 13. Current term is 14. Ops: []
W20260709 13:18:55.864530 14624 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:18:55.865275 14199 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:55.798115 14628 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:55.870335 14629 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:18:56.224820 14602 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.229246 14506 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:56.229827 14506 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.230818 14602 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:55.870544  8257 consensus_meta.cc:287] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.560s	user 0.013s	sys 0.001s
I20260709 13:18:56.231884  8257 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:56.232661  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:56.232872  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2129) took 1204 ms. Trace:
I20260709 13:18:56.233325  8180 rpcz_store.cc:276] 0709 13:18:55.028635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.341478 (+312843us) service_pool.cc:224] Handling call
0709 13:18:55.341789 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.342207 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.342254 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.451609 (+109355us) log.cc:844] Serialized 26 byte log entry
0709 13:18:55.574968 (+123359us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:55.575011 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.575078 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.232661 (+657583us) raft_consensus.cc:1685] finished
0709 13:18:56.232685 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.232814 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":169,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":75960,"threads_started":1,"wal-append.queue_time_us":147768}
I20260709 13:18:55.870836 14454 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:55.838259 14471 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.235870  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:56.233338  8101 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:56.231907 14506 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:56.237694 14471 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:55.873880 14435 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:55.730535 14587 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.240093 14587 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:55.884485  8179 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
W20260709 13:18:55.885936  8175 consensus_meta.cc:287] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.007s
I20260709 13:18:55.887252  8178 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:56.241889  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2123) took 1248 ms. Trace:
I20260709 13:18:56.242256  8178 rpcz_store.cc:276] 0709 13:18:54.993997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.337629 (+343632us) service_pool.cc:224] Handling call
0709 13:18:55.337935 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.241601 (+903666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.241830 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:55.891155  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 352041us
I20260709 13:18:56.234079  8104 raft_consensus.cc:2410] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:18:56.245532 14600 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.245702 14528 raft_consensus.cc:2764] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:18:56.246152 14600 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:55.827666 14531 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:56.247431 14531 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.248824  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:55.897332  8788 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:55.825767 14458 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 13:18:55.920317  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:56.250597 14527 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.250949  8790 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:55.918354  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:56.241186  8175 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:18:55.925050  8782 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:18:55.915532 14294 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.581s	user 0.006s	sys 0.014s
I20260709 13:18:56.253465 14294 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.254140 14531 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:56.255761 14294 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:55.837136 14631 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:55.945371  8221 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:56.257385  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:56.258054  8175 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 12.
W20260709 13:18:55.948283 14439 consensus_meta.cc:287] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.002s
I20260709 13:18:56.257385  8254 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 25: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:55.947485  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:56.258821 14439 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:55.952872 14630 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:55.954797 14549 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:55.998256  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 45000.3us
I20260709 13:18:55.893663 14255 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:56.004549 14620 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.473s	user 0.004s	sys 0.005s
W20260709 13:18:55.999544  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 214595us
I20260709 13:18:56.034584  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:56.261868  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:56.032274 14645 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:56.381393 14645 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.384078 14645 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:56.070472 14637 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.386004 14637 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.148623 14653 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:56.217876  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:56.390290  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 128503us
W20260709 13:18:56.390774  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 173001us
I20260709 13:18:56.391078  8149 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:56.191318  8250 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:56.044236  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:56.081108  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:56.266520 14631 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:56.175805  8252 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 19. Current term is 20. Ops: [19.9-19.9]
I20260709 13:18:56.078282  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:56.080921  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:56.262367  8253 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
W20260709 13:18:56.258018  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 312758us
I20260709 13:18:56.655409  8221 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:56.189486  8256 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:18:56.249516  8101 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:56.298415  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:56.289243  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:18:56.659777  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 361444us
I20260709 13:18:56.660220  8782 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:56.660516  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:56.290102  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:56.263149  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1212) took 1088 ms. Trace:
I20260709 13:18:56.663901  8791 rpcz_store.cc:276] 0709 13:18:55.175193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.176916 (+  1723us) service_pool.cc:224] Handling call
0709 13:18:55.177256 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.177639 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.177665 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.178158 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:18:55.474151 (+295993us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:55.474194 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.474265 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.996697 (+522432us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:18:56.262749 (+266052us) raft_consensus.cc:1685] finished
0709 13:18:56.262771 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.263046 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":5794688,"thread_start_us":295615,"threads_started":1,"wal-append.queue_time_us":346073}
I20260709 13:18:56.290163  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:56.664597  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:56.289129  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:56.666397 14649 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:56.110371 14240 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:56.291690  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:56.192198 14262 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:56.670580 14262 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.673097 14262 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:56.073200 14386 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:56.216989 14250 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:56.292793  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:56.310987  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:56.064018 14436 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.692381 14436 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.151549 14440 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:56.063603 14491 consensus_meta.cc:287] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.621s	user 0.005s	sys 0.009s
I20260709 13:18:56.313055  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:56.251189 14527 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.038225 14607 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.707360 14607 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:56.166617 14619 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.571s	user 0.002s	sys 0.001s
W20260709 13:18:55.856832 14623 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:18:56.260798 14439 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:56.713675  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2119) took 1465 ms. Trace:
I20260709 13:18:56.714097  8102 rpcz_store.cc:276] 0709 13:18:55.248435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.257714 (+  9279us) service_pool.cc:224] Handling call
0709 13:18:55.284227 (+ 26513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.284633 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.284660 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.285073 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:18:55.461317 (+176244us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:55.461355 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.461420 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.713405 (+1251985us) raft_consensus.cc:1685] finished
0709 13:18:56.713445 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.713609 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":558,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":175852,"threads_started":1,"wal-append.queue_time_us":366652}
I20260709 13:18:56.320495  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:18:56.716365  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 395951us
I20260709 13:18:56.717818 14403 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:56.334959  8147 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:56.718475 14403 raft_consensus.cc:697] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:18:56.718838  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 383996us
I20260709 13:18:56.719496 14403 consensus_queue.cc:237] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.339660  8178 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:18:56.372874  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.722111  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:56.723454  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:56.388005 14653 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.724148 14601 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:56.726056 14653 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:56.727387 14454 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.389312 14637 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:56.730253  8099 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:18:56.730448  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:56.731611  8103 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:56.731745  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:56.732728  8183 raft_consensus.cc:2368] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20.
I20260709 13:18:56.400065 14645 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:56.409540 14664 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:56.736805 14664 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:56.412985  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:56.738112  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 325205us
I20260709 13:18:56.737078  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:18:56.419835  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.446460 14549 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:56.452528  8002 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36106 (request call id 204) took 13244 ms (client timeout 15000 ms). Trace:
I20260709 13:18:56.457304  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:56.462539 14603 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:56.749696 14603 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.750213 14603 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:56.752274  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:56.465513 14655 raft_consensus.cc:2764] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:18:56.491071 14294 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:56.753391 14528 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.753494 14491 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:56.492098  8175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:56.754096 14528 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.754961  8175 raft_consensus.cc:606] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:56.755046 14250 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.530948 14516 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:56.541640 14458 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:56.562969 14588 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.545888 14371 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.587334 14631 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:56.756834 14587 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.756492 14458 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.757579 14240 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:56.594385  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:56.759280 14458 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:56.616963  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:56.758901 14664 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.620385  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:56.760035  8177 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:18:56.760380  8182 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:56.622323  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:56.739755 14439 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:56.761914  8179 raft_consensus.cc:2368] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16.
I20260709 13:18:56.756788 14371 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.631129  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:56.762913  8176 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:56.762590 14587 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.634922  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:56.643115 14203 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:56.646044  8181 raft_consensus.cc:2410] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:56.763846 14371 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:56.640692 14471 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.645514  8000 catalog_manager.cc:5697] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:56.764590 14471 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.764981 14587 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:56.661264 14257 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:56.769701 14257 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:56.740216  8002 rpcz_store.cc:269] 0709 13:18:43.208335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.212337 (+  4002us) service_pool.cc:224] Handling call
0709 13:18:56.452323 (+13239986us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:52.877060 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:53.038065 (+161005us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:53.043963 (+  5898us) write_op.cc:435] Acquired schema lock
0709 13:18:53.056298 (+ 12335us) tablet.cc:662] Decoding operations
0709 13:18:53.378323 (+322025us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:53.378394 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:53.378422 (+    28us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:18:53.379704 (+  1282us) tablet.cc:701] Row locks acquired
0709 13:18:53.379736 (+    32us) write_op.cc:260] PREPARE: finished
0709 13:18:53.379895 (+   159us) write_op.cc:270] Start()
0709 13:18:53.380031 (+   136us) write_op.cc:276] Timestamp: P: 1783603133379845 usec, L: 0
0709 13:18:53.380055 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:18:53.380729 (+   674us) log.cc:844] Serialized 6724 byte log entry
0709 13:18:53.532813 (+152084us) op_driver.cc:464] REPLICATION: finished
0709 13:18:53.733295 (+200482us) write_op.cc:301] APPLY: starting
0709 13:18:53.733467 (+   172us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:54.092486 (+359019us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:54.092640 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:54.689411 (+596771us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:54.689945 (+   534us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:18:54.690014 (+    69us) write_op.cc:312] APPLY: finished
0709 13:18:54.690781 (+   767us) log.cc:844] Serialized 156 byte log entry
0709 13:18:54.874427 (+183646us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:54.957661 (+ 83234us) write_op.cc:454] Released schema lock
0709 13:18:54.957769 (+   108us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:54.963226 (+  5457us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:54.963267 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3198299,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":200048,"apply.run_cpu_time_us":106459,"apply.run_wall_time_us":1229918,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75153,"num_ops":17,"prepare.queue_time_us":146068,"prepare.run_cpu_time_us":10294,"prepare.run_wall_time_us":552802,"raft.queue_time_us":104435,"raft.run_cpu_time_us":14412,"raft.run_wall_time_us":121006,"replication_time_us":134488,"thread_start_us":480033,"threads_started":5,"wal-append.queue_time_us":242457,"wal-append.run_cpu_time_us":26521,"wal-append.run_wall_time_us":2272571}]]}
I20260709 13:18:56.766634  8000 catalog_manager.cc:5697] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 7 to 10, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 10 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:56.661155  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:56.659124  8221 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:55.858368 14302 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:56.676452  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:18:56.803342  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 127003us
I20260709 13:18:56.804868  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:56.674189 14649 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:56.696025 14635 consensus_queue.cc:1059] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:56.697835  8785 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:56.701726  8787 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:56.702035 14666 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.703976 14527 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:56.709757  8249 raft_consensus.cc:2368] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16.
I20260709 13:18:56.720856 14199 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:56.727986 14454 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.392584  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:56.812405  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 419876us
I20260709 13:18:56.814270 14666 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.815160 14601 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:56.816636 14666 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:56.739084  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:56.817698  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 78745.1us
I20260709 13:18:56.817800 14386 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:56.818436 14386 raft_consensus.cc:697] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:56.819667 14386 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.820672  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:56.748867 14393 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.821699 14393 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.822152 14596 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:56.823676 14596 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:56.756608 14588 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.754190 14491 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.824991  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:56.830431 14454 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:56.830771  8257 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:56.765733  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:56.658190 14271 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:56.766639  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:56.766950 14471 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:56.650159  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 2979) took 1479 ms. Trace:
I20260709 13:18:56.767287  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:56.835242  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:56.835876  8103 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:18:56.760062  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:56.836822  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:56.768839 14436 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:56.770128 14257 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:56.841536  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:56.842845 14471 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:56.844468  8789 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:18:56.662369 14639 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:56.845544  8099 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 19: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:56.845672 14639 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.846189 14639 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:56.771194  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 112149us
I20260709 13:18:56.850281  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:56.771673 14439 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:56.757100 14631 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.858201 14631 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:56.773411  8000 catalog_manager.cc:5697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 7 to 12, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 12 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:56.789923  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 69019.8us
I20260709 13:18:56.805800 14203 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:56.818387  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:56.823923 14393 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:56.866372  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:56.826048 14491 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:56.755575 14250 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:56.758018 14240 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:56.826375 14588 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:56.611892 14600 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:56.826496  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:56.870653  8255 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 20: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:56.826795 14199 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:56.827078 14666 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:56.827924  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 2983) took 1374 ms. Trace:
I20260709 13:18:56.828648 14637 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:56.821273  8253 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:56.837113  8180 raft_consensus.cc:2410] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:56.756532 14528 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:56.835652  8174 rpcz_store.cc:276] 0709 13:18:55.170893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.581086 (+410193us) service_pool.cc:224] Handling call
0709 13:18:55.581349 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.665169 (+ 83820us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:55.888381 (+223212us) log.cc:844] Serialized 14 byte log entry
0709 13:18:55.999324 (+110943us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:55.999390 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:55.999439 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.649849 (+650410us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b5400331b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:56.649907 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.650064 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3105,"prepare.queue_time_us":264925,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":3825,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":18795,"spinlock_wait_cycles":192141056,"thread_start_us":293312,"threads_started":2,"wal-append.queue_time_us":139151}
I20260709 13:18:56.837561  8250 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:56.838569  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:56.840019  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:56.845111 14440 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:56.864605  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:56.825785  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:56.866760  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:56.898409  8254 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 16: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:56.868124  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:56.873453  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:56.898998  8257 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:56.899194  8102 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:56.899513  8107 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
W20260709 13:18:56.881812  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 63490.7us
I20260709 13:18:56.835253 14655 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:56.852865 14603 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.871266  8249 rpcz_store.cc:276] 0709 13:18:55.453749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.453890 (+   141us) service_pool.cc:224] Handling call
0709 13:18:56.827688 (+1373798us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400091fd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:56.827840 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2853485312}
I20260709 13:18:56.901845 14302 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:56.903525 14250 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:56.864027 14203 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.904173  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:56.904338  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:56.913408  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:56.906610  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 68132.7us
I20260709 13:18:56.908699  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:56.874308 14240 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:56.910564  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:56.867654 14271 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:56.940227 14271 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.940712 14271 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:56.941192  8785 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:56.912454  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:56.942941  8254 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 20: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:56.922060  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:56.918478  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:56.944444  8254 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:56.944928 14302 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:56.860692  8000 catalog_manager.cc:5697] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 7 to 9, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 9 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:56.910799 14294 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:18:56.938969  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:56.938259  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:56.942972  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:56.950106  8178 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:56.914006  8252 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:56.939640  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:56.937860  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:56.952116  8248 raft_consensus.cc:2368] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16.
I20260709 13:18:56.948254  8000 catalog_manager.cc:5697] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 9 to 11, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 11 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:56.951372  8256 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:56.949536  8782 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:56.954705  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:56.905515 14516 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.956079  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:56.906756 14199 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:56.959640  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:56.916778  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 164607us
I20260709 13:18:56.960565  8101 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:56.959682  8100 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:56.958398  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:56.963444  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:56.955381  8102 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:18:56.966580  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:56.967567  8250 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:56.909474 14655 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:56.985641 14655 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:56.985863 14645 raft_consensus.cc:993] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:18:56.986572 14645 raft_consensus.cc:1081] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:18:56.910658 14600 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:56.973836  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:56.975158 14294 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:56.975001 14601 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:56.998055  8149 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:56.998510  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:56.998585  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:56.999423  8252 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 25: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:56.999378  8248 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:56.999727 14601 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:57.000128 14601 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:57.000483 14601 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:56.977461  8147 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:56.976338 14386 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:56.977916  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:56.914430 14676 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:56.950954 14250 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:56.961212 14673 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:57.015736  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.016360  8099 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:18:57.019208  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:57.017346  8257 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:18:56.916625 14203 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:57.000371  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:56.982035 14603 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:57.021322 14603 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:57.021489  8149 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:57.021766 14603 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.022234 14603 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:57.022605 14645 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:57.023017 14645 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.023373 14645 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:56.998106  8103 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 25.
I20260709 13:18:57.002233  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:57.026631  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:57.028086  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:56.949761 14436 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:57.029356  8256 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:57.029410 14549 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:57.030033 14549 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.004086  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:57.006666  8178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:57.031085  8178 raft_consensus.cc:606] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:57.031435  8178 raft_consensus.cc:614] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:57.031533 14436 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:57.033041 14607 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:57.033571 14607 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 25 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:57.034590  8178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:57.034479 14607 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.035842 14528 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:57.065572  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 61597.4us
I20260709 13:18:56.996381 14600 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:57.030586 14549 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:57.010499 14471 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:57.071717  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:56.977094 14257 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.032325 14603 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:56.993242  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.074539  8099 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:57.074450  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:57.075955  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.108289  8101 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:18:57.079896  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:56.909282 14637 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.082266 14393 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:57.082767 14491 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:57.010398 14294 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:57.095238 14403 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:57.096095  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.010288 14673 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:57.001482 14386 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.109225  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:57.146065  8101 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 25: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:57.112618  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.146596  8103 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:18:57.113287  8100 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:57.085243 14666 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:57.115180  8178 raft_consensus.cc:606] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:57.150961  8178 raft_consensus.cc:614] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:56.996572 14516 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.067476  8252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57566
I20260709 13:18:57.009989 14371 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:18:57.080312 14600 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:57.078806 14664 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.124986  8223 leader_election.cc:400] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20.
W20260709 13:18:57.135164  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 63535.4us
I20260709 13:18:57.165599  8223 leader_election.cc:403] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:18:57.166100  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:57.105595 14471 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:57.143185  8108 raft_consensus.cc:2410] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 21 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 13:18:57.107460 14588 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:57.067785 14250 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.106518 14203 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.153548  8252 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:57.172812  8252 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:57.152647 14666 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.126296 14302 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:57.135361 14294 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:57.014722 14676 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.146194 14673 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:57.168197 14628 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:57.175853 14471 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:57.171665 14664 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.195313 14240 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.195986 14664 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:57.198145 14240 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:57.198900 14250 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:57.202994 14676 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:57.204993 14203 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:57.181773 14684 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:57.164922 14645 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.208088  8104 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:57.210930 14666 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:57.214406 14588 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.216506 14386 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:57.238620  8252 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.248100  8178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:57.216393 14271 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.226202 14603 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:57.176261 14436 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20.
I20260709 13:18:57.142213 14393 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.225800  8000 catalog_manager.cc:5697] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 9 to 12, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 12 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:57.227532 14637 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:57.187366 14685 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:57.179806 14294 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:57.244022  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.154306 14639 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.264575  8252 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:57.244905  8790 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:57.263268 14491 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.271605 14491 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.272725  8000 catalog_manager.cc:5697] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 7 to 10, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 10 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:57.238847 14684 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.279652 14684 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:57.280750 14294 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.282627 14528 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:57.249953 14686 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:57.283509 14294 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:57.283721 14686 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.288548 14393 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:57.291635 14588 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:57.293045  8178 raft_consensus.cc:606] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:57.293598  8178 raft_consensus.cc:614] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:57.299269  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 181927us
W20260709 13:18:57.270661 14681 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:18:57.315209  8786 raft_consensus.cc:2368] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21.
I20260709 13:18:57.315136  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:57.318743  8101 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:57.268687 14685 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.325738  8789 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:57.254106 14250 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:18:57.286684 14686 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:57.329506 14677 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.346s	user 0.005s	sys 0.000s
I20260709 13:18:57.332057  8786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1219) took 1043 ms. Trace:
I20260709 13:18:57.364018  8101 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:18:57.336163 14294 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:57.336795 14436 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:57.337932  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:57.353967 14516 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:57.371769  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08001cdce0 after lost signal to thread 7005
I20260709 13:18:57.375168 14666 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:18:57.376060  8129 debug-util.cc:398] Leaking SignalData structure 0x7b080031c780 after lost signal to thread 8040
W20260709 13:18:57.377624  8129 debug-util.cc:398] Leaking SignalData structure 0x7b080008d960 after lost signal to thread 8132
W20260709 13:18:57.377955  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3940 after lost signal to thread 8133
I20260709 13:18:57.378202  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:57.379400 14607 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:57.379940 14607 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.380362 14607 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:57.379139  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08000e74c0 after lost signal to thread 8207
W20260709 13:18:57.389739  8129 debug-util.cc:398] Leaking SignalData structure 0x7b0800296b60 after lost signal to thread 8208
W20260709 13:18:57.391088  8129 debug-util.cc:398] Leaking SignalData structure 0x7b08000dd3a0 after lost signal to thread 8281
W20260709 13:18:57.392524  8129 debug-util.cc:398] Leaking SignalData structure 0x7b080037e280 after lost signal to thread 8823
I20260709 13:18:57.400902 14607 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.403147 14639 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:57.403537 14607 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:57.409595 14679 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.258s	user 0.002s	sys 0.000s
I20260709 13:18:57.413040 14294 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.416126 14294 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:57.420604 14673 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.297509  8000 catalog_manager.cc:5697] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 9 to 12, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 12 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:57.423846  8000 catalog_manager.cc:5697] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 4 to 8, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 8 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:18:57.434186 14257 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:57.326231 14685 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:57.452602  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 297575us
W20260709 13:18:57.379261 14439 consensus_meta.cc:287] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
W20260709 13:18:57.359059  8755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.035s	sys 0.016s
W20260709 13:18:57.360992  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 186917us
I20260709 13:18:57.335489 14519 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:57.355463 14628 raft_consensus.cc:697] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:57.363824  8786 rpcz_store.cc:276] 0709 13:18:56.289006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.289845 (+   839us) service_pool.cc:224] Handling call
0709 13:18:57.331836 (+1041991us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b5400608bd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:57.331982 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1492186112}
I20260709 13:18:57.368836  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.370452  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:57.371031  8101 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:57.444751 14436 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.357937  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.542922  8100 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:57.498773  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:57.501374  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:57.502204  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 50509.7us
W20260709 13:18:57.514715  8755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.036s	sys 0.016s
I20260709 13:18:57.515704  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:57.365516  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:57.542054  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 171672us
I20260709 13:18:57.373606 14491 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:57.520720 14439 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:57.541651 14519 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:18:57.561348 14655 consensus_meta.cc:287] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.001s
I20260709 13:18:57.543990  8789 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:57.515599 14639 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:57.576241 14519 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:57.576022 14639 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.577564 14600 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.578996 14639 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:57.568264  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 52668us
I20260709 13:18:57.579751 14600 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:57.579859  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:57.563279 14271 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:57.568820 14689 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:57.563815  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:18:57.564675  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 66034.8us
I20260709 13:18:57.572359  8249 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:18:57.364579 14199 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.586504  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:57.521945 14371 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:18:57.581072  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:57.591257  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:57.592724  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:57.560575 14588 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:57.565181  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 758151us
I20260709 13:18:57.597882  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:57.599428  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.600204  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.601153  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:57.600365  8100 raft_consensus.cc:2410] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:18:57.605065  8221 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:57.591598  8147 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:57.612887  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:57.613801  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:57.617089  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:18:57.617348  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:57.614356  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:57.614516  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:57.619181  8250 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:18:57.572536 14695 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:57.621716  8101 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:18:57.631557  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:57.632345  8255 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:57.611208  8221 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:57.622798  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.623687  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:57.623732  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:57.624591  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:57.635592  8106 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:57.590142 14600 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:57.597506 14271 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:57.640206  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.596829 14454 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:57.642402  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:57.646116  8178 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:18:57.641729  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:57.608803 14491 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:57.598500 14588 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:57.616140 14603 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:57.615655 14686 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:57.620540 14439 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:57.648377 14491 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:57.651455  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:57.651371 14588 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:57.652019 14386 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:57.655233  8072 leader_election.cc:400] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21.
I20260709 13:18:57.644901 14294 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:57.639324 14600 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:57.661048 14603 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:57.581265 14685 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.720415  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:57.585273 14655 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.597859 14516 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:18:57.651332 14203 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:57.640707 14684 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:57.640166 14645 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:57.734643 14601 consensus_meta.cc:287] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.734s	user 0.013s	sys 0.002s
I20260709 13:18:57.663727  8178 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:57.629494 14371 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:57.723126  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.725520  8072 leader_election.cc:403] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:57.655650 14240 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:57.725414  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.666637 14458 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:18:57.729918 14491 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:57.730705 14199 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:57.772504  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 117419us
I20260709 13:18:57.733863  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:57.734597  8223 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:57.737082  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:57.775393  8255 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:57.739014  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:57.776888  8250 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:57.742055 14690 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:57.667054 14271 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:57.739845  8106 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
W20260709 13:18:57.741072  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 89706.1us
I20260709 13:18:57.758765 14203 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.662555 14691 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:18:57.757929  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:57.802588  8256 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:18:57.753924  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:57.723163  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:57.804334  8789 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:57.804476  8179 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:18:57.770403 14240 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:57.808372  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:57.765146  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:57.725315 14439 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.737807 14603 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.737740 14600 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:57.753098 14673 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:57.780629 14645 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.784544  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:57.739152  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:57.785362  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:57.759068 14386 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:57.752535 14294 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:57.752092  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:57.634954 14628 consensus_queue.cc:237] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.828058  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:57.802815 14203 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:57.801086  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:57.832055  8180 raft_consensus.cc:2410] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:18:57.805681  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:57.833938  8179 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:18:57.835063  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:57.763166  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:18:57.808938  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 217650us
I20260709 13:18:57.809177  8249 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:57.788389 14471 consensus_meta.cc:287] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.003s
I20260709 13:18:57.837752 14471 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.809060  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:57.812162  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:57.846175  8255 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
W20260709 13:18:57.798772 14549 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.691s	user 0.014s	sys 0.000s
I20260709 13:18:57.774319 14684 raft_consensus.cc:697] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:57.816582 14645 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.828843  8176 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:57.867904  8176 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:57.820211  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:57.830420  8178 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:57.789654  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:57.831142  8183 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 13.
I20260709 13:18:57.770851 14371 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.811921 14240 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:57.866559  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:57.838754  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:57.897269  8253 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:57.772595 14601 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.908237  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:57.908576  8179 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:18:57.817744 14653 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:57.909219  8787 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:57.868695  8176 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.897205  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:57.898293  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.814476 14439 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:57.912763  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:18:57.818899 14696 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:18:57.827852 14666 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:57.911676  8177 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:57.814637 14603 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:57.802690 14690 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.911499  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:57.914732  8176 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:57.914031  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 281047us
I20260709 13:18:57.788908 14587 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:18:57.919849  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 81240.5us
W20260709 13:18:57.924448  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 141451us
I20260709 13:18:57.924863  8183 raft_consensus.cc:2410] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:18:57.925369  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:57.909749 14371 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:57.932732  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:57.908039 14694 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.912135 14653 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:57.940953  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:57.940007  8179 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:18:57.953413  8179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:18:57.911499 14436 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:57.953958  8179 raft_consensus.cc:606] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:57.954327  8179 raft_consensus.cc:614] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:57.955400  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:57.918687 14666 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:57.897854 14549 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.951758  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:57.968223  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:57.958204  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.959100  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:57.971481  8176 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:18:57.972707  8176 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:57.971521  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.973917  8176 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:18:57.949916  8178 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:18:57.897161 14516 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:18:57.928759 14454 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:57.951532  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:57.823427 14294 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.966212  8789 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:57.976315  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.987594  8101 raft_consensus.cc:2368] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
I20260709 13:18:57.977041  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:57.976313  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:57.980794  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:57.976379  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:57.963876 14436 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.960489 14688 raft_consensus.cc:3055] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:57.995728  8255 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:57.997097  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:57.999010  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:57.966277 14666 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:57.991762  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:58.029316  8253 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:58.000715  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:58.032876  8256 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:18:58.031307  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:58.034861  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:58.001647  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:58.033548  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:58.043000  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:57.955777 14694 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:58.033958 14645 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:57.986511 14454 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:57.985791 14689 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.050770  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:58.049106  8782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1831) took 1045 ms. Trace:
I20260709 13:18:58.047417 14257 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:58.035737 14386 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:18:58.033636 14471 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:58.058259 14704 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:18:58.000684 14707 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:58.058518 14711 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:58.059068 14699 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:18:58.050635 14685 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:58.042719 14436 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.986027 14684 consensus_queue.cc:237] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:57.952401 14271 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:58.078250  8251 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:58.085140  8099 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:58.046617  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 49605.2us
I20260709 13:18:58.089532  8790 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:58.090158  8103 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:58.051972 14596 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.131515 14596 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.057930 14549 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:58.093570  8782 rpcz_store.cc:276] 0709 13:18:57.003291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.003528 (+   237us) service_pool.cc:224] Handling call
0709 13:18:57.065199 (+ 61671us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:57.078936 (+ 13737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.078982 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:57.146104 (+ 67122us) log.cc:844] Serialized 52 byte log entry
0709 13:18:57.454608 (+308504us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:57.454646 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.455449 (+   803us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.048877 (+593428us) raft_consensus.cc:1685] finished
0709 13:18:58.048898 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.049050 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3183,"raft.queue_time_us":14601,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":27001,"thread_start_us":275495,"threads_started":1,"wal-append.queue_time_us":456532}
W20260709 13:18:58.058472 14700 log.cc:927] Time spent T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:18:58.056771 14655 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:58.108378 14454 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:58.138839  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2146) took 1061 ms. Trace:
I20260709 13:18:58.138612 14588 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:58.139213  8102 rpcz_store.cc:276] 0709 13:18:57.077852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.107620 (+ 29768us) service_pool.cc:224] Handling call
0709 13:18:57.126606 (+ 18986us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:57.520097 (+393491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.520127 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:57.562321 (+ 42194us) log.cc:844] Serialized 52 byte log entry
0709 13:18:57.837629 (+275308us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:57.837677 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.837747 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.138616 (+300869us) raft_consensus.cc:1685] finished
0709 13:18:58.138634 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.138782 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22809,"raft.queue_time_us":119221,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3346,"thread_start_us":629985,"threads_started":2,"wal-append.queue_time_us":349938}
I20260709 13:18:58.140532  8107 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:18:58.142253 14458 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.142758 14458 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:57.995051 14702 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.117s
I20260709 13:18:58.045145 14688 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:58.124617  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:58.145515  8250 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:58.134276 14596 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:58.122167  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:18:58.147879  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 490475us
I20260709 13:18:58.157626  8074 leader_election.cc:400] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16.
I20260709 13:18:58.158023  8074 leader_election.cc:403] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:18:58.158913  8074 leader_election.cc:400] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16.
I20260709 13:18:58.159672  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:58.164671  8101 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:58.164885  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:58.035952 14653 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:58.170858  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 48900.3us
I20260709 13:18:58.174845  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:58.176757  8223 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:58.178802  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:58.179483  8251 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:58.180956  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.149953 14707 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:18:58.124164 14607 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:18:58.203950  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:58.170007 14601 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:58.173453 14549 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:58.205960  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:58.214278  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:58.221271  8099 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:58.224381  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:58.186430 14516 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:58.191097 14653 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:58.162098 14257 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:18:58.196378 14685 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:58.170114 14596 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:18:58.240924  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:58.233875  8149 leader_election.cc:400] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
I20260709 13:18:58.245247  8149 leader_election.cc:403] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:58.237816  8103 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:58.229815  8249 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:18:58.206772 14722 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:58.248864 14706 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:58.221376 14690 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:58.252697  8256 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 13: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:58.231559 14516 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:58.241874 14645 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.223583 14386 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:18:58.239053 14549 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:58.262081  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 55407.7us
I20260709 13:18:58.263445 14491 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:58.267491 14600 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:58.257696 14516 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:58.270471 14712 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:18:58.204660 14719 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16.
I20260709 13:18:58.301687  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3393) took 1128 ms. Trace:
I20260709 13:18:58.302098 14722 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:58.111815 14689 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.300105 14549 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.270871 14698 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.129446 14711 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:58.313174 14724 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.314249 14709 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:18:58.145819 14688 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.318913  8251 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:58.250000 14725 raft_consensus.cc:2764] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:18:58.249809 14702 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
I20260709 13:18:58.247391 14685 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:58.271108 14707 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 21.9, Last appended by leader: 9, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:58.329167  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:58.254770 14706 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.341264  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:58.344367  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 178808us
I20260709 13:18:58.366689  8254 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:58.367229  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:18:58.363693  8072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.893s (SENT) [suppressed 2 similar messages]
W20260709 13:18:58.348779  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 142922us
I20260709 13:18:58.345470  8257 rpcz_store.cc:276] 0709 13:18:57.173515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.174621 (+  1106us) service_pool.cc:224] Handling call
0709 13:18:57.175070 (+   449us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:57.179798 (+  4728us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:57.326457 (+146659us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.640826 (+314369us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:57.648242 (+  7416us) log.cc:844] Serialized 52 byte log entry
0709 13:18:57.648414 (+   172us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:57.648444 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.648759 (+   315us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.301421 (+652662us) raft_consensus.cc:1685] finished
0709 13:18:58.301459 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.301620 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63003,"prepare.queue_time_us":191875,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":21288,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":19073,"thread_start_us":327473,"threads_started":2,"wal-append.queue_time_us":415399}
I20260709 13:18:58.350212  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:58.369262  8255 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 18: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:58.353173  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:58.357502  8180 raft_consensus.cc:2410] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 21 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 13:18:58.327090 14371 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:58.270872 14240 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.360541  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:58.355530 14628 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:58.351847 14722 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.356173 14439 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.272821 14645 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.352905  8108 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:58.370903  8253 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:58.361373  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:58.363083  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:58.357645 14294 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.373896 14371 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:58.374665 14549 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:58.395395 14491 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:58.375851 14240 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:58.353619 14454 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.393311 14294 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.397511 14454 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:58.397833 14685 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:58.398069 14603 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.398530 14294 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:58.398705 14711 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:58.399633  8179 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:58.376371 14723 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:58.377045  8250 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:18:58.377651  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:58.358774 14666 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:18:58.378129 14721 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:18:58.378703  8175 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:18:58.372077  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:58.371019 14257 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:58.391414  8100 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 19: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:58.366308 14694 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:58.401823  8254 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:58.368134 14706 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:58.385597 14714 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:18:58.405485  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:58.406389  8252 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:58.406587  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:58.366149 14601 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:18:58.383519 14722 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:58.399323 14600 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:58.364267 14203 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.360396 14698 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.401553 14723 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:18:58.432323  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 67705us
I20260709 13:18:58.421676 14440 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:58.365585 14724 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.441282  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:58.445602  8250 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:18:58.447134  8221 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:58.450433  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:58.452862  8221 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:58.431547 14694 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:58.454540  8787 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:18:58.390612 14628 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.442276 14440 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:58.467509 14440 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:58.467756 14728 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:58.468526 14728 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:58.469720 14728 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.477679 14694 raft_consensus.cc:697] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:58.478797 14694 consensus_queue.cc:237] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.500644  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:58.501508  8174 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:18:58.434569 14723 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:58.449357 14458 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:58.542218  8183 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:18:58.466455 14257 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.547248  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 140712us
I20260709 13:18:58.514147 14684 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.546777  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 94015.4us
I20260709 13:18:58.456167 14726 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.089s
I20260709 13:18:58.582223  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:18:58.554883 14587 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.000s
I20260709 13:18:58.546520 14603 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:58.548698 14689 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:18:58.606582  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 235147us
I20260709 13:18:58.607580  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:58.666460  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:58.585610 14737 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:58.792328  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 125967us
W20260709 13:18:58.801690  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 438005us
W20260709 13:18:58.793998  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 186513us
I20260709 13:18:58.803931  8074 leader_election.cc:400] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16.
I20260709 13:18:58.609645 14587 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21.
I20260709 13:18:58.599345 14707 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:58.555567 14257 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.628382 14271 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:58.824136  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:58.812134 14730 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:58.844307  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:58.802325 14403 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:58.586043 14684 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:58.929498 14587 consensus_queue.cc:1059] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:58.930987 14587 raft_consensus.cc:3055] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:58.931087 14666 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:58.931402 14587 raft_consensus.cc:740] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:18:58.940544  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:58.941687  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:58.944525  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:58.945190  8783 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:58.945511  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:58.946245  8250 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:18:58.948091  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:58.948959  8250 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 20: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:58.951665  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:58.952425  8250 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:58.883611  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 304067us
I20260709 13:18:58.811067 14735 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:58.826997 14719 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:58.957304 14294 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.007s	sys 0.003s
I20260709 13:18:58.914000 14676 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:58.982255  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:58.982573  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:58.879209 14439 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:58.985757  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:58.987573  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:58.995155  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:58.995523  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:18:59.005347  8253 consensus_meta.cc:287] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.001s
I20260709 13:18:59.005645  8249 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:18:59.009234  8253 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:18:58.949924 14607 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:58.994258  8784 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:58.940405 14645 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:59.012207  8106 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:18:59.016001  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:18:59.016975  8254 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.009s	sys 0.011s
W20260709 13:18:58.991766 14294 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.007s	sys 0.004s
W20260709 13:18:59.010717 14696 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:18:59.018204  8249 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:59.011356  8250 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:59.025846  8147 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:59.004866 14203 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:58.993131 14676 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:59.056444  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:59.057761  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:58.996886 14603 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:59.028568  8254 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.010s	sys 0.012s
I20260709 13:18:59.012207 14735 raft_consensus.cc:697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:59.073664  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:58.940747 14730 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:59.078145  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:59.078939  8249 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:18:59.011857 14719 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:59.060477 14676 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:59.127023 14724 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:59.129024 14628 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:59.078817 14203 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:59.056511 14685 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:59.122419 14731 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 13:18:59.123329 14735 consensus_queue.cc:237] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:59.013326 14587 consensus_queue.cc:260] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:59.072954 14698 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:59.125942  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:59.131378  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:59.153882  8250 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:18:59.144212  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:59.155802  8249 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:18:59.167825 14257 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:59.168069 14740 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:18:59.171274 14436 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:59.176012 14684 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:59.178762  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:59.187204  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:59.188436  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:59.076581 14603 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:59.136477 14685 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:59.187482  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.196394  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:59.190392  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:59.233318 14587 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:59.231670 14698 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:59.239117 14752 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.239682 14752 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:59.241842 14698 raft_consensus.cc:697] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:59.242815 14698 consensus_queue.cc:237] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:59.243156  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:59.244231  8103 raft_consensus.cc:2410] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:18:59.256588  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:59.263402  8783 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:18:59.283113 14603 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:59.236958 14738 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 13:18:59.233383 14691 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:59.285625 14691 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:59.286784 14691 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:59.283625  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:59.291440  8101 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:59.291942 14440 consensus_meta.cc:287] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.000s
I20260709 13:18:59.292532 14440 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:59.129894 14203 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:59.185976 14684 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:59.267622 14719 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:59.274988  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:59.265249 14730 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:59.303333  8103 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
W20260709 13:18:59.360522  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 170223us
I20260709 13:18:59.365113  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:59.232206 14685 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:59.404031  8249 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:59.419158  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:59.420109  8103 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:18:59.403704 14637 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:18:59.422745  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 441232us
I20260709 13:18:59.448357  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:59.448729  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:59.449656  8249 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:18:59.416292 14706 consensus_meta.cc:287] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.984s	user 0.012s	sys 0.000s
I20260709 13:18:59.475807  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 2149) took 1811 ms. Trace:
I20260709 13:18:59.476001  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:18:59.476397  8181 rpcz_store.cc:276] 0709 13:18:57.664498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.665289 (+   791us) service_pool.cc:224] Handling call
0709 13:18:59.451917 (+1786628us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54002f8d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:59.475739 (+ 23822us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619178752}
I20260709 13:18:59.484579  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:18:59.355995 14684 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:59.486915  8101 raft_consensus.cc:2410] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:18:59.475865  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 893) took 1868 ms. Trace:
I20260709 13:18:59.406505 14676 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:59.522189  8107 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:59.523798 14676 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:59.484066 14706 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:59.525911  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:59.527570  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:59.528936  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:59.502974 14735 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:59.489660  8149 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:59.503362  8103 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:18:59.488232  8177 rpcz_store.cc:276] 0709 13:18:57.607055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.611984 (+  4929us) service_pool.cc:224] Handling call
0709 13:18:57.612347 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.923124 (+310777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.453887 (+1530763us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b540031e2d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:59.475810 (+ 21923us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687967616}
W20260709 13:18:59.539403  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 49961.6us
I20260709 13:18:59.503541 14684 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:59.507475  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 2154) took 1824 ms. Trace:
I20260709 13:18:59.457404 14637 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:59.543380  8180 rpcz_store.cc:276] 0709 13:18:57.682718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.932750 (+250032us) service_pool.cc:224] Handling call
0709 13:18:59.507199 (+1574449us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b5400331b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:59.507397 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":888483072}
I20260709 13:18:59.512418 14688 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:59.514210  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2151) took 1849 ms. Trace:
I20260709 13:18:59.447749 14730 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.518150  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3323) took 1538 ms. Trace:
I20260709 13:18:59.547930  8175 rpcz_store.cc:276] 0709 13:18:57.665010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.665465 (+   455us) service_pool.cc:224] Handling call
0709 13:18:57.724566 (+ 59101us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:58.404752 (+680186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.513861 (+1109109us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54000127d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:59.514129 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503800704}
I20260709 13:18:59.519088  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 3404) took 1335 ms. Trace:
I20260709 13:18:59.519903 14440 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:59.520673 14736 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:59.484553 14645 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:59.522220  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 3405) took 1299 ms. Trace:
I20260709 13:18:59.490424  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:59.509171  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 2164) took 1156 ms. Trace:
W20260709 13:18:59.536593  8074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.017s	sys 0.032s
W20260709 13:18:59.563380  8074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.017s	sys 0.033s
W20260709 13:18:59.546487 14516 consensus_meta.cc:287] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.186s	user 0.009s	sys 0.005s
W20260709 13:18:59.538992  8755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.003s	sys 0.046s
I20260709 13:18:59.541038  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:18:59.570842  8755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.003s	sys 0.047s
I20260709 13:18:59.544962 14707 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:18:59.549837 14637 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:59.569875  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:59.551759  8108 rpcz_store.cc:276] 0709 13:18:57.979913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.028796 (+ 48883us) service_pool.cc:224] Handling call
0709 13:18:58.029153 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.402431 (+373278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.517852 (+1115421us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54003f3254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:59.518073 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743988096}
W20260709 13:18:59.555135  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 136321us
W20260709 13:18:59.571132  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 779216us
I20260709 13:18:59.550906 14602 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:59.476555 14702 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:59.562748  8100 rpcz_store.cc:276] 0709 13:18:58.352714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.352866 (+   152us) service_pool.cc:224] Handling call
0709 13:18:59.508923 (+1156057us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b54003c3554. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:59.509093 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29328768}
I20260709 13:18:59.561718  8253 rpcz_store.cc:276] 0709 13:18:58.222728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.222890 (+   162us) service_pool.cc:224] Handling call
0709 13:18:59.522074 (+1299184us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b5400209c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:59.522171 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289420544}
I20260709 13:18:59.552922  8256 rpcz_store.cc:276] 0709 13:18:58.183808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.183971 (+   163us) service_pool.cc:224] Handling call
0709 13:18:59.518863 (+1334892us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b5400268754. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:59.519030 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65050496}
I20260709 13:18:59.539281 14676 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.575169  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:59.578748  8108 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:59.579545  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:59.581310  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:59.579718  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:59.585366  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:59.585753  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:59.586346  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:59.586722  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:59.588553  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:59.585662  8101 raft_consensus.cc:2410] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:18:59.591900  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:59.593957  8755 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:59.596097  8101 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:59.597128  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:59.571635 14302 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:59.578568 14602 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.604393  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:59.583557 14711 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:59.580293 14645 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:59.602315  8101 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:59.580775 14719 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:59.597844 14726 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:59.561300 14730 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:59.571815 14516 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:59.625258  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:59.599442 14393 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:59.580403 14706 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:59.599172 14257 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:59.613718  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:59.590775 14587 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:59.576503 14707 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:59.618682  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:59.639243  8787 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48096 (request call id 1010) took 1727 ms. Trace:
I20260709 13:18:59.607800 14602 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:59.604094 14766 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:59.601282 14765 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:59.610809 14596 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:59.588891 14676 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:59.630930  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:59.611686 14686 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:18:59.664606  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.585664 14702 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:59.629119 14645 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:59.636596 14587 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.641039  8249 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:59.641276  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 20 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.639827 14707 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:59.642969  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.605995 14724 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:18:59.645117  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.645869  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.639631  8787 rpcz_store.cc:276] 0709 13:18:57.912377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.912546 (+   169us) service_pool.cc:224] Handling call
0709 13:18:59.639074 (+1726528us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540065e854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:18:59.639189 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231515904}
I20260709 13:18:59.603976 14666 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:18:59.651460  8149 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:18:59.629820 14440 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:18:59.605955 14302 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:59.627274 14393 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.703356 14393 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:59.704351 14302 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:18:59.705392 14776 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:59.705946 14776 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:59.707098  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 918) took 1263 ms. Trace:
W20260709 13:18:59.708158 14762 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:18:59.709679  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 917) took 1266 ms. Trace:
I20260709 13:18:59.710536 14588 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:59.624770 14203 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:18:59.666338  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.629140 14694 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.641445 14386 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:59.615382 14741 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:18:59.670249  8253 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:59.673344  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:59.674062  8174 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:18:59.731748  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:18:59.651172 14722 consensus_meta.cc:287] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.217s	user 0.009s	sys 0.003s
I20260709 13:18:59.621855 14719 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:59.678296  8177 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 23: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:18:59.647151 14766 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:59.671599 14686 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:59.690418  8100 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:59.690606 14645 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:59.677089 14587 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:59.692319 14257 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:59.698482 14471 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:18:59.702068  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 50700.9us
I20260709 13:18:59.647092  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.745155  8175 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:18:59.706772 14776 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:18:59.659129  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.658219  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:59.752148  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.712423  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:59.707615  8251 rpcz_store.cc:276] 0709 13:18:58.444133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.444251 (+   118us) service_pool.cc:224] Handling call
0709 13:18:58.466060 (+ 21809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:58.879631 (+413571us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:58.879672 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:58.880156 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.077571 (+197415us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:59.079237 (+  1666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.706554 (+627317us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b5400387f54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:18:59.706622 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.706689 (+    67us) raft_consensus.cc:1685] finished
0709 13:18:59.706708 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.707017 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31313,"raft.queue_time_us":309580,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":106213,"spinlock_wait_cycles":107086080,"thread_start_us":190094,"threads_started":2,"wal-append.queue_time_us":248892}
I20260709 13:18:59.753206  8175 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:18:59.720475  8249 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:18:59.710115  8254 rpcz_store.cc:276] 0709 13:18:58.443719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.443917 (+   198us) service_pool.cc:224] Handling call
0709 13:18:58.444306 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:58.444685 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.444721 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:58.445257 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.059835 (+614578us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:59.059877 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.059963 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.709436 (+649473us) raft_consensus.cc:1685] finished
0709 13:18:59.709461 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.709608 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":72491,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":10897,"thread_start_us":543593,"threads_started":1,"wal-append.queue_time_us":944459}
I20260709 13:18:59.721640  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.689221 14516 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:18:59.734579  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 61384us
I20260709 13:18:59.759876  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.760313  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:59.760502  8178 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:18:59.735651  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.761086  8174 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:18:59.761986  8100 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:59.762413  8174 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:59.691756 14676 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:59.740667  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:18:59.740945  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.763823  8180 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:18:59.742691  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.745155  8149 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:59.754172  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:59.738282 14766 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:59.765470  8175 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:59.765811  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.766776  8251 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:18:59.739895 14203 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:59.769402  8253 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:59.772869  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:18:59.775882  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:59.778452  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:59.779259  8783 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:59.779685  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:59.780380  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:59.782215  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.781984  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:59.729463 14694 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:59.784233  8178 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 21: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:18:59.784789  8182 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:59.744444 14471 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:18:59.786165  8251 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:59.782928  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:18:59.786336  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:18:59.736971 14722 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:18:59.798120  8108 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 22: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:18:59.798437  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:59.798753  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:59.799407  8149 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:59.799639  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:59.799360  8786 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:18:59.802366  8253 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:59.799302  8784 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
W20260709 13:18:59.778913 14723 consensus_meta.cc:287] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.235s	user 0.011s	sys 0.002s
I20260709 13:18:59.797336  8175 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:18:59.806660 14686 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:59.774614 14203 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:18:59.809988 14730 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:18:59.812384 14722 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:18:59.812831  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.790683 14603 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:59.813736  8099 raft_consensus.cc:2368] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 18. Current term is 19.
I20260709 13:18:59.817699  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:59.781940 14440 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:59.819643  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:18:59.820945  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:18:59.821731  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:59.821848  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:18:59.822451  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:59.822952  8178 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:59.782142 14257 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:59.805452  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:00.099290  8101 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
W20260709 13:19:00.103816  8106 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 972) took 2189 ms (client timeout 1585 ms). Trace:
I20260709 13:19:00.198235  8101 pending_rounds.cc:85] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 13
I20260709 13:19:00.198776  8101 pending_rounds.cc:107] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:19:00.112246  8256 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:19:00.199456  8101 raft_consensus.cc:2889] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:59.850323  8783 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
W20260709 13:19:00.109786  8252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60806 (request call id 903) took 2507 ms (client timeout 1756 ms). Trace:
I20260709 13:18:59.866065  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:00.202838  8252 rpcz_store.cc:269] 0709 13:18:57.602329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.612614 (+ 10285us) service_pool.cc:224] Handling call
0709 13:19:00.109546 (+2496932us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b5400092ed4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:00.109695 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818102016}
I20260709 13:18:59.862707  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:18:59.828402  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:00.204699  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:18:59.863435  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:18:59.863081  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:00.206213  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:00.206452  8181 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:00.206959  8253 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 14: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:00.198262  8250 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:59.988696  8102 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:18:59.825237  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:00.207913  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:00.209455  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:00.209923  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 404591us
I20260709 13:19:00.211673  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2170) took 1387 ms. Trace:
I20260709 13:19:00.212100  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:00.214426  8178 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 15: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:00.215378  8183 raft_consensus.cc:2410] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
W20260709 13:19:00.217805  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 396018us
I20260709 13:19:00.218462  8180 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:00.218639  8100 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 20 index: 8. Preceding OpId from leader: term: 23 index: 10. (index mismatch)
I20260709 13:19:00.212071  8107 rpcz_store.cc:276] 0709 13:18:58.824055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.824176 (+   121us) service_pool.cc:224] Handling call
0709 13:18:58.915112 (+ 90936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.522607 (+607495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.211466 (+688859us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b540035f554. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:00.211620 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392152448}
I20260709 13:19:00.220331  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:00.211316  8149 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:00.222097  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:18:59.791136 14736 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:00.225622  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2158) took 2480 ms. Trace:
I20260709 13:19:00.223879  8783 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:19:00.198504  8106 rpcz_store.cc:269] 0709 13:18:57.914421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.914843 (+   422us) service_pool.cc:224] Handling call
0709 13:19:00.103587 (+2188744us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b54001667d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:00.103711 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2191053184}
I20260709 13:19:00.217703  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:00.228062  8221 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:19:00.229236  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 404076us
I20260709 13:19:00.230238  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:00.216768 14635 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:18:59.981232 14778 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:19:00.237807  8248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 3397) took 2263 ms (client timeout 2226 ms). Trace:
I20260709 13:19:00.234441  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:00.239315  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:00.239414  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:00.235400  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:00.109272 14705 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:00.245537 14716 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.245821 14705 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:00.237743  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:00.246060  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:00.246104 14716 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:00.247306  8221 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:00.248502 14716 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:00.249089 14716 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:00.225044 14686 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:00.103878 14766 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:00.225416 14655 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:19:00.242575 14694 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:00.222447 14673 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:00.236332 14692 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:00.243034 14587 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:00.200162 14203 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:00.233891 14302 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:00.244163 14653 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:59.998483 14393 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:00.007794 14637 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:00.009711 14601 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:00.233217 14635 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:00.245237 14770 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:00.246747  8180 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:00.200484 14755 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:00.249596 14741 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:00.249923 14607 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:00.226138  8179 rpcz_store.cc:276] 0709 13:18:57.730333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.967025 (+236692us) service_pool.cc:224] Handling call
0709 13:18:57.975072 (+  8047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.399987 (+424915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.210533 (+1810546us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400101154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:00.210671 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976024832}
I20260709 13:19:00.233181 14458 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:18:59.823845 14698 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:00.108727 14684 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:00.251493  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:00.238315  8072 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:00.322564  8255 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:00.322940  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 84692.6us
I20260709 13:19:00.323657  8072 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:00.324468  8072 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:00.131927 14752 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:00.245191  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:00.238322  8248 rpcz_store.cc:269] 0709 13:18:57.974672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.985557 (+ 10885us) service_pool.cc:224] Handling call
0709 13:19:00.237602 (+2252045us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400386b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:00.237736 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127824256}
I20260709 13:19:00.253876  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:00.201162 14440 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.108911 14596 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:00.255036  8149 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:00.255760  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:00.256647 14516 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:00.256976  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 976) took 1816 ms. Trace:
I20260709 13:19:00.217351 14688 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:00.256886 14705 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:00.259377  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:00.225188 14763 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
W20260709 13:19:00.262090 14685 consensus_meta.cc:287] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.846s	user 0.009s	sys 0.004s
I20260709 13:19:00.002087 14702 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:00.233839 14676 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:00.263948  8223 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:00.238204 14549 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:00.265398  8782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1844) took 1650 ms. Trace:
I20260709 13:18:59.981709 14602 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:00.262681 14727 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:00.262861 14686 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.251152 14257 raft_consensus.cc:697] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:18:59.827924 14723 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:00.265509 14736 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:59.972148 14471 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:00.399144  8176 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 22: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:00.302333 14653 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:00.306566 14601 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:00.315295 14393 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:00.316819 14766 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:00.266067 14673 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:00.325398  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:19:00.408226  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 82889.2us
I20260709 13:19:00.395740 14686 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:00.329252  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 74371.9us
I20260709 13:19:00.329556  8790 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:00.327723  8175 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:19:00.414608  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:00.361521  8250 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:00.374289  8255 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:19:00.333653  8104 rpcz_store.cc:276] 0709 13:18:58.440840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.441019 (+   179us) service_pool.cc:224] Handling call
0709 13:19:00.256773 (+1815754us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54000f4954. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:00.256920 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611637504}
I20260709 13:19:00.300266 14302 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:00.384454  8782 rpcz_store.cc:276] 0709 13:18:58.614723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.614980 (+   257us) service_pool.cc:224] Handling call
0709 13:18:58.813146 (+198166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.813342 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:58.881187 (+ 67845us) log.cc:844] Serialized 14 byte log entry
0709 13:18:59.029733 (+148546us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.015809 (+986076us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b18003b35c0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5c455 00007fa5a0e44060 00007fa5a0e56716 00007fa5a0e67287 00007fa5a0e67208
0709 13:19:00.264908 (+249099us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:00.264983 (+    75us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:00.265048 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.265142 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.265323 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51861,"prepare.queue_time_us":71843,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":130,"raft.queue_time_us":203811,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":41750,"spinlock_wait_cycles":6632192,"thread_start_us":345279,"threads_started":2}
W20260709 13:19:00.386536  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 122670us
I20260709 13:19:00.421586  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:00.422670  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:00.423707  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:00.326062 14692 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:00.353633 14730 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:00.329627 14770 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:00.328274 14440 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:00.309098 14719 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:00.305198 14637 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:00.333173 14752 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.328719 14596 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:00.400250  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 3007) took 1370 ms. Trace:
I20260709 13:19:00.313225 14755 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:00.402704  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 191191us
I20260709 13:19:00.479578  8103 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:00.479287  8249 rpcz_store.cc:276] 0709 13:18:59.029497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.576763 (+547266us) service_pool.cc:224] Handling call
0709 13:19:00.400043 (+823280us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b54001e6c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:00.400197 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125831424}
I20260709 13:19:00.381177 14607 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:00.394023 14705 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:00.325932  8178 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:00.412015  8177 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:00.417291  8104 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:19:00.424897  8252 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:19:00.332921 14458 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:00.430967  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:00.525589  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 94701.8us
I20260709 13:19:00.382807 14688 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:00.384223 14685 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:00.432828  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 210804us
I20260709 13:19:00.534077  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:00.425738 14676 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:00.462970 14741 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:00.430238 14645 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:00.487905 14596 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:00.549852  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:00.550391 14741 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:00.462766 14727 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:00.550953 14741 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:00.551314  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:00.551774 14727 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:00.552078 14596 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:00.471839  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:19:00.434911  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.475278  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:00.558861 14741 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:00.402992 14795 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:00.461056 14549 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:00.435850  8183 raft_consensus.cc:2410] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:19:00.559677 14795 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:00.559772 14685 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:00.489113  8221 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:19:00.564522  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 75484us
I20260709 13:19:00.565829  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:00.483060  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:00.483863  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:00.409515 14736 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:00.527271  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:00.528276  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:00.534893  8181 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 14.
W20260709 13:19:00.475056  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 46511.1us
I20260709 13:19:00.571825  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:00.581472  8786 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 14: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:00.606208  8787 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:00.608505  8249 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
W20260709 13:19:00.561002 14793 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:19:00.614656  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:00.615558  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:00.618772  8250 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:00.561537 14716 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:00.617242  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 123309us
I20260709 13:19:00.431061 14730 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.477252 14770 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:00.559789 14549 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:00.574352 14698 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:00.573853 14676 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:00.705674 14676 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:00.707803 14743 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:00.708209  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 3009) took 1009 ms. Trace:
I20260709 13:19:00.708293 14743 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:00.708657  8177 rpcz_store.cc:276] 0709 13:18:59.698475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.769723 (+ 71248us) service_pool.cc:224] Handling call
0709 13:18:59.770135 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.620530 (+850395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.707975 (+ 87445us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b5400328a54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:00.708145 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472711936}
I20260709 13:19:00.711706  8178 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:19:00.666312  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:00.605443 14454 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.528887 14386 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.092s
I20260709 13:19:00.664863 14516 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:00.485575 14752 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:00.687726 14784 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:19:00.687906  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2180) took 1122 ms. Trace:
I20260709 13:19:00.687361 14736 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:00.690263 14439 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:00.747645  8108 rpcz_store.cc:276] 0709 13:18:59.565195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.214572 (+649377us) service_pool.cc:224] Handling call
0709 13:19:00.214908 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.613537 (+398629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.613568 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:00.613607 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:00.613637 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.687646 (+ 74009us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400226ad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:00.687698 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.687849 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916288896}
I20260709 13:19:00.670878 14770 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:00.695073 14302 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:00.595698 14722 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:19:00.695642 14528 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:00.696060 14702 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:00.697124 14741 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:00.617359 14587 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:00.701797 14716 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:00.674052 14549 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:00.702102 14775 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:00.561271 14763 consensus_queue.cc:1059] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.093s
I20260709 13:19:00.595849 14694 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:19:00.606467 14653 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:00.703136 14719 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:19:00.703758 14789 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.370s	user 0.000s	sys 0.001s
I20260709 13:19:00.704102 14755 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:00.704216 14635 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:00.589409 14393 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
W20260709 13:19:00.721451  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 194878us
W20260709 13:19:00.720497  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 105000us
I20260709 13:19:00.856000  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:00.523471 14607 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:00.665809 14730 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:00.734285  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 59685.8us
I20260709 13:19:00.703078 14602 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:00.676333 14803 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:00.729197 14695 raft_consensus.cc:3055] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:19:00.764398  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.569007 14257 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:00.782317  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:00.784173  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:00.787390  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:00.703791 14802 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:19:00.762424 14458 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:00.819346  8180 consensus_meta.cc:287] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.001s
I20260709 13:19:00.742591 14454 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:00.843863  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 278090us
I20260709 13:19:00.781390 14528 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:00.783063 14722 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:00.781852 14810 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:00.852463 14752 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:00.854561  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:00.865554  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 3009) took 1835 ms. Trace:
I20260709 13:19:00.837289 14688 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:00.919682 14789 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:19:00.843621  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 174165us
I20260709 13:19:00.917400  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:00.845336 14719 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:00.909507  8180 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:00.910308  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:00.901010  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:00.902664  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:00.849572 14587 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.929833  8177 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:19:00.929924  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:00.946812  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:00.934486  8257 rpcz_store.cc:276] 0709 13:18:59.030022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.637403 (+607381us) service_pool.cc:224] Handling call
0709 13:18:59.637733 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.668190 (+ 30457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.668219 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:59.679244 (+ 11025us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.824635 (+145391us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:59.824676 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.824763 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.865267 (+1040504us) raft_consensus.cc:1685] finished
0709 13:19:00.865297 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.865477 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44573,"raft.queue_time_us":33425,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4786,"thread_start_us":91030,"threads_started":1,"wal-append.queue_time_us":582223}
I20260709 13:19:00.853188 14645 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 13:19:00.938598  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 84168.9us
W20260709 13:19:00.857446 14203 consensus_meta.cc:287] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.003s
I20260709 13:19:00.951351 14203 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:00.953701  8789 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:00.870558 14695 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:00.942898  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:00.942912  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:00.955266 14763 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:00.955320 14695 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:00.956943 14695 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:00.958820 14203 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:00.959429  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:00.961949  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:00.961290 14203 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:00.963068  8107 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:19:00.974478  8104 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:00.974606  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 64490us
I20260709 13:19:00.975390  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:00.930579 14694 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:00.979175  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:00.977532  8223 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:00.980720  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:00.930907 14722 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:19:00.976709  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 115375us
I20260709 13:19:00.985354  8074 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:00.967530 14203 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:00.944645 14302 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:00.941167 14743 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:00.994421  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.001513  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.008410 14722 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.009871 14809 consensus_queue.cc:1059] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 13:19:01.010324 14549 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.010869 14811 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.219s
I20260709 13:19:00.981604 14688 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:00.978680 14694 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:00.988819 14741 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:00.989681 14676 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:01.028455  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:00.990338 14587 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.024032 14549 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:01.047830 14795 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.048781  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 904) took 1037 ms. Trace:
W20260709 13:19:01.013046 14792 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.390s	user 0.000s	sys 0.001s
I20260709 13:19:01.021998 14694 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.025660  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:01.062453  8105 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:01.063485  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:01.054584  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:00.938930 14810 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.067759  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:01.068786 14810 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:01.025486 14797 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
W20260709 13:19:01.024495 14816 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:19:01.012526 14743 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:01.071441  8105 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
W20260709 13:19:01.059008  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 71266us
W20260709 13:19:01.034001 14814 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
W20260709 13:19:01.024966 14808 log.cc:927] Time spent T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:19:01.058790  8183 rpcz_store.cc:276] 0709 13:19:00.011543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.228074 (+216531us) service_pool.cc:224] Handling call
0709 13:19:01.048549 (+820475us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400003054. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:01.048717 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242861312}
I20260709 13:19:01.005059 14203 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:01.073539  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.074321 14203 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:01.060036  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 74742.9us
W20260709 13:19:01.023532 14794 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
I20260709 13:19:01.041563 14676 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:01.054178 14688 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:01.053925 14741 raft_consensus.cc:697] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:01.058794 14454 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:01.089905 14702 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:01.090755 14684 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:01.090929 14587 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.086941  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:01.023759 14823 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.109s
I20260709 13:19:01.095918  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:01.097919  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:01.096628 14600 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:01.085826 14676 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:01.101136 14684 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:01.088572 14688 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:01.096342 14795 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:01.094885 14743 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:19:01.050952 14528 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.109946 14833 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:19:01.111541 14799 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:01.111871 14440 consensus_meta.cc:287] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.002s
I20260709 13:19:01.112329 14812 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:01.107021 14549 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:19:01.106038 14607 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:01.113785 14824 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:19:01.062402 14719 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.114591 14741 consensus_queue.cc:237] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:01.115283 14800 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.413s	user 0.002s	sys 0.000s
I20260709 13:19:01.122428  8180 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 21 index: 9. Preceding OpId from leader: term: 23 index: 10. (index mismatch)
W20260709 13:19:01.124632 14686 consensus_meta.cc:287] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.000s
I20260709 13:19:01.116521 14587 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:01.118364 14688 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:01.153788  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2177) took 1334 ms. Trace:
I20260709 13:19:01.153491 14686 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.154196  8179 rpcz_store.cc:276] 0709 13:18:59.819434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.330785 (+511351us) service_pool.cc:224] Handling call
0709 13:19:00.331077 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.348113 (+ 17036us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:00.751231 (+403118us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.921152 (+169921us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:00.944097 (+ 22945us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.944357 (+   260us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:00.944733 (+   376us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.945112 (+   379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.945230 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:01.153548 (+208318us) raft_consensus.cc:1685] finished
0709 13:19:01.153569 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.153727 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1453,"prepare.queue_time_us":108087,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":84,"raft.queue_time_us":47721,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":14421,"spinlock_wait_cycles":8512768,"thread_start_us":450989,"threads_started":2,"wal-append.queue_time_us":236418}
I20260709 13:19:01.155700 14686 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:01.157620  8181 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:01.159492  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 903) took 1148 ms. Trace:
I20260709 13:19:01.159834  8181 rpcz_store.cc:276] 0709 13:19:00.011268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.696817 (+685549us) service_pool.cc:224] Handling call
0709 13:19:00.697101 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.158040 (+460939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.159268 (+  1228us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b5400011154. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:01.159434 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1058696448}
W20260709 13:19:01.160337  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 90517.5us
I20260709 13:19:01.148944 14711 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:01.144824  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:01.163219  8179 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:19:01.163569  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:01.164657 14588 raft_consensus.cc:3055] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:01.165071 14588 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:01.165854 14818 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:19:01.166429 14587 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:01.166638 14818 consensus_queue.cc:1243] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:01.167064 14587 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:01.168313 14755 raft_consensus.cc:3055] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:01.168731 14755 raft_consensus.cc:740] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:01.174120 14743 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:01.174556 14743 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.174904 14743 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:01.175274  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:01.175913  8103 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:01.176939  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:01.178254  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:01.178664 14588 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.179695 14588 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:01.180356 14806 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.622s	user 0.000s	sys 0.001s
I20260709 13:19:01.161720 14440 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.182390  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:01.183542 14440 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:01.183622 14240 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:01.184139  8102 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 3341) took 1911 ms (client timeout 1571 ms). Trace:
I20260709 13:19:01.184769  8782 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:01.185680  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2179) took 1365 ms. Trace:
I20260709 13:19:01.186028  8178 rpcz_store.cc:276] 0709 13:18:59.819947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.598547 (+778600us) service_pool.cc:224] Handling call
0709 13:19:00.654973 (+ 56426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.712317 (+ 57344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.185455 (+473138us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b54002f8854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:01.185629 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129874688}
I20260709 13:19:01.167974 14587 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.189445 14755 consensus_queue.cc:260] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:01.184648  8102 rpcz_store.cc:269] 0709 13:18:59.272674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.274709 (+  2035us) service_pool.cc:224] Handling call
0709 13:19:01.183977 (+1909268us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b540001bdd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:01.184072 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1426474368}
I20260709 13:19:01.119988 14809 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:19:01.198731  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:01.166520 14637 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:01.119235 14803 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
W20260709 13:19:01.195188 14804 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.521s	user 0.002s	sys 0.000s
I20260709 13:19:01.162734 14711 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:01.277266 14240 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:01.331027 14240 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.334216 14240 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:01.335361 14791 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 1.020s	user 0.002s	sys 0.000s
W20260709 13:19:01.337543  8099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 2168) took 2974 ms (client timeout 1751 ms). Trace:
W20260709 13:19:01.338049  8099 rpcz_store.cc:269] 0709 13:18:58.362686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.362816 (+   130us) service_pool.cc:224] Handling call
0709 13:19:01.337284 (+2974468us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54003f2d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:01.337466 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3271668480}
I20260709 13:19:01.338986  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 1021) took 1519 ms. Trace:
I20260709 13:19:01.339360  8784 rpcz_store.cc:276] 0709 13:18:59.819116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.208552 (+389436us) service_pool.cc:224] Handling call
0709 13:19:00.233581 (+ 25029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.259989 (+ 26408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.260019 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:00.260565 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.400583 (+140018us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:00.400622 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.400685 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:01.194541 (+793856us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:01.338690 (+144149us) raft_consensus.cc:1685] finished
0709 13:19:01.338710 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.338923 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26012,"raft.queue_time_us":29204,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2142,"spinlock_wait_cycles":36684032,"thread_start_us":139647,"threads_started":1,"wal-append.queue_time_us":300696}
I20260709 13:19:01.311936 14686 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:01.324018 14607 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:01.337680 14813 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.319033 14823 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:01.349010  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:19:01.350556  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.362815  8179 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 19: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:01.345654  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:01.323853 14302 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:01.163141 14770 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.352764  8782 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:01.354218  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:01.370500  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:01.368417  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:01.372675  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:01.373050  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.332970 14815 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.371728  8108 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 15.
I20260709 13:19:01.378829  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.379992  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:01.382289  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:01.383327  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:01.384516  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.328069 14688 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.395284 14673 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:01.396042 14819 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.396581 14819 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.383912  8108 raft_consensus.cc:2376] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21. Re-sending same reply.
I20260709 13:19:01.351605 14635 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:01.393934 14811 raft_consensus.cc:3055] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:01.387254 14815 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.399366  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 3010) took 2369 ms. Trace:
I20260709 13:19:01.414353  8256 rpcz_store.cc:276] 0709 13:18:59.030345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.639421 (+609076us) service_pool.cc:224] Handling call
0709 13:19:00.111942 (+472521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.199650 (+ 87708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.399168 (+1199518us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b5400092ed0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:01.399306 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085923072}
W20260709 13:19:01.415010  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.415288  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.388983  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:01.354898 14685 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:01.402850  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:01.419826  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:01.397013 14688 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:01.361277 14835 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:01.422294 14835 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.388394 14830 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 13:19:01.388263 14813 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.430188 14813 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:01.406606 14723 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.407126  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:01.354497 14686 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.410660 14770 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:01.374933 14823 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.431567  8785 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 16: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:01.425092 14835 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.432756 14686 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.379179 14203 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:01.433229  8108 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:01.434870 14823 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.427192 14830 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:01.437708 14830 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:01.438875 14830 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.440573 14830 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:01.446545  8104 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:01.452104  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:01.453511  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 99345us
I20260709 13:19:01.454687  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:01.361683 14607 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.467017  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:01.404748 14811 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:01.467422  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:01.467666  8255 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:01.379899 14302 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.474989  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:01.352627 14711 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.469719  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:01.383076 14386 consensus_queue.cc:1059] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:19:01.418009 14728 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:01.469374  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:01.471274  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:01.482439  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:01.483974  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:01.484553  8249 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:19:01.475708  8256 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:01.468854  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:01.413298 14694 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.477376  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:01.487224  8257 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:01.488076 14386 raft_consensus.cc:3055] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:01.488401 14694 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.488970 14811 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.460835 14685 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.490389 14811 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:01.490576  8108 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:01.491734 14685 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.492709 14302 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:01.461284 14813 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:19:01.470783 14770 consensus_queue.cc:1059] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
W20260709 13:19:01.477564  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 97677.2us
I20260709 13:19:01.415899 14635 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.480155  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:01.483026 14728 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:01.469480 14833 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.514441  8250 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:19:01.516669  8255 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:01.496628  8257 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:01.472064 14819 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.524554  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:01.530061  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 44725.3us
W20260709 13:19:01.527982 14840 consensus_queue.cc:1175] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9bd264598fd2483e9e17674bab9ba4e8" responder_term: 21 status { last_received { term: 19 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: [20.13-20.13]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:19:01.528995 14837 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:19:01.529253  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.493786 14549 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:01.497076 14730 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.001s
I20260709 13:19:01.531510  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:01.531780  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:01.531891  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:19:01.532649  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.545313  8179 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:01.534509  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:01.493742 14815 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:01.536824  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:01.570389  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:01.518213 14728 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:01.502208 14684 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.571327  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:01.572036  8251 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:19:01.572896  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:01.573133 14684 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.540336 14819 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.573949  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:01.574106 14819 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.574553  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.571319  8254 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:01.575326  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 921) took 1751 ms. Trace:
I20260709 13:19:01.575736  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.575639  8254 rpcz_store.cc:276] 0709 13:18:59.823798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.540049 (+1716251us) service_pool.cc:224] Handling call
0709 13:19:01.571137 (+ 31088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.575126 (+  3989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.575281 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:01.488432 14386 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:01.545292  8255 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:01.576725  8251 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:19:01.534307  8252 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:19:01.547127  8221 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:01.552956  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.556254 14822 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:01.557863 14516 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:01.561908  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:01.565538 14730 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.566298  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:01.545277  8257 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:19:01.588656 14302 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:01.594725  8250 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:01.603215  8179 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:19:01.608028 14635 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:01.600612 14240 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.640179 14240 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.639559 14728 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.529767 14833 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:01.644722 14795 consensus_meta.cc:287] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.000s
I20260709 13:19:01.645682 14607 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:01.592895 14516 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:01.651203 14676 consensus_meta.cc:287] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.000s
I20260709 13:19:01.651768 14676 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.654214 14819 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:01.657763  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:01.660935  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:01.657948  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.665320  8180 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:01.669890  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:01.599870 14822 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:01.687701  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:01.687608  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:01.696352  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:01.692265 14841 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:01.666302 14833 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:01.698493  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:01.667344 14607 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:01.702740  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:01.704175  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:01.689924 14302 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.698230 14698 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:01.711643  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 182079us
I20260709 13:19:01.699759 14635 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:01.694082 14819 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:19:01.706182 14843 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:01.716629  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:01.701802 14846 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:01.710413 14795 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:01.728681  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.715433 14635 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:01.741181  8180 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 23: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:01.712373 14841 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:01.694223 14386 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:01.727748 14743 consensus_meta.cc:287] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 13:19:01.726491 14846 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.722523 14676 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.711843 14698 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.729589 14843 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:01.747479 14635 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:01.712719 14302 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.786671 14841 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.787292  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:01.746351 14728 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:01.797680  8180 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:01.791211 14549 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:01.794517 14302 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:01.778673 14846 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:01.807885 14752 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:01.774261 14743 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.813799  8180 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:01.798528 14386 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:01.821026 14695 consensus_meta.cc:287] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.861s	user 0.007s	sys 0.001s
W20260709 13:19:01.817739  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.840231  8101 raft_consensus.cc:3055] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:01.840600  8101 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:19:01.822669 14786 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.503s	user 0.000s	sys 0.014s
W20260709 13:19:01.824337  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.835229  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:01.785290 14843 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:01.841285  8101 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.825069 14846 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.825960 14516 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.726722 14822 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.852743  8254 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:01.852978 14822 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.827926 14698 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.808348 14730 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:01.835179  8104 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 19. Ops: []
I20260709 13:19:01.816730 14752 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:01.858119 14752 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.859160 14752 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:01.851608 14386 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:01.834975 14635 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.860438 14386 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.862393 14635 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.862471 14386 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.862960  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:01.837229  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:01.865236  8180 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:01.838254  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:01.835011 14743 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.866590  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.849289  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:01.854609  8101 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:01.835644 14628 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:01.867419  8107 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:01.867336  8178 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:01.867858 14722 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:01.873744 14628 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.874965  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:01.878160  8105 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:01.876179  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:01.880288  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:01.881585 14635 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:01.883340  8180 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:01.884130  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.884544  8180 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:01.887416  8180 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:01.890235  8101 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:01.890995  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3345) took 1108 ms. Trace:
I20260709 13:19:01.891419  8101 rpcz_store.cc:276] 0709 13:19:00.782621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.782749 (+   128us) service_pool.cc:224] Handling call
0709 13:19:00.783019 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.840129 (+1057110us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b54003cc6a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0dc3dc0 00007fa5a0e4e1c0 00007fa5a0e4f231 00007fa5a0e4bd8f 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c
0709 13:19:01.890757 (+ 50628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.890944 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175419776}
I20260709 13:19:01.894210  8180 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:19:01.895388 14628 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.896301  8178 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:01.897010 14471 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.897547  8178 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:01.884884 14728 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:01.899808 14728 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:01.900205 14728 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:01.900383 14516 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:01.901292  8178 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:01.893064 14801 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:19:01.906642  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:01.884864 14386 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.909863  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:01.915623  8180 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 16: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:01.918327  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.920770  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.921602  8181 raft_consensus.cc:2393] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 15: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:01.921408  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:01.910097 14846 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:01.924104  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.915674 14765 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:01.932092  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:01.933910  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:01.934219  8101 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:01.937654  8107 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:01.934741  8180 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:19:01.914638 14386 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.942014  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:01.959120 14439 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.959574 14516 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.959764 14439 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:01.960198 14516 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:01.962055  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:01.962313 14439 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:01.988762  8174 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: []
W20260709 13:19:01.993192  8176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 3001) took 2304 ms (client timeout 2009 ms). Trace:
W20260709 13:19:01.993854  8176 rpcz_store.cc:269] 0709 13:18:59.644994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.645649 (+   655us) service_pool.cc:224] Handling call
0709 13:19:01.949033 (+2303384us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b5400247a54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:01.949217 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1658931968}
I20260709 13:19:02.004220  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:02.005458  8252 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 21: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:02.007187  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:02.011687  8253 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
W20260709 13:19:02.021067  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 101793us
I20260709 13:19:02.021395  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:02.023155  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:02.027510  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:02.036106  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:02.037067  8251 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:02.039317  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.039041  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:02.076860  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.053479  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.059044  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.040630  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:02.105264  8251 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
W20260709 13:19:02.109992  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 71032.8us
I20260709 13:19:02.086809  8253 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:19:02.110818  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:02.010830 14856 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:02.114511  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:01.997397 14743 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:02.119930  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.119864  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:02.121318  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.122148  8101 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:02.122941  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.123507  8101 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:02.124289  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.124862  8101 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:02.117762  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.126196  8105 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:02.127691  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:02.111927 14596 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:01.997851 14795 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:02.132248  8790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1236) took 2333 ms. Trace:
I20260709 13:19:02.133586  8251 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:02.147661  8100 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:02.134272  8248 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:19:02.059959 14820 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:19:02.115362 14637 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:19:02.155594 14864 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:19:02.040918 14811 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:02.143596 14203 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:02.136214 14743 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.061075 14386 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:02.162778  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 906) took 1953 ms. Trace:
I20260709 13:19:02.144371  8790 rpcz_store.cc:276] 0709 13:18:59.778408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.785511 (+  7103us) service_pool.cc:224] Handling call
0709 13:18:59.818354 (+ 32843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.420296 (+601942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.111921 (+1691625us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54008a5554. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:02.112070 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1175197440}
I20260709 13:19:02.163182  8177 rpcz_store.cc:276] 0709 13:19:00.209338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.710878 (+501540us) service_pool.cc:224] Handling call
0709 13:19:00.711160 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.945632 (+234472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.162519 (+1216887us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54002486d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:02.162717 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501914368}
I20260709 13:19:02.156864 14823 raft_consensus.cc:3055] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:02.159912  8105 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:19:02.161769  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:02.136775 14817 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:02.176636  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:02.177356 14743 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:02.180734  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.181589 14386 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:02.183869 14516 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:02.157224 14755 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:02.189915 14601 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:02.193324 14458 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.193948 14458 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:02.198206  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.198711  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.171491 14823 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:02.199587 14823 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.200621 14628 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.200650 14823 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:02.201370  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2186) took 1217 ms. Trace:
I20260709 13:19:02.201198 14628 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:02.157461 14776 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:19:02.201820  8108 rpcz_store.cc:276] 0709 13:19:00.983628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.437044 (+453416us) service_pool.cc:224] Handling call
0709 13:19:01.437345 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.491020 (+ 53675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.201118 (+710098us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b54001653d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:02.201309 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122006400}
I20260709 13:19:02.203027 14596 consensus_queue.cc:1059] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:02.204327 14637 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:02.204759 14637 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.205118 14637 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:02.162891 14602 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:19:02.175673  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:02.206569 14471 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:02.206939 14471 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:02.207372 14471 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:02.207726 14846 raft_consensus.cc:3055] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:02.208112 14846 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:02.116011 14701 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:19:02.209918 14776 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:02.202237  8182 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:02.212373  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:02.157305 14203 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.219666  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:02.213492  8791 raft_consensus.cc:2410] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:19:02.213618  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:02.227559  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.227620  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:02.227892  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:02.229897  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:02.230386  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:02.231202  8788 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 14.
I20260709 13:19:02.236408  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:02.238561  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:02.239969  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:02.241410  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:02.208937 14846 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.212590 14776 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:02.251451 14737 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:02.251760 14795 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.242594  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:02.254406  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:02.255662  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:02.241691  8248 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:02.226336 14203 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:02.248021  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:02.249156  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:02.243094 14695 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:19:02.250470  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:02.261418  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.263742  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:02.264608  8250 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
W20260709 13:19:02.264905  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.234898 14752 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:02.241258 14439 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:19:02.283075  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.252058 14701 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:02.303279  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 54202.8us
I20260709 13:19:02.300522  8790 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:19:02.252076 14737 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:02.267246 14549 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:02.259320 14516 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:02.266081 14741 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:02.305944  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:02.312269  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:02.287149 14846 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:02.311666 14695 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:02.312661 14737 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:02.314178 14549 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.332113 14549 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:02.321751 14516 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.323596 14458 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:02.355973  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.356612  8101 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:02.357537  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.358253  8101 raft_consensus.cc:2410] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 22 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:19:02.358111  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.358668  8102 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:02.358987  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.267724 14795 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.259985 14728 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.318516 14741 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:02.300674 14802 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:02.360924 14602 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:02.362972 14795 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:02.364607 14728 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:02.364826 14741 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:02.365119  8782 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:02.364856 14695 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:02.364928 14802 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:02.311517 14850 consensus_queue.cc:1059] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.074s
I20260709 13:19:02.374769  8783 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:19:02.375260 14850 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:02.375661 14850 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:02.376528 14850 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.343220 14815 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:02.343662  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.343803 14516 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:02.418495  8105 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:02.309485 14439 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.300932 14722 consensus_queue.cc:1059] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:19:02.315990 14843 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.345701  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 1025) took 2525 ms. Trace:
I20260709 13:19:02.251519 14776 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.346989  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2192) took 1219 ms. Trace:
I20260709 13:19:02.351526 14637 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:02.343788 14471 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:02.353196  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.354236  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:02.380359  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.382977 14711 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:02.387324 14549 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:02.388828 14694 raft_consensus.cc:3055] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:02.359772  8101 raft_consensus.cc:2410] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:19:02.399351  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2178) took 2579 ms. Trace:
I20260709 13:19:02.395766 14737 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:02.401692  8255 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 22: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:02.314410 14653 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:19:02.310585 14811 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.404582 14695 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.405171  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.405542  8182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 2175) took 2586 ms (client timeout 1604 ms). Trace:
W20260709 13:19:02.455354  8182 rpcz_store.cc:269] 0709 13:18:59.818906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.819391 (+   485us) service_pool.cc:224] Handling call
0709 13:19:02.405334 (+2585943us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b5400180954. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:02.405466 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4601452928}
I20260709 13:19:02.408779  8099 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:19:02.458496  8099 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:02.458634  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:02.419530  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:02.424676  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:02.380796 14741 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:02.426971  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:02.432438  8104 rpcz_store.cc:276] 0709 13:19:01.127942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.447848 (+319906us) service_pool.cc:224] Handling call
0709 13:19:01.448182 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.857422 (+409240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.346714 (+489292us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b540036f6d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:02.346922 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889602304}
I20260709 13:19:02.434530  8105 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:19:02.431356  8789 rpcz_store.cc:276] 0709 13:18:59.820353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.214498 (+394145us) service_pool.cc:224] Handling call
0709 13:19:00.241014 (+ 26516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.954188 (+713174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.345457 (+1391269us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b540039d0d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:02.345642 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638509824}
I20260709 13:19:02.467355  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:02.413394 14628 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:02.438365  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:02.441629 14694 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:02.427205 14815 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:02.439327  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 85189.8us
I20260709 13:19:02.442835  8175 rpcz_store.cc:276] 0709 13:18:59.819712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.431409 (+611697us) service_pool.cc:224] Handling call
0709 13:19:01.049709 (+618300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.050050 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:19:01.052707 (+  2657us) log.cc:844] Serialized 14 byte log entry
0709 13:19:01.100147 (+ 47440us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:01.100219 (+    72us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:01.100288 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.100383 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:02.399159 (+1298776us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b5400003050. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:02.399288 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2843,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":43,"raft.queue_time_us":1480,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":2467,"spinlock_wait_cycles":1420964736,"thread_start_us":47020,"threads_started":1,"wal-append.queue_time_us":76929,"wal-append.run_cpu_time_us":1115,"wal-append.run_wall_time_us":1040529}
I20260709 13:19:02.437979 14817 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:02.489401  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:02.489871  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:02.459574  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:02.490624  8256 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:19:02.441354 14587 raft_consensus.cc:3055] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:02.441354 14655 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:02.449702 14850 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:02.453303 14776 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:02.493530  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:02.489585  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:02.495434  8178 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:02.494529  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:02.498420  8254 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:19:02.499647  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:02.506443  8182 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:02.466431 14752 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:02.470685 14728 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:02.472020 14607 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:02.470985 14799 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:02.491425 14815 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:02.511783  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:02.497538 14294 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:19:02.472523 14695 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:02.525983 14637 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:02.526405 14549 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:02.527248 14695 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:02.528559 14832 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:02.473680 14724 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:19:02.494362 14587 raft_consensus.cc:740] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:02.497339 14840 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.533672 14765 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.533917  8181 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:02.494524 14812 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:19:02.506560 14655 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:02.535390 14799 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:02.535832 14817 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:02.549367 14802 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:02.551304 14716 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:02.551424 14471 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:02.552528 14843 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:02.554495 14741 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:02.557674  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:02.574733  8099 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:02.470752 14811 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.576143  8256 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:02.558660  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:02.578296  8248 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:02.559504  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:02.579370  8253 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:02.560321  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:02.562302  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:02.564242  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.507536 14874 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:02.582034  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:02.530064 14810 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:02.573784 14716 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:02.585655  8106 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:02.589859 14655 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:02.591001 14799 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.532379 14607 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 18 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:02.576028 14817 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.535413 14516 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:02.594763  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:02.610736  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 901) took 2600 ms. Trace:
I20260709 13:19:02.611202  8174 rpcz_store.cc:276] 0709 13:19:00.010650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.695577 (+684927us) service_pool.cc:224] Handling call
0709 13:19:01.949450 (+1253873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.989387 (+ 39937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.610469 (+621082us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400247a50. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:02.610659 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2882652928}
I20260709 13:19:02.569751 14705 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:19:02.571543 14765 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.593801 14701 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:19:02.619925 14765 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:02.586109 14863 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:19:02.593609 14833 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:02.621717 14833 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:02.622532 14833 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:02.623728 14833 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:02.627869 14811 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:02.570111 14840 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.586148 14587 consensus_queue.cc:260] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.582010 14203 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.629774 14587 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:02.629843  8147 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:02.631532 14203 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:02.631748  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:02.632965  8104 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:02.633936 14607 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.596724 14737 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:02.587173 14810 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.637637  8784 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:02.638063 14810 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:02.609804 14817 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:02.646649  8107 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:19:02.647217  8251 raft_consensus.cc:2410] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:19:02.614027  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.647541  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:02.653488  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.654385  8107 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:19:02.652731  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:02.613821  8099 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
W20260709 13:19:02.686321  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 56561us
I20260709 13:19:02.688812  8147 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:02.690703 14701 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:02.696803 14815 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.699175  8100 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 15: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:02.629805 14840 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:02.702330  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 54779.8us
I20260709 13:19:02.717666  8147 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:02.724057  8147 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:02.675309 14203 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.732028  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 229197us
I20260709 13:19:02.727589  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:02.734720  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:02.734891  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 217830us
I20260709 13:19:02.737637  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:02.739089  8784 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 18: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:02.719730 14765 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:02.726177 14602 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:02.725931 14705 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:02.732079 14831 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:02.674888 14850 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:19:02.744338  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:02.746989  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:02.746989  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:02.735723 14635 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:02.768189  8248 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:19:02.745532  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:02.771409  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:02.772025 14516 raft_consensus.cc:2764] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:19:02.773824  8178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:02.774427  8178 raft_consensus.cc:606] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:02.774756  8178 raft_consensus.cc:614] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:02.772490 14695 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.777524  8253 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:02.772212  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:02.779114  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:02.743167 14737 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.780706  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:02.775906  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:02.776178  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:02.781581  8256 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
W20260709 13:19:02.796639  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.797731  8147 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:02.799225  8074 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:02.738981 14728 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:19:02.747665 14765 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:02.739353 14203 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.725268 14716 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.780019 14705 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.813081  8147 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:02.806468  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:02.819046 14655 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:02.821722 14884 raft_consensus.cc:2764] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260709 13:19:02.822346  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.772879 14832 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.750977 14812 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:19:02.827831  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:02.835584  8074 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:02.832675  8147 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:02.808213 14831 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:02.887450  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 54847.3us
I20260709 13:19:02.890575  8147 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:02.888036  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 304906us
I20260709 13:19:02.828452 14722 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:02.794746 14877 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:02.895885  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 89540.5us
W20260709 13:19:02.888999  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 53484us
I20260709 13:19:02.886336 14799 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:02.891990  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:02.800408 14695 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.834316 14603 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:02.808429 14737 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:02.897575  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:02.908601  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:02.898202 14628 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:02.892829 14815 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:02.896657 14587 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:02.919341  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:02.895026 14698 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:02.916966 14850 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:02.898568 14728 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:02.924484 14722 consensus_queue.cc:1059] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:02.925243 14728 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.925647 14765 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.927306 14728 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:02.899211 14799 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:02.928052 14799 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:02.930014  8253 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
W20260709 13:19:02.938311 14878 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:19:02.900700 14882 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:02.920348 14689 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:02.894989 14811 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:02.947150  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.947489  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:02.947220  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:02.948503  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:02.949465  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:02.836984 14705 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.940506 14822 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:02.910157 14776 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:02.954277 14823 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:02.842664 14810 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.957373  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:02.966136  8107 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:02.886992 14832 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:02.961493  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.974459  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:02.976451  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:02.978060  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:02.978835  8786 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:19:02.977224  8790 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:19:02.963573  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:02.981762  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:02.982434  8254 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:02.972071  8789 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:02.935403 14701 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:02.973358  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:02.985615  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:02.986013 14728 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:02.986207  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:02.986720  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.987378  8755 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:02.987715  8788 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:19:02.940712 14881 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:19:02.990836  8223 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:02.991808  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.995764  8104 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:02.995936 14819 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:02.996415 14819 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.996733  8104 raft_consensus.cc:3055] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:02.997146  8104 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:02.996621 14603 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:02.957885 14737 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:02.998060 14603 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:02.998507 14603 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:02.999166  8256 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:03.000319  8256 raft_consensus.cc:1240] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:03.001336 14817 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:03.002156 14889 log.cc:927] Time spent T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:03.004506 14832 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:03.007303 14799 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:02.974303 14883 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:19:03.010221 14883 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:03.010566 14883 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:03.011363 14883 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.012615 14883 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:02.959744 14776 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:03.013729 14776 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:03.013618  8179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:03.014581  8179 raft_consensus.cc:606] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:03.015028  8179 raft_consensus.cc:614] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:03.015437  8256 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:02.997906  8104 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:03.017904 14880 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:19:02.940202 14203 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:02.960556 14823 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.020167 14823 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:02.958650 14811 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.022059  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57566 (request call id 3441) took 1015 ms. Trace:
I20260709 13:19:03.022310 14635 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:03.022433 14811 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:03.022869 14635 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.993551  8221 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:02.960328 14705 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:02.959816 14727 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:19:03.024385  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:03.018034  8104 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:03.022449  8255 rpcz_store.cc:276] 0709 13:19:02.006829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.006956 (+   127us) service_pool.cc:224] Handling call
0709 13:19:03.021888 (+1014932us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b54001e5854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:03.022005 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":904964352}
I20260709 13:19:03.027498  8784 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:03.027474 14819 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:03.029917  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:03.029928  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:03.041262  8254 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:19:03.041581  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:02.963889 14810 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:03.045480  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:03.046234  8101 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 23: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:19:03.050374  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 131098us
I20260709 13:19:03.046576  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:03.051151  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:03.052167  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:03.028837 14635 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:03.057942  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:03.058015  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:03.009341 14799 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:03.058468  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:03.030117 14756 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:03.030661 14294 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:03.044440 14812 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:03.069008  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:03.073841  8782 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:03.074929  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:03.079396  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:03.085718  8177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:03.086506  8177 raft_consensus.cc:606] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:03.086926  8177 raft_consensus.cc:614] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:03.090559  8254 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:03.044632 14711 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:19:03.064921 14810 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:03.125813 14810 raft_consensus.cc:697] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:03.099684  8177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:03.127065  8177 raft_consensus.cc:606] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:03.126921 14810 consensus_queue.cc:237] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.103713 14439 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:03.114038 14882 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:03.129508 14882 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.070900 14294 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.130882 14294 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:03.131150  8100 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:03.131430 14458 raft_consensus.cc:3055] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:03.131844 14458 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:03.132391  8177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:03.132962  8177 raft_consensus.cc:606] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:03.133387  8177 raft_consensus.cc:614] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:03.090687 14799 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:03.134431 14799 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:03.134827 14799 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:03.137815 14724 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:03.138218 14724 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:03.138579 14882 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:03.119575 14694 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.139019 14724 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:03.139657 14694 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:03.140175  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:19:03.123081 14886 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:03.088537 14817 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:03.071376 14812 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:03.142213 14741 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:03.071050 14822 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:03.142769 14741 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.144264 14822 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:03.144410  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.144980 14741 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:03.075330 14727 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:03.142647 14812 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:03.151297  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.113894 14756 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.188148  8254 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
W20260709 13:19:03.270998  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.255435 14895 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:03.132867 14458 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.283960 14895 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:03.284713 14458 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:03.299611  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 230684us
I20260709 13:19:03.311867  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:03.279423 14294 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.315007  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:03.315222  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:03.313733  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:03.321825 14689 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:03.329046 14689 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:03.330972 14897 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:03.313017 14741 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.347450 14741 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:03.352206 14635 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.357342 14294 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:03.357879  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:03.358595  8182 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:19:03.358911  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:03.359481  8179 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:03.358604  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:03.362347  8177 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:19:03.322425  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:03.370699  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:03.374560  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 60900us
I20260709 13:19:03.376798  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:03.373283  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:03.398705  8178 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:03.399735  8256 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:03.355657 14635 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:03.399936  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:19:03.364112 14841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.142s	user 0.008s	sys 0.025s
W20260709 13:19:03.410290  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 87303.1us
I20260709 13:19:03.412873  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:03.402976 14294 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:19:03.405355 14841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.226s	user 0.009s	sys 0.025s
I20260709 13:19:03.422312  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:03.423228  8252 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:03.424317  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:03.398623 14694 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:03.428262  8179 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:19:03.428836  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:03.429941  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:03.430909  8257 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:03.435667  8257 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:03.436381  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:03.436910  8257 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:03.438721  8257 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: []
W20260709 13:19:03.425545 14850 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.009s	sys 0.005s
I20260709 13:19:03.420395 14695 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:03.424528 14877 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:03.420894 14741 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:03.408468 14776 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:03.445652  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:03.443109 14850 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.009s	sys 0.005s
I20260709 13:19:03.449266  8257 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:19:03.189487 14756 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.451763  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:03.444408 14877 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:03.446367 14689 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:03.438077 14694 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:03.456274  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:03.447017 14911 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:03.459357  8257 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:19:03.461252  8252 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:03.461347 14912 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:03.462152  8257 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:19:03.463043 14903 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:03.463924 14716 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:03.464341  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3372) took 1302 ms. Trace:
I20260709 13:19:03.464690  8108 rpcz_store.cc:276] 0709 13:19:02.162150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.030489 (+868339us) service_pool.cc:224] Handling call
0709 13:19:03.039928 (+  9439us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:03.045796 (+  5868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.045827 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:03.046355 (+   528us) log.cc:844] Serialized 52 byte log entry
0709 13:19:03.308390 (+262035us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:03.308451 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.308547 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.464130 (+155583us) raft_consensus.cc:1685] finished
0709 13:19:03.464149 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.464286 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5592,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":13717,"thread_start_us":223909,"threads_started":1,"wal-append.queue_time_us":255907}
I20260709 13:19:03.466161 14840 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:03.466549 14840 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:03.467356 14840 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:03.468183 14840 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:03.471145 14756 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:03.456754 14894 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:19:03.450779 14850 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:03.457573 14877 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:03.461982 14912 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.446062 14799 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:03.496826  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 45119.1us
I20260709 13:19:03.285184 14895 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:03.496824 14908 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:19:03.491940 14906 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:03.498251 14458 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:03.492611 14689 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:19:03.506361 14819 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.524981 14458 raft_consensus.cc:697] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:03.523197 14911 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:03.528448 14822 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:03.530815 14694 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:03.544116  8788 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 16: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:03.545286  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:03.524199 14850 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:03.539974 14776 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:03.538448 14918 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:19:03.557886 14458 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:03.562811  8002 catalog_manager.cc:5697] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 13 to 21, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 21 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:03.566026  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:03.565119  8002 catalog_manager.cc:5697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 18 to 20, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 20 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:03.565078 14918 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:03.584012 14799 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:03.592720 14912 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:03.600558 14802 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:03.601750 14887 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.710s	user 0.004s	sys 0.000s
I20260709 13:19:03.603232  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3456) took 1045 ms. Trace:
I20260709 13:19:03.603632  8249 rpcz_store.cc:276] 0709 13:19:02.557732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.562844 (+  5112us) service_pool.cc:224] Handling call
0709 13:19:02.565108 (+  2264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.566303 (+  1195us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:02.566345 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:02.566876 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:19:02.777078 (+210202us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:02.777125 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.777202 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.553921 (+776719us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:03.602896 (+ 48975us) raft_consensus.cc:1685] finished
0709 13:19:03.602920 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.603160 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3216,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4736,"spinlock_wait_cycles":7752064,"thread_start_us":209893,"threads_started":1,"wal-append.queue_time_us":260197}
W20260709 13:19:03.605928 14915 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:03.577190 14918 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:03.613065  8784 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:03.615175  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:03.617095 14199 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:03.617726 14819 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:03.617924 14199 consensus_queue.cc:1243] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer 5033fc7e66374940a203908ea8b0078f log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:19:03.618468  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:03.619084  8782 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:03.619521 14695 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:03.618399 14199 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:19:03.624202  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.573495 14911 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:03.619910 14695 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:03.633859  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:03.627106  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:03.625361 14722 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.012s	sys 0.020s
W20260709 13:19:03.623862 14916 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:19:03.639138 14199 consensus_queue.cc:1243] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer 5033fc7e66374940a203908ea8b0078f log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:19:03.640381 14458 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:03.617327 14918 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:03.643914 14458 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:03.644749 14918 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:03.645936 14458 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:03.614828 14840 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:03.622073 14876 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.626541 14516 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:03.641834 14471 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:19:03.648593 14722 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.012s	sys 0.020s
I20260709 13:19:03.626624 14912 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:19:03.650408 14471 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.633633 14653 consensus_queue.cc:1059] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:19:03.634703 14799 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:19:03.620074 14603 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:03.653245 14812 consensus_meta.cc:287] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.009s
I20260709 13:19:03.659031 14471 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:03.650877 14516 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.649451 14840 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:03.650920 14876 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.665031 14812 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.664338 14695 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:03.672345 14921 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:19:03.672993 14695 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:03.674002 14812 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:03.675611 14876 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:03.676306 14840 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:03.678026 14925 log.cc:927] Time spent T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:19:03.709640  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.715821 14516 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:03.670512 14603 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:03.671309 14877 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:03.722096 14877 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:03.663172 14199 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:03.724804 14199 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:03.726953 14199 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.730003 14199 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:03.760461  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:03.763327  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 946) took 1301 ms. Trace:
I20260709 13:19:03.763221 14832 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:03.764948 14832 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:03.765683 14832 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:03.767190 14832 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:03.767637  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:03.770954 14877 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:03.786842  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:03.788190  8107 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:03.789143  8255 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:03.796770  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:03.769191 14832 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:03.797879  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 65459.9us
I20260709 13:19:03.803963  8103 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:03.804289  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:03.770270  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:03.784828 14815 raft_consensus.cc:3055] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:03.810467 14724 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:03.818559  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:03.819566  8175 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:03.819852  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.824359 14776 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:03.824841 14776 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:03.829362 14653 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:03.830190 14653 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.830788 14653 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:03.828727 14776 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.838826 14776 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:03.842100  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:03.843751  8174 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 22: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:03.809927 14815 raft_consensus.cc:740] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:03.851617 14815 consensus_queue.cc:260] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.852871  8002 catalog_manager.cc:5697] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:03.854046  8180 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:03.855775  8002 catalog_manager.cc:5697] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:03.861150 14902 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:03.862078 14902 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:03.863225  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.863899  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.865087 14902 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:03.867995  8255 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:03.869715  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:03.870685  8256 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:03.871417  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.869772  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.764276  8250 rpcz_store.cc:276] 0709 13:19:02.461769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.465086 (+  3317us) service_pool.cc:224] Handling call
0709 13:19:02.493480 (+ 28394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.148868 (+655388us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:19:03.149121 (+   253us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.311145 (+162024us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:03.311229 (+    84us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:03.311284 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.762800 (+451516us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b5400070b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:03.762879 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.763146 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":579,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":137,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5576,"spinlock_wait_cycles":1506805504,"thread_start_us":159877,"threads_started":1,"wal-append.queue_time_us":276932}
I20260709 13:19:03.893183  8256 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:03.896166  8107 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:03.899858 14603 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.910588  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:19:03.911527  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 115199us
I20260709 13:19:03.917382  8182 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:03.917740 14902 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:03.918183  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:19:03.918828  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.918581 14902 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.918586  8179 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:03.919240  8182 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:03.920128  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:03.920848  8182 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:03.919037  8183 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:03.900817 14877 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:03.924126  8175 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:19:03.925968 14846 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.926528 14846 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.928781 14846 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:03.929792  8002 catalog_manager.cc:5697] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 15 to 17, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 17 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:03.905232 14603 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:03.937361  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:03.938561  8250 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:03.945822  8177 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:03.945770 14846 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.947440 14846 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.949982 14846 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:03.933993 14815 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:03.954082 14810 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:03.954829 14810 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:03.956027 14810 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.959429 14907 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:03.960152 14907 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:03.962024  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 191979us
I20260709 13:19:03.951046  8002 catalog_manager.cc:5697] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:03.965452 14902 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:03.965155 14471 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:03.966363  8176 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:03.967680 14471 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:03.963766  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:03.971355  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 59841.9us
W20260709 13:19:03.971393  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 65470.1us
I20260709 13:19:03.974344 14603 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:03.975095 14603 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:03.976172 14695 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:03.976661  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.981709  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:03.981856  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:03.982589  8788 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:03.978645 14802 consensus_queue.cc:1059] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:19:03.984269 14802 raft_consensus.cc:3055] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:03.979552 14695 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:19:03.984982 14877 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.982626  8255 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 21: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:03.984772  8002 catalog_manager.cc:5697] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 16 to 18, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 18 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:03.979751 14199 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:03.993753  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:04.008476  8180 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
W20260709 13:19:04.015597  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.016674  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.018124  8182 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:04.018270  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:04.019455  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:04.019743  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.990697 14802 raft_consensus.cc:740] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:03.992990 14199 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:04.024260  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:04.026341  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 91747us
I20260709 13:19:04.027379  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.026607  8177 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:04.029572 14877 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.032120 14877 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:04.023020 14902 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:04.034543 14902 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.035158  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:04.035396  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.035835  8103 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:04.036868  8178 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:04.036974  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:04.037915  8103 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:04.037859  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:04.038826  8106 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:04.034876  8179 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:19:04.039161  8002 catalog_manager.cc:5697] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 10 to 11, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 11 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.041373  8182 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:19:04.041494  8002 catalog_manager.cc:5697] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.042969  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:04.043789  8248 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:19:04.044015  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:04.045014  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:04.045881  8257 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:04.046964  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:04.048210  8104 raft_consensus.cc:2410] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:19:04.047994  8002 catalog_manager.cc:5697] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 16 to 18, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 18 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:04.049971 14635 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:04.050447 14635 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:04.050854 14635 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:04.041517  8107 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:04.053572 14907 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:04.019492 14832 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:04.055179 14832 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.049808  8002 catalog_manager.cc:5697] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 8 to 16, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 16 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.047029  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:04.060112  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.021824  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:04.063772 14724 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:04.064003  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:04.064746 14724 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.065825  8182 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:04.068048 14724 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:04.069008 14802 consensus_queue.cc:260] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.070957 14802 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:04.071696  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:04.074451  8102 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:04.076857  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:04.077567  8102 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:04.086913  8183 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:04.089051  8175 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:19:04.091005 14724 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.091658 14724 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.093721 14724 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:04.036908 14902 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:04.106720  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 59773.5us
I20260709 13:19:04.103343  8002 catalog_manager.cc:5697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 9 to 14, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 14 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.105172  8180 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:04.105098  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:04.106033  8106 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:04.133701  8002 catalog_manager.cc:5697] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 16 to 18, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 18 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:19:04.136492  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 160858us
I20260709 13:19:04.095023 14846 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.141872  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:04.142838  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.103361 14819 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:04.101935 14832 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:04.145030  8788 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:04.103652 14863 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.150426  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.150348  8251 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:04.153676  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:04.156256 14471 raft_consensus.cc:993] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:19:04.161705  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.129908 14907 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:04.171037  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.173738  8147 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:04.176065  8002 catalog_manager.cc:5697] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:19:04.105670  8000 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39810 (request call id 295) took 58797 ms (client timeout 15000 ms). Trace:
I20260709 13:19:04.177945  8250 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:19:04.161535 14846 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.183669  8257 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:19:04.189353  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 84414.6us
I20260709 13:19:04.190639  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.170547 14603 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:04.192457  8175 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:04.170981 14907 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:04.196317  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 48152.9us
I20260709 13:19:04.196975  8180 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:04.194778 14832 raft_consensus.cc:1081] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:19:04.202103  8183 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:04.195130 14819 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.207991 14819 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:04.208528 14819 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:04.206103 14877 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:04.209650 14877 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.210063 14877 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:04.194077 14907 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:04.213498 14199 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.214181 14924 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:04.214989 14199 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:04.214881 14924 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.217048 14924 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:04.217504 14912 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:04.218171 14912 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.218887 14846 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:04.219293  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:04.220186 14912 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:04.220253  8223 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:04.222193 14841 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:04.223308 14841 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:04.223664 14841 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.223995 14841 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:04.200572  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:04.202960  8002 catalog_manager.cc:5697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 15 to 20, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 20 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:04.231005  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.231984  8180 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 23: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:04.201274 14802 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:04.229887 14912 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:04.245556  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.246515  8180 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:04.185945 14863 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.241055 14752 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:04.238837 14802 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:04.258447 14603 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.244597 14912 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:04.269362  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:04.261504 14933 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.271663  8250 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:04.274365  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:04.276724  8251 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
W20260709 13:19:04.277997 14929 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:19:04.279361 14911 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.280093 14911 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.282110 14802 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.286806 14933 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.289973 14924 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.290674 14924 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.267082 14912 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:04.277097  8251 pending_rounds.cc:85] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 10
I20260709 13:19:04.275391 14752 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:04.300486  8257 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:19:04.275799  8002 catalog_manager.cc:5697] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 17 to 19, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 19 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:04.297585  8251 pending_rounds.cc:107] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:19:04.306867  8252 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 16: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:04.311802 14863 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:04.311890  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:04.313095  8253 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:04.313483 14882 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:04.313977 14882 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:04.315150 14882 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.316682 14882 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:04.318213 14799 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.068s
W20260709 13:19:04.326030  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.305442  8251 raft_consensus.cc:2889] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:04.333581 14695 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.334208 14695 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.336663 14695 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:04.181559  8000 rpcz_store.cc:269] 0709 13:18:05.308538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.308868 (+   330us) service_pool.cc:224] Handling call
0709 13:19:04.105371 (+58796503us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:58.385451 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:58.386053 (+   602us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:58.386103 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:18:58.386126 (+    23us) tablet.cc:662] Decoding operations
0709 13:18:58.387144 (+  1018us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:58.387218 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:58.387251 (+    33us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:18:58.388143 (+   892us) tablet.cc:701] Row locks acquired
0709 13:18:58.388198 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:18:58.388354 (+   156us) write_op.cc:270] Start()
0709 13:18:58.388498 (+   144us) write_op.cc:276] Timestamp: P: 1783603138388286 usec, L: 0
0709 13:18:58.388519 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:18:58.389233 (+   714us) log.cc:844] Serialized 3646 byte log entry
0709 13:18:59.674222 (+1284989us) op_driver.cc:464] REPLICATION: finished
0709 13:19:00.316044 (+641822us) write_op.cc:301] APPLY: starting
0709 13:19:00.316134 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:00.327324 (+ 11190us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:00.327431 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:01.157549 (+830118us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b180041c020. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa5a0b8b0ec 00007fa5a0b8daf7 00007fa5a0b8efb0 00007fa5a48a31bb 00007fa5a48ea5d4 00007fa5a47968da 00007fa5a47993cb 00007fa5a4798fd3 00007fa5a4897e34
0709 13:19:01.392200 (+234651us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:01.392557 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:19:01.392628 (+    71us) write_op.cc:312] APPLY: finished
0709 13:19:01.393019 (+   391us) log.cc:844] Serialized 89 byte log entry
0709 13:19:01.539741 (+146722us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:01.566753 (+ 27012us) write_op.cc:454] Released schema lock
0709 13:19:01.566804 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:01.595874 (+ 29070us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:01.609936 (+ 14062us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52171,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":604101,"apply.run_cpu_time_us":47315,"apply.run_wall_time_us":1275451,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41729,"num_ops":9,"prepare.queue_time_us":237823,"prepare.run_cpu_time_us":79780,"prepare.run_wall_time_us":493306,"raft.queue_time_us":473203,"raft.run_cpu_time_us":40906,"raft.run_wall_time_us":362249,"replication_time_us":1255496,"spinlock_wait_cycles":44657024,"thread_start_us":1438478,"threads_started":5,"wal-append.queue_time_us":994631,"wal-append.run_cpu_time_us":26094,"wal-append.run_wall_time_us":2466926}]]}
I20260709 13:19:04.273074 14653 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.273957 14635 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.310506 14933 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:04.346849  8002 catalog_manager.cc:5697] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 9 to 20. New cstate: current_term: 20 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:04.360510  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.361387  8177 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:04.364602  8174 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 22. Current term is 23. Ops: []
W20260709 13:19:04.381935  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.350405 14924 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:04.385190  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.399641  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.300511 14752 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.410007  8002 catalog_manager.cc:5697] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:04.407310  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:04.399408 14799 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.430224  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.434216  8180 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:04.381080 14841 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:04.438670  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 181872us
I20260709 13:19:04.451103  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:04.452209  8251 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 16: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:04.441771 14924 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:04.454353 14924 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.457139 14924 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:04.461526  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:04.462311  8108 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:19:04.463160 14799 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.442327  8253 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:04.468981 14756 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:04.481226 14302 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:04.487874 14756 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.488018 14302 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.488548 14907 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.481995  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:04.450760 14724 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:04.483620 14911 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:04.484781 14635 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:04.485926 14938 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:19:04.486178  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:04.486763 14863 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.494415  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.500018  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:04.470497 14934 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 13:19:04.470733 14922 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:19:04.511394  8257 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:04.510169  8255 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
W20260709 13:19:04.515969  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.509677  8002 catalog_manager.cc:5697] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:04.517899  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.518522  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.519121  8174 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:04.517951  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.520304  8183 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:19:04.518069  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.521010  8175 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:04.525691  8253 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
W20260709 13:19:04.531682  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.534190  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.534879  8182 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:19:04.534680 14877 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.535985  8002 catalog_manager.cc:5697] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 13 to 19, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 19 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.536760 14877 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:04.538201  8180 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:19:04.538580  8180 pending_rounds.cc:85] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 9
I20260709 13:19:04.538805  8180 pending_rounds.cc:107] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:19:04.539042  8180 raft_consensus.cc:2889] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:04.500205 14603 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.497309 14302 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:04.559531  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 452652us
W20260709 13:19:04.560525  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.514407 14695 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:04.573990  8177 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 10. (term mismatch)
I20260709 13:19:04.537384 14877 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:04.574429  8177 pending_rounds.cc:85] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 9
I20260709 13:19:04.580013  8177 pending_rounds.cc:107] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 13:19:04.546000 14756 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:04.580399  8177 raft_consensus.cc:2889] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:04.584894 14695 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.587986 14653 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:04.588269  8102 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:04.589499 14695 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:04.590206  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.569600 14802 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.574770 14799 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:04.545182 14724 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.593008  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:04.603436  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.579806 14877 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:19:04.604372  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.567472 14863 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.620688 14635 consensus_queue.cc:1059] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
W20260709 13:19:04.626132  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 140090us
I20260709 13:19:04.596508 14756 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:04.603575 14810 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:04.618841 14877 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:04.582278 14603 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.583458 14912 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.631505  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:04.594623 14302 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:04.633826  8788 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:04.626463 14924 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:04.639406  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:04.632202 14199 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.642604  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:04.633603 14635 raft_consensus.cc:3055] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:04.643163  8255 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:04.643944 14907 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:04.644253  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:04.644800  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:04.645772  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:04.626533 14802 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.647756  8257 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
W20260709 13:19:04.656711  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 81027.9us
I20260709 13:19:04.658581  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:04.659083  8074 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:04.659732 14942 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:19:04.660545 14815 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:04.661780 14850 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:04.648002 14653 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:19:04.663280 14653 raft_consensus.cc:3055] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:04.663429 14850 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:04.663700 14653 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:04.663880 14850 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:04.665249 14850 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.661988 14815 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:04.654013 14302 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.670430 14302 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:04.670888 14802 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:04.672353 14850 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:04.672717 14603 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:04.674654  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:04.675529  8788 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:19:04.672592  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:04.647315 14841 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:04.680883 14949 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 25.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:04.680850 14302 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:04.699227 14949 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:04.683337  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:04.685757  8256 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:19:04.699612 14949 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:04.700599  8223 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:04.700567 14949 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.701707 14953 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:04.702047 14949 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:04.702251 14302 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:04.702718 14302 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:04.703099 14302 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:04.687148 14912 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:04.647065 14635 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:04.681124  8250 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:04.691982 14724 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:04.636534 14810 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:04.697885  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 70686.4us
I20260709 13:19:04.664845 14653 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:04.736554  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 94577.6us
I20260709 13:19:04.702088  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:04.738080  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 79111.4us
I20260709 13:19:04.648183 14199 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.648507 14756 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.738750  8147 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:04.745595 14603 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:04.745997 14603 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.746356 14603 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:04.751609 14635 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.752933 14635 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:04.760728 14756 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:04.766580 14940 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.767210 14940 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:04.750028  8221 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.555s (SENT) [suppressed 8 similar messages]
W20260709 13:19:04.771057  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 69049.8us
I20260709 13:19:04.772346 14653 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:04.769024  8250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57566
I20260709 13:19:04.773875  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:04.774619 14199 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:04.775406 14874 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:04.776122  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:04.777418  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:04.777657  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:04.778280  8788 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:19:04.779296 14802 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:04.779412  8147 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:04.780365 14695 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:04.775308  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:04.780862  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:04.787434  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:04.785758 14832 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:04.805699 14724 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:04.806085 14832 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.806305 14955 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:04.806505 14832 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:04.806823 14955 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.807202 14955 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:04.807277 14882 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:04.807948 14882 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.782769 14863 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:04.809538 14756 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.830220  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.846797  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 96789.1us
I20260709 13:19:04.853943 14966 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:04.807943 14302 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:04.858949  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 49324.7us
I20260709 13:19:04.842821 14912 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.863397  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 45805.8us
I20260709 13:19:04.879022  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:04.883294  8255 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:04.858440 14966 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.858680 14874 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:04.892517  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:19:04.893858  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.894125  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:04.895618  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:04.900470  8108 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:04.897711  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.899271  8102 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:04.891820  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.898394  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:04.900606  8250 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:04.851755 14756 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.905848  8250 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:04.896903 14966 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:04.880661 14940 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:04.890492 14882 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:04.912565  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:04.914974  8180 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:04.915241  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 58391.1us
I20260709 13:19:04.916563  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:04.889941 14199 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.917414  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.917933 14850 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:04.920768  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:04.932150 14953 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:04.932258  8174 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:19:04.933290 14199 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.935575 14199 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:04.914140  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:04.935639 14877 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:04.904282 14874 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:04.937371 14874 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:04.937551  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:04.938865  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:04.903445 14799 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:04.949517 14940 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:04.960888  8104 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:04.946046  8102 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:04.946683  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:04.881057 14912 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.961712  8180 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
W20260709 13:19:04.961083  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 44635.4us
I20260709 13:19:04.928893 14924 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:04.967085  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:04.967425  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:04.967857  8099 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:04.969617 14924 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:04.970815  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:04.972733  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:04.925113 14603 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.973601 14911 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:04.973486 14967 consensus_queue.cc:1059] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 13:19:04.974714 14653 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:04.975395 14603 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:04.977523 14850 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.996708  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 57799.5us
I20260709 13:19:04.926182 14302 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.008908  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:04.998772  8178 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:19:05.026281  8108 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:05.008944  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:05.028543  8250 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.052584  8782 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:05.053136  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 190478us
W20260709 13:19:05.054180  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 45411.5us
I20260709 13:19:05.006865 14756 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:05.049296 14695 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:05.005793 14924 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:05.016626 14907 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:19:04.975414 14653 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:04.997818 14850 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.027586 14815 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:19:05.005071 14955 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.060484 14799 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:05.057615 14967 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:05.072690 14724 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:05.076300 14724 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.078670 14724 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.079780 14964 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:05.080036 14974 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.080487 14964 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.081792 14971 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.064818 14940 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 18 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:05.082425 14971 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.088302  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.086210 14199 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.098554  8223 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.106168  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.106582 14955 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:05.107337 14955 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:05.107753 14955 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:05.108142 14955 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:05.108753  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.109455  8108 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:05.109562 14724 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:05.110375 14724 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:05.110544 14302 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:05.111279 14302 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:05.110678 14952 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.111483 14724 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.112181 14952 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.113161  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:05.113693  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:05.113991 14965 raft_consensus.cc:3055] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:05.114245 14952 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:05.114437 14965 raft_consensus.cc:740] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:05.115203  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:05.115578 14965 consensus_queue.cc:260] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.117031 14965 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:05.112185 14302 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.117847  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:05.118564  8183 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:05.119681  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:05.120362  8179 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:05.080756 14974 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.122653  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:05.125473  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:05.126358 14841 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:05.126631  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 71670.3us
I20260709 13:19:05.072976 14756 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.128018  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:05.131217  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 79603.4us
I20260709 13:19:05.089975 14199 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.119704 14653 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.151782  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.154033  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.155113 14907 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:05.157395 14940 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.161743 14977 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.162351 14977 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.164456 14977 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:05.164954 14977 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:19:05.165652  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.166422 14962 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:05.151132 14964 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.167218  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.166961 14962 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.170935  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:05.171290 14962 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:05.169759 14756 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.177090  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.177663  8102 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:05.178052  8107 raft_consensus.cc:2410] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 16 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:19:05.134991 14949 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:05.179023 14949 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:05.179173  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.179960  8099 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:05.180516 14962 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.133536 14841 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:05.181726  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:05.181908 14799 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:05.182358  8106 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:05.183231  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:05.179423 14949 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:05.191551  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 60479.1us
I20260709 13:19:05.185108  8250 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:05.186534  8179 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:05.181031  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:05.193765  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:05.194320  8100 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:19:05.194239  8106 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:05.195104  8782 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:19:05.196903  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:05.197633  8174 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:05.204027  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:05.205170  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:05.206000  8176 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:05.206888  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.207806  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:05.210304  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.211369  8107 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 22: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:05.198127  8174 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:05.212975  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:05.209470  8149 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:05.209313  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.214287  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.181094 14911 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:05.218724  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:05.218498  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.219564  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:05.221119  8256 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:05.215271  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.204574  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:05.227192  8257 raft_consensus.cc:2368] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
I20260709 13:19:05.230767  8103 raft_consensus.cc:2410] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:19:05.182385 14799 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:05.226670  8252 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:05.236656  8101 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:05.233143  8223 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.239573  8105 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:19:05.191547 14756 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.242319  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.141614 14815 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:19:05.169862 14971 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:05.133261 14967 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.249692  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:05.253170  8106 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:05.251622  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:05.247722  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:05.254755  8182 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:05.255627  8174 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.257017  8174 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:05.170629 14907 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 13:19:05.218457 14877 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:05.263383  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 128667us
I20260709 13:19:05.264328  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.206074 14924 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:19:05.263012  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.248040 14799 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:05.247394 14953 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:05.264207  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:05.273931  8182 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:05.278144  8251 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:19:05.166715 14695 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.280059  8181 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:05.226253 14952 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:19:05.288977  8106 raft_consensus.cc:2410] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:19:05.258069 14756 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:05.289988 14970 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:05.290496 14756 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:19:05.290652  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 81271.4us
I20260709 13:19:05.291481 14815 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.265537 14302 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:05.291566 14756 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.292207 14815 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.292511 14302 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:05.293846 14302 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.296653  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.297370  8107 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:05.297506  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.298342  8106 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 11.
I20260709 13:19:05.301000  8248 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:19:05.277536 14964 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:05.279548 14912 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:05.299196 14635 consensus_meta.cc:287] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.004s
I20260709 13:19:05.308457 14974 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:05.312053 14940 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:05.290470 14970 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.298213 14832 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.313733 14970 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:05.315572  8174 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
W20260709 13:19:05.316395  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.318075  8788 raft_consensus.cc:2410] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:19:05.289206 14953 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:19:05.330539  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 147368us
I20260709 13:19:05.331321  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:05.334890  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.335273 14815 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.336362  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:05.337023  8248 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:05.326565 14940 raft_consensus.cc:697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 16 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:05.338446 14940 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.307101 14850 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.341989  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:05.326881 14989 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:19:05.349692 14850 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:05.334288 14724 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.345167  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.350147 14850 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:05.350888  8074 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:05.351151 14850 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:05.351426 14951 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.693s	user 0.001s	sys 0.004s
I20260709 13:19:05.350827  8791 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:05.353933 14815 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:05.354375 14815 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.354300 14949 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.354844 14815 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:05.356557 14924 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:19:05.360806  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.331688 14199 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.367297  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:05.369899  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:05.374173  8791 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:05.377029  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:05.382309  8223 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.371978 14962 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:05.374053 14966 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.350828 14724 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.414593 14967 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.374368 14874 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.415928 14832 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.377650 14974 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:19:05.434124  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.434360 14841 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:05.435384 14949 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.469770  8254 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:05.377629 14964 raft_consensus.cc:2764] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:19:05.395768 14990 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:05.470906 14990 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.471325 14990 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:05.471537  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 97592.1us
W20260709 13:19:05.472229  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.403163 14953 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.474485  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:05.475245  8102 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:05.436870 14911 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:05.437364  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.483623  8786 raft_consensus.cc:2410] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:19:05.484784  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.484923 14990 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.485816  8786 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:05.486891  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.438488  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.439502  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.488418 14990 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.489537  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.490518  8787 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:05.491434  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.439952  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.440909  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:05.363412 14924 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:19:05.493986  8789 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:05.391498 14993 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:19:05.382256 14802 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:05.393209 14989 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:05.371742 14912 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:05.442998  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:05.496364 14912 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:05.496719  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 53821.2us
I20260709 13:19:05.497915  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.498696 14912 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.434202  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:05.499341  8183 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:19:05.499779 14953 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:05.500365 14953 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:05.460675  8791 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:05.501241 14961 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:05.462594 14933 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:05.501820 14961 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:05.501345 14953 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.502291 14961 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:05.503868 14752 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.504441 14752 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.463383  8783 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:19:05.463533 14948 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.797s	user 0.000s	sys 0.005s
I20260709 13:19:05.465221 14724 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:05.466138  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 93154.9us
I20260709 13:19:05.507654  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.508697  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:05.488428  8785 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 21: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:05.511471 14961 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.468678  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.436165 14810 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:05.514065 14961 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.515969  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:05.516768  8179 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:05.524138  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.524986  8099 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:05.525805 14752 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:05.527706  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:05.525008  8790 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:19:05.530298  8223 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.530735  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.531490  8099 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:05.532054  8181 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:19:05.533473  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:05.534595 14961 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:05.535028 14961 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.535418 14961 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:05.536437  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.537581 14949 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:05.538273 14949 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:05.539513 14949 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.531983 14724 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:05.551064 14724 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.551599 14724 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:05.467403 14970 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.566751 14962 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:05.567454 14962 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.567879 14970 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:05.462051 14952 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:05.569722 14952 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:05.570175 14982 log.cc:927] Time spent T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.307s	user 0.002s	sys 0.004s
I20260709 13:19:05.573359 14874 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:05.570168 14952 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:05.577975 14997 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:19:05.581583 14955 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.584087 14955 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.584826 14933 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:05.585248 14933 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:05.586428 14832 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.586172 14933 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:05.587078  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 118482us
I20260709 13:19:05.586934 14815 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.587471 14933 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:05.587918  8149 leader_election.cc:400] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
I20260709 13:19:05.588248  8149 leader_election.cc:403] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:05.588918  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:05.589238  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.591181  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.594394  8183 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:05.597852 14965 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:05.598311 14965 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.598694 14965 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:05.599359  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.600610  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:05.598923  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.595656  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.603092  8102 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:05.601197  8783 raft_consensus.cc:2376] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19. Re-sending same reply.
I20260709 13:19:05.572253 14850 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.605378  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:05.597863  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:05.608048  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.608592  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.614272  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:05.614945  8103 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:05.617558  8182 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:19:05.618438  8784 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 21: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:05.618578  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:05.619204  8099 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:05.620317  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:05.620476  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:19:05.620814  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 113243us
I20260709 13:19:05.622401  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.619511  8179 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:05.625473  8789 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:05.626644  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.623299  8787 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:05.593532 14815 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.631299  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.632937  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:05.627570  8785 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:05.586946 14832 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.636778 14832 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.637745  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.638445  8789 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:19:05.638275 14799 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.639487  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.640216  8789 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:05.637909  8783 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:05.640611 14799 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:05.641749  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.646414  8786 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:05.609094 14970 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:05.649930  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.607261 14974 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
I20260709 13:19:05.621347 14967 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:05.619269 14752 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.656213  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.627271 14912 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:05.665633  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.665750 14912 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.666396 14912 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:05.666977  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:05.667596  8104 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:05.668515  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:05.669946  8101 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:05.670674 14984 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:05.671166  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:05.671439 14984 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.673730  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.675685  8790 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:19:05.645622 14962 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:05.660388  8102 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
W20260709 13:19:05.661175  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.661834 14994 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.662400  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.662746  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:05.663416 14966 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.663805  8253 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:19:05.649706 14653 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:19:05.664347  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:05.689028  8787 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 21: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:05.646140 14989 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:05.714995  8251 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:05.678829  8099 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:05.689476  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.689574  8250 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 20: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:05.629786 14695 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.058s
I20260709 13:19:05.689805  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:05.664005 14952 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.652227 14967 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.713354  8183 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:19:05.713768  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:05.714197  8174 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 21. Current term is 22. Ops: [20.13-21.14]
I20260709 13:19:05.664964  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:05.716197  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:05.721350  8256 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:05.717062  8248 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:05.720878  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:05.723160  8257 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:19:05.727384  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:05.728765 14966 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:05.736949  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:05.733114  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:05.660516 14752 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.721829 14877 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.740706  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:05.762331  8183 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:05.741151  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:05.741618  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:05.763723  8176 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:05.763772  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.758622  8787 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 21: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:05.740576  8174 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:19:05.723090 14967 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:05.759380  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:05.734524 14815 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.732718 14973 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:05.766279  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.770723  8785 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:19:05.766737  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:05.719715 14802 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:19:05.773046  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:05.759248 14993 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.772056  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:05.774717  8176 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
W20260709 13:19:05.777514 15002 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:05.778415  8251 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:19:05.788000  8174 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:05.788926  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:05.720914 14989 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.766469 14990 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.791206  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:05.782781  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.717389 14994 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.797570  8176 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:05.798599  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:05.799309  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.800113  8785 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:05.802127  8250 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:05.765666 14966 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:19:05.764881 14877 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.782836 14964 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:05.811712 14964 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:05.805435  8183 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:05.812455  8252 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:05.822181  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.782322 14911 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:19:05.772948 14815 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.801764 14965 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.828347  8785 raft_consensus.cc:2410] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:19:05.807716 14984 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.781996 14993 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.814332 14964 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:05.837296  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:19:05.838330  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55621.9us
I20260709 13:19:05.840884  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:05.841228  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:05.842417  8251 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 16: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:05.843318  8176 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:05.824707 14973 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:05.828605 14850 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:05.801188 14990 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:05.853279 14752 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:05.853448 14877 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:05.825906 14966 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 13:19:05.856356  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.862632  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.858755  8103 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:05.860210 14995 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:05.847265 14973 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.866935 14995 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.861891 14932 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:05.936093  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 2234) took 1037 ms. Trace:
I20260709 13:19:05.888789  8181 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:05.938568  8181 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:05.939854  8251 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: []
W20260709 13:19:05.883802  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:05.940953  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 49802.1us
I20260709 13:19:05.888047  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:05.937925  8177 rpcz_store.cc:276] 0709 13:19:04.876201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.876526 (+   325us) service_pool.cc:224] Handling call
0709 13:19:05.888429 (+1011903us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54001c2ad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:05.913742 (+ 25313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110430976}
I20260709 13:19:05.962678  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:05.868721 14973 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:05.881608 15000 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.153s	user 0.000s	sys 0.002s
I20260709 13:19:05.962678  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:05.948612  8181 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.941954  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:05.974023  8181 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:05.877756 15004 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.881769 14932 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:05.979089  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:19:05.877857 15003 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.203s	user 0.000s	sys 0.002s
I20260709 13:19:05.882938 14993 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:05.882997 14952 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.884769 14990 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:05.962311 15011 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:05.878965 14995 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:05.878247 14994 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:05.992908  8072 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:05.994931  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:05.984998  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:05.884712 14961 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.995553  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:05.879846 14967 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:05.877398 14989 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:05.999336  8181 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 13:19:05.984437 14932 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:06.003676  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:05.998831  8254 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:06.006084  8180 raft_consensus.cc:2393] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:06.004540  8181 pending_rounds.cc:85] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 12
I20260709 13:19:06.007601  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:06.008204  8181 pending_rounds.cc:107] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:19:06.008558  8181 raft_consensus.cc:2889] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:06.009872  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:06.010524  8180 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:06.012472 15013 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:06.012676  8221 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:06.013087 15013 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.013582 14877 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:06.015331 15013 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:06.016124  8221 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:06.016963 14877 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:06.018532 14877 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:06.026348  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:06.027107 14695 raft_consensus.cc:3055] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:06.027235 14877 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:06.027962 14695 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:06.030162 14815 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:06.031772  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:06.051910  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:06.052690  8174 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 17: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:05.984582 15004 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.055711 15004 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:06.056293 14954 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 1.397s	user 0.004s	sys 0.000s
W20260709 13:19:06.056950  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.057441 14965 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:06.061558 15010 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:06.062103 15010 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:06.062517 15010 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:06.069734  8755 connection.cc:256] RPC call timeout handler was delayed by -1.3850075959999231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260709 13:19:06.070322  8755 connection.cc:256] RPC call timeout handler was delayed by -1.3513228440001512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
W20260709 13:19:06.070680  8755 connection.cc:256] RPC call timeout handler was delayed by -1.2093965189999381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28130000000000005s for a response
I20260709 13:19:06.003065 15011 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:06.071768  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:06.072041 15011 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.074115  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:06.074783  8175 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:19:06.075703  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:06.038226  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:06.078305  8253 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:06.078943 14961 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:06.079490  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:06.079665  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:06.080098  8072 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:06.081046  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:06.032241 15015 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:06.090448  8174 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 21. Current term is 22. Ops: [21.10-21.10]
I20260709 13:19:06.082826 14967 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:06.083014 14990 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:06.083382  8178 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:06.083820 14874 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:06.069909 14992 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:06.041325 14912 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.085749  8182 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:06.116612  8072 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:06.156728  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:06.029251  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:19:06.069237 14996 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.632s	user 0.002s	sys 0.000s
I20260709 13:19:06.153297  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:06.160153  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:06.157620  8251 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:06.161804  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:06.166777  8177 raft_consensus.cc:2393] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 16: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:06.165119  8254 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:19:06.082835 14911 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:06.171216  8182 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:19:06.171572  8182 pending_rounds.cc:85] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 13
I20260709 13:19:06.171777  8182 pending_rounds.cc:107] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:19:06.172015  8182 raft_consensus.cc:2889] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:06.180347  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:06.181922  8174 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:19:06.181799  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:06.183045  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:06.184448  8100 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: []
W20260709 13:19:06.184739  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 113060us
I20260709 13:19:06.150490 15004 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:06.185395  8174 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: []
W20260709 13:19:06.186220  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 376071us
I20260709 13:19:06.191382  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:06.191962  8790 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:06.192394  8174 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:06.187275  8147 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:06.194216  8174 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:06.195390  8174 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:19:06.195659 14967 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:06.196329 14967 raft_consensus.cc:697] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:06.156427 14992 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:19:06.176054 14724 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.004s
I20260709 13:19:06.199203  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:06.208315  8100 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:06.200304  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:06.203735  8790 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:19:06.199261  8251 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:06.161491 14815 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:06.209728  8106 raft_consensus.cc:2410] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:19:06.208189  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:06.221894  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:06.228502  8103 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:06.230257  8180 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:19:06.232223  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:06.251696  8782 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:06.234097 14924 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:19:06.234771 15012 log.cc:927] Time spent T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260709 13:19:06.236011 14911 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:06.029295 14695 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.238003  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:06.287068  8107 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:19:06.287564  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:06.288560  8099 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 23: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:06.238790 14998 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:06.246770  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:06.250231  8104 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:06.250749  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:06.214815 14724 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.278939  8102 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:19:06.199800 14302 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:06.286921  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:06.217572 14815 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:06.304661  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 73329.4us
W20260709 13:19:06.305454  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 54786.8us
W20260709 13:19:06.278360 14953 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.033s	sys 0.048s
I20260709 13:19:06.311230  8074 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:19:06.312644  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 283462us
I20260709 13:19:06.312904  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:06.315339  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:06.316172  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:06.316226  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:06.313835  8149 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:06.318106  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:06.209673 15004 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.324880  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:06.325281 15031 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:06.325709  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:06.325862 15031 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:06.326045 14724 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:06.326581  8257 raft_consensus.cc:2368] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21.
I20260709 13:19:06.326433 15031 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:06.327270 15019 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:19:06.327754  8255 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 24: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:06.312500 14603 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:06.329396 14799 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:06.329948 14799 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:06.330489  8256 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:06.330826 14799 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.332908  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:06.334092  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:06.336202 14907 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:06.336705 14907 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:06.338397  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:06.339215  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:06.340004  8102 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:19:06.339929  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 62569.7us
I20260709 13:19:06.341822  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:06.342636  8149 leader_election.cc:400] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21.
I20260709 13:19:06.342952  8149 leader_election.cc:403] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:06.344034 14776 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:19:06.344894  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:06.345824 14603 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:06.347231 14653 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:06.347666 14653 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:06.348075 14653 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:06.349016 14978 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:06.348821 14907 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:06.350347 15017 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:19:06.350819 14199 raft_consensus.cc:3055] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:06.351032  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:06.351312 14199 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:06.341059  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:06.325556  8782 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:06.340411  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:06.355443  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:19:06.308643 14970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.019s	sys 0.018s
I20260709 13:19:06.249253 14964 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:06.317087 14953 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.033s	sys 0.048s
I20260709 13:19:06.362594  8788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48110 (request call id 1880) took 1407 ms. Trace:
I20260709 13:19:06.368745  8788 rpcz_store.cc:276] 0709 13:19:04.946236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.946417 (+   181us) service_pool.cc:224] Handling call
0709 13:19:06.353397 (+1406980us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b540038e854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:06.353561 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816824704}
I20260709 13:19:06.312707 14874 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.314122 14815 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:06.317592 14695 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:06.370810  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:06.370328  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:06.321583 14965 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:06.353245 14971 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:19:06.362732 14970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.020s	sys 0.018s
I20260709 13:19:06.389662 14961 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
W20260709 13:19:06.390152 15020 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:19:06.231349 14967 consensus_queue.cc:237] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.357759 14978 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:06.400085  8250 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:06.400100  8177 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:06.321734 14911 consensus_queue.cc:1059] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:19:06.319101 15010 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.405925 14965 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.450847 14965 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:06.451706 15010 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:06.453991  8108 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:06.392657 14874 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.454636  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:06.455281  8103 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:06.321384 14832 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:19:06.455930  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:06.456292 14832 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:06.456704 14832 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:06.427132  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:06.457500 14832 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.458747 14832 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:06.460229 14653 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.459865 15031 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.432380  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:06.430469  8782 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:19:06.415613  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:06.433368  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:06.434727 15027 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:19:06.436568  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:06.436967 14978 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:06.437845 14912 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:06.412061 14971 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.412281 15013 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:06.438818  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:06.442139 14964 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:06.352412 14199 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.359046 14992 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.530344 14992 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:06.412501 14970 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:06.449066 14932 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.449842 14911 raft_consensus.cc:3055] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:06.456065 14874 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:06.466995  8147 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:06.378621 14302 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:06.484308  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:06.588366  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 121445us
W20260709 13:19:06.593719  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.499951  8100 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:19:06.501324  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:06.596464  8108 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:06.502694  8788 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:19:06.438102  8101 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:19:06.508260  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:06.598095  8102 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:06.412505 14841 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:06.465274 14776 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21.
I20260709 13:19:06.526491 14974 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
W20260709 13:19:06.474960 14802 consensus_queue.cc:1175] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9480609eccc44250a4d7fcc9686e76cf" responder_term: 24 status { last_received { term: 22 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 23. Current term is 24. Ops: [23.14-23.14]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:06.528942  8103 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:06.503350 15010 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:06.540706  8179 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
W20260709 13:19:06.554116  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:06.510157 14973 consensus_meta.cc:287] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.527s	user 0.003s	sys 0.007s
W20260709 13:19:06.561406  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.501956 14989 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:06.513695 14971 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:06.605671  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 289544us
I20260709 13:19:06.706984  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:06.707491  8074 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:06.615043  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 130857us
I20260709 13:19:06.708562  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:06.616756  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:06.618405 14603 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:06.618628 14970 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.619829 15013 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:06.621070 15004 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:06.625490 15027 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:19:06.564116 14911 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:06.563642 14964 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.629382 14965 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.635284 14932 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:06.649946  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:19:06.650470 14995 consensus_meta.cc:287] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.000s
I20260709 13:19:06.650576 14841 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:06.713356  8102 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:06.735543  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:06.721556  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.736366  8183 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:06.731647  8101 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:06.731849  8179 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:06.730465  8108 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 12.
I20260709 13:19:06.748219  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2255) took 1186 ms. Trace:
I20260709 13:19:06.752383  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:06.753237  8177 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:19:06.755887  8149 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:06.756906  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:06.758908  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.759922 14832 consensus_queue.cc:1059] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:06.761202 14832 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:06.761767 14832 raft_consensus.cc:697] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:06.761831 15011 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:06.762653 15011 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.762928 14832 consensus_queue.cc:237] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.765609 14912 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:06.765764 15013 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:06.766155 14912 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:06.766295 15023 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.766763 15023 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.767138 14912 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.770524 14989 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:06.771039 14989 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:06.771981 14989 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.773922 14911 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.775300 14911 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:06.776042  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:06.776741  8102 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:06.740931 14995 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.779124  8104 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 19: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:06.780092 14995 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:06.781385  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.781796 14989 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:06.782181 14841 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.723093 14776 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:06.775168  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:06.748765  8181 rpcz_store.cc:276] 0709 13:19:05.550820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.551196 (+   376us) service_pool.cc:224] Handling call
0709 13:19:05.888584 (+337388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.009105 (+120521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.736850 (+727745us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54001c2ad0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:06.736957 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773096832}
I20260709 13:19:06.789139  8102 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:06.789619  8108 raft_consensus.cc:2393] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 18: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:06.784168  8177 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:06.766158  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:06.786253  8179 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:06.793030  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:06.727892 14603 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:06.733893 14964 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.707232 15010 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.798874  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:06.765290 15011 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:06.706779 14973 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.797845 14932 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.798077 14990 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:06.844766  8175 raft_consensus.cc:2368] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 20. Current term is 21.
W20260709 13:19:06.846000  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 443650us
I20260709 13:19:06.848191  8755 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:06.852903  8248 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:19:06.825953 15023 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:06.831293 15038 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:19:06.858385 14907 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.030s	sys 0.066s
I20260709 13:19:06.801304 14799 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:19:06.841610 14990 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.844305 14992 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:19:06.864439 14907 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.030s	sys 0.066s
I20260709 13:19:06.871815  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:06.872216 14965 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:06.872491  8257 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:06.870837  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3403) took 1596 ms. Trace:
I20260709 13:19:06.871481 14990 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:06.865103 15038 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.873878 15038 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:06.835937 14932 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.878155  8105 rpcz_store.cc:276] 0709 13:19:05.265888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.266080 (+   192us) service_pool.cc:224] Handling call
0709 13:19:05.289320 (+ 23240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.303370 (+ 14050us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:06.214674 (+911304us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b180030f700. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5c455 00007fa5a48443c7 00007fa5a0e569a7 00007fa5a0e660bf 00007fa5a0e66038
0709 13:19:06.404428 (+189754us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.840093 (+435665us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.843646 (+  3553us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:06.843705 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.843802 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.861860 (+ 18058us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25720,"prepare.queue_time_us":24663,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":34888,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":13312,"spinlock_wait_cycles":7606144,"thread_start_us":476612,"threads_started":2}
I20260709 13:19:06.881758  8100 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:06.882282  8100 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:06.883183  8100 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.850020 14815 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.888542  8107 raft_consensus.cc:2368] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 20. Current term is 21.
I20260709 13:19:06.889616 14603 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.894950  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 3083) took 1156 ms. Trace:
I20260709 13:19:06.895421  8248 rpcz_store.cc:276] 0709 13:19:05.738568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.738743 (+   175us) service_pool.cc:224] Handling call
0709 13:19:05.763919 (+ 25176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.849846 (+1085927us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400290520. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0dc3dc0 00007fa5a0e4e1c0 00007fa5a0e4f231 00007fa5a0e4bd8f 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c
0709 13:19:06.853332 (+  3486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.894611 (+ 41279us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54002e8e54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:06.894871 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":908156928}
I20260709 13:19:06.897753 14799 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:06.898308 14799 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:06.899403 14799 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.900959 15031 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:06.903364 14850 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:06.861575 14978 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.903788 14850 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:06.904673 14850 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.905139  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:06.905864  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:06.906553  8250 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:06.907792  8253 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:06.910112 14874 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:19:06.910532  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.910679 14874 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 20 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:06.911923 14874 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:06.918107  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:06.919154 14302 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.920029  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 3082) took 1185 ms. Trace:
I20260709 13:19:06.920406  8255 rpcz_store.cc:276] 0709 13:19:05.734993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.735287 (+   294us) service_pool.cc:224] Handling call
0709 13:19:06.919823 (+1184536us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b5400268254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:06.919952 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287661824}
I20260709 13:19:06.924741  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 3060) took 1243 ms. Trace:
I20260709 13:19:06.925148  8178 rpcz_store.cc:276] 0709 13:19:05.681178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.681725 (+   547us) service_pool.cc:224] Handling call
0709 13:19:05.712953 (+ 31228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.156072 (+443119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.924521 (+768449us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54003408d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:06.924683 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":851414912}
I20260709 13:19:06.926859 14653 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:06.929550  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:06.930578  8180 raft_consensus.cc:2393] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:06.919770 14302 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.943496  8100 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:06.955523  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:06.956856  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:06.957659  8255 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:06.969928  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:06.972174  8223 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:06.972599  8257 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:06.964332 14199 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:06.979236  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:06.981381  8180 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:06.982169  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:06.983208  8147 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:06.989884  8100 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
I20260709 13:19:06.990414  8100 pending_rounds.cc:85] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 10
I20260709 13:19:06.990758  8100 pending_rounds.cc:107] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 21.11
I20260709 13:19:06.991349  8100 raft_consensus.cc:2889] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:06.991400  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:06.964602 15028 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.964818 15004 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.990939 14653 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:06.995488 15004 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:06.990967 14978 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:06.997588 15004 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:06.964620 14992 raft_consensus.cc:697] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:06.998696 14992 consensus_queue.cc:237] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:07.001935 14998 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:19:07.004015 14974 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:06.970405 14850 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:06.977640 14961 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:06.982939 14799 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:07.022058  8250 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:07.026016  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:06.980964 14953 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:07.005617 15028 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.051766  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:07.052551  8788 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:07.034010 14974 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:07.059248 14974 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.062942 14990 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.064316  8788 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:07.065527  8147 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:07.047603 14932 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:07.076843  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.049685 14961 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:07.053297 14653 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.034626  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:07.054018 14953 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:07.054896 14973 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:07.094887  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.070812 14802 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:07.067812 14990 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:07.032753  8255 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:07.111153  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:07.137714  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.129091  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.144061  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:07.144506  8250 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:07.145485  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:19:07.162209  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.221978  8255 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:07.221165  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:07.221745  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 90821.6us
W20260709 13:19:07.230746  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.147913  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 299774us
I20260709 13:19:07.229259  8104 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:19:07.236117  8755 leader_election.cc:400] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 20. Current term is 21.
I20260709 13:19:07.236569  8755 leader_election.cc:403] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:19:07.148974  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:07.149308  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:07.170670  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.238682  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.239233  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.149617  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:07.098523 14846 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:07.249025  8100 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:07.241587  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:07.253024  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:19:07.253916  8101 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.003s
I20260709 13:19:07.254503  8101 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:07.099218 14964 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.258775  8107 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 21: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:07.116643 15013 raft_consensus.cc:697] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:07.145337 15037 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:07.110595 15011 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:07.146191 14974 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:07.145952 14802 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:07.268172 15037 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.268975 14802 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.270205  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:07.270504 15037 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.271486 15039 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:07.111311 14932 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.272467 14932 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.275336 14964 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:07.275767 14964 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.276129 14964 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:07.272832  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:07.277611 15042 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:19:07.277761  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3416) took 1051 ms. Trace:
I20260709 13:19:07.277915 15037 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:19:07.278400 15045 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:19:07.278842 15037 raft_consensus.cc:697] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:07.278280  8106 rpcz_store.cc:276] 0709 13:19:06.226329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.226938 (+   609us) service_pool.cc:224] Handling call
0709 13:19:06.227370 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.508908 (+281538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.509010 (+   102us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.555944 (+ 46934us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.987974 (+432030us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:06.988006 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.988068 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.277539 (+289471us) raft_consensus.cc:1685] finished
0709 13:19:07.277559 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.277701 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":65207,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":584531,"threads_started":2,"wal-append.queue_time_us":522148}
I20260709 13:19:07.279633 14302 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:07.110807 15010 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.145375 15036 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:07.282364  8099 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:07.230613 14973 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.240293 14907 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.240777 14776 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.298225  8100 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:07.266400 15031 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:07.279935 15037 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.102355 14653 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.277760 14695 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:07.249557 15040 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 20. Current term is 21.
W20260709 13:19:07.281126 14911 consensus_meta.cc:287] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 13:19:07.249025 15041 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:19:07.337136 15041 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:07.301783 15036 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:07.337193 15023 consensus_queue.cc:1059] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
I20260709 13:19:07.337538 15041 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:07.265226 14846 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.344357  8174 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:07.268201 15011 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:07.335563  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 54826.3us
I20260709 13:19:07.321888 15053 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.284140 15050 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.068s
W20260709 13:19:07.345093  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 355909us
I20260709 13:19:07.351750  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:07.362654  8250 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:07.338035 15036 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:07.319717 14973 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.374573  8788 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:19:07.323001 14776 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.358794  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:07.370474  8250 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:07.285976 14961 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.343856 14695 raft_consensus.cc:697] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:07.329399 15031 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.321079 14907 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.398360  8175 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:19:07.388826  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 135917us
I20260709 13:19:07.373741 15010 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.403237  8255 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
W20260709 13:19:07.394652  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 111220us
I20260709 13:19:07.403796  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:07.400377  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:07.368386 14911 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:07.354831 14815 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:07.404660  8181 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 26: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:07.409209 14832 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:07.407670  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:07.408228 14911 raft_consensus.cc:697] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:07.409868 14832 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.411016 14911 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.412292 14832 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.408352  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:07.367743 15028 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:07.407548  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:07.415068  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.417917  8250 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 22: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:07.392095 14974 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.317987 14953 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.423216  8175 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:19:07.355576 15038 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.428385  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:07.420713  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:07.430546  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.432452  8255 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 26.
I20260709 13:19:07.366971 15053 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.435456  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:07.419328 14832 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:07.464670 14846 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.465818 14695 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.385419 15013 consensus_queue.cc:237] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.474123  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:07.435324  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:07.460119 14802 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:07.476472  8182 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 21. Current term is 22. Ops: [20.13-21.14]
I20260709 13:19:07.459859 14874 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:07.417152 15010 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.481657  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:07.426904 14974 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.433092 15044 consensus_queue.cc:1059] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:19:07.469949 14815 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.501665 14815 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.503288 15038 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:07.503934 14815 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:07.506063 14989 consensus_meta.cc:287] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.724s	user 0.013s	sys 0.002s
I20260709 13:19:07.467725 15041 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.510599 15041 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:07.511791 15059 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:19:07.513952 15063 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:19:07.515483 14974 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.480779 14832 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:07.471184 15056 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:07.480667 14802 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.497068 14776 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.476595 14993 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.530383 14977 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:07.530670 14993 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.489198  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:07.479694 14653 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:07.532902  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 43784us
I20260709 13:19:07.528199 15040 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:07.533555 15040 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:07.533716 15049 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.534s	user 0.004s	sys 0.000s
I20260709 13:19:07.534080 15040 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:07.535507 14815 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:07.487171 15050 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:07.537297 15050 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.537714 15050 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:07.526521  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:19:07.530031 15060 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:07.540203  8785 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:07.533026 14993 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.566526  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3502) took 1234 ms. Trace:
I20260709 13:19:07.544365  8176 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:07.554220  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:07.554440  8072 leader_election.cc:336] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.902s (SENT)
I20260709 13:19:07.570346  8072 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:07.497123 14973 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.572438  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:07.572605  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:07.573307  8788 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:07.567065  8256 rpcz_store.cc:276] 0709 13:19:06.332245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.347390 (+ 15145us) service_pool.cc:224] Handling call
0709 13:19:06.347721 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.373251 (+ 25530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.373288 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.394102 (+ 20814us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.809713 (+415611us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:06.809768 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.810516 (+   748us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.533117 (+722601us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:07.541482 (+  8365us) raft_consensus.cc:1685] finished
0709 13:19:07.541516 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.566456 (+ 24940us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14566,"raft.queue_time_us":21913,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":22799,"spinlock_wait_cycles":37491968,"thread_start_us":343758,"threads_started":1,"wal-append.queue_time_us":584993}
I20260709 13:19:07.586449  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:07.587423  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:07.589085  8785 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:07.592051  8784 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:07.573997 14989 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.593412  8786 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:07.599269  8785 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:07.600302 15038 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:07.601490  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 47085.1us
I20260709 13:19:07.602664  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:07.603139  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:07.603813  8175 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:07.604511  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:07.605175  8177 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:07.541503 14802 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:07.593526  8100 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:19:07.609524  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:07.613893  8788 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:07.615103  8177 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:07.597705 14993 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:07.619135  8106 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:07.622849  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:07.623646  8177 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 14.
I20260709 13:19:07.492650 14995 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:19:07.620950  8100 pending_rounds.cc:85] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 9
I20260709 13:19:07.630731  8100 pending_rounds.cc:107] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:19:07.631175  8100 raft_consensus.cc:2889] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:07.632925  8106 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:07.633190  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:07.634800  8178 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:07.638873  8107 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:07.640098  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:07.634214  8177 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:19:07.644696  8099 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:07.644713  8175 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:07.648063  8104 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:07.588765 14832 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:07.614485 15037 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.604528 15043 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:07.654697  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.626019 14993 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.597555 14989 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.653626 14995 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:19:07.676254 14799 consensus_meta.cc:287] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.642s	user 0.007s	sys 0.003s
I20260709 13:19:07.656638 15011 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:07.683947 14846 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:19:07.687785 15073 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:19:07.666620 14993 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:07.662959 14815 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:07.644863 15039 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:19:07.666523 14965 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.693406 14846 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:07.706815 14990 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:07.707657 14990 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.710978 14990 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:07.714103  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 107581us
I20260709 13:19:07.717638 14832 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.719338 15053 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.719977 15083 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.681821 14995 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:07.720557 15083 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.721535 14995 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.722582 14989 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:07.722744 14995 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:07.723146 15050 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.664678 15037 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.727522 15037 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:07.732160 14850 consensus_meta.cc:287] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.718s	user 0.006s	sys 0.005s
I20260709 13:19:07.732851 15037 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:19:07.732853 15048 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.734s	user 0.000s	sys 0.004s
I20260709 13:19:07.705523 14965 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:07.734573 15077 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:19:07.735526 14965 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.736119 14993 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.738343 14993 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.740188  8175 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:19:07.741636  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:07.752141  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:07.752796  8175 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:07.755062 15083 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.757982  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 2264) took 1331 ms. Trace:
I20260709 13:19:07.758405  8174 rpcz_store.cc:276] 0709 13:19:06.426693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.426836 (+   143us) service_pool.cc:224] Handling call
0709 13:19:07.757728 (+1330892us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b54002f9c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:07.757882 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2039143168}
I20260709 13:19:07.761866  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:07.762977  8072 leader_election.cc:336] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.597s (SENT)
W20260709 13:19:07.747941 14971 consensus_meta.cc:287] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.021s	user 0.006s	sys 0.009s
I20260709 13:19:07.767519  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:07.768278  8174 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:07.772239  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:07.773044  8174 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:07.774087  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.778474 14874 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.778999 14874 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.781045 14874 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.787209  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:07.749670 14964 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.769586 14993 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.774540 15056 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.804141  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:07.799218 15041 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.804235 15056 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.805325 15041 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.807538 15041 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:07.809886  8783 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.810958 15056 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.811544 15036 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.813580 15036 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.803798 14802 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.815495  8177 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:07.815845 14924 raft_consensus.cc:3055] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:07.816246 14924 raft_consensus.cc:740] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:07.816118 15040 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.817296  8787 raft_consensus.cc:2368] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 18. Current term is 19.
I20260709 13:19:07.817152 14924 consensus_queue.cc:260] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.817651  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:07.818177 14924 raft_consensus.cc:3060] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:07.820137  8179 raft_consensus.cc:2368] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 22. Current term is 23.
I20260709 13:19:07.820919 14964 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.826303  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:07.757261 14846 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.770401 14971 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.836615  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:07.837752  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:07.838325  8103 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:07.838465 14971 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:07.839210  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:07.839774  8105 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:07.840065 15004 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:07.840415  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.840685 15004 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.834462  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:07.835220  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:07.835788  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 477055us
I20260709 13:19:07.850097  8100 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:07.835902  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:07.851466  8102 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:07.836432 14841 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:07.841075  8256 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:07.832024  8106 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:07.841742  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.842074 14846 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:07.842406  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:07.860464  8250 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:07.843122  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.843796  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.827242 14874 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:07.845444  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.845813 15041 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:07.818199 15040 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.848016  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.874379  8251 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:19:07.837280  8108 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:19:07.874886  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.852506  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:07.866255 15004 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:07.859364 15083 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:07.881389  8223 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:07.868520  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.870908  8174 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:07.848105  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:07.875836  8257 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:19:07.874725  8253 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:19:07.878907  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:07.884538  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.802942 14993 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.849877 15062 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:07.856568 14841 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.885485  8253 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:07.888212  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:07.885440  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:07.890547  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.891700  8108 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:07.868824 15028 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.867625 15041 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:07.913666 15041 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:07.896112 15062 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.914320 14964 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:07.914856 14964 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.915791 15062 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:07.893326 14995 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:07.916802 14964 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:07.917032 14995 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:07.917470 14995 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:07.917725 14964 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.919766  8106 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:07.894708  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:07.921384  8102 raft_consensus.cc:2410] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:19:07.880928 15044 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:07.903625  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:07.924758  8100 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:07.926920 15062 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.927438 15062 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.929647 14911 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:07.930142 15062 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:07.930346 14911 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:07.931936  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.905143  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:07.908898  8250 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:07.889961 15040 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:07.933876  8099 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:19:07.878587 14802 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.909930 15056 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:07.893060 14841 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:07.889680 15004 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:19:07.893584  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:07.937130  8108 raft_consensus.cc:2410] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:19:07.923458  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:07.897943 15054 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.015s	sys 0.013s
W20260709 13:19:07.939139 15054 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.016s	sys 0.013s
I20260709 13:19:07.933055 14911 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.941160 15040 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:07.941569 15040 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:07.942377 15040 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:07.944710  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.944520 14841 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:07.946220  8100 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:19:07.946830 14841 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:07.944854  8099 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:07.890049 14724 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:07.953704  8174 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:07.900373 15087 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:07.884284 14955 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:19:07.896860 15061 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:07.958292  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.889205 14953 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:19:07.967569  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.969794  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.971139  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.972416  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:07.972995  8255 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:07.974555 14993 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.950451 15036 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.977883 15036 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.980172 15036 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:07.983222  8255 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:07.918352 14964 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:07.997645  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:08.034518  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:07.998522  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:08.001219  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:08.035645 14964 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:08.013826  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.036036  8251 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:08.017848  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:08.037889  8252 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:08.034581 14932 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:08.021914  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.922410 15028 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:08.028293 15064 log.cc:927] Time spent T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.638s	user 0.000s	sys 0.004s
I20260709 13:19:08.040187 15010 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:07.960896 14724 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:08.041296 15028 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:08.041941 14724 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.042762  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:08.043457  8181 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 23: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:08.018781  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:08.035676  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:08.036129  8249 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:08.046377  8250 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:19:08.046377  8251 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
W20260709 13:19:08.051091  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.051388  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:07.997529 15061 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:08.051986  8175 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:08.052826  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:08.052628 15061 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:08.053627  8182 raft_consensus.cc:2410] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 17 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:19:08.039155  8252 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:08.056365  8101 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:19:08.056502  8249 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:19:08.058655  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:08.061357  8099 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:19:08.066152  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:08.070041  8249 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: [19.12-21.13]
I20260709 13:19:08.071056  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:08.071942  8099 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 23: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:07.994421 14911 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.074069 15039 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.074313 14907 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:08.075717 15031 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:08.081708  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 154692us
I20260709 13:19:08.082194  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:08.070341 14199 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.071590  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:08.078994  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:08.082747  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:08.083503  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:08.089030  8175 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 22: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:08.084722  8182 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:19:08.076483  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 179952us
I20260709 13:19:08.097563  8755 leader_election.cc:400] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 20. Current term is 21.
W20260709 13:19:08.104482  8221 leader_election.cc:336] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.792s (SENT)
I20260709 13:19:08.106599  8249 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: [17.14-19.15]
I20260709 13:19:08.106904  8221 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:08.105135  8252 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:08.103745  8223 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:08.108621 14955 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:08.109887  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:08.113153  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:08.111621  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:08.113965  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:08.115115  8147 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:08.093933 15087 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:19:08.117019 15097 consensus_queue.cc:1059] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:08.117543 15087 raft_consensus.cc:3055] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:08.117666 15028 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:08.118042 15087 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:08.109901  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:08.118877  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:08.119158  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:08.120060  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.120404  8107 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:19:08.118116 15097 raft_consensus.cc:3055] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:08.119304  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:08.119215  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:08.121663  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:08.128859  8180 raft_consensus.cc:2410] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:19:08.128372  8223 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:08.132002  8785 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:19:08.094184 15013 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:08.080860 14911 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:08.138236  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:08.139406  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:08.140576  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:08.144879  8101 raft_consensus.cc:2468] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:08.146217  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:08.081559 15039 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.110144 14953 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:08.151700  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.118489 15028 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:08.160490  8074 leader_election.cc:400] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 22. Current term is 23.
I20260709 13:19:08.163990  8074 leader_election.cc:403] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:08.161600  8789 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:08.162006  8791 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:19:08.164968  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.162838  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:08.118835 14955 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:08.129739 14964 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:08.165992  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:08.131646 15083 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:08.109278 14874 consensus_queue.cc:1059] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:19:08.097535 15044 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.052s
W20260709 13:19:08.177697  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 58888.2us
I20260709 13:19:08.098048 14977 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:19:08.163112 14974 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:08.182993 14974 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.131837 15031 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:08.183367 15050 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:08.176149 15083 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:08.128121 15097 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:08.094748 14199 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.148761 14978 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:08.166819  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:08.212383  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45644.6us
I20260709 13:19:08.169190 14964 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:08.136245 14841 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:08.160838 14993 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:08.183380 14974 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:08.167312  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:08.127202 15010 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:19:08.135990 14932 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:08.162806 14998 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:08.180967  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.211915 14978 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.162858 14971 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:08.182600 14977 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:08.183626 15031 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.169399  8107 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:08.224864 15071 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:08.186020  8788 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:19:08.166081 15053 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:19:08.186163  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 71429.3us
W20260709 13:19:08.233687 15055 log.cc:927] Time spent T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.965s	user 0.005s	sys 0.000s
W20260709 13:19:08.257768  8221 leader_election.cc:336] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.152s (SENT)
I20260709 13:19:08.258287  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:08.174770  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.259123  8782 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:19:08.187906  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:08.214478  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.215225  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.259879  8790 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:08.184191 14995 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:08.188814  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.213703  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 46120.1us
I20260709 13:19:08.160451 15013 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.175379 14802 consensus_queue.cc:1059] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:19:08.158160 15023 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:08.275960  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:08.224334  8786 raft_consensus.cc:1240] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:08.220906  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:08.277820  8784 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:08.226260  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 3079) took 1315 ms. Trace:
I20260709 13:19:08.184118 15083 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:08.230418  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:19:08.231016  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.232708  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 65500.2us
I20260709 13:19:08.319964  8257 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:08.183440 14911 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:08.246563  8791 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:19:08.322443 14199 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:08.322793  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.181542 14955 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.324141 14995 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:08.222232 14964 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:08.168677 14924 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 22. Current term is 23.
I20260709 13:19:08.221078 14841 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:08.223378 14993 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.160290 15036 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:19:08.261093  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:08.335716  8174 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:08.262821  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:08.180120 15098 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:19:08.263528  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:08.263468  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:08.347047  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 58808.6us
I20260709 13:19:08.265560  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:08.231529 15084 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.279405  8183 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:08.279866  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:08.350546  8175 raft_consensus.cc:2410] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:19:08.246253 14998 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:08.351676  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.286105  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:08.286180  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:08.286906  8254 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:08.278365  8176 rpcz_store.cc:276] 0709 13:19:06.911390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.917778 (+  6388us) service_pool.cc:224] Handling call
0709 13:19:08.226114 (+1308336us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54000109d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:08.226207 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1352084864}
I20260709 13:19:08.243597 14932 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.271086  8102 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:08.247344 15011 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:08.290257  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.290784  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:08.290307  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:08.357329  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:08.291157  8099 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:08.292250  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.225142 15054 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:19:08.292910  8182 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:08.294920 15013 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:08.287166 14961 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:08.274708 15023 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.274891 14907 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.296329 15106 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:08.296609 14724 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:08.291071 15028 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:19:08.359475 14932 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:08.261719 14977 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.253091 14978 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:08.251760 14971 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.261890 15031 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:08.271168  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.302088  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:08.263588 15069 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:19:08.303201  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:08.245803 15097 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.265385 15053 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:08.256400 15071 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.255296 14695 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
W20260709 13:19:08.310082 15095 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:19:08.297708 15044 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:19:08.321731 14989 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.180701 15087 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.319957  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:08.413208  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 93327.9us
I20260709 13:19:08.354897 15084 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:08.418680  8252 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:08.340840  8790 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
W20260709 13:19:08.341986  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 127057us
I20260709 13:19:08.406147 14971 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:08.358698  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:08.361522  8251 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:08.335403 14841 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:08.433019  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.410920 15071 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:08.347240 14993 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:08.294934 15041 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.442209 15041 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:08.416471 14995 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:19:08.394795  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.443841  8782 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 22: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:08.444734  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.354846 14998 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:08.445554  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.450994 14993 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:08.351339 15039 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:08.226920 14965 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:19:08.356118 14874 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:19:08.402204  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.458045 14874 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:08.458101  8783 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:08.458566 14874 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:08.459658  8783 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:19:08.460012  8783 pending_rounds.cc:85] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 13
I20260709 13:19:08.459510 14874 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.460247  8783 pending_rounds.cc:107] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:19:08.460536  8783 raft_consensus.cc:2889] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:08.460747 14874 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:08.403566  8788 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 17.
I20260709 13:19:08.404320  8248 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:19:08.395000 15023 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:08.394378 15011 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 24 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:08.395895 14924 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.328929  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:08.416706  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:08.402314 14977 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:08.420611  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:08.428547  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.432011  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.433751  8786 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:08.408094 15053 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:08.364869  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:08.354807  8784 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:08.396131 15109 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:19:08.489475  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:08.399222 14907 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.422523 15036 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:19:08.458458 15107 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:19:08.494789  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 78149.3us
W20260709 13:19:08.494071  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 208007us
I20260709 13:19:08.477720  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:08.540012  8787 raft_consensus.cc:2393] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 19: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:19:08.498732  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 78188us
I20260709 13:19:08.505209 15039 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:08.538872  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:08.543763  8785 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:08.505661  8257 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:08.398316  8255 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:08.544597  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:08.420032 15087 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:08.430311 14846 consensus_meta.cc:287] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.002s
I20260709 13:19:08.437556 15097 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:08.512252  8783 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:08.454470  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:08.531075  8790 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:08.532889  8786 raft_consensus.cc:3055] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:08.540549  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:08.412763 14989 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:08.453245 14998 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.556793  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:08.558225  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.560469  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:08.557201  8786 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:08.513907 14965 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:08.583448  8791 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:08.513352 14695 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:08.514816 15036 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:19:08.619486  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 79088us
I20260709 13:19:08.614012  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:08.620158  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.621380  8787 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:19:08.619328  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:08.622861  8182 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
W20260709 13:19:08.565686  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 213997us
I20260709 13:19:08.505832 14924 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:08.633931  8100 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 23: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:19:08.431097 15114 consensus_queue.cc:1175] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9480609eccc44250a4d7fcc9686e76cf" responder_term: 18 status { last_received { term: 17 index: 16 } last_committed_idx: 16 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:08.553443 15010 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:08.558557 14802 consensus_queue.cc:1243] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:19:08.554518 14911 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:08.622412  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:08.586794 15039 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:08.624217 15036 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:08.630398  8786 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.672488  8786 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:08.676681  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 187869us
I20260709 13:19:08.634884 14965 raft_consensus.cc:697] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:08.677516  8221 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:08.655751 14815 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.551403 15011 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:08.627713 14695 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:08.699450  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 59368.8us
I20260709 13:19:08.660953 15044 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:19:08.641059 14961 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:19:08.664767 14973 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:19:08.720252  8786 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:19:08.736753  8786 pending_rounds.cc:85] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 13
W20260709 13:19:08.722440  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.722872 15113 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:19:08.724920  8002 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36106 (request call id 205) took 9100 ms. Trace:
W20260709 13:19:08.737856  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.726120 14998 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:08.731065 15050 raft_consensus.cc:3055] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:08.722472  8180 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: [17.14-19.15]
W20260709 13:19:08.738564  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.742770  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:08.690516 15111 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:08.679574 15114 consensus_queue.cc:1059] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 13:19:08.746861  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.737125  8786 pending_rounds.cc:107] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 21.14
I20260709 13:19:08.750268  8786 raft_consensus.cc:2917] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Aborting config change with OpId 21.14: Aborted: Op aborted by new leader
W20260709 13:19:08.701622  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 79269.7us
I20260709 13:19:08.750833  8786 raft_consensus.cc:2889] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:08.760640  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:08.762501 15111 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:08.763736 15111 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:08.748801 15050 raft_consensus.cc:740] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:08.797715  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:08.737821  8002 rpcz_store.cc:276] 0709 13:18:59.624621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.628965 (+  4344us) service_pool.cc:224] Handling call
0709 13:19:00.555474 (+926509us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b540006a9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db6090 00007fa5a0e54f3a 00007fa5a6c0b1cc 00007fa5a6d0937e 00007fa5a51ca2a4 00007fa5a51ca232 00007fa5a51ca161 00007fa5a51ca0dc 00007fa5a51c9392 00007fa59f18748c 00007fa59f1868c6
0709 13:19:08.724836 (+8169362us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:04.886847 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:04.918170 (+ 31323us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:04.918248 (+    78us) write_op.cc:435] Acquired schema lock
0709 13:19:04.918272 (+    24us) tablet.cc:662] Decoding operations
0709 13:19:04.920287 (+  2015us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:04.920455 (+   168us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:04.920493 (+    38us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:19:05.014386 (+ 93893us) tablet.cc:701] Row locks acquired
0709 13:19:05.014446 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:19:05.014638 (+   192us) write_op.cc:270] Start()
0709 13:19:05.014813 (+   175us) write_op.cc:276] Timestamp: P: 1783603145014566 usec, L: 0
0709 13:19:05.014852 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:19:05.015694 (+   842us) log.cc:844] Serialized 7869 byte log entry
0709 13:19:05.658709 (+643015us) op_driver.cc:464] REPLICATION: finished
0709 13:19:05.826427 (+167718us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa59dd420ac 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a4882ef0
0709 13:19:06.162446 (+336019us) write_op.cc:301] APPLY: starting
0709 13:19:06.183097 (+ 20651us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:06.644598 (+461501us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:06.644646 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:06.928895 (+284249us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:06.929286 (+   391us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:19:06.929346 (+    60us) write_op.cc:312] APPLY: finished
0709 13:19:07.099535 (+170189us) log.cc:844] Serialized 180 byte log entry
0709 13:19:07.424721 (+325186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:07.446918 (+ 22197us) write_op.cc:454] Released schema lock
0709 13:19:07.471446 (+ 24528us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:07.509213 (+ 37767us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:07.509275 (+    62us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":596612,"reported_tablets":29,"spinlock_wait_cycles":806139776,"child_traces":[["op",{"apply.queue_time_us":349460,"apply.run_cpu_time_us":44012,"apply.run_wall_time_us":1352169,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87687,"num_ops":20,"prepare.queue_time_us":168842,"prepare.run_cpu_time_us":49028,"prepare.run_wall_time_us":396640,"raft.queue_time_us":312209,"raft.run_cpu_time_us":30978,"raft.run_wall_time_us":366610,"replication_time_us":617692,"spinlock_wait_cycles":41207040,"thread_start_us":1002664,"threads_started":5,"wal-append.queue_time_us":557097,"wal-append.run_cpu_time_us":16830,"wal-append.run_wall_time_us":2269322}]]}
I20260709 13:19:08.791556  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:08.708192 15121 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:08.700713 14815 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:08.816028  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:08.820621  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:08.827783 14989 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:08.833616 15110 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.834342 15110 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:08.838083  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:08.835106 15039 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.774143 14846 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:08.842657  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:08.843739 15120 raft_consensus.cc:2804] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:08.846205 15127 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:08.847527 14695 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:08.848100 15114 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:08.836261 15109 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:08.820921 14724 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:19:08.810801 14965 consensus_queue.cc:237] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:08.854775 14978 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.813961 15106 raft_consensus.cc:3055] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:08.766520 15116 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.352s
W20260709 13:19:08.857740  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 317229us
W20260709 13:19:08.859249  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.796993 15069 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.860946  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:08.822715 15121 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.750429 15112 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.350s
I20260709 13:19:08.897575 15121 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:19:08.866295 15038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.010s	sys 0.014s
W20260709 13:19:08.907855  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 47031.6us
I20260709 13:19:08.867168 14907 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:08.796234 15050 consensus_queue.cc:260] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.797081 15128 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.100s
I20260709 13:19:08.911885  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:08.856777 14841 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:08.886698  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:08.858244 14846 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.862000 14874 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:08.921859  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:08.891439 15040 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:08.905709 15112 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:08.910446  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:08.876350 15120 raft_consensus.cc:697] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:08.920203  8249 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:19:08.931824  8250 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
W20260709 13:19:08.911664 15038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.010s	sys 0.014s
I20260709 13:19:08.912341 14924 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:08.922884  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 129765us
I20260709 13:19:08.923216  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:08.884755 15106 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:08.897511 15084 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:08.925539  8102 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:08.927556  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:08.908912 15114 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:08.930200  8786 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:19:08.922447  8788 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:08.944686 14815 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:08.946918 14978 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:08.961104  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:08.961395 14973 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:08.961814  8178 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:08.924043 14846 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:08.951112  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:08.954716 15109 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.965922  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:08.966200 15109 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.967141 14978 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:08.968173 14978 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:08.968487 14978 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:08.968638 15109 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:08.969364 15109 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:08.972152  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:08.973909  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:08.976076  8178 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:08.969326 14978 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.978298  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:08.979147 15109 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:08.985103 14846 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.988791  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:08.959012  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:08.991957 14973 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:08.993878  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:08.994681 14973 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:08.997172  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:08.997918 14973 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:08.997922 15120 consensus_queue.cc:237] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.002341  8149 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:19:09.003667 15031 consensus_meta.cc:287] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.000s
I20260709 13:19:09.004101 15031 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.004937 14973 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:09.005738 14973 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:19:09.005139 14974 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.000s
I20260709 13:19:08.930513 15111 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:09.025650  8108 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:19:09.026297  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:09.030650  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:09.031366 15036 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.907006 15069 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:08.948397 15106 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.033493  8252 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:19:09.036265 14971 consensus_meta.cc:287] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.000s
I20260709 13:19:08.934412 15110 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:08.945066 14977 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.033793 14974 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.044049  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:08.935035 15112 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.062853  8099 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:09.068123  8108 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:19:09.068648  8108 pending_rounds.cc:85] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 13
I20260709 13:19:09.068907  8108 pending_rounds.cc:107] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:19:09.042613 15050 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.069159  8108 raft_consensus.cc:2889] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:09.006706 14973 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:09.071520  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.073935  8784 raft_consensus.cc:2368] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18.
I20260709 13:19:09.074506  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:09.081864  8106 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:09.089351  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:09.090042  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:09.091476  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.092481  8181 raft_consensus.cc:2368] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 26. Current term is 27.
W20260709 13:19:09.068169 15023 consensus_meta.cc:287] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.000s
I20260709 13:19:09.057382 14815 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:09.064285 15083 consensus_meta.cc:287] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.747s	user 0.010s	sys 0.000s
I20260709 13:19:09.039929 15121 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.109023 14846 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:09.111703  8255 raft_consensus.cc:2368] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 26. Current term is 27.
W20260709 13:19:09.099946 15053 consensus_meta.cc:287] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.000s
I20260709 13:19:09.115476  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:09.117841  8103 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:09.056440 14971 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.110059  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:09.150975  8105 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:19:09.102630 15106 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:09.100932 14695 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.107016 15110 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:19:09.115481 14964 consensus_meta.cc:287] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.790s	user 0.012s	sys 0.000s
W20260709 13:19:09.120530 15097 consensus_meta.cc:287] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.534s	user 0.005s	sys 0.005s
W20260709 13:19:09.120121 15071 consensus_meta.cc:287] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
W20260709 13:19:09.164878  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 88185.6us
I20260709 13:19:09.178735  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:19:09.156790 14932 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.750s	user 0.010s	sys 0.002s
W20260709 13:19:09.179538  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.179322  8182 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:09.110929 15136 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.181279  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:09.107992 15023 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.111585 14989 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:19:09.111138 15083 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.212613  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:09.213325  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:09.191725  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:09.110780 14815 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:09.216655  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.150573 15053 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.219074  8108 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:19:09.214074  8105 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:19:09.231228  8101 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:09.228667  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:09.230933  8072 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:09.184092 15031 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:09.183512 15011 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.246198  8104 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 24 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:19:09.182293 14964 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:09.251838 15139 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:19:09.217484 14841 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:09.175530 14695 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.256069  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:09.257568  8105 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:19:09.267078  8108 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:09.264003  8182 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:09.177691 15110 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.268468  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:09.187466 14724 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:19:09.235664 15121 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:09.185964 15071 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.186277 14932 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.236245 14924 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:09.183362 15136 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:09.278193  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 62132.4us
I20260709 13:19:09.286532  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:09.291324  8182 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:09.268617  8104 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:19:09.298108  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 67239.9us
I20260709 13:19:09.298980  8072 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:09.299124 14695 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:09.300051 15031 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:09.300505 15031 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:09.300993 15031 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:09.306069 15142 log.cc:927] Time spent T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:19:09.306900 15131 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:19:09.307616 15036 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:09.253083 15011 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.300302 15084 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:19:09.368662  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 67365.2us
I20260709 13:19:09.378556  8072 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:09.370512  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:09.370980  8182 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:19:09.371596  8108 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:09.372998  8257 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:09.373719  8177 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 21: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:09.184643 15115 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:19:09.286362 15097 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:09.385918  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:09.387290 15053 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:09.388082 15110 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:09.389240 15136 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:09.390406 14932 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:09.391644 15011 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:09.391870 15071 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:09.393006 15023 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:09.393601 15069 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:09.394011 15144 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:19:09.394155 15036 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:09.394320 15122 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.203s
I20260709 13:19:09.395120 15150 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:09.395421  8182 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:19:09.408824  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:09.457700  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:09.457700  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:09.373277 14841 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:09.410399 15140 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:19:09.506517 15111 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:09.507897 15111 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:09.451675 14989 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:09.508261  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:09.509060 15011 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:09.397284 14974 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:09.395910 15149 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:09.402786 14907 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.077s
W20260709 13:19:09.408063 15138 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.258s	user 0.002s	sys 0.005s
I20260709 13:19:09.510553 14907 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:09.387321 14964 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:09.478536  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:19:09.511181 15130 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.715s	user 0.002s	sys 0.000s
I20260709 13:19:09.470711  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:09.511566  8257 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:09.465867 15132 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
W20260709 13:19:09.487186 15100 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 1.276s	user 0.008s	sys 0.005s
I20260709 13:19:09.487515 14977 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:09.489542 14971 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:09.464645 15112 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:09.491729  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:09.493343  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:09.451239 15097 raft_consensus.cc:697] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:09.468863 15053 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.457274 14850 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:19:09.497542  8104 raft_consensus.cc:1240] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:19:09.499542  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:09.472473 14815 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:09.502852  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:09.505650 14841 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.505998  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:09.508816 14989 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.510985 14907 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:09.484160  8147 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:09.578733  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 94655.3us
I20260709 13:19:09.526641 14978 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:09.523619  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 120883us
I20260709 13:19:09.526458  8108 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
W20260709 13:19:09.529358  7991 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9abaa411847e4bf9907f7af5e2689c7b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 13:19:09.530339  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:09.523838 15041 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.531145 14199 raft_consensus.cc:3055] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:09.535075  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1296) took 1322 ms. Trace:
I20260709 13:19:09.537523  8785 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:19:09.538070 15013 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:09.406899 14724 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.122s
I20260709 13:19:09.525452  8789 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:19:09.539351  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:09.546602  8105 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 23: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:09.500619 15083 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:09.570734 14977 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:09.571326  8257 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:19:09.572588  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:19:09.577543  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 71616us
I20260709 13:19:09.603969  8103 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:09.604151  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:09.577639  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:09.579744  8147 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:09.512652  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:09.605389  8099 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 21: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:19:09.605588  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 93012.5us
I20260709 13:19:09.606381  8074 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:09.588918  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:09.592228  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 3109) took 1040 ms. Trace:
W20260709 13:19:09.587582  7991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 64166.2us
I20260709 13:19:09.591706  8791 rpcz_store.cc:276] 0709 13:19:08.212976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.322529 (+109553us) service_pool.cc:224] Handling call
0709 13:19:09.534890 (+1212361us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540058d9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:09.535017 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597780352}
W20260709 13:19:09.571990 15040 consensus_meta.cc:287] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.001s
I20260709 13:19:09.601939  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:09.607626  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:09.615597 15071 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:09.616398 15039 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:09.616259 14977 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.594555 14199 raft_consensus.cc:740] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:09.617035 15039 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.617508 15039 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:09.618525 14977 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:09.610966 15011 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:09.619519 15011 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:09.620498 14695 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:09.620419 15011 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.621497 15112 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:09.621896 15112 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:09.622404 15112 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:09.594798 15013 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:09.623363 15013 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.612385  8147 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:09.624482 15013 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:09.626562 14989 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:09.626770  8788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1293) took 1414 ms. Trace:
I20260709 13:19:09.627116  8788 rpcz_store.cc:276] 0709 13:19:08.212248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.461890 (+249642us) service_pool.cc:224] Handling call
0709 13:19:08.462132 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.956038 (+493906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.626509 (+670471us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b5400521a54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:09.626683 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057972608}
I20260709 13:19:09.627553  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:09.628106  8791 raft_consensus.cc:2376] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19. Re-sending same reply.
I20260709 13:19:09.628506  8788 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:09.629769  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 3111) took 1076 ms. Trace:
I20260709 13:19:09.630442  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:09.631263  8105 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 24: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:09.630155  8174 rpcz_store.cc:276] 0709 13:19:08.553725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.553853 (+   128us) service_pool.cc:224] Handling call
0709 13:19:08.554135 (+   282us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:08.554454 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.554480 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:09.229573 (+675093us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b2c000e6688. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:19:09.230058 (+   485us) log.cc:844] Serialized 52 byte log entry
0709 13:19:09.421588 (+191530us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:09.421622 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.421688 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.629489 (+207801us) raft_consensus.cc:1685] finished
0709 13:19:09.629508 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.629710 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3225,"raft.queue_time_us":31910,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":6067,"spinlock_wait_cycles":63146752,"thread_start_us":191104,"threads_started":1,"wal-append.queue_time_us":344789}
I20260709 13:19:09.632004  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:09.632264  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.632566  8105 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:19:09.612036  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:09.633122  8174 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:09.634030  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:09.634737 14199 consensus_queue.cc:260] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.635515  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:09.635946 14199 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:09.627902 14932 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:09.637411 14965 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:09.637673 15155 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:09.638924 15155 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.639278 15155 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:09.621826 14907 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.642076 14907 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:09.637822 15110 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:09.642927 15110 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.643376 15110 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:09.600663 15041 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.620414 14924 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:09.591856 14964 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:09.647495 14964 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.647687 15041 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:09.647882 14964 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:09.637758  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:09.648348  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:09.648586  8108 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:09.649114  8790 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 15: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:09.649948  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 1040) took 1386 ms. Trace:
I20260709 13:19:09.650327  8100 rpcz_store.cc:276] 0709 13:19:08.263294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.264159 (+   865us) service_pool.cc:224] Handling call
0709 13:19:09.649747 (+1385588us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54001b9254. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:09.649869 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644761344}
I20260709 13:19:09.616547 14841 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:09.581763 14815 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:09.654858 14815 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.657021 14815 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:09.658988  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:09.660118  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:09.647686  8099 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:19:09.614180  8783 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:19:09.663793  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:09.608397  8183 rpcz_store.cc:276] 0709 13:19:08.552207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.552380 (+   173us) service_pool.cc:224] Handling call
0709 13:19:08.614574 (+ 62194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.614864 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.614889 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.628415 (+ 13526us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.781860 (+153445us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:08.781932 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.782034 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.510641 (+728607us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:09.575213 (+ 64572us) raft_consensus.cc:1685] finished
0709 13:19:09.575233 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.592158 (+ 16925us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11096320,"thread_start_us":94053,"threads_started":1,"wal-append.queue_time_us":131626}
I20260709 13:19:09.666283  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:09.663295  8104 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:19:09.668241  8791 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:09.668836  8105 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:09.670416  8108 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 27.
I20260709 13:19:09.670894  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:09.672423  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:09.627133 14989 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:09.674226 14815 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:09.676501 15106 consensus_meta.cc:287] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.002s
I20260709 13:19:09.674948 14815 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.678419  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 3115) took 1118 ms. Trace:
I20260709 13:19:09.678560  8182 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:19:09.678802  8177 rpcz_store.cc:276] 0709 13:19:08.560054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.560195 (+   141us) service_pool.cc:224] Handling call
0709 13:19:09.678217 (+1118022us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b5400329954. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:09.678368 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668753280}
I20260709 13:19:09.613312  8223 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:09.681061  8252 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 22: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:09.680893  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:09.681850  8174 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
W20260709 13:19:09.682237  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 72828.7us
I20260709 13:19:09.574096 15053 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.671209  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:09.685727  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:09.687825  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:09.683228  8147 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:09.684489  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.689411 15084 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.685585 15097 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.691527  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:09.692184  8255 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:09.692288  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:09.695616  8223 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:09.696777  8223 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:09.698559  8103 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:19:09.701956  8255 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:09.702539  8255 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:09.704795  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:09.594597 14973 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.088s
I20260709 13:19:09.705345  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:09.706552  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:09.666699 15114 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:09.713464  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:09.703502  8255 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.717142  8255 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:09.719229  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:09.685540 14724 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:09.690888 14989 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.705652 15132 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:09.725893  8252 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:19:09.722188  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 3124) took 1446 ms. Trace:
I20260709 13:19:09.727653  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:09.717401  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:09.730985 15137 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:19:09.704835 14932 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:09.712414 15041 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.737581  8248 rpcz_store.cc:276] 0709 13:19:08.275334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.275442 (+   108us) service_pool.cc:224] Handling call
0709 13:19:08.275716 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.462626 (+186910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.721915 (+1259289us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54001207d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:09.722120 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286635264}
I20260709 13:19:09.726800 15023 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:09.720602 15036 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:19:09.712177 14841 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:09.705502 14953 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:09.690137 15084 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.743849  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:09.690580 15162 consensus_queue.cc:1059] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:19:09.746685  8183 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 15: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:19:09.718297 15028 consensus_queue.cc:1175] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9480609eccc44250a4d7fcc9686e76cf" responder_term: 24 status { last_received { term: 24 index: 13 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24. Ops: [23.13-23.13]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:09.755816  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:09.759330  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:09.751609  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:09.760677  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:09.742157 14971 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:09.744498 15149 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:09.759917  8783 raft_consensus.cc:2376] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20. Re-sending same reply.
I20260709 13:19:09.724354 15040 consensus_queue.cc:1059] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:19:09.762984  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:09.778597  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:09.711040 15110 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.731175 15129 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:19:09.728430 15114 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.768805  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:09.748950 14841 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:09.758879 15106 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:09.740053 14989 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.764665 14977 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:09.747277 15041 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:09.794065  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:09.816692  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:09.767355 15121 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:09.817788  8099 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 27: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:09.783030 15023 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:09.817351  8783 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 12.
W20260709 13:19:09.790388 15120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.042s	sys 0.066s
I20260709 13:19:09.826572  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:09.813318 15083 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:09.792560 15149 raft_consensus.cc:697] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:09.836678  8103 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:19:09.816836 14977 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:09.841197  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:09.828333 15120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.046s	sys 0.069s
I20260709 13:19:09.846542  8103 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:09.792078 14841 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:09.799459 15122 consensus_queue.cc:1059] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:19:09.819932 15121 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:09.857748  8787 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:09.858887  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:09.861063  8108 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 21: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:09.823968 14815 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:09.827986 15040 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:09.867097  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 145491us
W20260709 13:19:09.885221  8107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.014s	sys 0.018s
W20260709 13:19:09.886015  8107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.015s	sys 0.018s
I20260709 13:19:09.895644  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 3113) took 1339 ms. Trace:
I20260709 13:19:09.896108  8181 rpcz_store.cc:276] 0709 13:19:08.556346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.556496 (+   150us) service_pool.cc:224] Handling call
0709 13:19:09.895409 (+1338913us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b5400011dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:09.895575 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135002496}
I20260709 13:19:09.902192  8108 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:19:09.838145 14964 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.847779 14977 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:09.889245  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.884471 14815 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.951119 14815 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:09.915601 15038 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:09.868703 15040 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.022433  8181 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 24. Current term is 25. Ops: []
W20260709 13:19:09.922001 15167 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:09.925774  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:09.938225 15114 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:09.940507  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:09.943555  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 1043) took 1238 ms. Trace:
W20260709 13:19:09.945529  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.920794  8255 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 13:19:09.914294 15083 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.950367  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:09.914597 15053 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:09.946352 15041 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.026264  8105 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:19:10.027496  8072 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.030731  8182 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:19:10.032126  8102 rpcz_store.cc:276] 0709 13:19:08.704918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.705058 (+   140us) service_pool.cc:224] Handling call
0709 13:19:08.705359 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.953142 (+247783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.943247 (+990105us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540001bdd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:09.943480 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505823488}
W20260709 13:19:10.032672  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.034438  8175 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:19:10.059933  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:10.061156  8175 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 22: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:10.036827 14846 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:10.032336  8255 pending_rounds.cc:85] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 12
I20260709 13:19:10.100529  8255 pending_rounds.cc:107] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 13:19:10.100914  8255 raft_consensus.cc:2889] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:10.030272  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:10.102346  8783 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:10.035332  8174 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:10.106721  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:10.107757  8174 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 27: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:10.108702  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:10.110978  8180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 970) took 1038 ms. Trace:
I20260709 13:19:10.111068  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:10.007803 14815 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.114969  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:10.115803  8178 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:10.111867  8180 rpcz_store.cc:276] 0709 13:19:09.072250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.640698 (+568448us) service_pool.cc:224] Handling call
0709 13:19:09.640986 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.641188 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:19:09.869252 (+228064us) log.cc:844] Serialized 14 byte log entry
0709 13:19:10.110532 (+241280us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.110604 (+    72us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:10.110668 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.110755 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.110890 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70831,"prepare.queue_time_us":90364,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":1998,"thread_start_us":396288,"threads_started":2}
W20260709 13:19:10.117869 15157 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:19:10.117883  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:10.118032 14846 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.118891  8180 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 24: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:19:10.117172 15131 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:10.119964  8785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 1085) took 1769 ms. Trace:
I20260709 13:19:10.120154  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:10.120719 14846 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:10.122486  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.123915 15071 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:10.124266  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:10.128420  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 990) took 1214 ms. Trace:
I20260709 13:19:10.132191  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:10.128831  8249 rpcz_store.cc:276] 0709 13:19:08.914340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.915336 (+   996us) service_pool.cc:224] Handling call
0709 13:19:08.918641 (+  3305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.932234 (+ 13593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.117231 (+1184997us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b5400196c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:10.128359 (+ 11128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2898304}
I20260709 13:19:10.120407  8785 rpcz_store.cc:276] 0709 13:19:08.350223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.551232 (+201009us) service_pool.cc:224] Handling call
0709 13:19:09.537129 (+985897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.592048 (+ 54919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.119753 (+527705us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b540058d9d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:10.119905 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2266678656}
I20260709 13:19:10.135740  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:10.136763  8182 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 23: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:10.136107  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:10.128212  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:10.149061  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:10.054462 15083 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.167080  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:10.149127 14695 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.153975 14989 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:10.159749 15031 consensus_meta.cc:287] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.858s	user 0.006s	sys 0.003s
I20260709 13:19:10.190567  8223 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:10.130139 15143 log.cc:927] Time spent T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:19:10.161332  8785 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:19:10.192574  8785 pending_rounds.cc:85] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 14
I20260709 13:19:10.192883  8785 pending_rounds.cc:107] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:19:10.193179  8785 raft_consensus.cc:2889] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:09.988528 15121 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:10.160801 15110 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:10.194413  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:19:10.188408 15169 log.cc:927] Time spent T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.369s	user 0.000s	sys 0.005s
I20260709 13:19:10.165769  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:10.201099  8174 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 23: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:10.150350  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:10.202018  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51767.8us
I20260709 13:19:10.026448 15149 consensus_queue.cc:237] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:10.088104  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 298042us
I20260709 13:19:10.204298  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:10.204759  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:10.187757 15023 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:10.180970  8074 leader_election.cc:400] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 26. Current term is 27.
I20260709 13:19:10.208662  8074 leader_election.cc:403] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 13:19:10.186671  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:10.170946  8147 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:10.152673 15165 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:19:10.163048  8177 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:10.198221 14961 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:10.209304  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:10.210326  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.211176  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:10.212035 15136 consensus_queue.cc:1175] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9bd264598fd2483e9e17674bab9ba4e8" responder_term: 21 status { last_received { term: 19 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: [20.13-20.13]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:10.212394 14989 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:10.207930 15150 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:19:10.214987 14907 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 26. Current term is 27.
I20260709 13:19:10.189561 14846 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:10.221845  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:10.222365  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:10.258960  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.227068 15161 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:19:10.232352 15112 consensus_meta.cc:287] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.000s
I20260709 13:19:10.233995 14993 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.234669 14964 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.236007 15062 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:19:10.236479 15039 consensus_meta.cc:287] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.000s
I20260709 13:19:10.195925 15162 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:19:10.176774  8178 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:10.195043 14695 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:10.269835  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:10.243523  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:10.208357 15023 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:10.251662  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 224238us
I20260709 13:19:10.208792 15110 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:19:10.265619  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.274516  8178 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:19:10.194653 15031 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.278812  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:10.279628  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:10.281037  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:10.281531  8072 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:10.253217 15097 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.286542  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2289) took 1261 ms. Trace:
I20260709 13:19:10.287075  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3447) took 1211 ms. Trace:
I20260709 13:19:10.288077  8104 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:10.288339  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.286978  8176 rpcz_store.cc:276] 0709 13:19:09.025058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.394093 (+369035us) service_pool.cc:224] Handling call
0709 13:19:09.394451 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.394855 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:09.394892 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.395413 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.740472 (+345059us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:09.740531 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.740648 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.286328 (+545680us) raft_consensus.cc:1685] finished
0709 13:19:10.286350 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.286481 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14870,"raft.queue_time_us":2008,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":11168,"thread_start_us":344608,"threads_started":1,"wal-append.queue_time_us":459619}
I20260709 13:19:10.254988 14989 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.249087 14973 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:19:10.285672 15170 log.cc:927] Time spent T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:19:10.285931 15031 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:10.217962 15108 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:19:10.252959 15041 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.278360 15004 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:10.287606  8107 rpcz_store.cc:276] 0709 13:19:09.075252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.075365 (+   113us) service_pool.cc:224] Handling call
0709 13:19:09.075670 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.075997 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.076025 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.093981 (+ 17956us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.894705 (+800724us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:09.908542 (+ 13837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.908670 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.286864 (+378194us) raft_consensus.cc:1685] finished
0709 13:19:10.286889 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.287018 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4742,"raft.queue_time_us":1750,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":7229,"thread_start_us":732095,"threads_started":1,"wal-append.queue_time_us":917626}
I20260709 13:19:10.288370 15111 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:10.297762  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 3114) took 1739 ms. Trace:
I20260709 13:19:10.270208 14965 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.265317 14846 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:10.300017  8183 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:10.274922 15040 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:10.279796 15023 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:10.305413 15150 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:10.274451 15039 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:10.310750 15162 raft_consensus.cc:3055] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:10.292943 14907 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:19:10.295083  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:10.339392  8072 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:10.297638 14989 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:10.343128 15183 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:19:10.308809 15071 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
W20260709 13:19:10.346051 15185 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:10.347559 15083 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.347865 15039 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.314976  8179 rpcz_store.cc:276] 0709 13:19:08.558247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.558419 (+   172us) service_pool.cc:224] Handling call
0709 13:19:08.558788 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.685715 (+126927us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:08.685745 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.696727 (+ 10982us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.536797 (+840070us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b18003d54c0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:19:09.707439 (+170642us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:09.707477 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.707539 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.290889 (+583350us) raft_consensus.cc:1685] finished
0709 13:19:10.290916 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.297673 (+  6757us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":134492,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8410,"spinlock_wait_cycles":36932992,"thread_start_us":274260,"threads_started":2,"wal-append.queue_time_us":1055950}
I20260709 13:19:10.335402 15162 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:10.329994 15150 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:10.349124 15162 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:10.350061 15184 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:19:10.350574 15162 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:10.350271 15150 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:10.351611 15150 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:10.297299 14932 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:10.267758 15112 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:10.358989 15155 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.000s
I20260709 13:19:10.359505 15155 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:10.359967 15112 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:10.360793  8178 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:10.351636 14695 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.363054 15155 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.298260 14964 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:19:10.336035 15040 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.326541 14965 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:10.373394 15040 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.379649 15040 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.309664  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.329689 15111 raft_consensus.cc:697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:10.301841 15053 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:19:10.325064 14846 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:10.409536 14815 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:10.411222 15031 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:10.411672 15031 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.412050 15031 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:10.355646 14907 consensus_queue.cc:1243] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer 5033fc7e66374940a203908ea8b0078f log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:19:10.298144 15097 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.317847 15004 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:10.414001 15111 consensus_queue.cc:237] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:10.415056 15097 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.350284  8179 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:10.283456  8174 raft_consensus.cc:2410] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:19:10.318328 15041 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.418540 15041 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.356020 14993 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:19:10.420446 14978 consensus_meta.cc:287] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.820s	user 0.013s	sys 0.003s
W20260709 13:19:10.421101  8786 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1302) took 1349 ms (client timeout 1723 ms). Trace:
I20260709 13:19:10.325110 15191 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:10.285714 15011 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
W20260709 13:19:10.385615  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 76040.2us
I20260709 13:19:10.461856  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.291268 14977 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.465395  8107 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:10.427915  8782 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
W20260709 13:19:10.476191  8784 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48096 (request call id 1087) took 1567 ms (client timeout 2085 ms). Trace:
W20260709 13:19:10.423555  8786 rpcz_store.cc:269] 0709 13:19:09.071541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.403092 (+331551us) service_pool.cc:224] Handling call
0709 13:19:10.420878 (+1017786us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b540038e854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:10.421032 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1620820736}
I20260709 13:19:10.463541  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:10.476655  8784 rpcz_store.cc:269] 0709 13:19:08.908695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.909136 (+   441us) service_pool.cc:224] Handling call
0709 13:19:10.461905 (+1552769us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400362c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:10.476121 (+ 14216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348046592}
W20260709 13:19:10.487593  8789 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50464 (request call id 1284) took 2274 ms (client timeout 1831 ms). Trace:
W20260709 13:19:10.488056  8789 rpcz_store.cc:269] 0709 13:19:08.188058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.214271 (+ 26213us) service_pool.cc:224] Handling call
0709 13:19:10.462374 (+2248103us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b540050e1d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:10.462476 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988508928}
I20260709 13:19:10.422955 14695 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:10.476063  8782 pending_rounds.cc:85] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 13
I20260709 13:19:10.503737  8782 pending_rounds.cc:107] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:19:10.504163  8782 raft_consensus.cc:2889] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:10.504616  8782 pending_rounds.cc:107] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:19:10.504931  8782 raft_consensus.cc:2889] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:10.506629 15110 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:10.509941 15134 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:10.510483 15134 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:10.511413 15134 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:10.512674 15134 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:10.513592 15041 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:10.514312 15041 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.517225 15041 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:10.519069  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.459369 15112 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.462327 15191 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:10.527717  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:10.489071 15053 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:19:10.494179 15013 consensus_meta.cc:287] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.009s
I20260709 13:19:10.536381  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:10.529678  8107 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:10.531764  8099 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:19:10.527153 14953 consensus_meta.cc:287] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.775s	user 0.016s	sys 0.000s
I20260709 13:19:10.544859  8180 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
W20260709 13:19:10.547241  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.552675  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.550176  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:10.553917  8099 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:10.538018 14695 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:10.532536 15191 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:10.566450  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:10.569866  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:10.570715  8108 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:10.533080 15053 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:10.567283  8074 leader_election.cc:400] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 26. Current term is 27.
I20260709 13:19:10.588850  8250 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:10.589289  8252 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:19:10.591051  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:10.550879 14953 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:10.595000  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:10.597338  8100 raft_consensus.cc:2410] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 23 because replica has last-logged OpId of term: 21 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 9.
I20260709 13:19:10.529742 15112 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.592391  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.600931  8249 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:19:10.602486  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.607734  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:10.608620  8257 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:10.610855  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:10.615847  8099 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:10.606040  8108 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:10.593039 15053 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:10.620883  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:10.621687  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:10.630964 15200 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:19:10.634011  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.598795 15155 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.618438 15201 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:10.630791 15154 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:10.594381 15162 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:19:10.636233  8249 raft_consensus.cc:2410] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 23 because replica has last-logged OpId of term: 21 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 9.
I20260709 13:19:10.637521  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.624056  8107 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:10.638756  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:10.610011 15163 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:10.625065 15116 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.643491 15155 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:10.672780 15168 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.698s	user 0.004s	sys 0.000s
I20260709 13:19:10.639424 15180 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:10.736814 15180 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:10.737246 15180 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:10.639595 14907 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:10.661402 14964 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:19:10.680004 15116 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.683276  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:10.684703  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:10.685477 15137 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:10.686285 15134 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:10.689580 15189 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:10.692837 14846 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.705165 15120 raft_consensus.cc:3055] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:10.708803  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 1093) took 1603 ms. Trace:
I20260709 13:19:10.713598 15124 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.643020 15041 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:10.715119  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:10.648999 14841 consensus_meta.cc:287] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.782s	user 0.012s	sys 0.000s
I20260709 13:19:10.700906 14989 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.674012 14695 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:10.728590  8221 leader_election.cc:400] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18.
I20260709 13:19:10.730484  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:10.730706  8072 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:10.742825 15061 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:10.735966 15023 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.654687 15004 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:10.742054  8181 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:19:10.745393  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:10.754415  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 69833.2us
W20260709 13:19:10.796092  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 65526.5us
W20260709 13:19:10.730525 15209 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.053s	user 0.000s	sys 0.006s
I20260709 13:19:10.766320 14977 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.763993  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:10.764422  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:10.765722  8791 rpcz_store.cc:276] 0709 13:19:09.105073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.628824 (+523751us) service_pool.cc:224] Handling call
0709 13:19:09.629052 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.668590 (+ 39538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.708511 (+1039921us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b54007201d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:10.708739 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89477376}
I20260709 13:19:10.765708  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.807240  8101 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:10.767876  8174 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:10.810667 15116 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:10.742848 15044 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.813784 15044 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.781744 15039 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:10.721621 14971 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:10.814862 15039 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.784236 15041 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.815622 14971 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:10.817225 15041 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.817828 15041 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:10.818370 15174 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:10.818447 15041 consensus_queue.cc:1059] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:19:10.781206  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 52812.7us
I20260709 13:19:10.822197 14965 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.822970  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:10.823455 15112 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:10.823597  8251 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
W20260709 13:19:10.823909  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.783499  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:10.722074 15011 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:10.825973  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:10.827251  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:10.762506 15203 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:10.828955 15203 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:10.828586  8105 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:10.784427 15124 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.830130 15203 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:10.831666 14989 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:10.832700 15145 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 1.419s	user 0.001s	sys 0.002s
I20260709 13:19:10.834215 14846 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:10.781919 14724 raft_consensus.cc:3055] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:10.768847 15120 raft_consensus.cc:740] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:10.840377  8103 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: [20.17-20.17]
I20260709 13:19:10.836737  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:10.837147  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:10.828322 15050 raft_consensus.cc:3055] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:10.839697  8180 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:10.827320 15155 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.832621 15124 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:10.843211  8101 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
W20260709 13:19:10.852348  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 214923us
W20260709 13:19:10.795465 15106 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.010s	sys 0.007s
I20260709 13:19:10.847856  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:10.854374  8257 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:10.853459  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:10.863299  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:10.864665  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:10.867610  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 57953.1us
I20260709 13:19:10.781257 14841 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.869022  8182 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 21: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:10.840790 14964 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.835830 15053 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:10.838780 14724 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:19:10.856631 15106 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.011s	sys 0.007s
I20260709 13:19:10.872747  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.871795  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:10.845536 15050 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:10.880272  8182 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:10.807291 15191 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.853706  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.896894  8248 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:10.866482 15112 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:10.906876  8181 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: []
W20260709 13:19:10.926788  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 54142.3us
I20260709 13:19:10.931830  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:10.885151  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 232103us
I20260709 13:19:10.935828  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:10.929893 15112 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:10.941563  8785 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:19:10.876384 15116 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:10.954710  8782 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:10.878731 14964 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:10.946225  8783 raft_consensus.cc:1240] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:10.940691  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 87094.9us
I20260709 13:19:10.950057 15040 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:10.950451  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.954645  8107 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:10.944757  8786 raft_consensus.cc:1275] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:10.957414  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.918197 15202 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:19:10.898102 15023 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:10.972649  8784 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:10.931977 14961 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.878652 15106 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 18 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:10.963356  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:10.972398  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:10.974665 15224 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:10.975138 15050 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.972854 15116 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:10.977130 14977 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:10.977631  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 3131) took 2065 ms. Trace:
I20260709 13:19:10.978219 15191 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:10.987254  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:10.981091  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:10.984236  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:19:10.980250 15031 consensus_meta.cc:287] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.001s
I20260709 13:19:10.943746 15178 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:10.943331 15112 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:10.961761  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:10.971318 15044 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.995850  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.998849 15218 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:10.999282 15218 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.999596 15218 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:10.999792  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.999899 14965 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:11.001052 15011 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:11.001646 15201 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:11.001827 15189 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.002557 15189 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.982380 15202 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:11.017611 15202 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:11.018854 15202 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:11.020392 15202 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:11.020605 15050 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:11.021646 15219 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:19:11.024509 14971 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:11.025923 15116 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 21.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:11.027112 15187 log.cc:927] Time spent T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.742s	user 0.000s	sys 0.005s
I20260709 13:19:11.027321 14971 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:11.001667 15011 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.994462  8182 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:19:11.014168 15216 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:19:11.015851 15220 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:11.017264 15106 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:10.986357  8253 rpcz_store.cc:276] 0709 13:19:08.911849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.912248 (+   399us) service_pool.cc:224] Handling call
0709 13:19:08.912569 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:08.913970 (+  1401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.913999 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:08.914646 (+   647us) log.cc:844] Serialized 52 byte log entry
0709 13:19:10.521539 (+1606893us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b18001dc800. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:19:10.741164 (+219625us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:10.741217 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.741314 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.977321 (+236007us) raft_consensus.cc:1685] finished
0709 13:19:10.977340 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.977572 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":987,"raft.queue_time_us":15917,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5714,"spinlock_wait_cycles":10156928,"thread_start_us":219420,"threads_started":1,"wal-append.queue_time_us":1917697}
I20260709 13:19:10.988700  8782 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:10.982900 15224 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.090240 14964 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:11.084414 15084 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:11.088656 15112 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:11.076924  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:11.074712 15154 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:19:11.004492 14977 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.091436 15136 consensus_queue.cc:1059] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:11.085769  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:11.003784 15036 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:19:11.095088  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:11.146798  8099 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:11.093212 15189 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:11.090056  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:11.150292  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:11.151309  8108 raft_consensus.cc:2410] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:19:11.152192  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:11.152851  8784 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:11.074873 14953 consensus_queue.cc:1048] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 13:19:11.074502 15134 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:19:11.029206 15137 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:11.096654  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:11.163524  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 66949.3us
I20260709 13:19:11.146627 14977 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:11.164597  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:10.983435 14961 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:11.004840 15023 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 13:19:11.063249  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:10.979156 15155 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:19:11.091729 15039 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:11.089821 14841 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:10.958950 14724 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:11.079756  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:11.182889  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 3125) took 1051 ms. Trace:
I20260709 13:19:11.181557  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:11.183319  8175 rpcz_store.cc:276] 0709 13:19:10.131262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.131905 (+   643us) service_pool.cc:224] Handling call
0709 13:19:11.079637 (+947732us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b58000d7d98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27eee 0000000000375939 00007fa5a5d9b1e0 00007fa5a5e640c4 00007fa5a5e64131 00007fa5a5e120a0 00007fa5a5e11984 00007fa59f38c6d4 00007fa59f38c662
0709 13:19:11.182831 (+103194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12673792}
I20260709 13:19:11.184708  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:11.185268  8175 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:11.090605 15053 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:10.900928 15120 consensus_queue.cc:260] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:11.049587 15044 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.958833 15221 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:19:11.085899 15225 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:11.030900  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:11.028548 15011 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:11.082114 15177 log.cc:927] Time spent T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.790s	user 0.000s	sys 0.002s
I20260709 13:19:11.133226  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:11.133831  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:11.226333  8105 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:11.056109 15149 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.072s
I20260709 13:19:11.226773  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:11.120640 15124 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:11.227559  8782 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:11.227653  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:11.228420  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:10.998219 15031 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:11.140466  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:11.142253  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.134910 15224 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:11.166028 15217 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:11.126663 15180 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:11.172127 15112 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:11.180784  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 117631us
I20260709 13:19:11.242364  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:11.242748  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:11.238620 15154 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:19:11.244414  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.241169 15124 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:11.179620  8108 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:19:11.178457 14695 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:11.176187 15137 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:11.182955 15164 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:11.253587  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:11.221344  8099 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:19:11.181751 14989 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:11.235492  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:11.266600  8103 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:11.268213 14989 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:11.269418  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:11.269986  8250 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 24
W20260709 13:19:11.270527 15228 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:19:11.272179 15232 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:19:11.274067  8789 pending_rounds.cc:85] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 13
I20260709 13:19:11.274364  8789 pending_rounds.cc:107] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:19:11.274600  8789 raft_consensus.cc:2889] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:11.277372  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2298) took 1284 ms. Trace:
I20260709 13:19:11.277791  8177 rpcz_store.cc:276] 0709 13:19:09.993077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.993206 (+   129us) service_pool.cc:224] Handling call
0709 13:19:10.129645 (+136439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.223179 (+ 93534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.277182 (+1054003us) spinlock_profiling.cc:243] Waited 76.2 ms on lock 0x7b54001c25d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:11.277312 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175353216}
I20260709 13:19:11.279119  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:11.279525 15011 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:11.279917  8177 raft_consensus.cc:2410] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:19:11.280128  8788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1915) took 1649 ms. Trace:
I20260709 13:19:11.280476  8788 rpcz_store.cc:276] 0709 13:19:09.630434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.671551 (+ 41117us) service_pool.cc:224] Handling call
0709 13:19:09.671847 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.672347 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.672374 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.694289 (+ 21915us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.087598 (+393309us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:10.087673 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.087800 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.081404 (+993604us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:11.279847 (+198443us) raft_consensus.cc:1685] finished
0709 13:19:11.279869 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.280071 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7472,"raft.queue_time_us":429,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":12261,"spinlock_wait_cycles":13977472,"thread_start_us":348800,"threads_started":1,"wal-append.queue_time_us":488448}
I20260709 13:19:11.281493  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 3131) took 1101 ms. Trace:
I20260709 13:19:11.281548 15031 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:11.282001  8183 rpcz_store.cc:276] 0709 13:19:10.180223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.186394 (+  6171us) service_pool.cc:224] Handling call
0709 13:19:11.281329 (+1094935us) spinlock_profiling.cc:243] Waited 89.9 ms on lock 0x7b5400331b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:11.281421 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206855552}
I20260709 13:19:11.283262  8183 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:11.222577 15044 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:11.250178 15225 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:11.245847  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:11.218869 15053 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:11.246274  8791 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:11.208446  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:11.223145 15120 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:11.186586 14953 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:11.259629  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.254520  8106 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:11.244289 15154 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:11.241173 14841 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:11.260500  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:11.215451 14973 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
W20260709 13:19:11.226563 15150 consensus_queue.cc:1175] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5033fc7e66374940a203908ea8b0078f" responder_term: 15 status { last_received { term: 14 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:11.263870  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:11.259034  8784 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
W20260709 13:19:11.291543  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 110127us
I20260709 13:19:11.263141 15164 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:11.266845  8179 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:11.292219  8250 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:11.300649  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:11.261305 14695 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:11.313913  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:11.318975  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:11.318909  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:11.330523  8788 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:11.291006  8175 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:11.330796  8147 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:11.344255  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:11.344758  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:11.345069  8101 raft_consensus.cc:2393] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 21: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:11.331306  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:11.332983  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:11.336278  8174 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:11.346019  8100 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:11.351835 14695 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:11.355536  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:11.356923 15154 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:11.358465  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2305) took 1148 ms. Trace:
I20260709 13:19:11.358196 15218 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:11.358826  8178 rpcz_store.cc:276] 0709 13:19:10.210191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.276272 (+ 66081us) service_pool.cc:224] Handling call
0709 13:19:10.276533 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.361230 (+ 84697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.358240 (+997010us) spinlock_profiling.cc:243] Waited 84 ms on lock 0x7b54001c39d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:11.358414 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193274240}
I20260709 13:19:11.360479 15218 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:11.333549 15023 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:11.361585 14953 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:11.362130 14953 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:11.312801 15071 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.367435  8182 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 13:19:11.316463 15053 raft_consensus.cc:697] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:11.367599  8183 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 19. Current term is 20. Ops: []
W20260709 13:19:11.382906  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 52172us
W20260709 13:19:11.440769  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 107838us
I20260709 13:19:11.334842 14841 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:11.329639 15225 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:11.500432  8790 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 18 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:11.442126  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:11.597599  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:11.525847  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.516266  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:11.560518  8100 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:19:11.504755  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:11.611470  8104 raft_consensus.cc:2393] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:19:11.616103  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.501652  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:11.501955 15192 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:19:11.709967  8256 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
W20260709 13:19:11.775717  8074 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.130:46389 timed out after 2.119s (SENT) [suppressed 15 similar messages]
W20260709 13:19:11.721062  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.397501 15071 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:11.788111 15071 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:11.798543 15071 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:11.791049 15031 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:11.793721 15248 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.394s	user 0.001s	sys 0.000s
I20260709 13:19:11.376385 15129 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:11.439903 15040 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.799700 15044 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:11.789073  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:11.789659 15053 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:11.895725  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.721177 15124 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:12.002889  8789 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.023s	sys 0.019s
W20260709 13:19:12.029944  8789 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.023s	sys 0.019s
I20260709 13:19:11.442205 15221 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:11.361357 15023 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:11.896739 15071 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:12.019994 14964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.027s	sys 0.073s
I20260709 13:19:12.040548 14907 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:12.062642 14964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.028s	sys 0.073s
I20260709 13:19:12.062860 14907 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.065539 14907 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:12.072765 14977 consensus_meta.cc:287] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.890s	user 0.009s	sys 0.000s
I20260709 13:19:12.045364  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:12.063262 14964 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:12.051978 14953 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:12.082512 14961 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:12.088001  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:11.969302 15245 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:12.134038  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:12.134882  8251 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:12.058604  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:12.137629  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.608508 15164 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:11.975853 15031 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:12.115110 15248 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:19:12.139773 15011 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.034s	sys 0.046s
I20260709 13:19:12.054788 15221 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:12.105523 15071 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:12.138028  8256 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:11.993652 15129 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.147818  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 3140) took 1017 ms. Trace:
I20260709 13:19:12.020891 15040 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.154398  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:12.161885  8250 raft_consensus.cc:2410] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:19:12.162262  8175 rpcz_store.cc:276] 0709 13:19:11.130790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.341065 (+210275us) service_pool.cc:224] Handling call
0709 13:19:11.341410 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.341661 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:19:11.344394 (+  2733us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.147191 (+802797us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.147490 (+   299us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:12.147546 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.147617 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.147753 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3977,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":389491,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":801895,"threads_started":2,"wal-append.queue_time_us":813500}
I20260709 13:19:12.144798 14964 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:19:12.164889  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 389207us
W20260709 13:19:12.165884  8149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.008s	sys 0.040s
W20260709 13:19:12.168589  8149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.009s	sys 0.041s
I20260709 13:19:12.170238  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:12.126931 14977 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:12.169142  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 727074us
W20260709 13:19:12.157375 15011 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.034s	sys 0.047s
I20260709 13:19:12.146488 15245 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.189751 15023 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:12.208356  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.179404 15137 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:12.222718  8782 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.020s	sys 0.067s
W20260709 13:19:12.223428  8782 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.020s	sys 0.067s
I20260709 13:19:12.230406  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:12.234965  8147 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.013s	sys 0.029s
W20260709 13:19:12.261016  8147 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.013s	sys 0.037s
I20260709 13:19:12.213796 14841 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:12.261497  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 874019us
I20260709 13:19:12.262115  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:12.205727 15221 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:12.260666 14695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.007s	sys 0.038s
I20260709 13:19:12.235569 15225 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:12.268661 15255 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:19:12.225818 15023 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.278350  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 995) took 2510 ms. Trace:
I20260709 13:19:12.289467  8248 rpcz_store.cc:276] 0709 13:19:09.762565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.763562 (+   997us) service_pool.cc:224] Handling call
0709 13:19:09.763885 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.929845 (+1165960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.272880 (+1343035us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002805d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:12.273101 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2583476992}
I20260709 13:19:12.226135 15257 consensus_queue.cc:1059] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:19:12.283099 15040 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:12.283461 15254 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:19:12.234062 14964 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:12.285535  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:12.286227 15253 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:19:12.293344  8248 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 19. Current term is 20. Ops: []
W20260709 13:19:12.271960 14695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.008s	sys 0.038s
I20260709 13:19:12.300806  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 3157) took 1009 ms. Trace:
W20260709 13:19:12.301604  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.302241  8248 rpcz_store.cc:276] 0709 13:19:11.291035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.292831 (+1001796us) service_pool.cc:224] Handling call
0709 13:19:12.293154 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.300499 (+  7345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.300742 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:12.297502 14932 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.019s	sys 0.039s
I20260709 13:19:12.301230 15260 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.332949 15266 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:12.336609 15116 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.337769 15150 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.338716 14955 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:12.361568 14841 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.362588 15040 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.293574 15023 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:12.374624 14932 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.019s	sys 0.039s
W20260709 13:19:12.326478 15134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.020s	sys 0.021s
I20260709 13:19:12.381636  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:12.375272 15116 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.326671 15129 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:12.387805  8175 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
W20260709 13:19:12.382552 15253 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:12.394619 14907 consensus_queue.cc:1059] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:12.405355 14907 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:12.405797 14907 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:12.383641 14841 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.406657 14907 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.407171 15023 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:12.380621 15150 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:12.407778 14841 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:12.407867 14907 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:12.395606 15116 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:12.380084 15260 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.409523 15150 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:12.376766 14955 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:12.411021 15260 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:12.411620 14955 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:12.395197 15097 raft_consensus.cc:3055] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:12.412739 15097 raft_consensus.cc:740] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:19:12.413672 15233 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.175s	user 0.004s	sys 0.025s
I20260709 13:19:12.413626 15097 consensus_queue.cc:260] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.414732 15097 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:12.417155  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 3148) took 1164 ms. Trace:
I20260709 13:19:12.399441  8105 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 27 index: 13. (index mismatch)
I20260709 13:19:12.377766 15031 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:12.382866 15134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.203s	user 0.020s	sys 0.021s
I20260709 13:19:12.408991  8782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1314) took 1437 ms. Trace:
I20260709 13:19:12.403709  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2304) took 1501 ms. Trace:
W20260709 13:19:12.397547 15250 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.439s	user 0.003s	sys 0.000s
I20260709 13:19:12.419255  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3486) took 1363 ms. Trace:
I20260709 13:19:12.417542  8253 rpcz_store.cc:276] 0709 13:19:11.252586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.253459 (+   873us) service_pool.cc:224] Handling call
0709 13:19:11.263048 (+  9589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.342259 (+ 79211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.342288 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.342343 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:11.342374 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.416933 (+1074559us) spinlock_profiling.cc:243] Waited 79 ms on lock 0x7b54002e9354. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:12.416976 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.417100 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181755776}
I20260709 13:19:12.428507  8103 rpcz_store.cc:276] 0709 13:19:10.902317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.234133 (+331816us) service_pool.cc:224] Handling call
0709 13:19:11.266361 (+ 32228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.267049 (+   688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.403471 (+1136422us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b54001685d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:12.403637 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73446144}
I20260709 13:19:12.428373  8782 rpcz_store.cc:276] 0709 13:19:10.971605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.236321 (+264716us) service_pool.cc:224] Handling call
0709 13:19:11.236592 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.284826 (+ 48234us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b48000606d8. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a5d75aa1 00007fa5a5d6cb37 00007fa5a5d6c9ca 00007fa5a5e6426f 00007fa5a5e63f37 00007fa5a5e7855c 00007fa5a5e78508 00007fa5a5e78488 00007fa5a5e78443 00007fa5a5e776ec 00007fa5a4da1a96
0709 13:19:11.514435 (+229609us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:19:11.558858 (+ 44423us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.224020 (+665162us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.231053 (+  7033us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.231208 (+   155us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:12.231240 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.231300 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.408670 (+177370us) raft_consensus.cc:1685] finished
0709 13:19:12.408787 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.408931 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11304,"prepare.queue_time_us":46273,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":43,"raft.queue_time_us":26270,"raft.run_cpu_time_us":2644,"raft.run_wall_time_us":70477,"spinlock_wait_cycles":40762752,"thread_start_us":942046,"threads_started":2,"wal-append.queue_time_us":762887}
W20260709 13:19:12.461462  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.432250  8108 rpcz_store.cc:276] 0709 13:19:11.055824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.247585 (+191761us) service_pool.cc:224] Handling call
0709 13:19:11.247927 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.251626 (+  3699us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:11.288050 (+ 36424us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.461679 (+173629us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:11.462246 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.462414 (+   168us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:11.462458 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.462545 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.410821 (+948276us) raft_consensus.cc:1685] finished
0709 13:19:12.410844 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.419182 (+  8338us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50143,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":37,"raft.queue_time_us":1162,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":61840,"thread_start_us":122361,"threads_started":1,"wal-append.queue_time_us":790816}
I20260709 13:19:12.387486 15245 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:12.495499  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:12.380285 15266 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:12.383018 15040 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.503944 15040 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:12.513692  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:12.507133  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 240560us
I20260709 13:19:12.516252  8253 raft_consensus.cc:2410] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:19:12.516106  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:12.518862  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:12.519541  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1315) took 1537 ms. Trace:
I20260709 13:19:12.520026  8789 rpcz_store.cc:276] 0709 13:19:10.982542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.273565 (+291023us) service_pool.cc:224] Handling call
0709 13:19:11.273879 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:11.291331 (+ 17452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.291360 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:11.291883 (+   523us) log.cc:844] Serialized 52 byte log entry
0709 13:19:11.326685 (+ 34802us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:12.030526 (+703841us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.043595 (+ 13069us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.043834 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.043934 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.396917 (+352983us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:12.518765 (+121848us) raft_consensus.cc:1685] finished
0709 13:19:12.519345 (+   580us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.519481 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21017,"prepare.queue_time_us":27035,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":40620,"raft.run_cpu_time_us":446,"raft.run_wall_time_us":71020,"spinlock_wait_cycles":66598016,"thread_start_us":718768,"threads_started":2,"wal-append.queue_time_us":243991}
I20260709 13:19:12.524348  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2312) took 1686 ms. Trace:
I20260709 13:19:12.524858  8181 rpcz_store.cc:276] 0709 13:19:10.837902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.841026 (+  3124us) service_pool.cc:224] Handling call
0709 13:19:10.841374 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.930261 (+ 88887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.524035 (+1593774us) spinlock_profiling.cc:243] Waited 59.3 ms on lock 0x7b5400332a54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:12.524267 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136466688}
I20260709 13:19:12.534595  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 3138) took 1433 ms. Trace:
I20260709 13:19:12.535014 15266 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:12.544476 14977 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:12.535027  8182 rpcz_store.cc:276] 0709 13:19:11.101160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.286908 (+185748us) service_pool.cc:224] Handling call
0709 13:19:11.287178 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.368056 (+ 80878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.534359 (+1166303us) spinlock_profiling.cc:243] Waited 79.9 ms on lock 0x7b54001c2ad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:12.534536 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183805824}
W20260709 13:19:12.563709 15120 consensus_meta.cc:287] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 1.251s	user 0.012s	sys 0.000s
W20260709 13:19:12.660728  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.626350  8177 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:19:12.643766  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:12.619144  8790 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 1096) took 1685 ms. Trace:
I20260709 13:19:12.665819  8107 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
W20260709 13:19:12.624357  8180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 980) took 1899 ms (client timeout 2229 ms). Trace:
W20260709 13:19:12.666803  8180 rpcz_store.cc:269] 0709 13:19:10.724569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.746033 (+ 21464us) service_pool.cc:224] Handling call
0709 13:19:12.624140 (+1878107us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b540031f6d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:12.624289 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74291072}
I20260709 13:19:12.627504  8788 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1318) took 1605 ms. Trace:
I20260709 13:19:12.632661  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:12.668120  8788 rpcz_store.cc:276] 0709 13:19:11.022117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.316791 (+294674us) service_pool.cc:224] Handling call
0709 13:19:11.330333 (+ 13542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.351284 (+ 20951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.627264 (+1275980us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b540065f4d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:12.627435 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30429440}
I20260709 13:19:12.588284  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3475) took 2027 ms. Trace:
I20260709 13:19:12.631606  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:12.623386  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3560) took 1261 ms. Trace:
I20260709 13:19:12.613087  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2294) took 2190 ms. Trace:
I20260709 13:19:12.595857  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:12.672722  8101 raft_consensus.cc:2410] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:19:12.671185  8102 rpcz_store.cc:276] 0709 13:19:10.423106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.425571 (+  2465us) service_pool.cc:224] Handling call
0709 13:19:10.425925 (+   354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:10.476055 (+ 50130us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:19:10.522175 (+ 46120us) log.cc:844] Serialized 14 byte log entry
0709 13:19:10.753423 (+231248us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:10.767901 (+ 14478us) log.cc:844] Serialized 52 byte log entry
0709 13:19:10.768061 (+   160us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:10.768267 (+   206us) log.cc:844] Serialized 14 byte log entry
0709 13:19:10.781508 (+ 13241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.781611 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.818140 (+ 36529us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b18004bb1a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dcd9c0a 00007fa5a7419219 00007fa5a4d2058f 00007fa59dd5f571 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd
0709 13:19:12.040347 (+1222207us) spinlock_profiling.cc:243] Waited 9.83 ms on lock 0x7b18004bb1a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f557 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:19:12.189866 (+149519us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b18004bb1a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f522 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:19:12.610002 (+420136us) spinlock_profiling.cc:243] Waited 8.09 ms on lock 0x7b18004bb1a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:19:12.612765 (+  2763us) raft_consensus.cc:1685] finished
0709 13:19:12.612803 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.612982 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61823,"prepare.queue_time_us":59965,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":66055,"raft.run_cpu_time_us":423,"raft.run_wall_time_us":22655,"spinlock_wait_cycles":84818816,"thread_start_us":230699,"threads_started":1,"wal-append.queue_time_us":276593}
I20260709 13:19:12.665706  8790 rpcz_store.cc:276] 0709 13:19:10.934107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.934681 (+   574us) service_pool.cc:224] Handling call
0709 13:19:10.934954 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.606547 (+671593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.618853 (+1012306us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b5400362c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:12.619071 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299785600}
I20260709 13:19:12.669953  8257 rpcz_store.cc:276] 0709 13:19:11.361960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.622329 (+1260369us) service_pool.cc:224] Handling call
0709 13:19:12.622755 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.622977 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.623014 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.623071 (+    57us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:19:12.623113 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.623182 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.623318 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.675894  8105 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 18: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:12.642547  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:12.682356  8108 raft_consensus.cc:2393] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 19: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:12.669365  8106 rpcz_store.cc:276] 0709 13:19:10.561357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.561532 (+   175us) service_pool.cc:224] Handling call
0709 13:19:10.561866 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.309075 (+747209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.587897 (+1278822us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b5400287654. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:12.588196 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1587241344}
W20260709 13:19:12.688202  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.692325  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.574285 15132 raft_consensus.cc:3055] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:12.575129 15180 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:12.701969  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.722404  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.703940  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:12.723242  8790 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:19:12.705175 15023 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:12.706151 15266 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:12.707139 15219 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:12.712137  8072 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:12.594771 15061 raft_consensus.cc:3055] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:19:12.679608 15224 consensus_meta.cc:287] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 1.429s	user 0.013s	sys 0.000s
I20260709 13:19:12.625744 15121 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:12.732475 14965 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.699182 15132 raft_consensus.cc:740] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:12.735816  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:12.596056 15031 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:12.778192  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:12.590557 14907 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:12.752897  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:12.782105  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:12.782835  8181 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:12.783838  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:12.784767  8181 raft_consensus.cc:2410] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:19:12.753840  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:12.754379  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:12.692595 14977 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.756215  8183 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:12.696322 15269 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.799644  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 3133) took 1700 ms. Trace:
I20260709 13:19:12.799443 15269 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:12.800038  8177 rpcz_store.cc:276] 0709 13:19:11.099430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.280536 (+181106us) service_pool.cc:224] Handling call
0709 13:19:12.625916 (+1345380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.664559 (+ 38643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.799445 (+134886us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540031f6d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:12.799590 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3093405440}
I20260709 13:19:12.627872 15217 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:12.802055 15217 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:19:12.803764  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.804092  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:12.804704 15116 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:12.805243 15116 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:12.805914  8791 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48096 (request call id 1097) took 1870 ms (client timeout 1804 ms). Trace:
W20260709 13:19:12.806283  8791 rpcz_store.cc:269] 0709 13:19:10.935346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.935493 (+   147us) service_pool.cc:224] Handling call
0709 13:19:12.805740 (+1870247us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b540039d0d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:12.805848 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705978240}
I20260709 13:19:12.770032  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:12.807314 15116 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:12.807404  8178 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
W20260709 13:19:12.808164  8223 connection.cc:256] RPC call timeout handler was delayed by -1.2953951299998607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
I20260709 13:19:12.808728 15120 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.809209 15120 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:12.810730  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 1932) took 1714 ms. Trace:
I20260709 13:19:12.811470 15116 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.811944 15116 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:12.813989 15116 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:12.814838 15134 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.815305 15134 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.815697 15150 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.816206 15269 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:12.816550 15150 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.817747 15134 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:12.811077  8784 rpcz_store.cc:276] 0709 13:19:11.096040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.330165 (+234125us) service_pool.cc:224] Handling call
0709 13:19:12.809714 (+1479549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.809896 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.809922 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.809961 (+    39us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:19:12.809992 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.810041 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.810574 (+   533us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540039d0d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:12.810668 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3368265088}
I20260709 13:19:12.819089 15150 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:12.811173 15120 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:12.819438 14841 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.821110 14841 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:12.771543  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:12.774384  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:12.822556  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 48273.5us
I20260709 13:19:12.823010 14841 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:12.823251  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:12.775221  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:12.825992  8180 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 21: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:12.787606  8174 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:19:12.747715 15061 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:19:12.796885  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.798233 15041 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:12.814860  8249 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:12.759967 15180 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:12.793282  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:12.828626 14199 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:12.828773  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 58340.4us
W20260709 13:19:12.830195  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 436841us
I20260709 13:19:12.774128  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:12.760257 14974 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:12.834282  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3566) took 1471 ms. Trace:
I20260709 13:19:12.837559  8249 rpcz_store.cc:276] 0709 13:19:11.363304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.814023 (+1450719us) service_pool.cc:224] Handling call
0709 13:19:12.814431 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.833964 (+ 19533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.834219 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.840730  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:12.839174  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3567) took 1475 ms. Trace:
I20260709 13:19:12.777664 15040 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:12.835443  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:12.842402  8249 rpcz_store.cc:276] 0709 13:19:11.363523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.838366 (+1474843us) service_pool.cc:224] Handling call
0709 13:19:12.838696 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.838867 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.838889 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.838927 (+    38us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:12.838955 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.839009 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.839123 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.746973 15266 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:12.741166 15023 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.840869  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:12.827865 15097 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:12.757568 15219 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:12.841352 14841 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:19:12.837436 14846 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:12.834098 15050 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:12.829535 14907 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:12.768383 15224 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.780548 14965 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.778757  8147 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:12.796257 15031 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.832707 14977 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.863627 15040 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:12.846622 14974 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:12.847973 15245 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:19:12.841827 15041 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.882519  8149 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:12.862928 15116 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:12.848548 15180 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.868840 15265 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:19:12.876034 15071 consensus_meta.cc:287] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.710s	user 0.006s	sys 0.005s
I20260709 13:19:12.857105 15269 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
W20260709 13:19:12.896677  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 118096us
W20260709 13:19:12.934294 15275 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:12.892798 14841 consensus_queue.cc:1243] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:19:12.890504 15050 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:12.902495 15221 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:19:12.908239  8146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.467s	user 0.016s	sys 0.030s
W20260709 13:19:12.976444  8146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.536s	user 0.017s	sys 0.030s
W20260709 13:19:12.909523  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 60378.4us
I20260709 13:19:12.896966 15116 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:12.892547 15217 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:12.935464 15224 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:12.893869 15040 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.974038 15053 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:12.871971 15220 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:12.903324  8789 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:19:12.866835 15097 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:12.905189 14973 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:12.907704 15265 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.938741  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 3155) took 1649 ms. Trace:
I20260709 13:19:12.936854 15071 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:13.005328 15251 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 13:19:13.056535  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 79909.3us
I20260709 13:19:13.036352 15164 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.999218  8179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
W20260709 13:19:13.057161  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 309823us
I20260709 13:19:13.087883  8179 raft_consensus.cc:606] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:13.088289  8179 raft_consensus.cc:614] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:13.057554  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 232332us
I20260709 13:19:12.997814 15116 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:13.078464  8256 rpcz_store.cc:276] 0709 13:19:11.289562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.163508 (+873946us) service_pool.cc:224] Handling call
0709 13:19:12.175691 (+ 12183us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:12.184910 (+  9219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.184956 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:12.191651 (+  6695us) log.cc:844] Serialized 52 byte log entry
0709 13:19:12.513251 (+321600us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:12.901277 (+388026us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.907542 (+  6265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.938383 (+ 30841us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.938454 (+    71us) raft_consensus.cc:1685] finished
0709 13:19:12.938477 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.938669 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1893,"prepare.queue_time_us":342868,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":14102,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":35979,"thread_start_us":653551,"threads_started":2,"wal-append.queue_time_us":580301}
I20260709 13:19:13.090360  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:12.898653  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:12.978677 15050 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.036448 15224 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:13.068600 14973 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.095777  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:19:13.089864 15291 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:19:13.106024  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:13.092530 15270 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
W20260709 13:19:13.096827  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 198253us
I20260709 13:19:13.082396 15265 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:13.099669 15280 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:19:13.110507  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:13.099045 15285 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:13.121380  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:13.119822  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:13.125561  8783 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
W20260709 13:19:13.126389  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 291000us
I20260709 13:19:13.098618 14932 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:13.105832 14973 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:13.133575  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:13.129956  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:13.077630 15053 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.108841 15266 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.093695 15164 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.095057 15129 consensus_queue.cc:1059] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:19:13.138655  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:13.149763  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 3146) took 2903 ms. Trace:
I20260709 13:19:13.121729 15220 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:13.223804  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 85254.8us
I20260709 13:19:13.125716 14964 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:13.161880  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3561) took 1799 ms. Trace:
I20260709 13:19:13.231086  8257 rpcz_store.cc:276] 0709 13:19:11.362177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.692496 (+1330319us) service_pool.cc:224] Handling call
0709 13:19:12.692868 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.702791 (+  9923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.702820 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.703278 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.983758 (+280480us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:12.983819 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.983919 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:13.161619 (+177700us) raft_consensus.cc:1685] finished
0709 13:19:13.161644 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.161805 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9524,"raft.queue_time_us":10691,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":280096,"threads_started":1,"wal-append.queue_time_us":392344}
I20260709 13:19:13.091856 15269 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 13:19:13.153214 15294 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:13.108987 15224 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.134239 15023 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:13.133906 15162 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:19:13.131659 15276 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
W20260709 13:19:13.151723 15283 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:19:13.159665 15296 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:19:13.150568 15282 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:19:13.223001 14907 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:13.153970 15284 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
W20260709 13:19:13.152376 15286 log.cc:927] Time spent T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:19:13.159626  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 3152) took 1871 ms. Trace:
I20260709 13:19:13.132134 15285 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.223686  8255 rpcz_store.cc:276] 0709 13:19:10.246527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.246879 (+   352us) service_pool.cc:224] Handling call
0709 13:19:10.247318 (+   439us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:10.258617 (+ 11299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.258651 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:10.259254 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 13:19:12.550445 (+2291191us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b180030f0a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:19:12.746999 (+196554us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:13.121723 (+374724us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.133722 (+ 11999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.133857 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:13.149484 (+ 15627us) raft_consensus.cc:1685] finished
0709 13:19:13.149573 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.149710 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10678,"prepare.queue_time_us":128895,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":61206,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":21106,"spinlock_wait_cycles":6269696,"thread_start_us":528458,"threads_started":2,"wal-append.queue_time_us":2589836}
I20260709 13:19:13.154492 15031 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:13.270664 15031 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:13.265048 15306 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:13.272147 15306 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.272521 15306 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:13.272588 15219 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:13.254630  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.144950 14977 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.273778 14977 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:13.274863 14977 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:13.155277 15097 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:13.144466 15217 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.276909 15217 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:13.265461  8251 rpcz_store.cc:276] 0709 13:19:11.288636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.135633 (+846997us) service_pool.cc:224] Handling call
0709 13:19:12.135996 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.136385 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.136423 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.136950 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.484195 (+347245us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:12.484235 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.484321 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:13.159371 (+675050us) raft_consensus.cc:1685] finished
0709 13:19:13.159397 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.159555 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2702,"raft.queue_time_us":35306,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2542,"thread_start_us":316157,"threads_started":1,"wal-append.queue_time_us":537955}
I20260709 13:19:13.277318 15217 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:13.278344 15217 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.154134 14973 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.281064 14973 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:13.149009 14974 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.143431 15041 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.155891 15071 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.237993 15266 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:13.282491 15266 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.282203 15306 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.156427 15301 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:13.283476 15301 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 24 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:13.285054 14965 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:13.139955 15278 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:13.282944 15266 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:13.287974 15132 consensus_queue.cc:260] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.289172 15132 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:13.284430 15301 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.292466 15136 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:13.292918 15136 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:13.293759 15136 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.294806 15136 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:13.149724 15110 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 13:19:13.302120 15266 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.304333 15266 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.306710 14961 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:13.307122 14961 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:13.307932 14961 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.309088 14961 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:13.268639  8179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:13.261710 15023 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.313156 15023 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.315295 15023 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.269492 15285 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:13.253682 15300 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:13.282913 15040 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:13.310070  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 3156) took 2020 ms. Trace:
I20260709 13:19:13.325958  8250 rpcz_store.cc:276] 0709 13:19:11.289832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.165642 (+875810us) service_pool.cc:224] Handling call
0709 13:19:12.178842 (+ 13200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.184239 (+  5397us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:12.485015 (+300776us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.899695 (+414680us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.900009 (+   314us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.900561 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.900720 (+   159us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:12.900766 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.900875 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:13.309857 (+408982us) raft_consensus.cc:1685] finished
0709 13:19:13.309877 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.310010 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72202,"prepare.queue_time_us":518678,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":1742,"raft.queue_time_us":64084,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":17192,"spinlock_wait_cycles":11204864,"thread_start_us":635201,"threads_started":2,"wal-append.queue_time_us":506221}
I20260709 13:19:13.318783 15116 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.281998 14907 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.261050 15180 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:13.310508  8179 raft_consensus.cc:606] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:13.355067  8179 raft_consensus.cc:614] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:13.330475  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 319137us
I20260709 13:19:13.356230  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:13.357883  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 3159) took 2046 ms. Trace:
I20260709 13:19:13.258258 15162 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.240234 15220 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:13.360895  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 272197us
I20260709 13:19:13.322269 14964 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:13.378585  8223 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:13.395442  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:13.329955 15221 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:13.399523  8179 raft_consensus.cc:2368] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 18. Current term is 19.
W20260709 13:19:13.401415  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.403294  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:19:13.404140  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.405049  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:13.406167  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:13.407734  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:13.379299 15121 consensus_meta.cc:287] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.004s
I20260709 13:19:13.377696 15004 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:13.382656 15110 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:13.412478  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:13.418560  8174 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:13.414376  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:13.419833  8105 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:13.420840  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 183433us
I20260709 13:19:13.358762  8248 rpcz_store.cc:276] 0709 13:19:11.311775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.303315 (+991540us) service_pool.cc:224] Handling call
0709 13:19:12.303699 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.303955 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:12.689698 (+385743us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.357145 (+667447us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.357395 (+   250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:13.357475 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:13.357540 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.357645 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.357808 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8313,"prepare.queue_time_us":475285,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":93,"raft.queue_time_us":87909,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6446,"thread_start_us":1034675,"threads_started":3,"wal-append.queue_time_us":450313}
I20260709 13:19:13.425626  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:13.429912  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:13.363416 14907 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.405736 15269 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:19:13.422797  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 285197us
I20260709 13:19:13.437844  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:13.438690  8101 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:19:13.439826  8107 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:19:13.440326  8107 pending_rounds.cc:85] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 14
I20260709 13:19:13.440599  8107 pending_rounds.cc:107] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:19:13.440959  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:13.440901  8107 raft_consensus.cc:2889] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.447438  8248 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:13.440891  8101 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:19:13.450539  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:13.451220  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:13.416543 15004 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.455577  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:13.456332  8101 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:13.418033 15028 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.453317  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:13.456389  8179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:13.457252  8179 raft_consensus.cc:606] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:13.451751  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:13.458577  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:13.458724  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:13.459177  8099 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:19:13.451220  8248 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:19:13.411764 14841 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:19:13.462234  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.424341 15302 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.462672  8102 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:13.463001  8107 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:13.463728  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:13.401974 14964 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.412128 15305 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
W20260709 13:19:13.454314  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.414176 15180 consensus_queue.cc:1059] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.039s
W20260709 13:19:13.469164  8221 connection.cc:256] RPC call timeout handler was delayed by -1.2609274820001701s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260709 13:19:13.434702 15269 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.489351 14973 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.489789 15269 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:13.489988 14973 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.492344 14973 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.457083 15004 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:13.484009  8107 raft_consensus.cc:1240] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:13.508055  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3489) took 1280 ms. Trace:
I20260709 13:19:13.485641  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:13.481835 14846 consensus_meta.cc:287] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.610s	user 0.011s	sys 0.000s
I20260709 13:19:13.486025  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:13.486420  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:19:13.528729  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 407411us
I20260709 13:19:13.528978  8099 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:13.487350  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:13.529742  8257 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:19:13.530843  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:13.488401  8221 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:13.408715 15221 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.480108 15302 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.493404  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:13.540393  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:13.494359 15220 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.501533  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:13.504433  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:13.523588  8785 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 15.
I20260709 13:19:13.486088  8248 raft_consensus.cc:1240] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:19:13.548693  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:13.461964 15310 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:13.525300  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:13.550619  8789 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:19:13.529624  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:13.425690 15110 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:13.542004  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 53716us
I20260709 13:19:13.542537  8254 raft_consensus.cc:2410] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:19:13.469041 15266 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:19:13.546557  8174 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:13.481644 15303 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:13.480427 15053 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:13.573518 15004 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.551168  8101 raft_consensus.cc:3060] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:13.524489  8105 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:13.552634 15180 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:13.468091 15028 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.558027  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:13.476989 15219 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.072s
I20260709 13:19:13.567464 14989 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.568284 15266 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.547859 14846 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:13.568813 15220 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:13.539773 15120 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:13.571125 15011 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:13.547015  8099 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:13.523320 15023 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:13.477941 15307 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 13:19:13.586438 15116 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:13.522675  8104 rpcz_store.cc:276] 0709 13:19:12.228071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.228204 (+   133us) service_pool.cc:224] Handling call
0709 13:19:12.228485 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.228676 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:19:12.572469 (+343793us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.249386 (+676917us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.499271 (+249885us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.507713 (+  8442us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:13.507768 (+    55us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:13.507812 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.507889 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.508000 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46366,"prepare.queue_time_us":117904,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":256168,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":8663,"thread_start_us":1198429,"threads_started":4,"wal-append.queue_time_us":493281}
I20260709 13:19:13.548059 14973 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:13.553264 15310 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.562713 14965 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:13.589285  8789 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:13.554391 15306 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.562328 15224 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:13.604084 14974 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:13.605011 14199 consensus_queue.cc:1059] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:13.589316 15180 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.620473 15011 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:13.605638 15277 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:13.606662 15071 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:13.607995 15285 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.576129 15061 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.615860  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3559) took 2254 ms. Trace:
I20260709 13:19:13.616127  8149 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:13.576157 14964 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:13.621619  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.579234 15221 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:13.576781  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 46250.4us
I20260709 13:19:13.624043  8101 raft_consensus.cc:2468] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:13.579450 15312 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:13.592917 15302 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:13.622963  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 206782us
I20260709 13:19:13.617980 15120 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:13.746050  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:13.746934  8179 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:13.605901 15218 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:13.573518 15303 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.632368 14973 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.628029 15023 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.629977 15310 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:13.732507 15317 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:13.616305 15266 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.622079 15053 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:19:13.774437 14973 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.775409 15004 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:13.775530 15164 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:13.653955 15265 consensus_meta.cc:287] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.528s	user 0.001s	sys 0.009s
I20260709 13:19:13.652585 15180 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:13.673533 14724 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:13.787575  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.788941 14850 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.789472 14850 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.791899 14850 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:13.795200  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3570) took 1455 ms. Trace:
I20260709 13:19:13.795640  8249 rpcz_store.cc:276] 0709 13:19:12.339623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.852323 (+512700us) service_pool.cc:224] Handling call
0709 13:19:12.854367 (+  2044us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:13.249555 (+395188us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:13.262874 (+ 13319us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.641555 (+378681us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.644526 (+  2971us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:13.646772 (+  2246us) log.cc:844] Serialized 26 byte log entry
0709 13:19:13.647709 (+   937us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:13.677556 (+ 29847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.677915 (+   359us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:13.794948 (+117033us) raft_consensus.cc:1685] finished
0709 13:19:13.794969 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.795138 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1862,"prepare.queue_time_us":12276,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":20541,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":2339,"thread_start_us":656517,"threads_started":2,"wal-append.queue_time_us":416068}
I20260709 13:19:13.799362 15266 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:13.802680 15150 raft_consensus.cc:3055] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:13.803148 15150 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:13.694361  8074 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:13.664328 15217 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:13.679406  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.725076  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:13.809720  8104 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:13.667500 15050 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.660008  8004 catalog_manager.cc:5697] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.811676  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:13.812529  8180 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:13.726891  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 172492us
I20260709 13:19:13.814724  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:13.815479  8248 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:13.816319  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:13.659286 15110 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:13.733690  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 117596us
I20260709 13:19:13.823348  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:13.730568  8253 rpcz_store.cc:276] 0709 13:19:11.361714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.533563 (+1171849us) service_pool.cc:224] Handling call
0709 13:19:12.533899 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.534127 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:19:12.709668 (+175541us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.574634 (+864966us) spinlock_profiling.cc:243] Waited 9.44 ms on lock 0x7b18002fb000. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa5a09f44bc 00007fa59dd4248b 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec23a
0709 13:19:13.575046 (+   412us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.586790 (+ 11744us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.587014 (+   224us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:13.587079 (+    65us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:13.587140 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.587232 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.615786 (+ 28554us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":372415,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":3052,"raft.queue_time_us":41603,"raft.run_wall_time_us":4130,"spinlock_wait_cycles":167952896,"thread_start_us":357626,"threads_started":2,"wal-append.queue_time_us":281164}
I20260709 13:19:13.717983 14907 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.739233  8755 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:13.695127 14955 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:13.750300  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:13.753832  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:13.826447  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:13.755718  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:13.730051 15219 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.743063 15061 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:13.745265  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:13.760200 15116 consensus_queue.cc:1059] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
W20260709 13:19:13.832778  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 87574.6us
I20260709 13:19:13.834290  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:13.620671 15220 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.766690  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:13.764204 14964 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.770692  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:13.737106 15013 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:13.773237 15317 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.776706 15265 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.849889  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:13.850773  8253 raft_consensus.cc:2410] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:19:13.851629  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:13.852151  8253 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 15.
I20260709 13:19:13.852897 15023 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.854182 15269 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.856544 15269 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:13.837579 15050 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:13.857352 15050 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:13.857730 15050 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:13.860292  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:13.861065  8251 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:13.861765  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:13.862524  8784 raft_consensus.cc:2393] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 20: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:13.863436  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:13.864143  8789 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 19: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:13.864004 14974 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:13.864717 14974 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:13.865052  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:13.886855  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.807293  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:13.759377 15155 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:13.678251 15134 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:13.780277 15320 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:19:13.810277  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 116018us
I20260709 13:19:13.817714  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:13.918303  8255 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:13.842613 15308 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:13.812752  8004 catalog_manager.cc:5697] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:13.822527  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 106782us
I20260709 13:19:13.827502  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:13.923012  8249 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:13.828732  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 89591.5us
I20260709 13:19:13.924649  8755 leader_election.cc:400] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 18. Current term is 19.
I20260709 13:19:13.925002  8755 leader_election.cc:403] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:13.757630  8103 raft_consensus.cc:2368] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22.
I20260709 13:19:13.836191  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:13.839363  8180 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:13.820655 15266 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:13.818843 15218 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:13.860495  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:13.866072  8785 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:13.866875  8786 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:19:13.868911  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:13.837714 14955 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.837962 15219 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.670120 15011 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.947932 15011 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:13.919272 15155 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.949023 15162 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:13.950194  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.950279 15155 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.951491 15164 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:13.951994 15164 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:13.952507  8004 catalog_manager.cc:5697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 12 to 17, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 17 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.952873 15164 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.953734  8106 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:13.870904  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:13.954926  8104 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 22: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:13.955781  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:13.852151 15265 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:13.852910  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:13.882961 15303 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.847991 14964 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.861372  8790 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:13.839463 15004 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:13.887162  8107 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:13.760934 15307 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:19:13.838606 14961 consensus_meta.cc:287] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.005s
I20260709 13:19:13.993649  8004 catalog_manager.cc:5697] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 13 to 16, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 16 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.886881  8783 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:19:13.898561 15134 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:13.903051 15050 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.903604 15285 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.908499  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:14.009465  8102 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:13.919495  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:14.011127  8255 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:13.819114  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:13.919922  8252 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:13.847437 15013 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.928208  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:14.013842  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 85716us
I20260709 13:19:14.014753  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:13.930009  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 93928.2us
I20260709 13:19:13.937019  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:14.016233  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:13.931242  8791 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:13.921195 14971 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.941890  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:13.939067 15327 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.947263 15219 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:13.931701 15116 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:14.012812  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3573) took 1672 ms. Trace:
I20260709 13:19:13.871582  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:14.046001  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:19:13.957782  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.825939 15120 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:13.990367  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:14.058736  8253 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:13.939352 15312 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 18. Current term is 19.
I20260709 13:19:13.992573  8249 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:13.994246 15053 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:14.016873  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:14.017773  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:14.018481  8250 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:13.988957 15023 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.046833  8255 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:14.022037  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:14.046167  8256 rpcz_store.cc:276] 0709 13:19:12.340502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.093317 (+752815us) service_pool.cc:224] Handling call
0709 13:19:13.110651 (+ 17334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:13.117566 (+  6915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.117691 (+   125us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:13.130452 (+ 12761us) log.cc:844] Serialized 26 byte log entry
0709 13:19:13.557744 (+427292us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:13.557797 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.557883 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.012514 (+454631us) raft_consensus.cc:1685] finished
0709 13:19:14.012544 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.012733 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7837,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":3316,"thread_start_us":316670,"threads_started":1,"wal-append.queue_time_us":485842}
I20260709 13:19:14.021351  8790 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:19:14.022542  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:14.048367  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 111428us
I20260709 13:19:14.048883  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:14.049306 14955 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:14.073657  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.049881 15221 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:14.049993 15327 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:14.050861 14971 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:14.021231 15300 consensus_meta.cc:287] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.690s	user 0.010s	sys 0.002s
I20260709 13:19:13.998945 15307 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:14.053287 15050 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:14.053942  8788 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 22: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:14.017546  8248 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:13.941344 15218 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:14.068588  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:14.094036  8253 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 22: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:14.072921  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:14.013007 15268 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.077689  8785 raft_consensus.cc:2393] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 19: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:19:14.078482  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 241614us
I20260709 13:19:14.085911  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:14.087739  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:14.020799 15013 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:14.045717 15224 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:14.070711 15306 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:14.108136  8253 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:19:14.108606  8253 pending_rounds.cc:85] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 11
I20260709 13:19:14.108875  8253 pending_rounds.cc:107] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:19:14.109157  8253 raft_consensus.cc:2889] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:14.066254 15132 consensus_meta.cc:287] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.777s	user 0.013s	sys 0.000s
I20260709 13:19:14.089845 14955 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:19:14.114326 15332 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:19:14.583261 15327 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:14.585605 15307 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:14.020080  8004 catalog_manager.cc:5697] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:13.992767  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 47245.4us
I20260709 13:19:14.075933  8149 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:14.088150  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 71367.2us
I20260709 13:19:14.105077  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:14.095978  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:14.103595  8255 raft_consensus.cc:2410] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:19:14.094233  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:14.606837  8784 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:14.607594  8256 raft_consensus.cc:2410] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:19:14.111989  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:14.064852 15028 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:14.092473 15221 raft_consensus.cc:697] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:14.637288 15111 raft_consensus.cc:2804] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:14.454133 14965 raft_consensus.cc:3055] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:19:14.447289  8252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 3149) took 3194 ms (client timeout 1529 ms). Trace:
I20260709 13:19:14.096766 15300 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:14.117811 15224 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:19:14.639281  8252 rpcz_store.cc:269] 0709 13:19:11.253122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.253287 (+   165us) service_pool.cc:224] Handling call
0709 13:19:14.446548 (+3193261us) spinlock_profiling.cc:243] Waited 2.65 s on lock 0x7b54002ae9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:14.446885 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6086514432}
I20260709 13:19:14.656235 15224 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:14.518604 15218 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:14.108973 15268 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:14.657714  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 581706us
I20260709 13:19:14.659217  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:14.659554 14955 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:14.647181 15111 raft_consensus.cc:697] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:14.480669 15120 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:14.662101 15218 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:14.662802 15218 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.662197 15111 consensus_queue.cc:237] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:14.663252 15218 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:14.663899  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.664170 15121 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:14.487033  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3575) took 1040 ms. Trace:
I20260709 13:19:14.421937  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:14.431006 14964 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:14.110772 15220 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:14.664917 15121 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:14.665309  8250 rpcz_store.cc:276] 0709 13:19:13.438310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.441064 (+  2754us) service_pool.cc:224] Handling call
0709 13:19:13.462205 (+ 21141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.067226 (+605021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.475254 (+408028us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b5400089dd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:14.478835 (+  3581us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237006080}
I20260709 13:19:14.485669 14974 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:14.394024  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.660588 14955 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:14.673621 14974 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:14.682304  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.385878  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.515523 15134 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:14.394062  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 987) took 1030 ms. Trace:
I20260709 13:19:14.397354  8179 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:14.612190  8004 catalog_manager.cc:5697] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:14.520922 15180 consensus_meta.cc:287] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.006s
I20260709 13:19:14.167392 15150 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:14.355077  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.698194 15180 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:14.423743  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:14.700166  8788 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:14.436722  8785 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:14.410881  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:14.701349 15180 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:14.426775  8249 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 25: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:14.421931  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:14.076475 15023 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:14.441948 14971 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:14.518006 15217 consensus_meta.cc:287] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.696s	user 0.014s	sys 0.005s
I20260709 13:19:14.693943  8182 rpcz_store.cc:276] 0709 13:19:13.363812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.363950 (+   138us) service_pool.cc:224] Handling call
0709 13:19:13.364308 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:13.379942 (+ 15634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.379990 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:13.397760 (+ 17770us) log.cc:844] Serialized 52 byte log entry
0709 13:19:13.625828 (+228068us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:13.649998 (+ 24170us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.971180 (+321182us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b180031bfa0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5c455 00007fa5a0e44060 00007fa5a0e56716 00007fa5a0e67287 00007fa5a0e67208
0709 13:19:14.384857 (+413677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.392970 (+  8113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.393101 (+   131us) raft_consensus.cc:1685] finished
0709 13:19:14.393328 (+   227us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.393788 (+   460us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15133,"prepare.queue_time_us":23825,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":26664,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":17736,"spinlock_wait_cycles":9743744,"thread_start_us":583780,"threads_started":2,"wal-append.queue_time_us":324606}
I20260709 13:19:14.706854  8108 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:14.710096  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:14.711299  8783 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:14.712306 15150 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:14.712782 15220 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.713575 15220 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:14.519809  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 135040us
W20260709 13:19:14.509317  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 55449.4us
I20260709 13:19:14.715627  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:14.719380 15341 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:14.638547 15221 consensus_queue.cc:237] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:14.720247  8147 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:14.575973 15329 log.cc:927] Time spent T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.612s	user 0.003s	sys 0.009s
I20260709 13:19:14.578248 15317 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:14.095062  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:14.642582 14965 raft_consensus.cc:740] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:19:14.723538  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.576574 15334 log.cc:927] Time spent T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.461s	user 0.000s	sys 0.011s
I20260709 13:19:14.386940  8251 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 27 index: 13. (index mismatch)
I20260709 13:19:14.724470 14965 consensus_queue.cc:260] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:14.559754 15330 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.781s	user 0.000s	sys 0.003s
I20260709 13:19:14.691805  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:14.661307 15268 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:14.726516 14965 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:14.663283  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.673216 15121 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:14.719709 15164 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:14.722077 15341 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:14.730966 15341 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:14.731412 15341 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:14.732533  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3580) took 1205 ms. Trace:
I20260709 13:19:14.732976  8257 rpcz_store.cc:276] 0709 13:19:13.526881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.533183 (+  6302us) service_pool.cc:224] Handling call
0709 13:19:13.537769 (+  4586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:13.555263 (+ 17494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.555295 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:13.557073 (+  1778us) log.cc:844] Serialized 26 byte log entry
0709 13:19:13.762828 (+205755us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:13.762877 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.762946 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.732089 (+969143us) raft_consensus.cc:1685] finished
0709 13:19:14.732139 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.732332 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11264,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":90,"thread_start_us":205419,"threads_started":1,"wal-append.queue_time_us":358810}
I20260709 13:19:14.717096  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:14.718622 15013 consensus_meta.cc:287] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.608s	user 0.016s	sys 0.024s
I20260709 13:19:14.710439 15023 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:14.751899  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:14.717417 15220 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:14.759101  8147 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:14.765537  8182 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:14.765976  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:14.757148  8104 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:14.750303 15013 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:14.778195  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:14.779371  8102 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 18.
I20260709 13:19:14.789562  8175 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 16: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:14.788190  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2311) took 1340 ms. Trace:
I20260709 13:19:14.799526  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:14.800258 14964 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:14.800608  8099 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:14.800799 14964 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:14.800936 15013 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:14.801306 14964 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:14.804598  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.805327 15268 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:14.806064  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:14.806166 15268 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:14.807168  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:14.808032  8251 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:14.808770  8176 raft_consensus.cc:2410] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:19:14.809262  8257 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:14.794364  8108 rpcz_store.cc:276] 0709 13:19:13.442528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.442666 (+   138us) service_pool.cc:224] Handling call
0709 13:19:13.442929 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.707347 (+1264418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.757750 (+ 50403us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002a3854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:14.782741 (+ 24991us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2905275136}
I20260709 13:19:14.808840 15268 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:14.825455  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:14.826653  8105 raft_consensus.cc:2393] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 13: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:14.825148 14971 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:14.833777  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:14.834636  8251 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 15.
I20260709 13:19:14.841383  8099 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:14.843468  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46064 (request call id 3154) took 1075 ms. Trace:
I20260709 13:19:14.845041  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:14.846325  8179 rpcz_store.cc:276] 0709 13:19:13.749692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.749968 (+   276us) service_pool.cc:224] Handling call
0709 13:19:14.798842 (+1048874us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b54000d7fd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:14.824737 (+ 25895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1244647680}
W20260709 13:19:14.863848  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 47380.7us
W20260709 13:19:14.873808  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 251138us
W20260709 13:19:14.873272  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 76266.5us
I20260709 13:19:14.875962 15268 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:14.880872  8257 raft_consensus.cc:2410] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:19:14.865888  8004 catalog_manager.cc:5697] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 12 to 16, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 16 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:14.883314  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:14.891027  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 169695us
I20260709 13:19:14.882578 15268 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:14.886353 15310 consensus_meta.cc:287] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 1.032s	user 0.005s	sys 0.037s
I20260709 13:19:14.892783 14971 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.896379 15268 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:14.907956  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:14.905462  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:14.914467 14974 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:14.911001 15116 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:19:14.917233 15116 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:14.918210  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:14.917727 15116 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:14.920517 14971 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:14.925788  8251 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:19:14.902806 15310 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:14.928073 15116 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:14.928905  8100 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:14.936108  8108 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:14.940843  8074 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:14.919677 14955 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:14.948148  8147 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:14.941524 15116 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:14.963414  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51524.7us
I20260709 13:19:14.955245 14971 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:14.955358 15306 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:14.966670  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:14.969791 15053 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:14.976562  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2313) took 1525 ms. Trace:
I20260709 13:19:14.973620  8223 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:14.978761  8074 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:14.976967  8100 rpcz_store.cc:276] 0709 13:19:13.451054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.452596 (+  1542us) service_pool.cc:224] Handling call
0709 13:19:13.478441 (+ 25845us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.929569 (+1451128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.964998 (+ 35429us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54001662d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:14.976500 (+ 11502us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3335063936}
I20260709 13:19:14.956866 14974 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:19:14.983654 15220 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:14.995210  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 46263.5us
I20260709 13:19:14.970456 15306 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:14.995442 15220 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:19:15.008105  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.005518  8249 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:15.001282 15053 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:19:14.999207 15310 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:15.001044 15023 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:15.011366  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:15.018621 15300 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:15.010958 15220 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:15.013656 15023 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.016925 14955 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:15.035899  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.020200 15300 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.025905 15023 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:15.038810  8782 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 22: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:15.033459  8223 leader_election.cc:400] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22.
I20260709 13:19:15.039258  8223 leader_election.cc:403] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:19:15.014163  8004 catalog_manager.cc:5697] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 14 to 17, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 17 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.041932  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:15.042620  8787 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:15.046010 15300 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:15.039325 14955 raft_consensus.cc:697] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:15.065091  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.072000  8175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:15.073230  8175 raft_consensus.cc:606] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:15.073700  8175 raft_consensus.cc:614] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:15.063340 15180 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:15.075626 14955 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.065549 15053 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:15.077368  8787 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:19:15.081748 15306 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:15.084353 14964 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.086225 15053 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:15.105832 15053 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:15.106101 15346 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:19:15.081236 15224 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:15.107422 15224 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.109407 15224 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:15.090185  8004 catalog_manager.cc:5697] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 10 to 13, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 13 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.105111  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:19:15.110124 15348 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:15.081724  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:15.118788  8251 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:15.124637 14964 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:15.126905 15023 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.127939 15341 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.129802  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:19:15.131944  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.135768  8147 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:15.142228 15306 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.143587  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:15.144373  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 140103us
W20260709 13:19:15.160344  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 78771.4us
I20260709 13:19:15.129850 15180 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22.
I20260709 13:19:15.166625  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:15.166903  8179 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 13.
I20260709 13:19:15.169140  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:15.171721  8175 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 22: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:15.113343 15218 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:15.178895  8176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
W20260709 13:19:15.179754  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.166568 14974 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:15.163866 15306 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.186192  8100 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:19:15.186726 15306 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:15.175275 15224 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:15.175500 15317 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:15.198065  8101 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:15.199579 15317 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:19:15.201885  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 58600us
I20260709 13:19:15.203145  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.203601  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.203989  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.201633 15116 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:15.204397  8108 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:19:15.204527  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.205065 15116 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:15.191334 14974 raft_consensus.cc:697] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:15.205506 15116 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:15.206717  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.206811 15116 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:15.205454  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.205447  8099 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:15.158514 15220 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.205456  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.213339  8102 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
W20260709 13:19:15.214249  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.215026  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:15.215237  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.216084  8105 raft_consensus.cc:2393] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 23: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:15.215989 15300 consensus_queue.cc:1059] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:15.217645  8182 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:15.217905 15050 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:15.208300  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.206740 14974 consensus_queue.cc:237] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.221738  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:15.208102 15268 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:15.230473 14971 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.231003 14971 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.208495 15116 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:15.231755 15268 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:15.201680 15053 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:15.200910 15317 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:15.239636  8101 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:15.240013 15053 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:15.242226  8182 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:15.243044  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:15.210541 15023 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:15.246927 15224 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:15.247237 15220 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:15.247885 15224 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:15.248215 15220 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:15.248764 15224 consensus_queue.cc:1243] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:19:15.252067  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.253094  8180 raft_consensus.cc:2410] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:19:15.253702  8178 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:19:15.254244  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.255075  8177 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 22: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:19:15.256285  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.256839  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.245361  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:15.261662  8101 raft_consensus.cc:2393] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:15.258168  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.264343  8183 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:19:15.232069 15310 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.270726 15218 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:15.270551 15310 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:15.189391 15180 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:19:15.275637  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:15.282524  8257 raft_consensus.cc:2410] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:19:15.276016  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:15.276930 15310 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:15.277104  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:15.277828  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:15.277839  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:15.279001  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:15.248977 15220 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:15.272069  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.283296  8178 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 13:19:15.295287  8251 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
W20260709 13:19:15.296480  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51233.4us
I20260709 13:19:15.284585  8255 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:19:15.302637 15306 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:15.303100 15306 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:15.303452 15306 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:15.305761  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.308073 15053 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.308771 15053 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:15.310043  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.310495  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.308784  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:15.261174 15224 raft_consensus.cc:3055] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:15.314167  8176 raft_consensus.cc:606] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:15.315716  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.308125  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.319518  8181 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:15.319643  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.320902  8250 raft_consensus.cc:2410] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 26 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:19:15.321650  8182 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:19:15.321745  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.322213  8177 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 24: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:15.323735  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.325780  8257 raft_consensus.cc:1240] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:15.325554  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.326387  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:15.329674  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:15.333917  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:15.334590  8250 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:15.335668  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.336541  8182 raft_consensus.cc:2410] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:19:15.317139 15224 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:15.338769  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.338577 15224 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.339900 15224 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:15.340607  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:15.341274  8104 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:15.346241  8787 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:19:15.346352  8248 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:15.347751  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.349962  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:15.350709  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.348251  8180 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:15.321739 15310 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.353055  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:15.324299 15341 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:15.357897 15220 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.359753 15341 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.359858  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.360320 15341 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:15.355152  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:15.366699  8178 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:15.380541 14971 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:15.380695  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.382993 15053 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:15.384419  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.384845  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.384761  8107 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:15.385032  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:15.386029 15341 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:15.387933  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:15.388620  8257 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:15.389482  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:15.390100  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.390802  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.392064  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:15.384280  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:15.393913  8255 raft_consensus.cc:2410] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 23 because replica has last-logged OpId of term: 22 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 10.
W20260709 13:19:15.385272  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.393939  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:15.394851  8254 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:15.390388  8253 raft_consensus.cc:2410] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:19:15.396488  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:15.395644  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:15.397089  8257 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:15.397683 15180 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:15.399751  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:15.400513 15180 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:15.354812 15300 raft_consensus.cc:2764] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:19:15.405921  8181 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:15.407047  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:15.417088  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:15.418493  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:15.419147  8257 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:19:15.420745 15366 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:15.423573  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:15.427732  8253 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:15.424453  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.431702  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.432840  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:15.433656  8255 raft_consensus.cc:1240] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:15.431053  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:15.437551  8104 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 25.
I20260709 13:19:15.434818  8256 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:15.440237  8249 raft_consensus.cc:2410] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 25 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:19:15.417361 15359 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.441834  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.442464  8785 raft_consensus.cc:2368] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21.
I20260709 13:19:15.454008  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.421232 15366 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:15.405714 15310 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.459756  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:15.469800  8108 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:15.470556 15053 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.431170 15306 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.476961  8178 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:15.463321 15180 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:19:15.483162  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.490607  8252 raft_consensus.cc:2368] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
I20260709 13:19:15.485531 15116 consensus_queue.cc:1059] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:15.494632  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:15.488325  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.456391 15341 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.492293  8178 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:19:15.492851  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:15.493590  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.494613 15050 raft_consensus.cc:3055] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:15.489120  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:15.472326 15300 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.503369  8789 raft_consensus.cc:2410] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:19:15.503983  8255 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:15.499177  8249 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:15.504143  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:15.472771 15366 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:15.490309 15180 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.513202  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.515436  8787 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:15.518011  8178 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 22. Current term is 23. Ops: [21.10-22.11]
I20260709 13:19:15.519259 15370 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:15.519917 15370 raft_consensus.cc:697] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:15.525831  8253 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:15.503700 15050 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:15.527359 15050 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.528697 15050 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:15.529389  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.530942  8104 raft_consensus.cc:1240] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:15.531971  8254 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:15.533908  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.496279 15053 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.536239  8255 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:19:15.537411 15053 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:15.463886 15359 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:15.539803  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.540395  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.544997  8181 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24. Ops: []
W20260709 13:19:15.540302  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 118596us
I20260709 13:19:15.548256  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:15.548919  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:15.518353 15180 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:15.549091  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.551362  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.553254  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:15.554939  8108 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:15.559788  8789 raft_consensus.cc:2393] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 16: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:15.563009  8180 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:15.564170  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:15.556133 15164 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:15.565730  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.565799 15164 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.566303  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:15.567124 14964 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:15.567399  8181 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:15.567924  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:15.558583 14955 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:15.569234 14955 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:15.570369 14955 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.571784 14955 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:15.573652  8783 raft_consensus.cc:2410] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:19:15.574401  8181 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 25.
I20260709 13:19:15.574908 15310 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:15.567726 14964 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:15.578965  8782 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:15.561630  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:15.568713 15164 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:15.584486  8147 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:15.586059  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 95023.7us
I20260709 13:19:15.589956 15023 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:15.587535  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:15.586580  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:15.594158  8180 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:15.521097 15370 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.517532 15300 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.599447  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:15.603993  8178 raft_consensus.cc:2368] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22.
I20260709 13:19:15.604221  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.541319 15341 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.585799 14964 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:15.607092  8789 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:15.609122  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.609903  8178 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 22: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:15.608198  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:15.610278  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 48832.5us
I20260709 13:19:15.611558  8785 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:15.605697 15268 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:15.597308 15224 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.601147 15306 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:15.615718  8787 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:19:15.600505 15359 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:15.601923 15164 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:15.616555  8176 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 22: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:15.617280  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:15.618969  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.608804 15221 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:15.621898  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.624737  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:15.625555 15224 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.607812 15116 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.633942  8789 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:19:15.666996  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:19:15.666266  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 117623us
I20260709 13:19:15.633769 15221 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:15.669649  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:15.671260  8788 raft_consensus.cc:2410] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:19:15.677412  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:15.678020  8178 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:19:15.677205  8147 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:15.679419  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.681353  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.684052  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.684322 15341 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:15.685146  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:19:15.685556  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 74452.8us
I20260709 13:19:15.686905  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:15.690054  8791 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:15.689954  8147 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:15.692107 15268 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:15.692198 15244 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:15.692836 15268 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:15.693367 15268 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:15.694237 15244 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:15.694736 15244 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.695276 15244 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:15.699322 14955 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:15.699908 14955 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.700350 14955 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:15.701773  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:15.702641  8176 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
W20260709 13:19:15.709784  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 110427us
I20260709 13:19:15.711094  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:15.712837  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:15.715773 15224 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:15.721834 15218 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:15.722468 15218 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.722937 15218 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:15.723423  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.723513 15331 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:15.727679  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.667335 15164 raft_consensus.cc:697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:15.736442 15164 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.739144 15116 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:15.675768 15221 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:15.743714 15116 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:15.760092  8107 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:19:15.760737  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.761565  8787 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 16.
I20260709 13:19:15.774593 15053 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.775628 15377 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.185s	user 0.002s	sys 0.000s
I20260709 13:19:15.775317 15053 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:15.779377  8178 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:15.787700  8147 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:15.792035  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.793143  8787 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 22: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:19:15.794102  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.763593 15331 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:15.791441 15378 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.200s	user 0.000s	sys 0.002s
I20260709 13:19:15.819216  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.825647 15300 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:15.826596  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.829154  8072 leader_election.cc:336] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.814s (SENT)
I20260709 13:19:15.829855  8072 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:15.831375 15310 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:15.861981  8180 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:15.801389 14974 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:19:15.864415  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 194878us
I20260709 13:19:15.801779 15220 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:19:15.870273  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 157522us
I20260709 13:19:15.875174  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:15.880354  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 193540us
I20260709 13:19:15.882131  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:15.883495  8783 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:15.867554 14974 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.890040 15220 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:15.891285 15331 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:15.900951  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.901858  8790 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:15.902166  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.902910  8782 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 21: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:15.901876  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:15.903971  8789 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:15.901082  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:15.904682  8785 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:15.883361 15053 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:15.888970 14974 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:15.873467 15268 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:15.929942  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:15.970952 15382 log.cc:927] Time spent T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:19:15.981091 15385 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:15.932793  8787 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:15.915968 15116 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
W20260709 13:19:15.984943  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.985808  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.990005  8789 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:16.000274 15383 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:16.001026 15164 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:16.003317  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.011329 15370 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:16.011986 15370 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:16.012091 15218 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:16.013444  8181 raft_consensus.cc:2368] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22.
I20260709 13:19:15.998672 14971 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:19:16.013957 14971 consensus_queue.cc:1243] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 24.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:19:16.014348 15370 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:16.018560 15268 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:16.022923 14955 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:16.028527  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 157391us
I20260709 13:19:16.031878 15389 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:19:15.949288 15180 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:16.038822 14955 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:16.038956 15180 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:16.040895 14974 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:16.042011  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.042855  8790 raft_consensus.cc:2410] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:19:16.043071 14974 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:16.043733  8791 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:16.043995 14964 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:16.044464  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.045075  8784 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:16.045924  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.046267 14964 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:16.046411  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:16.047225  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:16.047906  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:16.050529 15366 consensus_meta.cc:287] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.024s
I20260709 13:19:16.050655 15310 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:16.043643  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.051141 15310 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:16.051338  8790 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:16.009891 15383 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.948573 15221 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:16.055859  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:16.066568  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.067596  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:16.056857  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:16.057200 15374 consensus_queue.cc:1059] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:16.057483  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:16.057986  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.068620  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:16.061861  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.063482  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:16.070475  8790 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:16.071127  8180 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:16.073556  8783 raft_consensus.cc:2393] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 20: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:16.074661  8791 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 19: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:19:16.074692  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 67510.3us
I20260709 13:19:16.076920  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:16.077906  8180 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 23: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:16.052300 15310 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:16.079331 14964 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:16.079773 14964 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:16.080153 14964 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:16.081715  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:16.081825  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:16.082405  8177 raft_consensus.cc:2368] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:19:16.082290  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:16.082765  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:16.073494 15383 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:16.083443 15331 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:16.083860  8149 leader_election.cc:400] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
I20260709 13:19:16.084218  8149 leader_election.cc:403] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:16.084849  8105 raft_consensus.cc:2393] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 17: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:16.084913  8106 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:16.052417 15180 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.091967  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:16.053843 15218 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:16.075848  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:16.050944 15366 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:16.100672  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.103041  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:16.100468  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:16.094908 15053 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:16.066166 15221 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:16.108716  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.103317  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:16.112565  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:16.099412  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:16.118404  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:16.118741  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:16.128444  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.129582  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.129894  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.130719  8100 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:16.132771 15116 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:16.136091 15394 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:16.136929  8106 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
W20260709 13:19:16.139564  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 85395.3us
I20260709 13:19:16.140447  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:16.142573 15023 raft_consensus.cc:3055] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:16.143102 15023 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:16.145749  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.145848  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.146713  8786 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:16.147074  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:16.147855  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:16.148278  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:16.148561  8786 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:16.120504  8177 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:16.106106 15180 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:16.125697  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.150265 15121 raft_consensus.cc:3055] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:16.150836  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.151561  8791 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 19: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:16.151604 15180 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:16.094658 15341 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
W20260709 13:19:16.152009  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 49034.1us
I20260709 13:19:16.109701 14974 consensus_queue.cc:1059] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:19:16.066392 15244 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:16.144425 15023 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:16.152392  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.153374 14974 raft_consensus.cc:3055] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:16.167073 14974 raft_consensus.cc:740] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:16.167996 14974 consensus_queue.cc:260] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:16.154446  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:16.110426 15053 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.169761 15053 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:16.169963  8180 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:16.170514 15023 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:16.171271  8791 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:19:16.150853 15121 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:16.172845 15121 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:16.174031 15121 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:16.175256 15244 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:16.176059  8181 raft_consensus.cc:2368] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:19:16.153631  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:16.148902  8787 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:16.178675  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:16.179963  8791 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:19:16.163547 15384 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:19:16.119841 15391 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:16.183086  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 107161us
I20260709 13:19:16.186281 15116 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:16.186990 15116 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 25 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:16.188174 15116 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:16.191390 15366 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:16.153738 15317 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:16.169301 14974 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:16.198016  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.195904  8221 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:16.185299  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:16.200609  8790 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:16.201579  8786 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:16.205888  8147 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:16.207906  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.226341  8783 raft_consensus.cc:1240] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:16.227051  8787 raft_consensus.cc:2410] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:16.207265 14955 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:16.214243 15244 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:16.215785 15180 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:16.215958 15268 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:16.229596  8221 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:16.234311 14955 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:16.255200 14955 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:16.259403  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.259655 15310 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:16.239305 15268 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.261833 15268 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:16.265566 15395 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:19:16.265909  8072 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.541s (SENT)
I20260709 13:19:16.266144 15395 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:16.266561  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:16.267190 15395 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:16.268141 15317 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:16.270394 15383 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:16.272593 15383 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:16.238775 15180 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:16.274075 15180 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:16.274590  8788 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:19:16.285287  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.285964  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.310254  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 226502us
I20260709 13:19:16.312613  8791 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:19:16.311364 15221 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:19:16.314911  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:16.314460  8002 catalog_manager.cc:5697] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.316819  8147 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:16.320426  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:16.240521 15244 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:16.323592  8002 catalog_manager.cc:5697] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:16.333119  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 44710.9us
I20260709 13:19:16.345114  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:16.348315  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:16.354210  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:16.354874  8105 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:19:16.363552 15300 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:16.363991 15300 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:16.364383 15300 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:16.363374  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:16.368904  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:16.369323  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:16.369771  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:16.331373 15361 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.058s	user 0.008s	sys 0.005s
W20260709 13:19:16.331663 15390 log.cc:927] Time spent T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:19:16.374507  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:16.374993  8254 raft_consensus.cc:2410] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 26 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:19:16.375272  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:16.378850  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:16.379420  8251 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:16.379165  8101 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:16.376233  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:16.379469  8250 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:19:16.381412  8104 raft_consensus.cc:2410] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 26 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:19:16.381219  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:16.380872  8252 raft_consensus.cc:2393] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:16.382124  8100 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:16.383388  8105 raft_consensus.cc:1275] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:19:16.384619  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:16.331545 15341 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:16.385537  8255 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 22: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:16.331636 15221 raft_consensus.cc:2804] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:16.386309  8256 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:19:16.388526  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:16.390213  8254 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:19:16.390578  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:16.392721  8257 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
W20260709 13:19:16.391410  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 174019us
I20260709 13:19:16.393277  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:16.396020  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:16.396584  8105 raft_consensus.cc:3060] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:16.399931  8107 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:16.405751  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:16.406188  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:16.406811  8256 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:16.408103  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:16.408700  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:16.408859  8255 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:16.414588  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 272304us
I20260709 13:19:16.406235  8254 pending_rounds.cc:85] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 13
W20260709 13:19:16.443117  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 213581us
I20260709 13:19:16.445870  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:16.446465  8249 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:19:16.415693  8254 pending_rounds.cc:107] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260709 13:19:16.411943 15310 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:16.451550  8255 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:19:16.453747  8251 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:16.457049  8250 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:16.413611 15370 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:16.482134  8254 raft_consensus.cc:2889] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.481932  8221 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:16.492161  8105 raft_consensus.cc:2468] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
W20260709 13:19:16.496649  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.507233  8256 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
W20260709 13:19:16.515633  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 117977us
W20260709 13:19:16.518966  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 82385.5us
I20260709 13:19:16.519786  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:16.520565  8105 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:16.521407  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:16.436094 15244 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:16.522680  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:16.514925  8002 catalog_manager.cc:5697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 19 to 24, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 24 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:16.486829 15370 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:16.512027 15374 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:19:16.537606  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 123471us
I20260709 13:19:16.540921  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:16.539481  8251 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:16.522924  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:16.552101  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:16.553248  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.494820 15404 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 13:19:16.557457  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:16.558238  8255 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:19:16.560221  8250 raft_consensus.cc:2368] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:19:16.539773 15221 raft_consensus.cc:697] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:16.559568  8255 pending_rounds.cc:85] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 14
I20260709 13:19:16.562561  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:16.566016  8255 pending_rounds.cc:107] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:19:16.563102  8252 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
W20260709 13:19:16.564697  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.647418  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.606032  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:16.662469  8249 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:19:16.610119  8101 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
W20260709 13:19:16.634148  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 99816.6us
I20260709 13:19:16.548139 15370 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:16.565711 15310 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:16.607738  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:16.617624  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 76782us
W20260709 13:19:16.623229  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.548048 15374 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:19:16.651695  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.566371  8255 raft_consensus.cc:2889] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.633493 14971 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.678088  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.677299 15023 consensus_meta.cc:287] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.002s
I20260709 13:19:16.638936 15413 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:16.689576 14964 consensus_meta.cc:287] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.609s	user 0.014s	sys 0.000s
I20260709 13:19:16.690738 15374 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:16.718621  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:16.720033  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:16.721800  8105 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:16.755131  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 137373us
I20260709 13:19:16.721688 15395 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.691215 15310 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:19:16.757519  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:19:16.773093  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.776611  8105 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
W20260709 13:19:16.726354 15121 consensus_meta.cc:287] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.006s
I20260709 13:19:16.779718  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:16.781471  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:16.782068  8101 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:16.782204  8105 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 25.
I20260709 13:19:16.727617 15408 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:16.787717  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:16.788322  8253 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 13:19:16.788436  8177 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 25.
I20260709 13:19:16.715058 14964 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:16.710453 14971 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:16.788659  8253 pending_rounds.cc:85] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 11
I20260709 13:19:16.792268  8253 pending_rounds.cc:107] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:19:16.792101  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:16.792709  8253 raft_consensus.cc:2889] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.790563  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:16.794099  8105 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 22: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:16.791481  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:19:16.790961  8072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.009s (SENT) [suppressed 22 similar messages]
I20260709 13:19:16.795713  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:19:16.789479  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 126046us
I20260709 13:19:16.796746  8177 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 22: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:16.787088 15408 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:16.802309  8101 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:16.803121  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:16.781149 15395 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:16.797312 15121 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:16.811267 15426 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.859005  8072 leader_election.cc:336] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.635s (SENT)
I20260709 13:19:16.726796 15221 consensus_queue.cc:237] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:16.859549 15053 consensus_meta.cc:287] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.689s	user 0.006s	sys 0.005s
W20260709 13:19:16.872392  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 114954us
I20260709 13:19:16.858143  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:16.873842  8072 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:16.868176 15417 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:19:16.880002  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 68940.6us
I20260709 13:19:16.871654 15164 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:16.871551 15383 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:16.860558 15420 consensus_queue.cc:1059] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:19:16.876189 15425 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.895066  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:16.869343 15023 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:16.885960 15310 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:16.885305  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:16.899351 15317 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:16.900315 14964 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:16.900702 15164 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:16.906037 15409 log.cc:927] Time spent T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:19:16.906808 15416 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 23.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:19:16.940245  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 81250.7us
I20260709 13:19:16.885047 15417 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.898636  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:16.882215 15341 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:19:16.897327 15268 consensus_meta.cc:287] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.002s
W20260709 13:19:16.886632  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 76194.9us
I20260709 13:19:16.874519 15121 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:16.952533 15420 raft_consensus.cc:3055] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:16.952950 15420 raft_consensus.cc:740] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:16.953522 15414 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
W20260709 13:19:16.953717 15424 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:19:16.953771 15420 consensus_queue.cc:260] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:16.935506  8223 leader_election.cc:400] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22.
I20260709 13:19:16.954838  8223 leader_election.cc:403] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:19:16.957006 14971 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:16.957168 15416 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:16.957758 15416 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:16.959465 15180 consensus_meta.cc:287] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.685s	user 0.007s	sys 0.002s
I20260709 13:19:16.959760 15416 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:16.959867 15180 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:16.961699 15435 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:16.962078 15435 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:16.915030 15425 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:16.962893 15435 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.10, Last appended by leader: 10, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:16.942073 15220 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:16.943147 15317 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:16.965799 15433 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22.
W20260709 13:19:16.937623  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 52406.1us
I20260709 13:19:16.876550 15426 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:16.966681 15317 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:16.883630 15053 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:16.708161  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:16.970072 14974 consensus_meta.cc:287] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.755s	user 0.012s	sys 0.000s
W20260709 13:19:16.962893 15300 consensus_meta.cc:287] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.000s
I20260709 13:19:16.970602 15053 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:16.916774 15023 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:16.971127 15300 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:16.939034 14955 consensus_meta.cc:287] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.683s	user 0.012s	sys 0.000s
I20260709 13:19:16.972277 14955 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:16.971474 15023 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:16.975174  8180 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 24: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:16.974809  8788 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:16.983714  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:16.954383 15121 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:16.885713 15402 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:16.975214  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:17.012887  8177 raft_consensus.cc:2393] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 25: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:17.013007  8791 raft_consensus.cc:2410] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:19:16.912176 15383 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.016593  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:17.018544  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:16.973999  8002 catalog_manager.cc:5697] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 14 to 16, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 16 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:19:17.028168  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 50172.7us
I20260709 13:19:16.944656 15417 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:17.029596  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:17.032351  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 137406us
I20260709 13:19:17.035382  8181 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:17.039712  8176 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:19:17.039865  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:17.040485  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:16.978470 15420 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:17.041421  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:16.973122 15300 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:16.978319 15435 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:17.044243  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 145701us
W20260709 13:19:17.044287  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 65564.3us
I20260709 13:19:17.011339 15426 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:17.047350  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:16.989355 15220 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:16.974545 14955 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:16.975633 15341 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:17.054807  8223 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:17.055094  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:17.057193  8255 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:19:17.058436 15426 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:17.058943 15426 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.059494 15341 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:17.061038 15426 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:17.061553 15394 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:17.061975 15394 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:19:17.062095 15429 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:19:17.062382 15394 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:17.066120 15422 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:19:17.037985 15425 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:17.072857 15395 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:17.078383  8223 leader_election.cc:400] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22.
I20260709 13:19:17.078231 14955 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:17.078843  8223 leader_election.cc:403] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:17.079116 14955 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:17.080564  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:17.080228 14955 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:17.081995 15438 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.082248 15426 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22.
I20260709 13:19:17.082595 15438 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.083442 15416 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:17.083868 15416 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.084246 15416 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:17.085034 15438 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:17.044173 15331 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:17.049316 15432 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:17.086189 15432 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:17.086593 15432 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:17.092613  8072 leader_election.cc:336] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.865s (SENT)
W20260709 13:19:17.095413 15401 log.cc:927] Time spent T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.611s	user 0.004s	sys 0.000s
I20260709 13:19:17.096715 15416 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.103098 15416 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:17.103329 15403 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.103681  8002 catalog_manager.cc:5697] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 18 to 20, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 20 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:17.103909 15403 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.054256 15433 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:17.107658 15164 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:17.108685 15180 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:17.108210  8002 catalog_manager.cc:5697] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 11 to 12, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 12 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:17.111156 15374 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.111855  8180 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:17.112498  8106 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 22. Current term is 23. Ops: []
W20260709 13:19:17.111191  8072 leader_election.cc:336] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.987s (SENT)
I20260709 13:19:17.113600  8072 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.113941 15442 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:17.115103 15310 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:17.116222  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:17.116961  8180 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:19:17.122008  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 65843.4us
I20260709 13:19:17.123492  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:17.126006  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:17.114018  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 74349.7us
I20260709 13:19:17.123626  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:17.117316  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 68788.9us
I20260709 13:19:17.129854  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:17.131760  8178 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:17.044819 15121 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:17.132844  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:17.135545  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.137419  8105 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:17.139501  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.140201  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:16.989650 15268 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:17.142480  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:17.154245  8176 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:16.943112 15408 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.142966  8183 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:19:17.145269  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:17.147023  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.146862  8002 catalog_manager.cc:5697] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:17.152284  8178 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:17.153240  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:17.142601  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:17.159601  8101 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 25.
I20260709 13:19:17.159798  8181 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:17.155134  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:17.160792 15416 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:17.103021 15383 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:17.028932 15402 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:17.162041  8004 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39814 (request call id 282) took 43240 ms (client timeout 15000 ms). Trace:
I20260709 13:19:17.161221  8002 catalog_manager.cc:5697] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 16 to 18, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 18 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:17.163215 15402 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:17.163631  8002 catalog_manager.cc:5697] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:17.175649  8002 catalog_manager.cc:5697] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 11 to 16, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 16 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:17.164700  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.165218 15435 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:17.165585 15416 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:17.186206  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:17.139230 15426 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.186113  8002 catalog_manager.cc:5697] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 17 to 19, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 19 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:17.187120 15426 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.187595  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:17.165669  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:17.166390  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:17.155324 15433 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:17.133545 15395 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:17.172456  8251 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: []
W20260709 13:19:17.173530  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.174158 15220 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:17.184446 15370 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.518s	user 0.012s	sys 0.001s
I20260709 13:19:17.177582  8107 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:17.171826 15394 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.179626  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:17.145870 15180 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:19:17.180646  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:17.181743  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:17.182333 15403 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:17.164445  8755 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.189721  8002 catalog_manager.cc:5697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 20 to 22, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 22 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:17.194051 15121 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:19:17.162492  8004 rpcz_store.cc:269] 0709 13:18:33.921800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.922099 (+   299us) service_pool.cc:224] Handling call
0709 13:19:17.161951 (+43239852us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:15.240956 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:15.241743 (+   787us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:15.241798 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:19:15.241842 (+    44us) tablet.cc:662] Decoding operations
0709 13:19:15.243044 (+  1202us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:15.243191 (+   147us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:15.243219 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:19:15.244250 (+  1031us) tablet.cc:701] Row locks acquired
0709 13:19:15.244300 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:19:15.244490 (+   190us) write_op.cc:270] Start()
0709 13:19:15.244667 (+   177us) write_op.cc:276] Timestamp: P: 1783603155244418 usec, L: 0
0709 13:19:15.244705 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:19:15.256657 (+ 11952us) log.cc:844] Serialized 3699 byte log entry
0709 13:19:15.543183 (+286526us) op_driver.cc:464] REPLICATION: finished
0709 13:19:15.819385 (+276202us) write_op.cc:301] APPLY: starting
0709 13:19:15.819480 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:15.892963 (+ 73483us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:15.893078 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:15.899316 (+  6238us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:15.899637 (+   321us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:19:15.899697 (+    60us) write_op.cc:312] APPLY: finished
0709 13:19:15.900047 (+   350us) log.cc:844] Serialized 89 byte log entry
0709 13:19:15.912490 (+ 12443us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:15.921812 (+  9322us) write_op.cc:454] Released schema lock
0709 13:19:15.990870 (+ 69058us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:16.051682 (+ 60812us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:16.052688 (+  1006us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":175665,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":263416,"apply.run_cpu_time_us":13761,"apply.run_wall_time_us":197466,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41729,"num_ops":9,"prepare.queue_time_us":96586,"prepare.run_cpu_time_us":47691,"prepare.run_wall_time_us":112919,"raft.queue_time_us":71153,"raft.run_cpu_time_us":70406,"raft.run_wall_time_us":221022,"replication_time_us":298265,"thread_start_us":317090,"threads_started":4,"wal-append.queue_time_us":144954,"wal-append.run_cpu_time_us":12089,"wal-append.run_wall_time_us":1495661}]]}
I20260709 13:19:17.189549  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:17.191574  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:17.192324  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 68924.7us
I20260709 13:19:17.193830  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:19:17.247761  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 58314.3us
I20260709 13:19:17.248284  8149 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:19:17.192186  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 60412.2us
I20260709 13:19:17.156796 15374 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:17.190917 15413 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:17.218945 15164 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:17.240707  8221 leader_election.cc:336] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.649s (SENT)
I20260709 13:19:17.244432  8103 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:17.191213  8101 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:17.256960  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:17.258971  8002 catalog_manager.cc:5697] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 16 to 19, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 19 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:17.260639  8002 catalog_manager.cc:5697] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 16 to 18, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 18 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.264355  8002 catalog_manager.cc:5697] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:19:17.265753  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 101385us
I20260709 13:19:17.266450  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:17.194155 15435 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 13:19:17.195063 15383 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:19:17.273518 15412 consensus_queue.cc:1059] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:17.274216 15394 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:17.268427 14955 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:19:17.277889 15300 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:17.255283 15121 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.330226 15121 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:17.331277 15394 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:17.331678 15394 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:17.332494 15394 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.281235 15408 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:17.333652 15394 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:17.260442 15433 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:17.282778 15417 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:17.287389  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 95930.7us
I20260709 13:19:17.290161 15413 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:17.288590  8101 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:17.261791 15437 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:19:17.350442  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 56254.7us
I20260709 13:19:17.310571  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:17.257844 15403 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:19:17.327333  8072 leader_election.cc:336] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.162s (SENT)
I20260709 13:19:17.353410  8072 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:17.354486 15447 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:17.355780 15440 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:19:17.357558 15433 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:19:17.320794  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 80122.6us
I20260709 13:19:17.358868 15433 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:17.359844  8221 leader_election.cc:336] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.755s (SENT)
I20260709 13:19:17.360255  8221 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:17.235771 15370 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:17.361857 15445 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:17.363423 15417 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:17.364545 15370 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:17.268137 15418 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:17.365898  8149 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:17.365873 15418 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.366730 15164 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:17.367094 15164 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:17.367462 15164 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:17.367952 15418 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:17.365232  8784 raft_consensus.cc:1240] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:17.368391 15432 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:17.234988 15395 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:17.336000 15416 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.371495 15395 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:17.292943 15404 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:17.287362  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:17.372895  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 85672.6us
I20260709 13:19:17.319456 15116 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.346884 15412 raft_consensus.cc:3055] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:17.320299 15420 raft_consensus.cc:2764] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:17.374187  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.375831  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:17.345566  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 79189.2us
I20260709 13:19:17.352149  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:17.376586  8788 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 23: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:17.390419  8755 leader_election.cc:400] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:19:17.390826  8755 leader_election.cc:403] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:17.379046  8103 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:17.374715 15403 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:17.375707 15116 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.394613 15426 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:17.403730 15448 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:17.406790 15432 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:17.410157 15446 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:19:17.319906 15331 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:19:17.447202 15116 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:17.444557 15370 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:19:17.423105 15403 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:17.390435 15437 consensus_queue.cc:1048] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:19:17.456826 15437 consensus_queue.cc:1243] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:19:17.442334 15435 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:17.413573 15447 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:17.377875 15412 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:17.414148  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:17.474026  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 59957.6us
I20260709 13:19:17.474193 15412 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:17.475618 15412 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:17.417372 15428 raft_consensus.cc:2764] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 13:19:17.478042 15428 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:17.478503 15428 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:17.479321 15428 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.482618  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:17.483214  8253 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:17.483345  8108 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:19:17.483560  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:17.484385  8103 raft_consensus.cc:2410] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:19:17.484819  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:17.485201  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:17.485662  8101 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 24: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:17.485754  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:17.486356  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:17.486636  8255 raft_consensus.cc:2410] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:19:17.488411  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:17.489612  8257 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:17.414634 15413 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.415616 15121 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:17.416189 15268 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:17.416335 15023 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.418004  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:17.422453  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.508323  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:17.508978  8252 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:17.509089  8105 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 23. Current term is 24. Ops: []
W20260709 13:19:17.438158  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 47876.8us
I20260709 13:19:17.375761 15404 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:17.506417  8253 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:17.514437  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:17.514541  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:17.510167 15404 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:17.516415 15121 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:17.517248 15121 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:17.518203  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 100280us
I20260709 13:19:17.514459  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:17.518946  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:17.519125  8249 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:17.516494 15404 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:17.520107  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:17.520938 15317 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:17.521696 15438 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:17.517299  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 94962us
I20260709 13:19:17.510983  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:17.531699  8255 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:19:17.533138  8072 leader_election.cc:336] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.774s (SENT)
I20260709 13:19:17.533610  8072 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.534112  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.535391  8755 leader_election.cc:400] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:19:17.535642  8755 leader_election.cc:403] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:17.532567  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:17.546720  8221 leader_election.cc:336] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.859s (SENT)
I20260709 13:19:17.547187  8221 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.548004  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.550685  8100 pending_rounds.cc:85] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 12
I20260709 13:19:17.551004  8100 pending_rounds.cc:107] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:19:17.551234  8100 raft_consensus.cc:2889] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:17.554051  8106 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:17.553974  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:17.555629  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:17.559816  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.536505 15432 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:17.564653  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:17.569316  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:17.570003  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:17.570569  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:17.571404  8177 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:17.573530  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:17.574344  8175 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:17.576328  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:17.576814  8175 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:17.579087  8221 leader_election.cc:336] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.983s (SENT)
I20260709 13:19:17.580466  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:17.545974 15420 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:17.585464 15442 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:17.585985  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:17.587324  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:17.561058 15437 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.589359  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:17.590152  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:17.557282 15417 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:19:17.591192  8755 leader_election.cc:400] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:19:17.592012  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:17.592137  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:17.557397 15053 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.560947 15244 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:17.564146 15432 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.545810 15433 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:19:17.594590  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.557727 15300 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.595984  8784 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:19:17.564769 15416 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:17.587726 15402 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:17.577369 15121 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:17.584698 15268 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:17.599902 15053 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.591773 15437 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.587296 15435 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:17.590368  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:17.589778 15442 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:17.611207  8072 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:17.592170 15421 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:17.616655  8791 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:17.616540  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:17.618412  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:17.618755  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:17.630867  8252 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:17.619366  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:17.631400  8183 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:17.619469  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.628887  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:17.626341  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:17.583722 15218 consensus_queue.cc:1059] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:19:17.633870  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:17.619771  8249 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:17.635170  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:17.635928  8179 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:19:17.620378  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:17.637883 15464 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 13:19:17.638262  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:17.621326  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:17.629127  8255 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:19:17.600682 15432 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:17.599738 14964 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:17.611950 15425 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:17.626178  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:17.671041  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.639758  8149 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:19:17.670121  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 50736us
I20260709 13:19:17.626929  8072 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.685398  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:17.702817  8106 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:17.708961  8252 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:17.640242 15310 raft_consensus.cc:2764] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:19:17.714663  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:17.715271  8101 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:17.715795  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 76088.3us
I20260709 13:19:17.716706  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:17.717168  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:17.717730  8221 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:17.717883  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:17.718736  8791 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 22: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:17.718956  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:17.719537  8787 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:17.641534 15435 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:17.668920 15425 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.722430  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:17.684794 15426 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:17.734341  8791 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 23: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:17.610828 15300 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:17.723806  8790 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:17.739949  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:17.741724  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:17.725149  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:17.723068  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:19:17.729704  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 46612.2us
I20260709 13:19:17.686375 15121 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:17.738656  8787 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:17.744664  8106 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:17.745102  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:17.745606  8789 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 23: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:17.712291 15421 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:17.714593 15383 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:17.755734  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:17.757513  8786 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:19:17.746148  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:17.745162  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:17.721071 15389 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:19:17.747479  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 120621us
I20260709 13:19:17.683104 15331 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:19:17.750849  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:17.779692  8790 raft_consensus.cc:2376] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23. Re-sending same reply.
I20260709 13:19:17.643790 15116 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.085s
I20260709 13:19:17.749596  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:17.625902 15443 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.132s
I20260709 13:19:17.766885 15300 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:17.763832 14971 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:19:17.770087 15415 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:17.734233 15164 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:17.771260  8784 raft_consensus.cc:2393] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 21: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:17.771063  8183 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:17.777967  8791 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 16.
I20260709 13:19:17.740291 15425 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:17.810926 15244 raft_consensus.cc:3055] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:17.811390 15244 raft_consensus.cc:740] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:17.812259 15244 consensus_queue.cc:260] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:17.741353 14955 raft_consensus.cc:2764] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:19:17.740617 15426 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.741086 14974 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:17.685007 15434 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.086s
I20260709 13:19:17.705940 15413 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:19:17.746872 15121 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.740450 15417 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:17.770994 15436 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.162s
I20260709 13:19:17.779631 15374 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:17.815496  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 250957us
I20260709 13:19:17.825253  8248 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:17.825850  8101 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:19:17.780484 15023 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:17.831795 15023 consensus_queue.cc:1059] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:19:17.832814  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 83316us
I20260709 13:19:17.833513 15023 raft_consensus.cc:3055] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:17.834048 15023 raft_consensus.cc:740] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:17.835527  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:17.835602 15023 consensus_queue.cc:260] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:17.837620 15023 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:17.842607  8101 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:19:17.751386 15402 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:19:17.853575  8177 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:17.751222 15404 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.814512 15415 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.817582 15426 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:17.868242  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:17.870814 15461 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:19:17.851662 15244 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:17.820008 15218 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:17.849553 14964 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:17.764972 15421 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:17.826247 15121 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:17.882480  8106 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:19:17.881902 15445 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:17.881819 15394 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:17.849777 14974 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:17.854480 15447 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:17.866981 15415 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:17.789877 15430 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.142s
I20260709 13:19:17.876995  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:17.903569  8072 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:17.903823  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 70279.6us
I20260709 13:19:17.927649  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:17.912684  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 68837.8us
I20260709 13:19:17.853642 15417 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:18.001032  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 124099us
I20260709 13:19:17.984076  8177 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:19:18.021723  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 118222us
I20260709 13:19:17.913300 15475 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:17.915063 15428 raft_consensus.cc:3055] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:18.033286  8072 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:18.029222  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:17.914996 15053 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:18.036811  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:17.984419 15433 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.047950 15433 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:18.004835  8221 leader_election.cc:336] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.795s (SENT)
W20260709 13:19:18.050206  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 45433.1us
I20260709 13:19:18.051841  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:17.999569 15420 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:17.871590 15435 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:17.904564 15408 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.137s
I20260709 13:19:18.053647  8221 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:19:18.062666  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 61993.7us
I20260709 13:19:18.030351 15300 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:17.900689 15218 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:18.052403  8788 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:18.073998  8221 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:18.040005 15428 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:18.000135 15389 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:18.034457 15310 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:18.034638 15317 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:17.914907 15374 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.136s
I20260709 13:19:18.037339 15475 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:17.999172 14964 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:18.092145  8175 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
W20260709 13:19:18.099622  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 68229.8us
W20260709 13:19:18.075835 15403 consensus_meta.cc:287] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260709 13:19:18.116890 15489 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:18.170953 15489 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:18.057683 15437 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:18.109889  8072 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:19:18.122844 15412 consensus_meta.cc:287] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.647s	user 0.013s	sys 0.000s
I20260709 13:19:18.112625 15413 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.011s
W20260709 13:19:18.123281 15467 log.cc:927] Time spent T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:19:18.123709 15466 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.175638 15466 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:18.177881 15466 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:18.124631 15468 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:19:18.178429 15489 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:18.125942 15475 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:18.181123 15475 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:18.118098 15403 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:18.185904 15403 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:18.189015 15477 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:18.130390 15417 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:18.130013 14964 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:18.198275 15383 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:18.198675 15383 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:18.199496 15383 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:18.119014  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:18.200747 15383 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:18.201134  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 82239.2us
I20260709 13:19:18.202512 15412 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:18.202883  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:18.097498 15420 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:18.140652 15404 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:18.203749 15482 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:18.204116 15412 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:18.140973 15218 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:18.204599 15412 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:18.204777 15244 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:18.205067 15412 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:18.139997 15433 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:18.141851 15389 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:18.143358 15421 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:18.139642 15370 consensus_meta.cc:287] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.691s	user 0.011s	sys 0.000s
I20260709 13:19:18.134300 15415 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:18.062368 15395 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:19:18.149384 15268 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:18.153762 15426 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:18.276019 15426 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:18.139638 15425 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:18.169843  8788 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:18.153051 15432 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:18.153385 15478 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:19:18.076220 15331 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:19:18.189674  8108 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:18.190640 15485 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:18.191576 15374 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:18.195379 15317 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:18.292524 15317 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:18.293748 15317 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:18.296300 15425 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:18.289199 15374 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:18.298216 15374 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:18.299481 15374 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:18.300436 15415 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:18.195286  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 85462.4us
I20260709 13:19:18.129849 15428 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:18.141119 15164 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:18.097051 14974 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:18.204144 15420 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:18.203744  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:18.206274 15121 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:18.205173 15244 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:18.210305 15438 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:18.212034 15220 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:18.213023  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:19:18.232447  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 195723us
I20260709 13:19:18.239838  8174 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 19.
I20260709 13:19:18.269335 15370 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 17. Current term is 18.
I20260709 13:19:18.302129  8072 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
W20260709 13:19:18.305965  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 102295us
I20260709 13:19:18.312683  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:18.307494 15420 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:18.323580  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.329248  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:18.329964  8107 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:19:18.334067  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:18.334817  8252 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:18.335917  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:18.336589  8252 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:18.337699  8255 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:19:18.338204  8255 pending_rounds.cc:85] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 12
I20260709 13:19:18.338488  8255 pending_rounds.cc:107] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:19:18.338730  8255 raft_consensus.cc:2889] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:18.339636 15300 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 22 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:18.340739 15300 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:18.341866  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 267927us
I20260709 13:19:18.342469  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:18.343031 15218 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.343336  8255 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 23: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:18.343628 15218 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:18.345203  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:18.345293  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:18.346026  8174 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 13:19:18.346352 15331 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:18.346724  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:18.346390  8174 pending_rounds.cc:85] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 11
I20260709 13:19:18.346815  8149 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:18.347429  8174 pending_rounds.cc:107] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:19:18.347716  8174 raft_consensus.cc:2889] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:18.347976  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:18.348668  8175 raft_consensus.cc:2393] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:18.348810 15341 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:18.350433 15218 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:18.352219  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 323076us
I20260709 13:19:18.352859  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:18.353798  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:18.353706  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:18.354539  8788 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:19:18.355490  8100 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 25.
I20260709 13:19:18.357117 15432 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:18.309749 15488 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:18.361972  8253 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:18.314468 15428 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:18.360401  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:18.364526  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:18.370244  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:18.370695  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:18.371479  8100 raft_consensus.cc:2393] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 23: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:18.365137  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:18.362911  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:18.373312  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 62893.5us
I20260709 13:19:18.373256  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:18.375305  8103 raft_consensus.cc:1275] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:18.325759 15164 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:18.378587  8147 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:18.358224 15493 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:18.361078 15494 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.380604 15499 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:18.382407  8181 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:19:18.383358  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:18.472123  8099 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 13.
I20260709 13:19:18.383288  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:18.384016 15432 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:18.385288 15479 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:18.372960 15416 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:18.359258 15475 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:19:18.482100  8106 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:18.483556  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:18.362958 15484 consensus_queue.cc:1059] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:19:18.374711  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:18.369299 15370 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:18.390004  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:18.390336  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:18.392463 15477 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:18.402884  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:18.414932  8101 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:18.424907  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:18.428246  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 49763.3us
I20260709 13:19:18.402756  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:18.472551  8104 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:19:18.428160  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:18.391162  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:19:18.388177  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.479884  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 96662.3us
I20260709 13:19:18.485358  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:18.379559 15488 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:18.490219  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:18.491315  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 101059us
I20260709 13:19:18.390857  8174 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:18.389897 15402 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:18.432696 15164 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:18.436985 15331 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:18.555974  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:18.556497  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:18.557530  8256 raft_consensus.cc:2410] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 24 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:19:18.558744  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:18.559477  8256 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:18.548106  8179 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:18.549145  8790 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 19. Current term is 20. Ops: []
W20260709 13:19:18.493611  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 118951us
I20260709 13:19:18.421020 15496 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:18.554114  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:18.565152  8791 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 20: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:18.431968 15121 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:18.426966 15116 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:18.567282  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 139193us
W20260709 13:19:18.634133  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 70058.5us
I20260709 13:19:18.634361  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:18.486193 15438 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:18.575321  8074 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:18.385399 15374 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.171s
I20260709 13:19:18.633021  8788 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:18.632826  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:18.570652 15221 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:18.490317 15432 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:18.641749  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:18.573158  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:18.636421  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:18.635711 15469 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:19:18.642622  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:18.643519  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:18.644765  8255 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:19:18.550136 15402 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.389695 15498 consensus_queue.cc:1059] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.183s
I20260709 13:19:18.490371 15370 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.556025 15218 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:19:18.680441  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 107368us
I20260709 13:19:18.636883 15496 raft_consensus.cc:697] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:18.728595  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:18.697887  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 127649us
I20260709 13:19:18.709609 15438 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:18.651674 15484 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.101s
I20260709 13:19:18.637358 15433 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:18.739459  8176 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:18.705621  8182 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:18.739957  8181 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 25.
I20260709 13:19:18.636881 15420 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:19:18.737046  8180 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:19:18.550231 14964 raft_consensus.cc:3055] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:18.555979 15331 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.746901  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:18.756647 15370 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:18.549568 15426 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:18.512550 15268 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:18.747669  8250 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 20: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:18.706598 15402 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:18.750154  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 109399us
I20260709 13:19:18.815305 15331 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:18.755350  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:18.481454 15494 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:18.728855 15023 raft_consensus.cc:3055] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:18.761369  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:18.761650  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:18.762545  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:18.426528 15244 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:18.728591 15310 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:18.723119  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:19:18.768369  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 200767us
I20260709 13:19:18.728749 15477 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:18.648120 15116 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:18.748793 15500 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:18.776460  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:18.755199 15218 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.704535 15221 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:18.783691  8256 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:18.963352  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:18.489789 15416 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:18.553510 15164 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:18.764988 15121 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.742821 15413 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:19:18.779100 14964 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:18.748252 15418 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:19:18.470803 15493 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:18.859356  8149 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:19:18.852080 15478 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:19:18.815454 15433 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 25 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:18.868355  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:18.867767  8176 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:18.844523 15432 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:18.874818 15505 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.382s	user 0.001s	sys 0.000s
W20260709 13:19:18.873173 15383 consensus_meta.cc:287] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.000s
I20260709 13:19:18.896310  8179 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
W20260709 13:19:18.857343 15412 consensus_meta.cc:287] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
W20260709 13:19:18.896473  8072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.858292 15421 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
W20260709 13:19:18.919586  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 158296us
W20260709 13:19:18.915663  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 153189us
I20260709 13:19:18.901593 15394 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.910822 15023 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:18.910732 15442 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:18.982414  8256 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:19:19.024895  8256 raft_consensus.cc:1240] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:18.959757 15477 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:18.992054  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.956884 15395 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.952816 15403 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:18.929349 15268 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:18.980314 15218 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:19.008158  8251 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 22. Current term is 23. Ops: []
W20260709 13:19:19.007493  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 251714us
I20260709 13:19:19.008953  8181 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 23. Current term is 24. Ops: []
W20260709 13:19:19.009915  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 150630us
I20260709 13:19:19.047693  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:18.880437 15428 consensus_queue.cc:1048] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.109s
I20260709 13:19:18.918479 15341 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 13:19:18.990389 15500 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:18.995781 15497 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:19.026504  8256 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:18.860090 15426 raft_consensus.cc:697] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:19.102855  8179 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:18.999156 15121 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.015592 15516 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:19.023885 15374 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.081s
W20260709 13:19:19.129766 15507 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.376s	user 0.001s	sys 0.001s
I20260709 13:19:19.020270 15412 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:19.104753 15478 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:19:19.129623 15527 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:19:19.130059 15374 raft_consensus.cc:3055] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:19.130461 15474 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.102s
W20260709 13:19:19.130643  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 91815.3us
W20260709 13:19:19.131052 15524 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:19:19.032577 15383 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 13:19:18.996068 15438 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.028806 15394 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.052891 15415 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 13:19:19.042260 15395 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:19.140812  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 109682us
I20260709 13:19:19.146092  8179 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 23. Current term is 24. Ops: []
W20260709 13:19:19.146497 15521 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:19:19.228906  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 206156us
W20260709 13:19:19.214589  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 46553.6us
I20260709 13:19:19.163065 15482 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:19.216424 15489 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.216307 14974 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:19.218526 15477 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:19.247082  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:19.247723  8183 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:19.220301 15518 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:19:19.143936 15374 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:19.225369  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:19.240942  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:19.242606  8785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 2024) took 1030 ms. Trace:
I20260709 13:19:19.272485  8785 rpcz_store.cc:276] 0709 13:19:18.211936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.219816 (+  7880us) service_pool.cc:224] Handling call
0709 13:19:18.220132 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:18.220471 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.220498 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:18.221015 (+   517us) log.cc:844] Serialized 52 byte log entry
0709 13:19:18.354466 (+133451us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:18.354492 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.354543 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.242408 (+887865us) raft_consensus.cc:1685] finished
0709 13:19:19.242425 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.242550 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":703,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":86234,"threads_started":1,"wal-append.queue_time_us":261396}
I20260709 13:19:19.219259 15402 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:19.278765  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 53447.7us
I20260709 13:19:19.221242 15164 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.280592  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:19.306195  8175 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.021s	sys 0.062s
W20260709 13:19:19.306895  8175 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.021s	sys 0.062s
I20260709 13:19:19.140977 15433 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.299134  8252 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
W20260709 13:19:19.310150  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 80330.8us
I20260709 13:19:19.320814  8183 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:19.243371 15412 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:19.274164 15116 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:19.281481 15477 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:18.773135 15488 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.306181 15435 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.299973 15499 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:19.117447 15497 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.273947 14974 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:19.338155 15517 log.cc:927] Time spent T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.339s	user 0.001s	sys 0.000s
I20260709 13:19:19.274109 15489 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:18.956902 15496 consensus_queue.cc:237] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:19.351394  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 70886us
I20260709 13:19:19.243279 15426 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.345166 15416 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:19.356391  8783 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:19.342944 15477 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.342561 15533 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.307184 15317 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:19:19.313730 15534 consensus_queue.cc:1059] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 13:19:19.375491  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:19.372610  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:19.376384  8183 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:19.218531 15500 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.364228 15403 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:19.350096 15493 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:19.357857 15523 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:19.373627 15477 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:19.350224 15435 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.403053  8174 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:19:19.362600 15526 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.238s
I20260709 13:19:19.405520  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2375) took 1046 ms. Trace:
I20260709 13:19:19.347957 15374 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.375924 15533 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:19.418355 15528 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
W20260709 13:19:19.419152 15538 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:19:19.423313 15403 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:19.449599  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3637) took 1120 ms. Trace:
I20260709 13:19:19.387400 15493 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.387425 15121 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:19.467410  8250 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:19.410210  8102 rpcz_store.cc:276] 0709 13:19:18.359130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.359452 (+   322us) service_pool.cc:224] Handling call
0709 13:19:18.373559 (+ 14107us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.373887 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.373913 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:19.228820 (+854907us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b2c000014c8. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59f745a11 00007fa59f755372 00007fa5a0e87a01 00007fa5a0e4c43a 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2
0709 13:19:19.238927 (+ 10107us) log.cc:844] Serialized 26 byte log entry
0709 13:19:19.389940 (+151013us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:19.389998 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.390103 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.390156 (+    53us) raft_consensus.cc:1685] finished
0709 13:19:19.390173 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.405447 (+ 15274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":102,"spinlock_wait_cycles":136788224,"thread_start_us":146891,"threads_started":1,"wal-append.queue_time_us":142667}
I20260709 13:19:19.408263 15527 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.475579  8248 rpcz_store.cc:276] 0709 13:19:18.329207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.329441 (+   234us) service_pool.cc:224] Handling call
0709 13:19:18.358893 (+ 29452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.491833 (+132940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.491864 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.546888 (+ 55024us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.762940 (+216052us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:19.029721 (+266781us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.039234 (+  9513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.039417 (+   183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.449268 (+409851us) raft_consensus.cc:1685] finished
0709 13:19:19.449296 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.449513 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":203006,"raft.queue_time_us":142765,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":10566,"thread_start_us":307512,"threads_started":2,"wal-append.queue_time_us":341847}
I20260709 13:19:19.402086 15523 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.452047 15412 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
I20260709 13:19:19.508774 15416 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.507455 15403 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.518512 15533 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:19.518826 14974 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:19.519964  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:19.406868 15494 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:19.226449 15436 consensus_queue.cc:1175] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a0f96c12124b4e1a816d9fa970464091" responder_term: 24 status { last_received { term: 24 index: 13 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 23. Current term is 24. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:19.526937  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2387) took 1155 ms. Trace:
I20260709 13:19:19.537398  8175 rpcz_store.cc:276] 0709 13:19:18.358772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.367334 (+  8562us) service_pool.cc:224] Handling call
0709 13:19:18.546792 (+179458us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b58000d7d98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:19:18.546994 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:18.547210 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:19:19.307298 (+760088us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.513608 (+206310us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.513787 (+   179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.513836 (+    49us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:19:19.513889 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.513958 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.514081 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":215296,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":4105,"spinlock_wait_cycles":9668480,"thread_start_us":908984,"threads_started":3,"wal-append.queue_time_us":109904}
I20260709 13:19:19.534699  8783 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:19.500821 15493 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.523320 15527 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.541743  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:19.542557  8174 raft_consensus.cc:606] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:19.543099 15482 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:19.543898 15527 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:19.545686  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:19.546491  8102 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:19.542994  8174 raft_consensus.cc:614] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:19.548352  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:19.515002 15300 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:19:19.553012  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 505423us
I20260709 13:19:19.545102  8147 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:19.557243 15482 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:19.557717 15482 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:19.558604 15482 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.559978 15482 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:19.560031 15523 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:19.561756 15435 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:19.563166 15489 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:19.533054 15402 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:19.577095  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:19.556313 15300 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:19.534966 15416 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.582113  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:19.584051  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:19.566747 15527 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:19.583933  8106 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:19:19.586947  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:19.571339 15523 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:19.590727 15523 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.591117 15523 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:19.582224 15402 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.595355 15395 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:19.604579  8178 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:19.586658 15493 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:19.617254  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:19.586369 15527 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.617908  8174 raft_consensus.cc:606] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:19.620213  8174 raft_consensus.cc:614] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:19.582799 15300 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.619817  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:19.620880 15300 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:19.623338  8783 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:19:19.616412 15546 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.118s	user 0.000s	sys 0.002s
I20260709 13:19:19.623498  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:19.644016  8106 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:19.622540 15527 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:19.604115 14974 consensus_queue.cc:1059] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.030s
I20260709 13:19:19.634459 15497 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:19.669018 15370 consensus_meta.cc:287] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.814s	user 0.005s	sys 0.006s
I20260709 13:19:19.617707 15402 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.635870 15412 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
W20260709 13:19:19.689982  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 72295.7us
W20260709 13:19:19.684945 15218 consensus_meta.cc:287] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.580s	user 0.005s	sys 0.006s
W20260709 13:19:19.700857  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.714802 15402 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:19.717815 15526 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:19.718495 15526 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.722052  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:19.722764  8101 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:19.675100 15370 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:19.728108  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.729179 15556 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.729413  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:19.729791 15556 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.723840 15218 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.731046 15432 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:19.732389 15432 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.732563  8176 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:19:19.734331 15556 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:19.734084 15218 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:19.736965 15331 consensus_meta.cc:287] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.001s
I20260709 13:19:19.729388 15534 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:19.753093  8789 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:19.755031  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:19.758534  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:19.758232 15534 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.766795  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:19.767616  8099 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
W20260709 13:19:19.767877 15515 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.748s	user 0.002s	sys 0.000s
I20260709 13:19:19.769600 15433 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.770329 15416 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:19.770217 15433 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.773224  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3648) took 1407 ms. Trace:
I20260709 13:19:19.774019 15534 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:19.774757 15534 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:19.775880  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:19.776638  8248 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
W20260709 13:19:19.777230  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 55170.9us
I20260709 13:19:19.777737  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:19.751978 15526 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:19.778864  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:19.778216 15477 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.778144 15493 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.789836 15485 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:19.790150  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:19.782877 14964 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.792150 15220 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:19.785414 15544 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:19:19.773669  8254 rpcz_store.cc:276] 0709 13:19:18.365759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.365873 (+   114us) service_pool.cc:224] Handling call
0709 13:19:18.381664 (+ 15791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.437732 (+ 56068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.437759 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.438212 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.849882 (+411670us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:18.849930 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.850016 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.556049 (+706033us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b4800061158. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a5d75aa1 00007fa5a5d6cb37 00007fa5a5d6c9ca 00007fa5a5e6426f 00007fa5a5e63f37 00007fa5a5e7855c 00007fa5a5e78508 00007fa5a5e78488 00007fa5a5e78443 00007fa5a5e776ec 00007fa5a4da1a96
0709 13:19:19.767260 (+211211us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:19.769264 (+  2004us) raft_consensus.cc:1685] finished
0709 13:19:19.769288 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.773158 (+  3870us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55692,"raft.queue_time_us":102827,"raft.run_cpu_time_us":13303,"raft.run_wall_time_us":1070588,"spinlock_wait_cycles":16821248,"thread_start_us":280363,"threads_started":1,"wal-append.queue_time_us":474058}
I20260709 13:19:19.780351 15221 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:19.789908 15493 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.794412  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:19.796057  8254 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:19:19.800238 15495 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:19.800925 15432 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:19.801497 15532 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:19.802002 15532 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:19.802286 15415 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.796097 15493 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:19.796705 15447 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:19.802866 15415 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.802956 15532 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.797475 15220 consensus_queue.cc:1059] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:19.804888 15532 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:19.805011 15220 raft_consensus.cc:3055] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:19.805178 15415 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:19.787683 15551 raft_consensus.cc:3055] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:19.805980 15551 raft_consensus.cc:740] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:19.807087 15551 consensus_queue.cc:260] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.805533 15394 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:19.779001  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.809553 15477 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:19.810954 15370 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:19.811332  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3639) took 1476 ms. Trace:
I20260709 13:19:19.813308  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:19.805508 15220 raft_consensus.cc:740] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:19.778981  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:19.772611 15433 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:19.798553 15485 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:19.815505  8248 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
W20260709 13:19:19.822192  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 63754.2us
I20260709 13:19:19.813761  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:19.823907  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:19.824442  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 55077.3us
I20260709 13:19:19.820024  8251 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:19.811776  8257 rpcz_store.cc:276] 0709 13:19:18.334659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.335401 (+   742us) service_pool.cc:224] Handling call
0709 13:19:18.335739 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:18.366061 (+ 30322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.366100 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:18.430583 (+ 64483us) log.cc:844] Serialized 52 byte log entry
0709 13:19:18.740426 (+309843us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:18.994714 (+254288us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.810394 (+815680us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b1800340060. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dcd9c0a 00007fa5a7419219 00007fa59dd61a40 00007fa59dd5c4e4 00007fa59dd5c455 00007fa5a48443c7 00007fa5a0e569a7 00007fa5a0e660bf 00007fa5a0e66038
0709 13:19:19.810655 (+   261us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.810902 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.810985 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.811114 (+   129us) raft_consensus.cc:1685] finished
0709 13:19:19.811142 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.811270 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99306,"prepare.queue_time_us":272047,"raft.queue_time_us":42008,"raft.run_cpu_time_us":398,"raft.run_wall_time_us":56294,"spinlock_wait_cycles":16397440,"thread_start_us":548881,"threads_started":2,"wal-append.queue_time_us":427897}
I20260709 13:19:19.819494  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:19.828540  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:19.829213  8783 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:19:19.829516  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:19.830410  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:19.831142  8785 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 16.
I20260709 13:19:19.831952  8107 raft_consensus.cc:2393] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:19.833158  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:19.835704  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:19.836264  8175 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:19.836334  8179 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:19.835755  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:19.838651  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.843844  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.848004  8248 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:19:19.854596  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:19.856190  8221 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:19.856897  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:19.857736  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:19.858562  8102 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:19:19.752748 15331 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.832856 15426 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:19.825529 15432 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.863735  8782 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:19.833233 15433 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:19.833575 15300 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:19.868546  8099 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:19.839445 15488 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.815886 15523 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.864454 15485 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:19.866601 15383 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:19.882942 15383 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.883361 15383 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:19.883423 15523 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:19.885670 15433 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:19.870271 15121 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.886644 15121 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.886855 15433 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.839242 15527 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.871834  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:19.890331  8179 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:19.891350 15488 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.892145  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:19.892763  8108 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:19.862440 15395 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:19.893783 15488 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:19.893889 15395 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:19.895313 15395 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.866331 15445 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:19.898545 15445 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.903972  8107 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:19.905253  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:19.906277  8104 raft_consensus.cc:2410] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 27 because replica has last-logged OpId of term: 26 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 13:19:19.891359 15527 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:19.871047  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:19.871387  8101 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:19:19.863912 15116 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:19.843310 15489 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:19.909977 15116 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.910612 15116 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:19.910355 15489 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.855769 15534 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:19.912853 15534 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:19.913735 15447 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:19.913923 15534 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.914556 15447 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.878922 15023 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.917987 15023 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:19.918234  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:19.919842 15331 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:19.879559 15526 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:19.872861 15432 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.926121  8149 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:19.927567  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:19.929055  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:19.929833  8104 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:19.930130  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:19.932636 15527 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:19.933095 15527 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:19.933521 15527 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:19.935443 15510 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 1.037s	user 0.004s	sys 0.000s
I20260709 13:19:19.939844 15526 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:19.940709  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3563) took 1612 ms. Trace:
I20260709 13:19:19.940969 15370 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:19.948693  8105 rpcz_store.cc:276] 0709 13:19:18.328251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.330858 (+  2607us) service_pool.cc:224] Handling call
0709 13:19:18.331135 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.018411 (+687276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.018456 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.018512 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:19.018556 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.940373 (+921817us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b54000f3f54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:19.940438 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.940632 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1580082048}
I20260709 13:19:19.942934  8108 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:19.943050 15383 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:19.946766  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:19.956825  8104 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.947413  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:19.954341  8755 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:19.969241  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:19.815124 15220 consensus_queue.cc:260] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:19.917338 15447 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:19.945765 15432 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:19.977036  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:19.949997 15485 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:19.951591 15488 raft_consensus.cc:2804] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:19.962399 15331 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:19.984930  8104 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:19:19.965169 15300 raft_consensus.cc:2804] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:19.966030 15494 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:19.993474  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:19.995429  8179 raft_consensus.cc:2410] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 25 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 13:19:19.998917  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:19.989068 15331 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.995864 15494 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.008072  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:20.013325  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 53890.5us
I20260709 13:19:20.013684  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:19.997098 15426 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:20.022557 15426 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.024832 15426 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:20.007265 15331 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:19.987597 15403 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:19:19.997843 15488 raft_consensus.cc:697] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:19.999948 15300 raft_consensus.cc:697] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 22 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:20.015754  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.005852 15221 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.013609 15494 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:19.989743 15485 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.044433 15244 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:20.021581 15383 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:20.046586 15500 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:19:20.049525 15221 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.052064 15221 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:20.054342 15300 consensus_queue.cc:237] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.021716 15548 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.057870 15548 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.060896 15548 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:20.062353 15488 consensus_queue.cc:237] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.066545 15421 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:20.067199 15421 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.039384  8177 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
I20260709 13:19:20.064016 15116 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.069763 15421 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:20.035916  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:20.071967  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 57754.5us
I20260709 13:19:20.075560  8223 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:20.076996  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.078022  8179 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:20.033746 15475 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:20.033524 15426 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:20.077837 15403 consensus_queue.cc:1243] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 22.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:20.074718 15116 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:20.107229  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:20.094803 15500 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:20.110839  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:20.095940 15534 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:20.103037 15383 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:20.114459 15497 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:20.062419 15494 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.112390 15500 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:20.126736  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.119947 15543 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:19:20.114616 15415 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:19:20.129581  8253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60806 (request call id 1037) took 1574 ms (client timeout 1848 ms). Trace:
I20260709 13:19:20.130268  8254 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:20.120527 15497 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.133360 15500 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:20.108476 15475 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:20.133950  8253 rpcz_store.cc:269] 0709 13:19:18.555541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.555710 (+   169us) service_pool.cc:224] Handling call
0709 13:19:20.129324 (+1573614us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54001207d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:20.129495 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2769049344}
I20260709 13:19:20.144333  8180 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 13:19:20.118187 15514 log.cc:927] Time spent T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 1.388s	user 0.000s	sys 0.005s
I20260709 13:19:20.113879 15403 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:19:20.138760 15415 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.154011 15415 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:20.141952 15497 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:20.110451 15426 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.116757 15534 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.199272  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:20.205758  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.205089  8149 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:20.194886 15526 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.202440 15565 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:20.218575  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:20.219659 15121 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:20.221920 15568 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:19:20.223762 15570 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:19:20.226155 15475 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:20.226696 15534 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:20.230000 15494 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:20.239243  8183 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:19:20.254446  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48096 (request call id 1151) took 1690 ms. Trace:
I20260709 13:19:20.255035  8789 rpcz_store.cc:276] 0709 13:19:18.549159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.549513 (+   354us) service_pool.cc:224] Handling call
0709 13:19:18.549771 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.753873 (+1204102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.239508 (+485635us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400362c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:20.239771 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2750600064}
W20260709 13:19:20.260056  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 58646.3us
I20260709 13:19:20.232450 15331 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.268211 15331 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:20.215368 15526 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.234208 15500 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:20.290373  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 53299.9us
I20260709 13:19:20.220381 15565 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.289649 15415 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.305403 15526 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:20.326612 15426 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:20.328215 15527 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.330624 15527 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:20.325078 15565 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:20.310895 15500 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:20.332361 15415 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:20.334143 15485 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:20.339020 15445 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:20.299489 15497 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.350338 15394 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:20.350908 15415 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.350997 15394 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.351508 15415 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:20.351007 15520 log.cc:927] Time spent T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 1.111s	user 0.002s	sys 0.000s
I20260709 13:19:20.353575 15435 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.354127 15435 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.356333 15435 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:20.345703 15445 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:20.357455 15445 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.359387 15420 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:20.359884 15445 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:20.359928 15420 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.353381 15394 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:20.363142 15420 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:20.315765 15438 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.012s	sys 0.004s
I20260709 13:19:20.373245  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:19:20.376979  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.377393 15415 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:20.379621  8255 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
W20260709 13:19:20.390554  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 185522us
I20260709 13:19:20.399320  8177 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 22. Current term is 23. Ops: [20.13-22.14]
W20260709 13:19:20.370059 15438 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.012s	sys 0.004s
I20260709 13:19:20.417146  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.416260  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:20.421790  8177 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:20.371296 15394 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:20.424731  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:20.425484  8257 raft_consensus.cc:3060] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:20.426198  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.426936  8251 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 17: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:20.427904  8255 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:20.433720  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.434401  8183 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:20.435452  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.436285  8183 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:19:20.441793 15412 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.442672 15412 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.446416 15425 raft_consensus.cc:3055] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:20.446998 15425 raft_consensus.cc:740] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:20.448182 15425 consensus_queue.cc:260] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.470059  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.478629  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.390635 15533 raft_consensus.cc:2804] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:19:20.471633  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.482683  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.486920  8183 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:20.487864  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.489017  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:20.492645  8257 raft_consensus.cc:2468] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:20.496979  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.500113  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.497644  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.500932  8255 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:20.502064  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.503441  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.460466 15435 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.499430  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:20.509737  8248 raft_consensus.cc:3060] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:20.419390 15415 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
I20260709 13:19:20.504374  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.511482  8253 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:20.512367  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.505676  8255 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 25: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:20.508455  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:20.513926  8183 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:20.496480 15442 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:20.496659 15300 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.521173 15300 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.494887 15533 raft_consensus.cc:697] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:20.521852 15543 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:20.522291 15543 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:20.522594 15533 consensus_queue.cc:237] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.523335 15300 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:20.523097 15543 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.524307 15543 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:20.493868 15500 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:20.494472 15425 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:20.529644  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:20.555771  8174 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:20.531328  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 3193) took 1969 ms. Trace:
I20260709 13:19:20.535184 15220 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:20.538158  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:20.539958  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:20.541574  8791 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:20.542029  8782 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:20.542143  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:20.561831  8790 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:20.542842  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:20.562490  8257 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:19:20.562777  8787 raft_consensus.cc:3060] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:20.563436  8783 raft_consensus.cc:2410] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:19:20.560716  8785 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:20.514674 15121 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:19:20.543906  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:20.544060 15496 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:20.514907 15489 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:20.544816  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.547642  8177 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:20.516762 15442 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.554061  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:20.556188  8178 rpcz_store.cc:276] 0709 13:19:18.561838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.562094 (+   256us) service_pool.cc:224] Handling call
0709 13:19:18.562510 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.612513 (+1050003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.531109 (+918596us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400329454. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:20.531271 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2395999104}
I20260709 13:19:20.483860 15394 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.546705 15412 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:20.576719  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.594607  8257 raft_consensus.cc:2368] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19.
I20260709 13:19:20.551143 15500 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.583724  8183 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:20.587244  8255 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:20.560209 15221 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.514457 15426 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 13:19:20.595894  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.589763  8790 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:20.597131  8223 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:20.630798  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.602355  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.598439  8248 raft_consensus.cc:2468] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
W20260709 13:19:20.610749  8252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 3200) took 2036 ms (client timeout 1839 ms). Trace:
I20260709 13:19:20.515578 15435 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.574895 15496 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:20.637868  8790 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:20.643836  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:20.606817  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:20.644752  8178 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:19:20.636610  8252 rpcz_store.cc:269] 0709 13:19:18.574451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.722748 (+148297us) service_pool.cc:224] Handling call
0709 13:19:20.610552 (+1887804us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54002e8e54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:20.610674 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663204608}
I20260709 13:19:20.611371  8255 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:20.646461  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.646970  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.647655  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.644505  8783 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:20.648368  8255 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:20.636962  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.640817  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.641920  8254 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:20.581359 15121 consensus_queue.cc:1243] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 5033fc7e66374940a203908ea8b0078f log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:19:20.652551  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:20.642186  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 45136.7us
I20260709 13:19:20.642760  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.655740  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.655831  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:20.605851 15221 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.656843  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.657143  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:20.657876  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:20.658144 15221 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:20.613957 15497 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:20.627161 15499 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:20.658627  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.659191 15499 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.661119 15499 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:20.651804  8787 raft_consensus.cc:2468] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 14.
I20260709 13:19:20.665315  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:20.666445  8178 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 26.
I20260709 13:19:20.658034  8255 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 25: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:20.667094  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:20.685776  8783 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:20.686070  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:20.687414  8783 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:19:20.688740  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.686736  8787 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:20.689606  8178 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:20.690760  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.693359  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:20.693774  8178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:20.646479 15413 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:20.669263  8790 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:19:20.669293  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:20.669471 15383 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.670866 15435 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:20.671694 15496 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.673985 15442 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:20.678619 15394 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:20.602785 15500 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:20.616932 15164 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:20.620464 15536 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 1.257s	user 0.001s	sys 0.002s
I20260709 13:19:20.694182  8174 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:20.696327  8178 raft_consensus.cc:606] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:20.666309  8755 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:20.719869  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 53648.6us
I20260709 13:19:20.724778  8178 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:20.727106  8178 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:20.710592 15413 raft_consensus.cc:697] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:20.734302  8787 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:20.715412 15496 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:20.736912  8178 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:19:20.736984  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:20.751611  8178 raft_consensus.cc:1240] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:20.708002 15383 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.759686  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:20.754338 15300 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:20.764277 15413 consensus_queue.cc:237] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.770107  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3650) took 1912 ms. Trace:
I20260709 13:19:20.771350  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:20.773597 15596 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:19:20.774976  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.737869 15499 raft_consensus.cc:2764] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:19:20.777839 15403 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:20.778723 15403 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.781067 15403 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:20.787931  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:20.770596  8256 rpcz_store.cc:276] 0709 13:19:18.857389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.113969 (+256580us) service_pool.cc:224] Handling call
0709 13:19:19.114343 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:19.114755 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:19:19.114796 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:19.115344 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:19:19.247102 (+131758us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:19.247143 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.247212 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.619871 (+1372659us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:20.769743 (+149872us) raft_consensus.cc:1685] finished
0709 13:19:20.769769 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.770016 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":8796,"spinlock_wait_cycles":10006784,"thread_start_us":113538,"threads_started":1,"wal-append.queue_time_us":225041}
I20260709 13:19:20.787822  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:20.938155  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 382984us
I20260709 13:19:20.939790  8106 raft_consensus.cc:2410] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:19:20.785130 15485 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.797307  8174 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:20.940802  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.756603 15445 raft_consensus.cc:3055] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:20.943045 15445 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:20.755344 15370 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.041s
I20260709 13:19:20.943513 15485 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.800860  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.803959  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:20.945770  8107 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:20.804189  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:20.804548  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 389627us
W20260709 13:19:20.946646  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 142534us
I20260709 13:19:20.947347  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:20.948128  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.948313 15164 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:20.948709  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:20.806334 15383 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:20.806209 15438 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:20.949700  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.949977 15543 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.950400 15438 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:20.950492 15543 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.950953 15438 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.952533 15543 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:20.801031 15437 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:20.952960 15438 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:20.807097  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:20.953573  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:20.954015 15412 consensus_queue.cc:1059] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:19:20.954691  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.954907 15412 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:20.955385 15412 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:20.956156 15412 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.811069  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:20.811745  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:20.812412  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:20.813046  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:20.815047  8249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 3199) took 2241 ms (client timeout 1637 ms). Trace:
W20260709 13:19:20.815773  8250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57556 (request call id 3203) took 2184 ms (client timeout 2064 ms). Trace:
I20260709 13:19:20.815838  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:20.958135  8251 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:20.960976  8099 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:20.961812  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:20.953931  8108 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:20.958576  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:20.958024  8101 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 27.
I20260709 13:19:20.963299  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:20.963570  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:19:20.960861  8249 rpcz_store.cc:269] 0709 13:19:18.574122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.707732 (+133610us) service_pool.cc:224] Handling call
0709 13:19:20.814864 (+2107132us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b54001e5854. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:20.814981 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2062000896}
I20260709 13:19:20.964471  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:20.817276  8257 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:20.957751  8102 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:20.819609  8104 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:19:20.965854  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:20.966379  8102 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:19:20.953019 15543 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:20.967242 15543 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:20.943269  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:20.968103 15543 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.968961  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:20.835582  8790 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:20.835807  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:20.820358  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:20.970669  8784 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:20.855602  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.957728  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:20.972393  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:20.858155  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:20.973265  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:20.879815  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:20.829005 15023 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.881635  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.975509 15023 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.976142  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:20.976979  8102 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:20.977380  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:20.858765 15498 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:20.977612 15488 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:20.978181 15498 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:20.979228  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:20.979864 15551 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:20.979982 15488 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:20.902966  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:20.980752  8782 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:20.982144  8782 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: [17.14-19.15]
I20260709 13:19:20.982859 15500 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.900714 15435 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:20.984292 15435 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.906185 15374 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:20.907194 15442 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.918032  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46064 (request call id 3200) took 2163 ms. Trace:
I20260709 13:19:20.924860  8072 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:20.925709  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 104129us
I20260709 13:19:20.926527 15477 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:19:20.949362 15539 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:20.954789  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.977756 15481 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:21.015820 15481 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.016252 15481 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:21.016716  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.017791  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:20.961913  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:20.962412  8789 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:21.018285 15500 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:21.011408 15442 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.019200  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:20.817874 15447 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:21.019927 15447 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:21.020272 15442 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:21.020483  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:21.021042  8790 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:19:21.021387  8790 pending_rounds.cc:85] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 14
I20260709 13:19:20.964702  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:21.021651  8790 pending_rounds.cc:107] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:19:21.021909  8790 raft_consensus.cc:2889] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:20.814466  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:20.966310  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:20.970739  8786 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 23: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:20.838376  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:20.958698 15437 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:21.023804  8104 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
W20260709 13:19:21.024101  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 99322.1us
I20260709 13:19:20.957322 15412 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:20.963464  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:20.986759  8251 raft_consensus.cc:1275] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:19:20.980439  8250 rpcz_store.cc:269] 0709 13:19:18.631893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.858675 (+226782us) service_pool.cc:224] Handling call
0709 13:19:20.815603 (+1956928us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b540030cfd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:20.815704 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26809088}
I20260709 13:19:20.915397  8248 raft_consensus.cc:1240] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:20.990188  8257 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:19:20.955529  8174 raft_consensus.cc:2410] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:19:20.992475  8107 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
W20260709 13:19:20.996138  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.957974 15595 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.313s	user 0.003s	sys 0.000s
I20260709 13:19:20.977576 15023 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:20.994654  8074 leader_election.cc:400] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19.
I20260709 13:19:20.999261  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.994357  8181 rpcz_store.cc:276] 0709 13:19:18.760479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.781331 (+ 20852us) service_pool.cc:224] Handling call
0709 13:19:19.008733 (+227402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.103273 (+ 94540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.917789 (+1814516us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400331b50. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:20.917944 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367413504}
I20260709 13:19:20.981045 15432 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:19:20.960800 14964 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:21.005697 15485 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:21.006832  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:21.043556  8108 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:20.969329 15543 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:21.057590 15572 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:19:21.058440 15572 consensus_queue.cc:1243] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:19:21.034245 15425 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:21.059266 15603 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:21.060459 15603 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:21.060806 15603 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:20.980227 15498 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:21.010838  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.810456 15310 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:21.012377  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:20.959216 15558 raft_consensus.cc:993] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:19:21.020841 15447 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:20.911300  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:20.970008  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:20.985906  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:21.072463  8102 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 19: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:21.033774 15474 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:19:21.033296  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:21.030285 15579 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:21.041160  8074 leader_election.cc:403] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:21.046809  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:21.075438  8099 raft_consensus.cc:2376] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19. Re-sending same reply.
I20260709 13:19:21.053627 15434 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:21.033905 15494 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:19:21.070327  8147 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:21.062618 15310 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.032006  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:21.080200  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 91391.7us
I20260709 13:19:21.081658  8074 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:21.081962  8784 raft_consensus.cc:2468] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:19:21.083324  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:21.085667  8102 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:19:21.087280  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:21.098230  8102 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:21.024142 15394 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:19:21.099815  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:21.100486  8102 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:21.079255 15437 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:19:21.101926 15500 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:21.102216  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:21.102993  8182 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 23: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:21.103767  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:21.106402 15310 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:21.097684 15428 raft_consensus.cc:1081] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:19:21.108721  8182 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:19:21.109401 15425 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.109928 15425 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:21.110136  8182 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:19:21.110486  8182 pending_rounds.cc:85] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 15
I20260709 13:19:21.110689  8182 pending_rounds.cc:107] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:19:21.110910  8182 raft_consensus.cc:2889] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:21.112301  8182 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:21.113570 15023 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 18. Current term is 19.
I20260709 13:19:21.119269  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:21.114333  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:21.147187  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 45968.6us
I20260709 13:19:21.149564  8099 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:19:21.150090  8099 pending_rounds.cc:85] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 15
I20260709 13:19:21.150382  8099 pending_rounds.cc:107] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 20.16
W20260709 13:19:21.150568  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 78910.9us
I20260709 13:19:21.150681  8099 raft_consensus.cc:2889] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:21.158510 15539 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:21.160319 15438 raft_consensus.cc:3055] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:21.160853 15438 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:21.170369  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:21.172330  8178 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:21.079684 15579 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:19:21.175040  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 104774us
I20260709 13:19:21.171118  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:21.123450 15220 consensus_meta.cc:287] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.001s
I20260709 13:19:21.074501 15053 consensus_queue.cc:1059] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:19:21.190227  8106 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
W20260709 13:19:21.184639  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.092181 15447 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:21.188073  8108 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 13:19:21.182955 15579 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:21.073635 15497 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:19:21.194547  8108 pending_rounds.cc:85] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 13
I20260709 13:19:21.201314  8108 pending_rounds.cc:107] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:19:21.201633  8108 raft_consensus.cc:2889] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:21.195629  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:21.151762 15496 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:21.143827 15485 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:21.210691  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:21.211644  8104 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 27.
W20260709 13:19:21.205587  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.186728 15341 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:21.224261  8182 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:19:21.183776 15426 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:19:21.204456  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55955.1us
I20260709 13:19:21.230507  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:21.227420 15221 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:19:21.233403  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:19:21.234819  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 58188.6us
I20260709 13:19:21.255909  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:21.258905  8178 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:21.096871 15603 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.229180 15435 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:21.263736  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.238054 15474 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:21.248971 15485 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:19:21.267987  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 293507us
I20260709 13:19:21.267652  8002 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36106 (request call id 206) took 6228 ms. Trace:
I20260709 13:19:21.272158  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:21.330049  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 132726us
I20260709 13:19:21.253850 15426 raft_consensus.cc:697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:19:21.334039  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 51502.7us
I20260709 13:19:21.228251 15438 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.268817 15496 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:21.330834  8002 rpcz_store.cc:276] 0709 13:19:15.035152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.038331 (+  3179us) service_pool.cc:224] Handling call
0709 13:19:21.262487 (+6224156us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:17.498508 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:17.499100 (+   592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:17.499139 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:19:17.499163 (+    24us) tablet.cc:662] Decoding operations
0709 13:19:17.500949 (+  1786us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:17.501050 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:17.501086 (+    36us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:19:17.502540 (+  1454us) tablet.cc:701] Row locks acquired
0709 13:19:17.502563 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:19:17.502713 (+   150us) write_op.cc:270] Start()
0709 13:19:17.502831 (+   118us) write_op.cc:276] Timestamp: P: 1783603157502651 usec, L: 0
0709 13:19:17.502849 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:19:17.503520 (+   671us) log.cc:844] Serialized 5962 byte log entry
0709 13:19:18.161634 (+658114us) op_driver.cc:464] REPLICATION: finished
0709 13:19:18.399161 (+237527us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b18000fa780. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:19:18.399299 (+   138us) write_op.cc:301] APPLY: starting
0709 13:19:18.399384 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:18.417021 (+ 17637us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:18.417047 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:19.594493 (+1177446us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:19.594799 (+   306us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:19:19.594844 (+    45us) write_op.cc:312] APPLY: finished
0709 13:19:19.595220 (+   376us) log.cc:844] Serialized 139 byte log entry
0709 13:19:19.634099 (+ 38879us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:19.655543 (+ 21444us) write_op.cc:454] Released schema lock
0709 13:19:19.658827 (+  3284us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:19.667839 (+  9012us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:19.667892 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":689653,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":183936,"apply.run_cpu_time_us":31838,"apply.run_wall_time_us":1268413,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66797,"num_ops":15,"prepare.queue_time_us":215516,"prepare.run_cpu_time_us":20410,"prepare.run_wall_time_us":77373,"raft.queue_time_us":522362,"raft.run_cpu_time_us":13294,"raft.run_wall_time_us":160376,"replication_time_us":658602,"spinlock_wait_cycles":14177920,"thread_start_us":632164,"threads_started":5,"wal-append.queue_time_us":205162,"wal-append.run_cpu_time_us":36023,"wal-append.run_wall_time_us":2317118}]]}
W20260709 13:19:21.374336  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 45403.7us
W20260709 13:19:21.377924  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 110167us
I20260709 13:19:21.381183  8074 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:21.382647  8789 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:21.266492 15341 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:21.357344 15474 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:21.385982 15485 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.386518 15572 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.386627 15389 raft_consensus.cc:3055] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:19:21.387529 15611 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:19:21.404028 15438 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:21.404526 15496 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:21.329169 15477 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:21.418887  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:21.430816  8181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:21.443997  8181 raft_consensus.cc:606] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:21.431805  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:21.423897 15220 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:21.269347 15482 consensus_queue.cc:1059] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.118s
I20260709 13:19:21.446417  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:21.416039 15383 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:21.454535  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:21.433902  8253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57566
I20260709 13:19:21.457369  8253 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:21.457974  8253 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:21.415344 15023 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:21.459863 15499 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:21.472078  8180 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:21.433391 15389 raft_consensus.cc:740] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:21.432534 15445 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.484263  8178 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 23. Current term is 24. Ops: []
W20260709 13:19:21.476552  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 53235.4us
I20260709 13:19:21.483337  8249 raft_consensus.cc:1217] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Deduplicated request from leader. Original: 18.8->[19.9-23.11]   Dedup: 21.10->[23.11-23.11]
I20260709 13:19:21.446921 15496 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:21.449075 15370 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:21.492121  8249 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 23. Current term is 24. Ops: [19.9-23.11]
I20260709 13:19:21.440662 15543 consensus_queue.cc:1059] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:19:21.493491  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:21.507359  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:21.492918  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:21.438009 15572 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:21.507463  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:21.509380  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:21.464845 15495 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:21.473493 15414 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.508539  8099 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:21.495704  8257 raft_consensus.cc:1240] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:21.492515 15403 consensus_queue.cc:1059] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:19:21.453943 15477 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.483137 15220 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 26 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:21.532061  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:21.537237  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:21.538440  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:21.515831 15374 consensus_meta.cc:287] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.010s
I20260709 13:19:21.431859 15474 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:21.500033 15479 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:21.509557 15445 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:21.514153 15370 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:21.490346 15436 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:19:21.559870  8100 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:21.560151  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:21.562170  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:21.588263  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 417218us
I20260709 13:19:21.590116  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:21.590329  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:21.590953  8107 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:21.534395 15341 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.564173 15479 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:21.531570 15414 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.549945 15412 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.619086 15412 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.621677 15221 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:21.530273 15442 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.066s
I20260709 13:19:21.569950 15244 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:21.489602 15426 consensus_queue.cc:237] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:21.570371  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:21.519963 15498 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:21.581496  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:21.514593 15300 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:21.630236 15612 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:19:21.630966 15477 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:21.552173 15495 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.633030 15495 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:21.529917 15023 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:21.633781 15023 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.636096 15023 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:21.596580  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:21.636816  8099 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:21.637547 15412 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:21.583611 15608 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:19:21.611263  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 51200.4us
I20260709 13:19:21.637701 15220 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:21.638821  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:21.622382 15221 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.639624 15221 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:21.640061  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:21.640992 15551 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:21.583724 15616 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:19:21.583106 15601 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.643196 15601 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:21.595913 15621 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:21.646927 15601 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:21.649119 14964 consensus_meta.cc:287] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
I20260709 13:19:21.649876  8183 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:21.650442 15475 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.651023 15475 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:21.651758 15579 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.652976  8101 raft_consensus.cc:1240] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:21.586555 15610 raft_consensus.cc:3055] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:21.654860 15610 raft_consensus.cc:740] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:21.655854 15610 consensus_queue.cc:260] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:21.560243 15389 consensus_queue.cc:260] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:21.575879 15481 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.559s	user 0.013s	sys 0.000s
I20260709 13:19:21.583302 15617 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:21.661738  8099 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:19:21.663126 15572 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:21.663932 15481 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.664731 15370 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:21.641696 15551 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:21.607304  8253 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:21.667069  8107 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:21.669121 15572 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:21.657315 15610 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:21.671000 15479 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:21.674973 15627 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.682029  8175 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 24: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:21.673974  8106 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
W20260709 13:19:21.688493  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 98262.5us
I20260709 13:19:21.689368  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:21.691376  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:21.691886  8253 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:21.701493 15121 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:19:21.702499  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 181427us
I20260709 13:19:21.702435  8223 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:21.704154  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:21.705685  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:21.705953  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:21.727434  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:21.725939  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:21.739043  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 96180.2us
I20260709 13:19:21.693359 15500 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:21.745505  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:21.748214  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:21.746079  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:21.746605  8783 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:19:21.746620  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:21.699775 15579 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:21.760107  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:21.726655 15121 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:21.678954 15572 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.725028 15617 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:21.765254  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:21.776559  8252 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:21.768808  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:21.769549  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:21.729745 15499 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:21.741307 15442 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:21.693497 15627 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:21.778869  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:21.772753 15425 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.004s
I20260709 13:19:21.787168 15425 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.784484 15500 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:21.749475 15626 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:21.759582 15426 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:21.741890 15498 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:19:21.775902  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:21.797468  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 47313.9us
I20260709 13:19:21.792078  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:21.806775  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:21.795989 15627 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:21.783365 15499 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:21.784682 15551 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:21.819337 15601 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:21.827836 15631 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:21.828287 15601 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.828962 15601 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:21.829077 15572 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:21.817533 15636 consensus_queue.cc:1048] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:19:21.837883 15484 raft_consensus.cc:993] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:19:21.804733 15121 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:21.807770 15436 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:21.801383 15426 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:21.838444 15484 raft_consensus.cc:1081] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:19:21.844588  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:21.848802  8107 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:21.824896 15617 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:21.857085 15436 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:21.858387 15436 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:21.818243 15500 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:19:21.861797 15603 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:21.831553 15499 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:21.847259 15121 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:21.865854 15121 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:21.847106 15551 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:21.853703 15627 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:19:21.870410 15551 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.10, Last appended by leader: 10, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:21.850196 15221 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:21.870913  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:21.874929  8099 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:21.875495  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.852542 15426 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:21.876616  8254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57566
I20260709 13:19:21.877187  8254 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:21.878309  8254 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:21.875810  8105 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:19:21.869163  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 2423) took 1357 ms. Trace:
W20260709 13:19:21.874197  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.879801  8183 rpcz_store.cc:276] 0709 13:19:20.512110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.642500 (+130390us) service_pool.cc:224] Handling call
0709 13:19:21.868985 (+1226485us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b5400332a54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:21.869101 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2288398592}
I20260709 13:19:21.904078  8105 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:21.906705  8105 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:21.908154  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:21.909039  8105 raft_consensus.cc:1275] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:19:21.911754  8107 raft_consensus.cc:1240] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:21.916353  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:21.919482  8183 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:21.819850 15497 consensus_queue.cc:1059] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:19:21.920428  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:21.945161  8183 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:21.945604  8183 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:21.915442 15413 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:21.926293  8254 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:21.928138 15499 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.930226 15636 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:21.932876  8755 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.130:46389 timed out after 2.006s (SENT) [suppressed 10 similar messages]
I20260709 13:19:21.874639 15617 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 22 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:21.942066  8181 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:21.942808  8102 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:21.946580  8183 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:21.956501  8183 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:21.939293 15496 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.953727  8254 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:21.957150 15636 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:21.959069 15496 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:21.959625 15636 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:21.959749  8107 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:21.970490  8183 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:21.980921  8099 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 24.
I20260709 13:19:21.910537 15481 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:21.989421 15413 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:21.993592 15413 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:21.954519 15425 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:22.004940  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:22.008529  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:22.017062  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:19:22.017851  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.037482  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 104615us
I20260709 13:19:22.040216  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:22.041278 15617 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.054337 15499 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:22.046474 15601 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.058908 15601 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:22.060453  8177 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:22.041774 15121 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.067042 15121 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:22.067695  8252 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:22.072455 15628 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.299s	user 0.003s	sys 0.000s
I20260709 13:19:22.078862 15426 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:22.081564  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:22.084075  8252 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:22.106019  8183 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:22.106856  8183 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:22.108016  8183 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:22.109838  8183 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:19:22.119453  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 78599.3us
W20260709 13:19:22.121480  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.122239  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.138739 15477 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 13:19:22.141583 15477 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:22.141978 15477 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:22.142861 15477 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:22.143970 15477 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:22.149199 15627 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.139987 15648 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:22.149802 15627 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.150135 15648 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.152056 15627 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:22.158502  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:22.159801  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:22.160907  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:22.162343  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:22.164368  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:22.167434  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:22.167934  8784 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:22.168339  8174 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:22.170495  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:22.164928 15426 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:22.171797  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:19:22.172379  8147 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.174044  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:22.174770  8788 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 24: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:22.177196  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:22.139103 15548 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.178704  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:22.181246  8791 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:22.181653  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:22.152613 15648 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:22.200464 15481 consensus_queue.cc:1059] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:22.201622 15481 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:22.201982 15481 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:22.202765 15481 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.204123 15481 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:22.193493 15548 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.206509  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 1027) took 1394 ms. Trace:
I20260709 13:19:22.206887  8175 rpcz_store.cc:276] 0709 13:19:20.811843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.099404 (+287561us) service_pool.cc:224] Handling call
0709 13:19:22.206311 (+1106907us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54002f9754. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:22.206451 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287184768}
I20260709 13:19:22.209573 15426 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:22.210129 15426 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:22.211819 15630 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.441s	user 0.001s	sys 0.001s
I20260709 13:19:22.172843 15627 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:22.213490 15627 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:22.218632 15624 log.cc:927] Time spent T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.538s	user 0.001s	sys 0.001s
W20260709 13:19:22.224503 15644 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 13:19:22.226697 15633 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.399s	user 0.000s	sys 0.002s
W20260709 13:19:22.230557 15645 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.366s	user 0.003s	sys 0.000s
I20260709 13:19:22.235579  8147 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:22.237211 15482 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:22.237634 15482 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.237964 15482 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:22.239389 15477 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.239750  8174 raft_consensus.cc:1275] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:19:22.239909 15477 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:22.252198  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 1020) took 1443 ms. Trace:
I20260709 13:19:22.252637  8177 rpcz_store.cc:276] 0709 13:19:20.808675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.010527 (+201852us) service_pool.cc:224] Handling call
0709 13:19:22.252045 (+1241518us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54002490d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:22.252142 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2295418240}
I20260709 13:19:22.207803  8175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:22.257951  8175 raft_consensus.cc:606] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:22.258394  8175 raft_consensus.cc:614] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:22.258713  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:22.265607 15432 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:22.266055 15394 raft_consensus.cc:3055] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:22.266619 15394 raft_consensus.cc:740] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:22.267452 15394 consensus_queue.cc:260] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:22.268610 15394 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:22.268772 15499 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:22.271787 15389 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:22.276827  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.266134 15432 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.263352  8183 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:22.288573  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:22.291725  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:19:22.279422 15415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.027s	user 0.003s	sys 0.023s
I20260709 13:19:22.275673 15610 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.311303  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:22.313135  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:22.281658 15648 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:22.315972  8105 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 24: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:19:22.296916 15637 log.cc:927] Time spent T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.494s	user 0.000s	sys 0.004s
I20260709 13:19:22.321755  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:22.316910 15548 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:22.318703 15383 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.319672 15648 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:22.299477 14964 consensus_queue.cc:1048] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:19:22.322366  8788 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
W20260709 13:19:22.308624 15415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.004s	sys 0.023s
I20260709 13:19:22.325996 15383 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:22.329339  8106 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:22.252219 15477 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:22.336051  8147 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:22.339363 15603 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:22.339541 15414 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:22.339843 15603 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.340271 15603 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:22.342690  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:22.351358 15603 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.362514  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:22.366210 15474 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:22.366629 15639 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.516s	user 0.000s	sys 0.002s
I20260709 13:19:22.366808 15474 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:22.368314 15623 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.627s	user 0.001s	sys 0.002s
I20260709 13:19:22.369330  8181 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:22.370959  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:22.371258  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:22.372715 15617 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.373219 15617 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.373629 15300 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:22.374202  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2411) took 1466 ms. Trace:
I20260709 13:19:22.374449 15300 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:22.374603  8102 rpcz_store.cc:276] 0709 13:19:20.907884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.216061 (+308177us) service_pool.cc:224] Handling call
0709 13:19:21.216484 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.956023 (+739539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.373949 (+417926us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b540036f1d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:22.374118 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669553920}
I20260709 13:19:22.375346 15617 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:22.375053 15300 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.376730  8178 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 13:19:22.376844  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:22.378032  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:22.372294 15383 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:22.308570 15597 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:19:22.382753  8181 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:19:22.392349  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:22.384614  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:22.323088 15610 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:22.402331  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:22.417021  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:22.423652  8106 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:22.382088  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:22.403980  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:22.425384  8102 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:22.425848  8791 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:19:22.380798  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:22.429757  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:22.430815  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.429289  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:22.434530  8221 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:22.436733  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:22.438030  8102 raft_consensus.cc:2368] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24.
I20260709 13:19:22.439540  8782 raft_consensus.cc:2368] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24.
I20260709 13:19:22.440929  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:22.441891  8099 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:22.376576 15627 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:22.443660  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:22.392200 15220 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:22.392648 15579 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.416550 15432 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:22.446439  8791 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:22.447774 15648 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.466061  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:22.450433  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2396) took 1634 ms. Trace:
W20260709 13:19:22.451941  8100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 3579) took 2865 ms (client timeout 1984 ms). Trace:
I20260709 13:19:22.499554  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:22.432412 15603 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:22.457875  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:22.433073 15413 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:19:22.530236  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 72438us
I20260709 13:19:22.464702 15497 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:22.466014 15300 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:22.464721  8182 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:19:22.468273  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:22.466917  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:22.573220  8790 raft_consensus.cc:2368] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20.
I20260709 13:19:22.471427  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:22.490739  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:22.417797 15543 raft_consensus.cc:3055] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:19:22.494360  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 62597.8us
W20260709 13:19:22.496657  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 53145.3us
I20260709 13:19:22.578507  8072 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:22.579124  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:22.579324  8221 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:22.579762  8105 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:22.500936  8100 rpcz_store.cc:269] 0709 13:19:19.586539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.586719 (+   180us) service_pool.cc:224] Handling call
0709 13:19:22.451678 (+2864959us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54003f3754. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:22.451827 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4535429888}
I20260709 13:19:22.580240  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:22.580981  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:22.380908 15481 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:22.503435  8104 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:22.453929 15500 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.108s
I20260709 13:19:22.500793  8101 rpcz_store.cc:276] 0709 13:19:20.816412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.053603 (+237191us) service_pool.cc:224] Handling call
0709 13:19:21.053919 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.653333 (+599414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.450063 (+796730us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54001b9754. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:22.450348 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1377358080}
I20260709 13:19:22.569476 15432 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:19:22.551417 15643 consensus_queue.cc:1175] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9bd264598fd2483e9e17674bab9ba4e8" responder_term: 23 status { last_received { term: 23 index: 15 } last_committed_idx: 15 last_received_current_leader { term: 23 index: 15 } }
I20260709 13:19:22.570439  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:22.575373  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:22.568104  8099 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:22.630980  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:22.584147  8100 raft_consensus.cc:1240] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 26 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 13:19:22.600325  8072 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:22.588608  8221 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:22.674340  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 85837.9us
I20260709 13:19:22.676357  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:22.529958 15496 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:22.507872 15627 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:22.463397  8106 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:22.673280  8179 raft_consensus.cc:2368] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20.
I20260709 13:19:22.582648  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:22.631419  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:22.677675  8102 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 25: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:22.499032 15438 consensus_queue.cc:1059] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.128s
I20260709 13:19:22.562382 15413 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:22.500365 15220 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.459287 15482 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.578478 15477 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:22.577890 15543 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:22.722416 15300 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:22.645316 15435 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:22.739523  8182 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:22.761931  8181 raft_consensus.cc:2393] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:22.748381  8105 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:22.672948 15432 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.764043 15435 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:22.764241 15432 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:22.764601 15435 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:22.720589 15658 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 13:19:22.767484 15656 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:19:22.769093 15615 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 1.337s	user 0.000s	sys 0.003s
I20260709 13:19:22.781749  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2388) took 1972 ms. Trace:
I20260709 13:19:22.782171  8103 rpcz_store.cc:276] 0709 13:19:20.809130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.813507 (+  4377us) service_pool.cc:224] Handling call
0709 13:19:20.813844 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:20.944840 (+130996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.944871 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:20.945407 (+   536us) log.cc:844] Serialized 52 byte log entry
0709 13:19:21.202648 (+257241us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:21.714406 (+511758us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.714726 (+   320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.245978 (+531252us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b18003d0e40. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd2d2a6 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419
0709 13:19:22.247033 (+  1055us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54000fb4d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:22.247080 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.768396 (+521316us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:22.781501 (+ 13105us) raft_consensus.cc:1685] finished
0709 13:19:22.781523 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.781672 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":582902,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":1292,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":3991,"spinlock_wait_cycles":335776256,"thread_start_us":733039,"threads_started":2,"wal-append.queue_time_us":486402}
W20260709 13:19:22.786257  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.508208 15579 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:22.684651 15394 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:22.700807 15496 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.707103 15636 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.740840  8104 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:19:22.762861  8182 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:19:22.757277 15413 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:22.793309 15221 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:22.751072 15634 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.931s	user 0.005s	sys 0.003s
I20260709 13:19:22.685878 15415 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:22.827452  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3687) took 1408 ms. Trace:
I20260709 13:19:22.739511 15497 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.829811 15497 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.832748 15497 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:22.758798 15383 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:22.834024  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:22.834656  8251 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:22.837911  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:22.838472 15543 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:22.839547 15543 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:22.840157 15220 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:22.840742 15220 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:22.801132 15610 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:22.843001 15610 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:22.752650 15477 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:22.749747 15627 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:22.774442 15435 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:22.776932  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 93648us
I20260709 13:19:22.790934 15475 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:22.794080 15474 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:22.803359  8254 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:22.810912  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:22.859001  8253 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:19:22.744582 15602 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:19:22.813608  8180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 1022) took 2004 ms (client timeout 2006 ms). Trace:
I20260709 13:19:22.815703  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:22.819383  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:22.801056  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:22.863307  8257 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:22.821823 15636 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.821772 15579 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:22.851119  8251 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:22.828023  8255 rpcz_store.cc:276] 0709 13:19:21.418601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.418737 (+   136us) service_pool.cc:224] Handling call
0709 13:19:21.419122 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.435100 (+ 15978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.435134 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.435597 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.726769 (+291172us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:21.726810 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.726882 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.563314 (+836432us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:22.827060 (+263746us) raft_consensus.cc:1685] finished
0709 13:19:22.827093 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.827378 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15593,"raft.queue_time_us":18505,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8134,"spinlock_wait_cycles":107916032,"thread_start_us":254339,"threads_started":1,"wal-append.queue_time_us":368637}
I20260709 13:19:22.866371 15477 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:22.854236  8221 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:22.818403 15496 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:22.852708 15389 consensus_meta.cc:287] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.002s
W20260709 13:19:22.860055  8180 rpcz_store.cc:269] 0709 13:19:20.809587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.994148 (+184561us) service_pool.cc:224] Handling call
0709 13:19:22.813383 (+1819235us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b5400329e54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:22.813533 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990366464}
I20260709 13:19:22.821699 15482 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:22.870530  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:22.875254  8177 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.005s	sys 0.014s
I20260709 13:19:22.841355 15220 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:22.852594 15627 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:22.886828  8149 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:22.887457  8177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.005s	sys 0.015s
I20260709 13:19:22.890085  8178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2437) took 1048 ms. Trace:
I20260709 13:19:22.897369 15597 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:22.899092  8178 rpcz_store.cc:276] 0709 13:19:21.841510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.135219 (+293709us) service_pool.cc:224] Handling call
0709 13:19:22.376495 (+241276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:22.377137 (+   642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.889795 (+512658us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400181350. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:22.889992 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554009472}
I20260709 13:19:22.873910 15053 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
W20260709 13:19:22.920253  8176 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.003s	sys 0.016s
W20260709 13:19:22.929494  8176 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.004s	sys 0.016s
W20260709 13:19:22.920656  8175 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.011s	sys 0.008s
W20260709 13:19:22.930594  8175 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.012s	sys 0.008s
I20260709 13:19:22.938971  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2441) took 1063 ms. Trace:
I20260709 13:19:22.931131  8257 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:22.932430  8221 leader_election.cc:400] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24.
I20260709 13:19:22.873891 15394 raft_consensus.cc:2804] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:19:22.921264 15499 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.103s	sys 0.145s
W20260709 13:19:22.940442 15499 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.103s	sys 0.145s
I20260709 13:19:22.940338 15394 raft_consensus.cc:697] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:22.941391 15394 consensus_queue.cc:237] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:22.878482 15497 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:19:22.949479 15426 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:22.898415 15648 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:22.906418 15597 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.958544 15597 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:22.962862 15636 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:22.970666 15435 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:22.979867  8179 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:22.980496  8221 leader_election.cc:403] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
W20260709 13:19:23.009343  8788 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.056s	sys 0.084s
W20260709 13:19:23.010136  8788 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.056s	sys 0.085s
W20260709 13:19:23.014322  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 108784us
I20260709 13:19:23.017102  8255 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:19:23.019093  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:23.020182  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:23.022979  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.024899  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.026677  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:22.878618 15602 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:23.030565  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:22.976876 15300 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:22.939497 15389 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:23.035648  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:23.029927  8107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.009s	sys 0.017s
W20260709 13:19:23.036761  8107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.009s	sys 0.017s
I20260709 13:19:23.057667  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.058472  8248 raft_consensus.cc:2368] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20.
I20260709 13:19:23.060365  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.028795 15415 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24.
I20260709 13:19:23.070760  8255 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 24: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:23.082090  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.087440  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.089483  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.095649  8248 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:23.101256  8249 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:23.101747 15389 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:23.102241  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.103338  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.102936 15389 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:23.103921  8249 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:19:23.104734  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:23.106771  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.108110  8256 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:23.109262  8256 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 14. (term mismatch)
I20260709 13:19:23.109884  8256 pending_rounds.cc:85] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 13
I20260709 13:19:23.110256  8256 pending_rounds.cc:107] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 25.14
I20260709 13:19:23.110605  8256 raft_consensus.cc:2889] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:23.110669 15602 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:23.132242 15300 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:23.132483 15543 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:23.157477 15053 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.158164 15053 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:23.160742 15053 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:23.161579  8249 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 23 index: 10. Preceding OpId from leader: term: 25 index: 11. (index mismatch)
I20260709 13:19:23.162489  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.131654 15496 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:23.162976  8149 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:23.163123  8256 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:23.165757  8256 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:23.169633  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:23.169735  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.222963  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 1037) took 1291 ms. Trace:
I20260709 13:19:23.156997 15300 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:23.161826 15597 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:23.217133 15600 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:23.190932 15341 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:23.162235 15543 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:23.242283  8071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.000s	sys 0.036s
W20260709 13:19:23.243793  8108 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.015s	sys 0.025s
W20260709 13:19:23.245582  8071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.000s	sys 0.037s
W20260709 13:19:23.245884  8108 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.016s	sys 0.025s
W20260709 13:19:23.251003  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.218358 15053 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 13:19:23.254776  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.191972 15432 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:23.220708 15602 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:19:23.237097 15600 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:23.252100 15341 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:23.281466 15600 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:23.326014 14964 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.325757 15341 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:23.326467 14964 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:23.327392 15627 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:23.305861 15432 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:23.228050  8174 rpcz_store.cc:276] 0709 13:19:21.931970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.259209 (+327239us) service_pool.cc:224] Handling call
0709 13:19:22.259462 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.259644 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:19:22.801348 (+541704us) log.cc:844] Serialized 14 byte log entry
0709 13:19:23.219334 (+417986us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:23.219389 (+    55us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:23.221268 (+  1879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.222128 (+   860us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.222904 (+   776us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28246,"prepare.queue_time_us":94290,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":1286,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":2655,"thread_start_us":908845,"threads_started":2}
I20260709 13:19:23.278040 15383 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:23.257690 15475 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.315057  8102 raft_consensus.cc:1275] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:19:23.315809  8133 heartbeater.cc:646] Failed to heartbeat to 127.6.214.190:45311 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.6.214.190:45311 timed out after 15.000s (SENT)
I20260709 13:19:23.315935  8105 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:19:23.316485  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:23.316552  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:23.338117  8255 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:23.338398  8100 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:23.317237  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:23.319890  8106 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:23.338989  8103 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:23.324493  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:23.339629  8099 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
W20260709 13:19:23.339965  8072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.012s	sys 0.007s
I20260709 13:19:23.329583 15496 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:23.329249  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:23.340794  8101 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:19:23.328341 14964 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:23.341382  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.322642 15543 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:22.939394  8177 rpcz_store.cc:276] 0709 13:19:21.875396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.253410 (+378014us) service_pool.cc:224] Handling call
0709 13:19:22.258724 (+  5314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.258927 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:22.286865 (+ 27938us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.938626 (+651761us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.938676 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:22.938725 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.938791 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.938913 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39468,"prepare.queue_time_us":94799,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":39613,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":1408,"thread_start_us":611896,"threads_started":1}
I20260709 13:19:23.331254 15597 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:23.345307  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:23.345899  8256 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:19:23.334417 15661 log.cc:927] Time spent T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.330s	user 0.003s	sys 0.000s
I20260709 13:19:23.354437 14964 consensus_queue.cc:1048] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:23.359793  8254 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 21: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:23.359841  8149 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:23.361776 15551 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:23.362159 15551 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.362511 15551 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:23.363337  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:23.364399  8099 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
W20260709 13:19:23.342132  8072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.012s	sys 0.007s
W20260709 13:19:23.365270  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 765012us
I20260709 13:19:23.365792  8099 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 23 index: 10. Preceding OpId from leader: term: 25 index: 11. (index mismatch)
I20260709 13:19:23.366010  8072 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:23.342388  8147 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.011s	sys 0.007s
W20260709 13:19:23.359236  8074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.008s	sys 0.048s
W20260709 13:19:23.367997  8074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.008s	sys 0.049s
W20260709 13:19:23.369208  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 850488us
W20260709 13:19:23.342936  8755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.003s	sys 0.015s
W20260709 13:19:23.379392  8755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.004s	sys 0.015s
W20260709 13:19:23.380101  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 749174us
W20260709 13:19:23.383517  8147 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.011s	sys 0.007s
W20260709 13:19:23.389544  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.390900  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:23.381327  8221 leader_election.cc:400] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20.
I20260709 13:19:23.393826  8221 leader_election.cc:403] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:19:23.402688  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:23.403515  8783 raft_consensus.cc:3060] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:23.414687  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:23.415715  8791 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 20: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:23.425908  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:23.426559  8099 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:23.428128  8105 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:19:23.429737  8177 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 13:19:23.431378  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 62643.7us
I20260709 13:19:23.432406  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:23.433776  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:23.429230  8174 raft_consensus.cc:2410] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
W20260709 13:19:23.445282  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 79353.8us
I20260709 13:19:23.446430  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:23.427167  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:19:23.474413  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 102646us
I20260709 13:19:23.475334  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:23.475975  8103 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 19.
I20260709 13:19:23.477066 14964 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:23.477694 14964 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:23.477979 14964 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.478253 14964 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:23.489336  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:23.492321  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 46000.4us
I20260709 13:19:23.493147  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:23.501948  8106 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:23.511054  8256 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:23.512459  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.513264  8256 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:23.517486  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:23.554795  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:23.390829 15601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.003s	sys 0.016s
I20260709 13:19:23.563071  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:23.470455 15648 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.348417 15383 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:23.427949 15432 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:23.367033 15548 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.197s
I20260709 13:19:23.593837  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.349778 15475 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:23.579553  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:23.564523 15601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.005s	sys 0.023s
I20260709 13:19:23.527799  8099 raft_consensus.cc:2468] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
W20260709 13:19:23.606328  8223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.042s	sys 0.059s
I20260709 13:19:23.603967  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.616046  8255 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:23.587683  8101 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:23.429575 15413 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20.
W20260709 13:19:23.588754  8754 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.008s	sys 0.016s
I20260709 13:19:23.554329 15636 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.562734 15220 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:23.562549 15426 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.552258 14964 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:23.612056  8148 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.009s	sys 0.011s
W20260709 13:19:23.626348  8148 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.010s	sys 0.011s
I20260709 13:19:23.591552 15648 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:23.612783  8175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.008s	sys 0.008s
I20260709 13:19:23.516275 15579 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.086s
I20260709 13:19:23.636509 15627 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:23.619566 15601 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:23.515982 15496 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.095s
W20260709 13:19:23.609714 15438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.036s	sys 0.041s
I20260709 13:19:23.563158 15414 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
W20260709 13:19:23.603312 15436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.035s	sys 0.066s
W20260709 13:19:23.619686  8754 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.008s	sys 0.016s
I20260709 13:19:23.602973 15432 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:23.479945 15477 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:23.635489  8175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.009s	sys 0.008s
I20260709 13:19:23.636346 15300 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:23.704221 15679 log.cc:927] Time spent T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:19:23.706529 15543 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:23.669234 15548 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.637943  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:23.616462  8223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.042s	sys 0.059s
I20260709 13:19:23.717005  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:23.718657 15627 raft_consensus.cc:2764] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:19:23.602169 15600 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:23.721132 15600 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:23.661875 15220 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.726720 15220 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:23.727885 15436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.035s	sys 0.069s
W20260709 13:19:23.660401 15438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.037s	sys 0.041s
I20260709 13:19:23.698207 15053 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.728945 15438 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:23.640033 15601 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:23.729218 15053 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:23.703890 15300 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:23.731714 15300 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:23.732462 15300 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:23.733076 15300 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:23.733635 15300 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:23.744294  8174 raft_consensus.cc:1240] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 19. Current term is 21. Ops: []
I20260709 13:19:23.746376  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:23.747160  8174 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:23.749122  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:23.750064  8177 raft_consensus.cc:2368] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 24. Current term is 25.
I20260709 13:19:23.751809  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:23.753484  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:23.754400  8179 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:19:23.758193  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.761044  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.763075  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.765050  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2445) took 1811 ms. Trace:
I20260709 13:19:23.765885  8175 rpcz_store.cc:276] 0709 13:19:21.953843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.267029 (+313186us) service_pool.cc:224] Handling call
0709 13:19:22.267310 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.267495 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:19:22.933858 (+666363us) log.cc:844] Serialized 14 byte log entry
0709 13:19:23.764620 (+830762us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:23.764693 (+    73us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:23.764761 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.764850 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.764985 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128778,"prepare.queue_time_us":86819,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":22,"thread_start_us":1347788,"threads_started":2}
W20260709 13:19:23.622901 15394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.008s	sys 0.012s
I20260709 13:19:23.767899  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:23.770292  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:23.775458  8255 raft_consensus.cc:2393] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:19:23.771683  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 54795.7us
I20260709 13:19:23.776328  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:23.660699 15671 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.778434  8176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.018s	sys 0.059s
W20260709 13:19:23.814433  8176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.018s	sys 0.059s
I20260709 13:19:23.787623  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:23.795650  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:23.800858  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.804621  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:23.816381  8099 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:19:23.777459  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:23.806005  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:23.818733  8102 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:23.628489 15636 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:23.822892 14964 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:23.823621  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:23.730327 15601 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:23.634236 15426 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:23.709990 15548 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:23.784379 15600 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:23.837792 15600 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:23.838449  8783 raft_consensus.cc:2468] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:23.839835 15600 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:23.841498 15548 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:23.841933  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2427) took 1452 ms. Trace:
I20260709 13:19:23.842859 15675 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:23.843288 15675 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:23.844270  8102 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:23.844061 15675 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:23.842344  8108 rpcz_store.cc:276] 0709 13:19:22.389747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.390688 (+   941us) service_pool.cc:224] Handling call
0709 13:19:22.417491 (+ 26803us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:22.417916 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.417950 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:22.418456 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:19:23.250098 (+831642us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:23.250159 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.250253 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:23.841723 (+591470us) raft_consensus.cc:1685] finished
0709 13:19:23.841743 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.841877 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44330,"raft.queue_time_us":14760,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":10017,"thread_start_us":829848,"threads_started":1,"wal-append.queue_time_us":1214633}
W20260709 13:19:23.800007 15394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.008s	sys 0.012s
I20260709 13:19:23.853497 14964 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:23.869527 14964 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:23.854372  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 58847.3us
W20260709 13:19:23.868040  8253 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.029s	sys 0.046s
W20260709 13:19:23.871377  8253 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.029s	sys 0.047s
I20260709 13:19:23.778939 15579 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:23.878964  8248 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:23.880394  8149 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:23.818105 15477 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.821029 15499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.002s	sys 0.019s
I20260709 13:19:23.822012 15413 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:23.888284  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:23.822376 15627 raft_consensus.cc:2764] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election decision vote started in defunct term 23: won
W20260709 13:19:23.888950  8250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.047s	sys 0.055s
W20260709 13:19:23.889278  8250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.048s	sys 0.055s
I20260709 13:19:23.889735 14964 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:23.845340 15675 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:23.906273 15597 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:19:23.906955 15548 raft_consensus.cc:2804] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:19:23.915099  8257 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.000s	sys 0.020s
W20260709 13:19:23.915553  8257 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.000s	sys 0.020s
W20260709 13:19:23.886521  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:23.920655  8251 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.005s	sys 0.013s
W20260709 13:19:23.921155  8251 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.005s	sys 0.013s
I20260709 13:19:23.926968  8149 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:23.871441 15436 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:23.928159  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:19:23.892515 15499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.002s	sys 0.019s
I20260709 13:19:23.881352 15053 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:23.888512 15413 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:23.949944  8252 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.015s	sys 0.045s
I20260709 13:19:23.949622  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:23.948381  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.887573 15676 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:23.953523  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.954371  8255 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:23.955341  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:23.955375  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:23.955988  8255 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 17.
I20260709 13:19:23.872617 15500 consensus_queue.cc:1048] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:19:23.828091 15671 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:23.960444  8252 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.016s	sys 0.046s
I20260709 13:19:23.945115 15672 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.968436  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:23.963491  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:23.945111 15482 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:23.951046 15414 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:23.969147  8108 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:23.974838  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:23.982539  8103 raft_consensus.cc:2410] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:19:23.953969 15053 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:23.944887 15600 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:23.959357 15673 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.954080 15413 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:23.945240 15548 raft_consensus.cc:697] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:23.911471 15477 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:23.991823 15648 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:23.992441 15220 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:23.953194 15383 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:23.958748 15676 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.951296 15436 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:23.988947 15475 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:23.993336 15600 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.998520 15499 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:23.994728 15389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.010s	sys 0.049s
W20260709 13:19:24.119436  8104 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.050s	sys 0.086s
W20260709 13:19:24.121097  8104 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.051s	sys 0.086s
W20260709 13:19:24.000639 15435 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.003s	sys 0.014s
I20260709 13:19:24.008311  8256 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:24.002642 15597 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.000381 15680 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:19:24.131422 15681 log.cc:927] Time spent T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:19:24.135706  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 3237) took 1036 ms. Trace:
I20260709 13:19:24.150959  8248 rpcz_store.cc:276] 0709 13:19:23.099654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.099784 (+   130us) service_pool.cc:224] Handling call
0709 13:19:23.100212 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.888827 (+788615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.135445 (+246618us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b5400197b54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:24.135644 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1790433536}
I20260709 13:19:24.122087 15600 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:24.123900 15435 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.003s	sys 0.020s
W20260709 13:19:24.123533 15389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.010s	sys 0.059s
I20260709 13:19:23.996299 15053 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:23.980513 15672 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:24.002826 15673 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:24.119045 15676 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:24.173111  8071 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:24.173498  8146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.003s	sys 0.015s
W20260709 13:19:24.135731 15682 log.cc:927] Time spent T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:19:24.210491  8146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.003s	sys 0.015s
I20260709 13:19:24.142585 15432 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:24.156786 15603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.009s	sys 0.012s
W20260709 13:19:24.250044  8147 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.009s	sys 0.011s
W20260709 13:19:24.272621  8147 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.009s	sys 0.011s
I20260709 13:19:24.179576 15636 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:24.274740  8072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.014s	sys 0.039s
W20260709 13:19:24.275184  8072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.014s	sys 0.039s
W20260709 13:19:24.275642  8249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.003s	sys 0.016s
W20260709 13:19:24.275838  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 782725us
I20260709 13:19:24.149883 15597 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:24.125675 15499 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:24.287061  8074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.022s	sys 0.033s
W20260709 13:19:24.287573  8074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.022s	sys 0.033s
W20260709 13:19:24.288319  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 725283us
I20260709 13:19:24.289312  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:24.291287  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:24.255735 15341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.024s	sys 0.046s
W20260709 13:19:24.294449 15341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.025s	sys 0.046s
I20260709 13:19:24.295280 15341 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:19:24.238458 15603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.013s	sys 0.012s
I20260709 13:19:24.285888  8072 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:24.299729  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:24.276011  8249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.004s	sys 0.016s
I20260709 13:19:24.226663 15389 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:24.239200 15426 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:24.155014 15680 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:24.304301 15674 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:24.306632 15383 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:24.305045 15670 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:24.339538  8754 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.016s	sys 0.028s
W20260709 13:19:24.349896  8754 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.016s	sys 0.028s
I20260709 13:19:24.179231 15548 consensus_queue.cc:237] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:24.348064  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 48466.7us
I20260709 13:19:24.320823 15496 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:24.352583 15636 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.354733 15053 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:24.350376 15579 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:24.306890 15220 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:19:24.322999 15389 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:24.358031  8755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.010s	sys 0.004s
W20260709 13:19:24.358383  8755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.010s	sys 0.004s
W20260709 13:19:24.359023  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 841579us
W20260709 13:19:24.366662  8176 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.001s	sys 0.012s
I20260709 13:19:24.374761 14964 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:24.376878 14964 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:24.312076 15341 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:24.359242 15389 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:24.358736 15671 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:24.382416 15477 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:24.418452  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3707) took 1258 ms. Trace:
I20260709 13:19:24.352331 15383 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:24.427839  8223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.009s	sys 0.034s
W20260709 13:19:24.428784  8223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.009s	sys 0.034s
I20260709 13:19:24.381882 15670 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:19:24.430838  8101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.000s	sys 0.012s
I20260709 13:19:24.390139 15579 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:24.429255  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 607687us
W20260709 13:19:24.433403  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.354715 15636 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:24.432341  8251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.005s	sys 0.006s
W20260709 13:19:24.432595  8257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.011s	sys 0.001s
W20260709 13:19:24.440531  8257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.011s	sys 0.001s
W20260709 13:19:24.414582  8106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.006s	sys 0.006s
W20260709 13:19:24.441174  8106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.006s	sys 0.007s
W20260709 13:19:24.431241  8101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.000s	sys 0.012s
W20260709 13:19:24.430783 15684 log.cc:927] Time spent T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 13:19:24.449361  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:24.420379 15697 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:24.430711 15670 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:24.444957  8755 leader_election.cc:400] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20.
I20260709 13:19:24.462836  8755 leader_election.cc:403] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:24.419080  8252 rpcz_store.cc:276] 0709 13:19:23.160184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.163551 (+  3367us) service_pool.cc:224] Handling call
0709 13:19:23.163855 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.164118 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:23.965863 (+801745us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.418005 (+452142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:24.418075 (+    70us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:24.418143 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.418232 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.418382 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58031,"prepare.queue_time_us":1156974,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":101,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4680,"thread_start_us":1225967,"threads_started":2}
I20260709 13:19:24.455562  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 3233) took 1371 ms. Trace:
I20260709 13:19:24.442392 15414 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:24.468266 15414 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:24.465791  8251 rpcz_store.cc:276] 0709 13:19:23.083988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.084118 (+   130us) service_pool.cc:224] Handling call
0709 13:19:23.084633 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.084887 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:19:23.921649 (+836762us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.454911 (+533262us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:24.454980 (+    69us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:24.455041 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.455131 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.455488 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21482,"prepare.queue_time_us":1231556,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"thread_start_us":1354692,"threads_started":2}
W20260709 13:19:24.484450  8253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.045s	sys 0.090s
W20260709 13:19:24.485968  8253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.045s	sys 0.090s
I20260709 13:19:24.484088  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:24.447028 15436 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:24.479697 15683 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:19:24.504583  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:24.491870  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 528261us
I20260709 13:19:24.492583  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 1064) took 1473 ms. Trace:
I20260709 13:19:24.511682  8253 rpcz_store.cc:276] 0709 13:19:23.018848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.018946 (+    98us) service_pool.cc:224] Handling call
0709 13:19:23.019197 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.019373 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:19:23.872108 (+852735us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.490989 (+618881us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:24.491190 (+   201us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:24.491433 (+   243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.491828 (+   395us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.492343 (+   515us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9557,"prepare.queue_time_us":1220178,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"spinlock_wait_cycles":17792,"thread_start_us":1421241,"threads_started":2}
W20260709 13:19:24.482561 15497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.005s	sys 0.014s
I20260709 13:19:24.455356 15500 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:19:24.438778 15579 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:24.557873  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 43496.5us
I20260709 13:19:24.559505  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:24.498314 15597 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:24.498903 15672 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:24.488281 15701 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20.
I20260709 13:19:24.519358 15415 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:24.541616 15432 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:24.563395 15694 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:19:24.563540 15691 log.cc:927] Time spent T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
W20260709 13:19:24.542055 15685 log.cc:927] Time spent T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 13:19:24.537210 15686 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
W20260709 13:19:24.567826 15693 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 13:19:24.568549 15695 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:19:24.528965 15702 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.598769  8176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2444) took 2653 ms. Trace:
W20260709 13:19:24.554582 15551 consensus_meta.cc:287] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.192s	user 0.013s	sys 0.001s
W20260709 13:19:24.533998  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 83492.4us
I20260709 13:19:24.526487 15499 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:24.573892  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 69397.7us
I20260709 13:19:24.529282 15704 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:24.464567 15697 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:24.533506 15497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.006s	sys 0.015s
W20260709 13:19:24.567255  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 210592us
I20260709 13:19:24.538311 15426 consensus_queue.cc:1059] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:19:24.535353 15696 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:24.598426  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 1062) took 1581 ms. Trace:
I20260709 13:19:24.585767 15672 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:24.603390  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:24.589488 15715 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:24.602048 15415 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:19:24.621656  8752 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.020s	sys 0.028s
W20260709 13:19:24.630295  8752 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.020s	sys 0.028s
I20260709 13:19:24.599263  8176 rpcz_store.cc:276] 0709 13:19:21.945052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.265925 (+320873us) service_pool.cc:224] Handling call
0709 13:19:22.266261 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:22.266679 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:22.978042 (+711363us) log.cc:844] Serialized 14 byte log entry
0709 13:19:23.833591 (+855549us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:23.834301 (+   710us) log.cc:844] Serialized 52 byte log entry
0709 13:19:23.834491 (+   190us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:24.368079 (+533588us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.368341 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.435559 (+ 67218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.598565 (+163006us) raft_consensus.cc:1685] finished
0709 13:19:24.598584 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.598713 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110124,"prepare.queue_time_us":87430,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":233920,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":7251,"thread_start_us":1910176,"threads_started":3,"wal-append.queue_time_us":1203697}
I20260709 13:19:24.589073 15432 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:24.605942  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 46531us
I20260709 13:19:24.515902 15482 raft_consensus.cc:697] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:24.620415  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:24.604902  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:24.631807  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:24.553828 15670 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:24.609104  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3616) took 1294 ms. Trace:
I20260709 13:19:24.639971  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:24.641645  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:24.642051  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:24.649382  8782 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:24.643023  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:24.643736  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:24.610447 15698 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:19:24.650766  8786 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 21: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:24.651069  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:24.620822  8250 rpcz_store.cc:276] 0709 13:19:23.016747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.016849 (+   102us) service_pool.cc:224] Handling call
0709 13:19:23.017113 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.017420 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.017469 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:23.017889 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:19:23.889636 (+871747us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:23.889677 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.889743 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.598222 (+708479us) raft_consensus.cc:1685] finished
0709 13:19:24.598240 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.598369 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7237,"raft.queue_time_us":854,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5122,"thread_start_us":871410,"threads_started":1,"wal-append.queue_time_us":1278028}
I20260709 13:19:24.648273  8104 rpcz_store.cc:276] 0709 13:19:23.314619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.314730 (+   111us) service_pool.cc:224] Handling call
0709 13:19:23.315009 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.315342 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.315373 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:23.315798 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:19:24.121797 (+805999us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:24.121857 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.121950 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.608892 (+486942us) raft_consensus.cc:1685] finished
0709 13:19:24.608911 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.609042 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1040,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":81,"thread_start_us":805340,"threads_started":1,"wal-append.queue_time_us":1036314}
I20260709 13:19:24.618616 15610 raft_consensus.cc:3055] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:24.670047  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:24.598423 15680 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:24.612723 15579 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:24.611819 15413 consensus_meta.cc:287] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.000s
I20260709 13:19:24.606524 15341 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:24.615849 15300 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:24.620434 15426 raft_consensus.cc:3055] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:24.674378  8790 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:19:24.619665 15497 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:24.678754  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:24.617483 15697 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:24.664522 15543 consensus_meta.cc:287] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.957s	user 0.013s	sys 0.000s
I20260709 13:19:24.638814 15672 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:24.640206 15703 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:24.662742 15704 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:24.674778 15700 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:24.674947 15610 raft_consensus.cc:740] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:24.722862  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3714) took 1383 ms. Trace:
I20260709 13:19:24.604691 15551 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:24.688023 15671 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:24.639117 15435 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:19:24.644088 15715 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:24.679932 15383 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:24.687686 15481 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:19:24.719753  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 68789.5us
I20260709 13:19:24.620700 15696 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:24.689596 15670 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:24.712888 15600 consensus_meta.cc:287] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.000s
I20260709 13:19:24.603120 15702 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:24.677616 15477 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:19:24.695693 15426 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:19:24.691598 15675 consensus_meta.cc:287] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.772s	user 0.012s	sys 0.000s
I20260709 13:19:24.716964 15300 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:24.719394 15543 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:24.716140 15220 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:24.714592 15703 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:24.797703 15726 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:19:24.797992 15703 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:24.718107 15704 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.758688 15383 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:24.681300 15699 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:19:24.689812 15413 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:24.722425 15718 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.801337 15704 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:24.717264 15497 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:24.722820 15672 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:24.792579 15696 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:24.796464 15426 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:24.754415 15736 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:24.718585 15496 consensus_queue.cc:1059] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
W20260709 13:19:24.788645 15709 log.cc:927] Time spent T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 13:19:24.788193 15721 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:19:24.757555 15729 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:24.761500 15481 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:24.925879 15674 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:24.757171 15482 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:24.927587 15701 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:24.927214 15674 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:24.928589 15701 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:24.929821 15543 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:24.930897 15543 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:24.931921 15701 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:24.932152 15734 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:24.933416 15723 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.868052  8101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3634) took 1065 ms. Trace:
W20260709 13:19:24.718636  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 86153.2us
W20260709 13:19:24.881579  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 198818us
I20260709 13:19:24.963326  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:24.705116  8074 leader_election.cc:400] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 24. Current term is 25.
I20260709 13:19:24.887274  8176 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:24.888962  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:24.889276  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:24.888962  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:24.890920  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:24.894258  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:24.745527  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 113805us
I20260709 13:19:24.735167  8249 rpcz_store.cc:276] 0709 13:19:23.339944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.340328 (+   384us) service_pool.cc:224] Handling call
0709 13:19:23.344205 (+  3877us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.345974 (+  1769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.346003 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:23.346457 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:19:24.321496 (+975039us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:24.321554 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.321643 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.722650 (+401007us) raft_consensus.cc:1685] finished
0709 13:19:24.722673 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.722802 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1390,"raft.queue_time_us":2095,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":9179,"thread_start_us":830819,"threads_started":1,"wal-append.queue_time_us":1064356}
I20260709 13:19:24.758795  8755 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:24.796253 15220 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.993302 15220 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:24.993939 15543 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:24.994974 15742 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:24.903370 15477 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.996107 15701 raft_consensus.cc:2804] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:24.996356 15477 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:24.802086 15383 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:25.000274 15383 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:25.000686  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.000983 14964 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:24.804471 15389 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:24.818320 15497 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:24.788877 15499 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 13:19:24.816583 15551 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:24.905932 15485 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.996407 15627 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:19:25.010252 15485 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.012137 15674 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:25.013021 15485 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:24.823247 15672 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:24.818853 15676 consensus_meta.cc:287] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.002s
I20260709 13:19:24.907262 15670 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:25.005172 15389 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:24.748703 15415 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.034360 15670 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.034411 15676 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.037014 15670 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:24.818884 15426 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:24.816097 15432 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:24.908556 15704 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:24.821223 15496 consensus_queue.cc:1243] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:24.804386 15636 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:24.825062 15702 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:24.832448 15703 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.044030 15704 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:25.046008 15703 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:24.803942 15718 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.049039 15718 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:25.041282 15673 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:25.050570 15496 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.829617 15729 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.051578 15496 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.037292 15676 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:24.822247 15736 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:24.918473  8785 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:24.922101 15714 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.924050  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60806 (request call id 1058) took 1908 ms. Trace:
I20260709 13:19:24.929839 15735 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:25.056878 15714 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.058312 15736 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:25.056557  8257 rpcz_store.cc:276] 0709 13:19:23.015350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.021753 (+  6403us) service_pool.cc:224] Handling call
0709 13:19:23.022089 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.022478 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:19:23.915993 (+893515us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.601748 (+685755us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.601937 (+   189us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:24.606998 (+  5061us) log.cc:844] Serialized 26 byte log entry
0709 13:19:24.607200 (+   202us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:19:24.607503 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 13:19:24.607750 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.607859 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.923336 (+315477us) raft_consensus.cc:1685] finished
0709 13:19:24.923380 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.923724 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67550,"prepare.queue_time_us":1307073,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":8232,"raft.queue_time_us":130162,"raft.run_cpu_time_us":402,"raft.run_wall_time_us":17285,"thread_start_us":1504406,"threads_started":3,"wal-append.queue_time_us":762838}
I20260709 13:19:24.967531  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:24.908358 15394 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.059093  8181 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:24.968247  8106 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 26.
I20260709 13:19:24.971642 15723 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:24.933300 15734 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:24.981765 15413 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:24.927074 15481 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:24.934160  8101 rpcz_store.cc:276] 0709 13:19:23.802450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.802592 (+   142us) service_pool.cc:224] Handling call
0709 13:19:23.802947 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.803195 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.803232 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:23.803743 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:19:24.442557 (+638814us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:24.442658 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:24.442784 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:24.867271 (+424487us) raft_consensus.cc:1685] finished
0709 13:19:24.867340 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:24.867762 (+   422us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":546475,"threads_started":1,"wal-append.queue_time_us":683781}
I20260709 13:19:24.991820 15675 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:24.995196  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 236354us
I20260709 13:19:24.999689 15477 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:24.759760 15600 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.070556  8755 leader_election.cc:400] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20.
I20260709 13:19:25.072366 15600 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:24.817973 15601 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:25.073794 15675 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.076472 15675 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:24.995863 15742 consensus_queue.cc:1243] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 23.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:25.025537  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:25.027974  8791 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:25.079491 15496 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:25.079890  8790 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 21: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:25.028527  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:25.032963  8788 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:25.057837 15735 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.084307 15735 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:24.965632  8074 leader_election.cc:403] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:25.085547  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 380587us
I20260709 13:19:25.087037  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:24.970695  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:25.087563 15734 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:25.059962 15714 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:25.059752  8103 raft_consensus.cc:2410] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 25 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260709 13:19:25.090026 15723 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:25.091470  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:25.090096 15477 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 24. Current term is 25.
I20260709 13:19:25.059717 15394 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.065536  8180 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:25.096346  8176 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:25.100638 15670 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:25.101787  8782 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:25.103641 15610 consensus_queue.cc:260] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.106238 15729 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:25.107506  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:25.100028 15496 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:25.118651 15394 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:25.147434 15394 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:25.149374 15707 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:25.120306  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 133751us
I20260709 13:19:25.150254 15707 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.151424  8223 leader_election.cc:400] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24.
I20260709 13:19:25.129166  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.133003  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.133606  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.134624  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:25.141927 15610 raft_consensus.cc:3060] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:25.149665 15394 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:25.119396  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 46174.2us
I20260709 13:19:25.147801 15715 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:25.067744 15701 raft_consensus.cc:697] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:19:25.146199  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 54942.4us
I20260709 13:19:25.157325  8103 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 24: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:25.167639  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:25.159404  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:25.153417 15707 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:25.208317  8221 leader_election.cc:336] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 1.605s (SENT)
I20260709 13:19:25.157027  8106 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:25.209062  8221 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:25.164974  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:25.213658 15707 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:25.159902  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:25.214695  8785 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:25.186578  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.216629  8257 raft_consensus.cc:2410] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:19:25.216451 15701 consensus_queue.cc:237] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.158357  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:25.188820 15696 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.218907 15696 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.189328  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.157748 15719 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:25.156467  8108 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:25.189831  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:25.223807 15719 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.225070  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.226001  8254 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:25.226584 15719 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:25.190651  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.191740  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.226964 15723 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:25.164453 15742 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:25.163211 15548 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.194281  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.195811  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.166747 15220 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.154719  8223 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:25.199712  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.200259 15383 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.206679  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:25.208576  8788 raft_consensus.cc:3060] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:25.213958  8786 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 21: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:25.189790 15603 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.227717  8104 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:25.222802  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:25.187350 15300 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:25.231938  8251 raft_consensus.cc:2410] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 27 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:19:25.233204 15603 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.236367 15603 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:25.238351 15548 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:25.239902  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 85413.7us
I20260709 13:19:25.241798 15707 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:25.227535 15723 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:25.245712 15723 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:25.241029  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:25.263325 15477 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:19:25.264370  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 56210.8us
I20260709 13:19:25.265918  8147 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:25.267098  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:25.268812 15697 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:25.270893 15697 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:25.271541 15600 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:25.272837 15415 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:25.276293 15415 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:25.276568  8147 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:25.272789 15414 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:19:25.272078  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 43962.9us
I20260709 13:19:25.277318 15414 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:25.277835 15414 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:19:25.278333  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 71844.9us
I20260709 13:19:25.279387  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:25.281102 15751 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:25.281540 15220 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:25.273627 15707 consensus_queue.cc:1059] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:25.282948 15707 raft_consensus.cc:3055] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:25.283381 15707 raft_consensus.cc:740] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:25.276810 15415 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:25.223830 15696 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:25.323514 15426 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:25.370611 15707 consensus_queue.cc:260] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.325161  8250 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 27. Current term is 28. Ops: []
I20260709 13:19:25.326613  8252 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:19:25.328934 15735 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:25.334033  8789 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
W20260709 13:19:25.333956  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 57556.1us
I20260709 13:19:25.385684  8789 pending_rounds.cc:85] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 15
I20260709 13:19:25.386005  8789 pending_rounds.cc:107] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:19:25.385738 15735 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:25.334928 15481 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:25.386780 15481 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:25.387253 15481 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:25.387394  7999 catalog_manager.cc:5697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 6 to 15. New cstate: current_term: 15 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.389672 15734 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:25.335268 15383 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:25.241912 15742 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.394423 15707 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:25.350816  8248 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:25.351615  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:25.353910  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 58706.6us
I20260709 13:19:25.355810  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:25.356110  8257 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:19:25.357160  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 53622.3us
I20260709 13:19:25.360327  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:25.365932  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 143322us
I20260709 13:19:25.368536 15394 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:25.369458 15548 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:25.377029  8788 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:25.378146  8106 raft_consensus.cc:2468] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:25.371888 15426 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.382675 15220 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:25.384742 15756 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.004s
I20260709 13:19:25.386349  8789 raft_consensus.cc:2889] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:25.397544  7999 catalog_manager.cc:5697] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.406922  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:25.407778  8785 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:19:25.418089  8147 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:25.419811  8784 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:25.422673 15696 raft_consensus.cc:2804] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:19:25.423043  7998 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39828 (request call id 278) took 62256 ms (client timeout 15000 ms). Trace:
I20260709 13:19:25.423413 15696 raft_consensus.cc:697] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:25.423882 15426 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:25.431977 15415 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.433943  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:25.416734 15220 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.437647 15696 consensus_queue.cc:237] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.438119  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:25.441659 15548 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:19:25.443346  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 87793.5us
I20260709 13:19:25.443882 15603 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:25.471861  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.472342 15699 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:25.472637 15610 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.445103 15600 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.472993 15699 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.446569  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.474665  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.473407 15610 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.475342 15699 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:25.476764 15481 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.473830 15600 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.479226 15481 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:25.448743  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.387293 15735 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.479902 15600 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:25.474216  8106 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:25.477332 15610 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:25.482934  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.483738  8180 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 24.
I20260709 13:19:25.485467  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.486486  8177 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:25.487972  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.472913 15220 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:25.490093  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.490803  8106 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 24.
I20260709 13:19:25.491997  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:25.493811 15603 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:25.493898 15220 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:25.494469 15603 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:25.495039 15603 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:25.494649 15220 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:25.493624  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 59772.1us
I20260709 13:19:25.494755  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:25.434082  7999 catalog_manager.cc:5697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 3 to 13, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 13 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:25.437700 15394 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:25.496978  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:25.502002  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.496793  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:25.450250 15742 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:25.504596  8104 raft_consensus.cc:2410] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 13:19:25.423568  7998 rpcz_store.cc:269] 0709 13:18:23.166087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.166390 (+   303us) service_pool.cc:224] Handling call
0709 13:18:23.531496 (+365106us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b540006a9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db6090 00007fa5a0e54f3a 00007fa5a6c0b1cc 00007fa5a6d0937e 00007fa5a51ca2a4 00007fa5a51ca232 00007fa5a51ca161 00007fa5a51ca0dc 00007fa5a51c9392 00007fa59f18748c 00007fa59f1868c6
0709 13:19:25.422784 (+61891288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122112,"reported_tablets":49,"spinlock_wait_cycles":64128896}
I20260709 13:19:25.493003 15723 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:25.516927  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 106189us
I20260709 13:19:25.433275 15414 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.519124  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:25.521571  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.518376 15610 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:25.528812  8785 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:25.531795  8147 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:25.522310 15394 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:25.539189  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.544456  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:25.530294 15481 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:25.568629  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.569537  8108 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 26.
I20260709 13:19:25.575314  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.576400  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:25.577401  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:25.578207  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.584129  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.583259  8104 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
W20260709 13:19:25.586973  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 149056us
I20260709 13:19:25.579066  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:25.584913  8103 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:25.595820  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.544427 15426 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:25.602308  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:25.605743  8106 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:25.602267  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.568960 15481 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:25.626633 15415 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:25.626919  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.626681  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.595356 15436 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:25.631963  8103 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
W20260709 13:19:25.632613  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.633421  8249 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:25.607126 15426 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.637897  8252 raft_consensus.cc:2393] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 22: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:25.640231  8253 raft_consensus.cc:1240] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 23. Current term is 24. Ops: []
W20260709 13:19:25.641655  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 147036us
I20260709 13:19:25.621817 15481 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:25.643136  8101 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:25.641381  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:25.644397  8102 raft_consensus.cc:2410] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:19:25.642844  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.631999 15220 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:25.652271  8248 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:25.637988 15426 raft_consensus.cc:3060] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:25.658601  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.662401  8257 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:19:25.640856 15436 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:25.673627  8253 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:19:25.673710 15548 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:25.679170  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:25.669744 15758 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:19:25.683521  8256 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:25.667930 15723 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:25.674026 15436 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.674271 15414 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:25.697263  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55949.8us
I20260709 13:19:25.689318  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.699321  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.699640  8099 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:25.707448  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:25.708393 15548 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:25.708864 15548 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:25.709263 15548 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:25.679258 15394 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.714250 15603 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.716387 15603 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:25.719938  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:25.725919  8249 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:25.737170  8101 raft_consensus.cc:2468] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:19:25.727662  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.741487  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.743501  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.744349  8108 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:25.730808 15723 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:25.752820  8255 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 24: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:25.757555 15610 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:25.758368  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.759267  8100 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:25.760107  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:25.760872  8100 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 24: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:25.761767 15735 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.762295 15735 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.763530  8102 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
I20260709 13:19:25.763895  8102 pending_rounds.cc:85] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 15
I20260709 13:19:25.764137  8102 pending_rounds.cc:107] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 13:19:25.764393  8102 raft_consensus.cc:2889] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:25.764412 15735 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:25.767634  8178 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:19:25.768187  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.768945  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.775308  8103 raft_consensus.cc:1275] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:19:25.782122  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:25.783360  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.803036  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.757099  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:25.806239  8105 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:25.804428 15723 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:25.814733  8253 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:19:25.821184  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.822211 15548 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:25.825295 15548 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:25.834177  8149 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:25.842275  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:25.853646  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.856045  8179 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:19:25.857993  8179 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:25.858556  8177 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 23: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:25.859525  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.861985  8179 raft_consensus.cc:1240] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 13:19:25.863468  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:25.865355  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:25.866310 15760 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:25.868006  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:25.868595  8177 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:25.874946  8074 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:25.875901  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 62280.1us
I20260709 13:19:25.875993 15610 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:25.876443 15610 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.876682  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:25.876856 15610 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:25.878687  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.884485  8177 raft_consensus.cc:2468] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:25.897801 15220 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:25.897998  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:25.898528  8100 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:19:25.897323  8106 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:25.898872  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.898510  8105 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:25.902521  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:25.914806  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:25.915412  8180 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:25.917654  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.914446 15699 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:25.920077  8784 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:19:25.922343  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:25.927475  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.901319 15220 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.929812  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:25.930076  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 113525us
I20260709 13:19:25.930178  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:25.931190  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:25.932199  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.932392  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.928261  8105 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:25.915357 15415 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.938522  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.938524  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.941319  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.943780  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:25.946419  8788 raft_consensus.cc:1240] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:19:25.949303  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.932171 15220 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:25.953573  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:25.957021  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.959048  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:25.959882  8174 raft_consensus.cc:2393] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 21: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:25.961387  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.962092  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:25.938541 15603 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:25.964347  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:25.965981  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:25.967825  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.966863  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.928242 15699 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:25.975773  8179 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 21: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:25.975756  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.984642  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.988435  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:25.999218  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:26.001339  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:25.944358 15415 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:26.009507 15500 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:19:26.010600 15696 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:26.012616  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:25.997370 15715 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:19:25.986125 15707 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:26.017704  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:26.026907  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:26.053632  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:26.053716  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:26.054821  8180 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
W20260709 13:19:26.024909  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 68258.9us
I20260709 13:19:26.055505  8103 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:25.974413 15676 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 27.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:19:26.063076  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:26.063963  8786 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
W20260709 13:19:26.017385 15764 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.263s	user 0.000s	sys 0.002s
I20260709 13:19:26.069892  8176 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 26. Current term is 27. Ops: []
I20260709 13:19:26.056185 15603 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:26.070652  8223 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:26.071728 15394 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:26.074083  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 60633.4us
I20260709 13:19:26.074365 15676 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:19:26.053337 15696 consensus_queue.cc:1059] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:19:26.074842 15676 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:26.075609 15696 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:26.075934 15436 raft_consensus.cc:3055] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:26.075735 15676 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 27.13, Last appended by leader: 13, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:26.076359 15436 raft_consensus.cc:740] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:26.077070 15676 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:26.077275 15436 consensus_queue.cc:260] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:26.078439  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:26.017493 15737 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.078617 15436 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:26.079741  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:26.079466 15737 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:26.081754  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:26.087281  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:26.075872  8149 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:26.082440  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:26.089282  8149 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:19:26.087100  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:26.090059  8789 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.012s	sys 0.028s
I20260709 13:19:26.087771  8102 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
W20260709 13:19:26.091156  8789 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.013s	sys 0.028s
I20260709 13:19:26.024705 15426 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:26.070714 15603 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.117066  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:26.118444  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:26.120664  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:26.108325  8180 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:26.118863  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:26.118093  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:26.123538  8256 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:26.123736  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:26.121459  8105 raft_consensus.cc:2368] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24.
I20260709 13:19:26.123013  8103 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:26.093487 15715 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:19:26.150236  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.127517  8250 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 18: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:26.106000 15697 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:26.169183 15680 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:19:26.172533  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:26.107569 15707 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 13:19:26.173800  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:26.173926  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:26.174794  8183 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 23: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:26.175698  8180 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:19:26.158253 15715 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.178136 15715 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:26.179395 15610 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:26.183476  8105 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:19:26.173192  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:26.191952  8256 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:26.185212  8105 raft_consensus.cc:1217] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Deduplicated request from leader. Original: 18.8->[19.9-24.12]   Dedup: 21.10->[22.11-24.12]
I20260709 13:19:26.194947  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:26.195843  8103 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:26.122591 15603 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:26.193059  8105 pending_rounds.cc:85] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 10
I20260709 13:19:26.201409  8105 pending_rounds.cc:107] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 23.11
I20260709 13:19:26.201887  8105 raft_consensus.cc:2889] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:26.147936 15696 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.221046  8102 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:19:26.221182  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:26.227581  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:26.186740 15699 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:26.238193 15715 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:26.213680 15414 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.252429  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:26.263154  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 358619us
I20260709 13:19:26.264523 15414 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:26.254884 15697 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:26.274688 15719 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:26.274896 15610 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:26.275609 15481 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.001s
I20260709 13:19:26.271721  8103 pending_rounds.cc:85] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 11
I20260709 13:19:26.286794  8103 pending_rounds.cc:107] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 23.12
I20260709 13:19:26.287307  8103 raft_consensus.cc:2889] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:26.286528  8223 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:26.267545 15394 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:26.229547 15696 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:26.289844 15481 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:26.269588 15426 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:26.288326 15719 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.302218  8223 leader_election.cc:400] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24.
I20260709 13:19:26.302915  8223 leader_election.cc:403] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:19:26.303822  8174 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:26.297148 15610 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.298863 15707 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:26.318965  8223 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:26.320117  8785 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.009s	sys 0.033s
W20260709 13:19:26.320750  8785 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.009s	sys 0.033s
I20260709 13:19:26.303328 15719 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:19:26.311676  8101 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.005s	sys 0.021s
W20260709 13:19:26.334860  8101 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.005s	sys 0.022s
W20260709 13:19:26.321560  7999 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.008s	sys 0.041s
W20260709 13:19:26.404642  7999 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.008s	sys 0.041s
W20260709 13:19:26.405073 15766 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:19:26.322048 15426 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:26.303562 15742 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:19:26.333926 15718 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:26.322630 15610 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:26.407495 15220 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:26.440901  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 81326.8us
W20260709 13:19:26.362588 15477 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.013s	sys 0.035s
W20260709 13:19:26.446327  8107 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.004s	sys 0.022s
W20260709 13:19:26.498588  8107 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.005s	sys 0.023s
I20260709 13:19:26.363461 15737 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:26.439257 15715 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:26.506539  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 528765us
W20260709 13:19:26.496879 15477 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.013s	sys 0.036s
I20260709 13:19:26.511345  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:19:26.515357  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.489938 15415 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:26.537571 15383 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.005s	sys 0.024s
I20260709 13:19:26.438761 15697 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:26.586330  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:26.565495 15383 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.006s	sys 0.025s
I20260709 13:19:26.588837  8249 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:26.589759  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:26.590939  8108 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:26.587662  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
W20260709 13:19:26.584836  8755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.015s	sys 0.012s
W20260709 13:19:26.598284  8755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.016s	sys 0.013s
I20260709 13:19:26.598340  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:26.598822  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 579635us
I20260709 13:19:26.538802 15415 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:19:26.605652  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:26.607963  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:26.608814  8789 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:26.610560  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:26.612566  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:26.574455 15414 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:26.577556 15737 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:26.621352  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:26.627354  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:26.634809  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:26.638046  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:26.615725 15481 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:26.639482  8249 raft_consensus.cc:2410] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:19:26.640766  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:26.643532  8254 raft_consensus.cc:2393] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 21: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:19:26.644670  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 325780us
I20260709 13:19:26.645727  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:26.620178 15737 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:19:26.667621  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 440109us
I20260709 13:19:26.668486  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:26.672631  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:26.673784  8782 raft_consensus.cc:2376] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24. Re-sending same reply.
I20260709 13:19:26.632532 15394 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:26.638512 15696 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:26.685851  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:26.696606  8782 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
W20260709 13:19:26.698817  8073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:26.702207  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:26.702786  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.671114 15737 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:26.703514  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:26.703526  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:26.706450  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:26.710736  8099 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:19:26.722393  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:26.743940  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:26.754122  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:26.755442  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:26.755880  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:26.762239  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:26.764951  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:26.765847  8178 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:26.726617 15220 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:26.691701 15707 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:26.769460  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:26.772019  8176 raft_consensus.cc:2410] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:19:26.724798 15481 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:26.742769 15600 raft_consensus.cc:2764] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:19:26.727341 15701 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:26.773182  8149 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:26.789634  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:26.791469  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:26.768970 15696 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:26.770759 15610 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:26.779881 15481 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:26.803596  8099 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:19:26.810312 15481 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:26.816319  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:26.803881 15769 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.329s	user 0.001s	sys 0.001s
W20260709 13:19:26.806425 15603 consensus_meta.cc:287] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.001s
I20260709 13:19:26.822829  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:26.798537 15696 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:26.807276 15742 raft_consensus.cc:3055] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:19:26.828544  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 260986us
I20260709 13:19:26.826231  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:26.814824 15600 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:26.843137  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:26.853310  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:26.854671  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:26.854310 15707 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:26.855860  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:26.857642 15723 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:26.819501 15680 raft_consensus.cc:2804] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:26.858747 15680 raft_consensus.cc:697] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:26.832942 15742 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:26.862812  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:26.863559  8104 raft_consensus.cc:2393] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 18: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:26.842926 15603 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:26.865761  8177 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:26.840893 15696 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:26.872891  8178 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:26.869342  8790 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:26.879053  8108 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 26.
I20260709 13:19:26.881377  8101 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:26.871583  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3670) took 1117 ms. Trace:
I20260709 13:19:26.798328 15701 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:26.897226  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 53340us
I20260709 13:19:26.826025 15482 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:26.898466  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:26.903091  8099 raft_consensus.cc:1240] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
W20260709 13:19:26.903537  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 257960us
I20260709 13:19:26.907225  8108 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:19:26.886205  8107 rpcz_store.cc:276] 0709 13:19:25.754273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.760547 (+  6274us) service_pool.cc:224] Handling call
0709 13:19:25.760959 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.761209 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:19:26.504236 (+743027us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.871224 (+366988us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:26.871272 (+    48us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:19:26.871320 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.871395 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.871507 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":466265,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":757,"thread_start_us":1103985,"threads_started":2}
I20260709 13:19:26.869729 15477 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.871778 15600 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:26.917644  8178 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:19:26.920778  8072 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:26.920142  8784 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:19:26.930491  8253 raft_consensus.cc:1240] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:19:26.933876  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:26.861261 15742 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:26.939330  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:26.939777  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:26.968237  8251 raft_consensus.cc:2393] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 24: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:26.968787  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:26.968942  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:26.823105 15394 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:26.976114  8788 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:19:26.968415  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:26.976217  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:26.979996  8179 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
W20260709 13:19:26.993712  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 84685.7us
I20260709 13:19:26.995927  8072 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:26.995918 15781 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:26.997594 15798 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:19:26.997792 15787 log.cc:927] Time spent T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:19:26.998049 15781 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:26.998859 15829 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:26.999974 15383 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:27.000487 15383 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:27.002063  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:27.001920 15383 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.003324 15383 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:27.003557  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:27.004317  8252 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:27.005225 15701 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:27.005709  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:27.007251  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:26.976260 15785 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:26.928730 15600 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:26.983755 15603 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:27.011183 15782 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 13:19:26.918560 15477 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.011387  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:26.934818 15220 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:27.013087 15719 consensus_meta.cc:287] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.552s	user 0.012s	sys 0.000s
W20260709 13:19:27.008613 15426 consensus_meta.cc:287] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.000s
I20260709 13:19:27.016393  8221 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:27.022796  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:27.012012 15793 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:19:27.060989 15801 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:27.063521 15829 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:27.063956 15801 raft_consensus.cc:697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:27.064348 15829 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:27.064827 15829 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.065188 15829 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:27.065044 15801 consensus_queue.cc:237] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.052083 15785 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.067762 15603 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:27.069573 15426 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24.
W20260709 13:19:27.063097  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 46776.9us
I20260709 13:19:27.060105  8174 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:26.998165 15798 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:19:27.061579 15780 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:19:27.012777 15790 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:26.976591 15500 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:19:26.893316 15680 consensus_queue.cc:237] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.012756 15800 consensus_queue.cc:1048] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.216s
I20260709 13:19:27.013342 15807 consensus_queue.cc:1059] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.238s
I20260709 13:19:27.062436 15781 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:19:27.062547 15786 log.cc:927] Time spent T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:19:27.063021 15819 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:27.063282  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 52063.4us
I20260709 13:19:27.111898  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.112658  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2459) took 1345 ms. Trace:
I20260709 13:19:27.113389  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.114400 15807 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:27.113287  8182 rpcz_store.cc:276] 0709 13:19:25.767448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.770007 (+  2559us) service_pool.cc:224] Handling call
0709 13:19:25.836340 (+ 66333us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b58000d7d98. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:19:25.836588 (+   248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.904910 (+ 68322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.904938 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:25.938789 (+ 33851us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.322739 (+383950us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:26.322779 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.322860 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.112111 (+789251us) raft_consensus.cc:1685] finished
0709 13:19:27.112141 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.112430 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46472,"raft.queue_time_us":80360,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":11406,"spinlock_wait_cycles":31167360,"thread_start_us":367028,"threads_started":1,"wal-append.queue_time_us":664376}
I20260709 13:19:27.080019  8175 raft_consensus.cc:1240] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:27.061290 15481 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.116416  8223 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:27.117376 15819 raft_consensus.cc:2804] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:27.117998 15819 raft_consensus.cc:697] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:27.118345 15481 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:27.061744 15791 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.087137  8253 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:27.119030 15819 consensus_queue.cc:237] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.064352 15810 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.094842  8181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37206 (request call id 1060) took 1100 ms. Trace:
I20260709 13:19:27.095016  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:27.120011 15791 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.120291  8181 rpcz_store.cc:276] 0709 13:19:25.994652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.996710 (+  2058us) service_pool.cc:224] Handling call
0709 13:19:26.033080 (+ 36370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:26.063321 (+ 30241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:26.063351 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:26.063879 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.438292 (+374413us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:19:26.438384 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.438470 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.010189 (+571719us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:27.094478 (+ 84289us) raft_consensus.cc:1685] finished
0709 13:19:27.094507 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.094755 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6017,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":28039424,"thread_start_us":373884,"threads_started":1,"wal-append.queue_time_us":512224}
I20260709 13:19:27.122257 15791 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:27.122862 15784 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:27.123311 15784 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.123488  8254 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:19:27.123771 15784 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:27.120304 15810 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.126157 15707 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:27.126360 15810 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:27.126809 15707 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.129076 15600 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:27.115236 15807 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:27.071285 15719 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.126953 15737 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.122207  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:27.082697 15477 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:27.140635  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.057765  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:27.143934  8180 raft_consensus.cc:2393] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 27: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:27.082048 15798 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:27.139168 15707 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:27.146451  8257 raft_consensus.cc:2393] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 22: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:27.147203 15719 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:27.148201 15737 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:27.150956 15784 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.155865  8177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 2470) took 1154 ms. Trace:
I20260709 13:19:27.168015  8223 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:27.144901  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 87220.1us
I20260709 13:19:27.179786  8177 rpcz_store.cc:276] 0709 13:19:26.001419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.001599 (+   180us) service_pool.cc:224] Handling call
0709 13:19:27.155568 (+1153969us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b54002f9754. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:27.155776 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1914496768}
I20260709 13:19:27.178785 15436 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:27.089323 15790 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.233909  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:27.236562  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2455) took 1267 ms. Trace:
W20260709 13:19:27.232848  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 64968.5us
I20260709 13:19:27.231725 15735 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.142077 15781 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.234015  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:27.241043  8102 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:19:27.237653  8223 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.233894  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:27.236857  8099 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:27.228716 15791 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:27.236995  8103 rpcz_store.cc:276] 0709 13:19:25.968909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.257448 (+288539us) service_pool.cc:224] Handling call
0709 13:19:26.271497 (+ 14049us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:26.295466 (+ 23969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:26.295499 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:26.298590 (+  3091us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.550772 (+252182us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:26.550830 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.550937 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.236361 (+685424us) raft_consensus.cc:1685] finished
0709 13:19:27.236384 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.236506 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":250009,"threads_started":1,"wal-append.queue_time_us":857321}
I20260709 13:19:27.242986  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:27.228886 15477 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.232403 15737 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:27.245513  8099 raft_consensus.cc:2393] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 23: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:27.246287  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:27.250263  8108 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:27.246321  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:27.247177 15783 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.253995  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:27.254143  8107 raft_consensus.cc:2410] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 26 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 12.
I20260709 13:19:27.234896 15436 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:27.227991 15812 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:19:27.251778  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.254634  8104 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:27.247509  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:27.258949 15812 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:27.249606 15477 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.249277 15781 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:27.241580 15735 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.268486 15812 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:27.270213 15394 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:19:27.270455 15735 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:27.270673 15394 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:27.261665 15783 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.271870 15394 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.272908 15394 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:27.261844 15383 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:27.273569 15829 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.256392 15791 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.275872 15791 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:27.276324 15829 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:27.273181 15783 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:27.307376 15827 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:19:27.307559 15798 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.310417 15784 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:27.286901 15436 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.311477  8223 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:27.288678 15814 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:19:27.288868 15790 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:27.289770  8179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 2477) took 1117 ms. Trace:
W20260709 13:19:27.292325  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.298322 15477 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:27.300694 15822 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:19:27.301640 15735 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:27.302093 15785 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:27.310150 15696 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.284798  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:27.313410  8223 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.318161  8105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2450) took 1358 ms. Trace:
I20260709 13:19:27.331763  8108 raft_consensus.cc:2468] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 27.
I20260709 13:19:27.314702  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2445) took 1369 ms. Trace:
I20260709 13:19:27.321956  8104 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:27.323196  8248 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: []
W20260709 13:19:27.315284  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.358069  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:27.331882  8105 rpcz_store.cc:276] 0709 13:19:25.959581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.184515 (+224934us) service_pool.cc:224] Handling call
0709 13:19:26.184946 (+   431us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:19:26.640187 (+455241us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:26.680371 (+ 40184us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.841266 (+160895us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.841404 (+   138us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:26.842147 (+   743us) log.cc:844] Serialized 52 byte log entry
0709 13:19:26.842326 (+   179us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:26.842576 (+   250us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.847936 (+  5360us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.848167 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.848398 (+   231us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.998322 (+149924us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b180038ecc0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:19:27.296117 (+297795us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b180038ecc0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f522 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:19:27.299697 (+  3580us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:27.317940 (+ 18243us) raft_consensus.cc:1685] finished
0709 13:19:27.317964 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.318101 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27714,"prepare.queue_time_us":272454,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":138,"raft.queue_time_us":255494,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":70406,"spinlock_wait_cycles":291160960,"thread_start_us":468299,"threads_started":2,"wal-append.queue_time_us":226082}
I20260709 13:19:27.336856  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.315006  8179 rpcz_store.cc:276] 0709 13:19:26.172080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.172276 (+   196us) service_pool.cc:224] Handling call
0709 13:19:27.289595 (+1117319us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54002f9c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:27.289708 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":952362368}
I20260709 13:19:27.338302 15821 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:27.338569  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 53920.9us
I20260709 13:19:27.339304 15785 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:27.318571 15735 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:27.319238 15831 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.252s	user 0.002s	sys 0.000s
I20260709 13:19:27.343786 15817 raft_consensus.cc:3055] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:27.347851  8101 raft_consensus.cc:1275] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:19:27.385151  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:27.386041  8256 raft_consensus.cc:2410] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 26 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 12.
I20260709 13:19:27.367542  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:27.349786  8100 rpcz_store.cc:276] 0709 13:19:25.944971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.170023 (+225052us) service_pool.cc:224] Handling call
0709 13:19:26.170401 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:26.496621 (+326220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:26.496655 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:26.508656 (+ 12001us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.783840 (+275184us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:26.784062 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.784367 (+   305us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.288056 (+503689us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:27.314382 (+ 26326us) raft_consensus.cc:1685] finished
0709 13:19:27.314402 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.314605 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":191207,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":73347,"spinlock_wait_cycles":54744448,"thread_start_us":547251,"threads_started":2,"wal-append.queue_time_us":489275}
I20260709 13:19:27.336681 15394 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:27.374603  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:27.314457 15784 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:19:27.382186  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:27.383167  8252 raft_consensus.cc:1240] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:27.364748  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:27.379824  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:27.386090  8223 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:27.390919  8249 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:27.390991  8788 raft_consensus.cc:3060] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:27.392505 15383 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:19:27.393452 15811 log.cc:927] Time spent T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.324s	user 0.001s	sys 0.002s
W20260709 13:19:27.394130 15839 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:19:27.370708 15819 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:27.384593 15817 raft_consensus.cc:740] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:27.398886 15817 consensus_queue.cc:260] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.400357 15817 raft_consensus.cc:3060] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:27.368749 15785 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:27.402341 15785 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:27.406015 15790 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:27.382942 15735 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:27.406678 15790 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.407099 15784 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:27.348548 15737 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:19:27.410632 15784 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:27.411767 15784 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.413029  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:27.413944  8252 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 25: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:27.414887  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:19:27.415846  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.416676 15383 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:27.417092 15383 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:27.417951 15383 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.419148 15477 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:27.419564 15799 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:27.419726 15477 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.420116 15799 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.422968 15696 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:27.424947 15791 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:27.425464 15791 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:27.427004 15832 log.cc:927] Time spent T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.363s	user 0.003s	sys 0.000s
I20260709 13:19:27.427284 15791 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:27.410718 15798 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:27.428799  8249 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:27.409195 15790 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:27.413081 15784 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:27.429502 15610 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:27.430812  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:27.431416 15783 consensus_queue.cc:1059] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:19:27.432497 15809 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.363s	user 0.001s	sys 0.001s
W20260709 13:19:27.428406 15775 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.792s	user 0.004s	sys 0.000s
I20260709 13:19:27.434450  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.437116  8788 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:27.446744  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:27.451107  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 65118.1us
I20260709 13:19:27.447443  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:27.464387 15791 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:27.445510 15436 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:19:27.467569  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:27.474990 15436 consensus_queue.cc:1243] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer 5033fc7e66374940a203908ea8b0078f log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:19:27.465384  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:27.467996  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:27.465076 15500 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:27.476753  8108 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:19:27.465415  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:27.478108  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:27.478230  8183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2482) took 1304 ms. Trace:
I20260709 13:19:27.476191  8107 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:27.446329 15723 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:27.479180 15723 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.479627  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:27.433698 15220 consensus_queue.cc:1059] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:19:27.473635 15600 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.481134 15220 raft_consensus.cc:3055] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:27.481583 15220 raft_consensus.cc:740] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:19:27.464898 15825 log.cc:927] Time spent T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.396s	user 0.003s	sys 0.001s
W20260709 13:19:27.468245 15820 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.468s	user 0.000s	sys 0.004s
I20260709 13:19:27.478415  8099 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:27.482537 15220 consensus_queue.cc:260] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.481631 15600 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:27.469086 15824 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.400s	user 0.003s	sys 0.000s
I20260709 13:19:27.474171 15477 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:27.481760 15610 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:27.476754 15500 raft_consensus.cc:697] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:27.481925  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:27.470554  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:27.486503 15500 consensus_queue.cc:237] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.464509 15799 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:27.466291 15783 raft_consensus.cc:3055] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:27.487708 15783 raft_consensus.cc:740] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:27.485297  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:27.488564 15783 consensus_queue.cc:260] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.489528  8179 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:27.472662 15742 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:27.485652  8182 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 26. Current term is 27. Ops: [26.16-26.16]
I20260709 13:19:27.465749  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:27.470249  8101 raft_consensus.cc:1275] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:19:27.489912 15783 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:27.508881  8101 pending_rounds.cc:85] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 10
I20260709 13:19:27.509461  8101 pending_rounds.cc:107] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:19:27.510020  8101 raft_consensus.cc:2889] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:27.491950  8105 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:27.464910  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:27.483808 15220 raft_consensus.cc:3060] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:27.510730  8102 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 25.
W20260709 13:19:27.459537  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:27.491490  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 44157.8us
W20260709 13:19:27.523216  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.524250  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:27.525219  8180 raft_consensus.cc:2410] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:19:27.526391  8788 pending_rounds.cc:85] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 13
I20260709 13:19:27.526714  8788 pending_rounds.cc:107] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:19:27.526960  8788 raft_consensus.cc:2889] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:27.485787 15610 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.521296  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:27.529244  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 94863.8us
I20260709 13:19:27.419139 15383 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:27.534776  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.536103  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.538179  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:27.485410 15600 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:27.478787  8183 rpcz_store.cc:276] 0709 13:19:26.173957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.175399 (+  1442us) service_pool.cc:224] Handling call
0709 13:19:26.175722 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:26.220501 (+ 44779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:26.220533 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:26.264849 (+ 44316us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.675210 (+410361us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:26.675251 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.675333 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.431834 (+756501us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:27.477933 (+ 46099us) raft_consensus.cc:1685] finished
0709 13:19:27.477957 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.478170 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52609,"raft.queue_time_us":50915,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":19840,"spinlock_wait_cycles":35014528,"thread_start_us":409882,"threads_started":1,"wal-append.queue_time_us":803678}
I20260709 13:19:27.504654 15791 raft_consensus.cc:2764] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:19:27.504730 15719 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:19:27.504765 15680 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:27.473734 15676 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.065s
I20260709 13:19:27.504716 15790 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:27.543726  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:27.586990  8785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 2112) took 1808 ms. Trace:
I20260709 13:19:27.536757 15834 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:27.541381 15799 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:27.594060  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 50438us
I20260709 13:19:27.543282 15737 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:27.595533  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 54216.4us
I20260709 13:19:27.588747  8785 rpcz_store.cc:276] 0709 13:19:25.778374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.779754 (+  1380us) service_pool.cc:224] Handling call
0709 13:19:25.780065 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.780444 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.780473 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:25.780913 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.321213 (+540300us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:26.321276 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.321376 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.427764 (+1106388us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:27.578958 (+151194us) raft_consensus.cc:1685] finished
0709 13:19:27.578979 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.586884 (+  7905us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2096,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6825,"spinlock_wait_cycles":12803840,"thread_start_us":539732,"threads_started":1,"wal-append.queue_time_us":795474}
W20260709 13:19:27.597643  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 61625us
I20260709 13:19:27.599224  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:27.600602  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:27.602638 15810 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:27.603439 15821 consensus_queue.cc:1059] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:27.606107  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:27.607385  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:27.607824  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:27.608510  8249 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 25.
I20260709 13:19:27.612396 15426 raft_consensus.cc:3055] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:27.612823 15426 raft_consensus.cc:740] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:27.613759 15426 consensus_queue.cc:260] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.614914 15426 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:27.615408  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:27.605906 15781 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:27.618378  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:27.587459 15707 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.621052  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:27.621582 15707 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.623905 15707 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:27.624565 15737 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.627072 15737 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:27.630249  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:27.632891  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:27.635464  8107 raft_consensus.cc:2468] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:27.632222  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:27.642026  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 44509.1us
I20260709 13:19:27.646855  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:27.648016  8755 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.594933 15835 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:27.652321  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:27.656859  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:27.657677  8180 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 28.
I20260709 13:19:27.671236  8256 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:27.672529  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:27.675460  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.677174  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:27.679435  8254 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 28: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:27.670303  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:27.682966  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:27.636893 15477 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:27.681730  8251 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
W20260709 13:19:27.686944  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 50387us
W20260709 13:19:27.688872  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 46180us
I20260709 13:19:27.690722  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:27.702500 15834 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:27.703629 15834 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.659569 15835 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:27.688988 15789 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:27.709649 15835 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:27.709852 15789 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:27.710311 15789 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:27.687091 15701 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:27.717504  8784 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:27.719812 15735 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.722496  8786 raft_consensus.cc:1240] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:27.685626 15790 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:27.722970  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 119891us
I20260709 13:19:27.737713  8149 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:27.772275  8223 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:27.790671  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.794234  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:27.798241  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 29 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:27.798418  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:27.799072  8249 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 28.
I20260709 13:19:27.812805  8249 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:19:27.729700 15781 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 24 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:27.810853  8223 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:27.819394 15858 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:27.824187  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:27.825930  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:27.832587  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:27.833853  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.838701  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:27.839387  8180 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 25.
W20260709 13:19:27.843523  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 195590us
I20260709 13:19:27.844385  8174 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:27.844553  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.810467 15600 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:27.760246 15696 consensus_queue.cc:1059] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.089s
I20260709 13:19:27.866290  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.834934 15819 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:27.873324  8178 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:19:27.860693  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 177849us
I20260709 13:19:27.883365  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:27.845047 15737 raft_consensus.cc:2804] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:27.873235 15799 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:27.899287 15799 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:27.830687 15821 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:19:27.852031 15735 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:27.902427  8102 raft_consensus.cc:1275] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:19:27.822883 15785 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:27.904567  8752 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.834780 15500 consensus_queue.cc:1048] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:19:27.874396 15707 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:27.888078 15819 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.894600 15812 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:27.893807 15858 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:27.899823 15799 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:27.930367 15737 raft_consensus.cc:697] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:27.945143 15819 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:27.914528 15829 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 13:19:27.978657 15835 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:27.981724  8178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:27.982313  8789 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:19:27.980268 15737 consensus_queue.cc:237] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:27.993839  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 105310us
I20260709 13:19:28.010408  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.986733 15600 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:27.988364 15835 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:28.012255 15600 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:28.007782  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 124525us
I20260709 13:19:28.019403  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.023751 15861 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:28.034543  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.037099  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:27.946473 15781 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:28.040900  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:28.041705 15863 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:19:28.038749 15500 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:28.046469  8183 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 24. Current term is 25. Ops: []
W20260709 13:19:28.048619 15808 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:28.034466 15861 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:28.051676 15861 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:28.052260 15861 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:28.049842 15857 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 13:19:28.054387 15850 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:19:27.962491 15858 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:28.059392  8178 raft_consensus.cc:606] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:28.063685 15849 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:19:28.066705 15785 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:28.067162 15862 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:28.039149 15860 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:28.067960  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 223517us
I20260709 13:19:28.086018  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:28.068634 15859 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:28.070464  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:28.074213  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:28.090782  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 56327.2us
I20260709 13:19:28.087901  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:28.042913  8074 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:28.092895 15383 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:28.103606 15834 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:28.104153 15870 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:28.105480 15799 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:28.128693  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:28.107493 15220 consensus_meta.cc:287] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.000s
I20260709 13:19:28.090862 15790 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:28.108019 15858 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:28.111145 15719 raft_consensus.cc:3055] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:19:28.122355  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 79511.1us
I20260709 13:19:28.123404  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.127683  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:28.136198  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.138873  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:28.140059  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:28.140707  8791 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 25.
I20260709 13:19:28.141508 15680 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:28.141798  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.142043 15876 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:28.142947  8149 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:28.143503 15876 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:28.143985  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:28.144197 15876 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:28.144941 15876 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:28.145330  8149 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.146220 15826 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:19:28.148495 15871 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:19:28.129834 15735 consensus_queue.cc:1059] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 13:19:28.150763 15735 raft_consensus.cc:3055] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:28.151103 15735 raft_consensus.cc:740] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:28.151934  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:28.152518  8108 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:28.125099 15862 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:28.153286 15862 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:28.153671 15862 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:28.154240 15819 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:28.156373 15819 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:28.125797 15870 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.157714 15870 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:28.162032  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:28.123070 15859 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:28.125984 15834 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.163507 15834 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:28.157194 15723 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:28.169395 15610 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:28.137756 15719 raft_consensus.cc:740] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:28.151973 15735 consensus_queue.cc:260] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:28.172536 15735 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:28.172298 15719 consensus_queue.cc:260] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:28.173036  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 29 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:28.185150  8104 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 27.
I20260709 13:19:28.175328  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.185971  8149 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.178959  8108 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
W20260709 13:19:28.131273 15855 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.180s	user 0.001s	sys 0.003s
I20260709 13:19:28.192319  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:28.195293  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:28.196025  8254 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 27.
I20260709 13:19:28.197722  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:28.203722  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:28.204535  8254 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:28.208127 15220 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:28.208539 15220 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:28.208889 15220 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:28.209564 15699 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.209749 15789 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:28.210081 15699 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:28.211957 15699 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:28.212066 15789 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:28.214187  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 75853.7us
I20260709 13:19:28.214994  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.203071 15826 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:28.218890 15826 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:28.179865 15394 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:19:28.183784 15477 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:28.222229  8174 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:28.222772 15436 raft_consensus.cc:2804] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:28.222887 15867 consensus_queue.cc:1048] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:19:28.223304 15436 raft_consensus.cc:697] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:28.224525  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:28.224238 15436 consensus_queue.cc:237] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:28.227339  8178 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:28.227610  8108 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:19:28.230150  8103 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:19:28.231230  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:28.231454 15798 consensus_queue.cc:1059] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 13:19:28.200690 15676 raft_consensus.cc:2804] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:28.232460 15676 raft_consensus.cc:697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:28.232640 15798 raft_consensus.cc:3055] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:28.233008 15798 raft_consensus.cc:740] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:28.233497 15676 consensus_queue.cc:237] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:28.217198  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.237623  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.239008  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.236470  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:28.237036  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:28.252627  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:28.253125  8257 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:19:28.259092  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:28.260478  8180 raft_consensus.cc:2393] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:28.264420  8248 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:19:28.265129  8788 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
W20260709 13:19:28.267014  8072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.009s	sys 0.012s
W20260709 13:19:28.267874  8072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.009s	sys 0.012s
I20260709 13:19:28.261487  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:28.273088  8174 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 24: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:28.286516  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:28.287385  8178 raft_consensus.cc:2393] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 27: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:28.236426 15719 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:28.289561  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.254611 15789 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:28.306589  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 67674.8us
I20260709 13:19:28.260782 15785 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:28.305981  8104 raft_consensus.cc:1240] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 26. Current term is 27. Ops: [26.16-26.16]
I20260709 13:19:28.317914  8782 raft_consensus.cc:2410] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 23 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 13:19:28.301559  8174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:28.318898  8174 raft_consensus.cc:606] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.319366  8174 raft_consensus.cc:614] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:28.263689 15481 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:19:28.307646  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.321803  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.285616 15383 consensus_queue.cc:1059] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:19:28.250909 15862 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:28.309635 15697 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:28.310309 15861 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:28.310433  8100 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:19:28.310815 15791 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.311229 15781 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:28.311389  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:28.295743 15812 raft_consensus.cc:3055] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Stepping down as leader of term 26
W20260709 13:19:28.321784 15742 consensus_meta.cc:287] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.791s	user 0.008s	sys 0.004s
I20260709 13:19:28.311251  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.308574 15477 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.308352 15610 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.322885 15735 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:28.303866 15817 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:19:28.325726  8099 raft_consensus.cc:1275] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:19:28.369292  8099 pending_rounds.cc:85] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Aborting all ops after (but not including) 13
I20260709 13:19:28.369576  8099 pending_rounds.cc:107] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:19:28.369871  8099 raft_consensus.cc:2889] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:28.334059  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.311916 15858 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:28.286005 15867 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:19:28.342588  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:28.336135 15799 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.341147  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:28.345206  8180 raft_consensus.cc:1240] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:28.346525  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:28.377292  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:28.354678  8257 raft_consensus.cc:1275] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
W20260709 13:19:28.357853  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 46660.5us
I20260709 13:19:28.322512  8104 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:28.380033  8257 pending_rounds.cc:85] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 14
I20260709 13:19:28.380347  8257 pending_rounds.cc:107] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:19:28.380575  8257 raft_consensus.cc:2889] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:28.380853  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:28.340426 15812 raft_consensus.cc:740] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:28.364499 15800 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:28.364089  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:28.365015  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:28.365919  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:28.368075  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:28.368521  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:28.333949 15701 raft_consensus.cc:2749] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:28.329841 15784 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:28.507916  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.328205  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:28.375415  8785 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:28.367837  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:28.348699 15699 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:28.352136 15860 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:28.381448  8104 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:28.349359  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:28.384888 15799 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:28.384372  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:28.395048  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:28.513262  8251 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:28.513707  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:28.361469 15790 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:28.398418  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:28.398974  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 52517.7us
I20260709 13:19:28.367949 15610 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:28.306357 15798 consensus_queue.cc:260] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:28.359925 15477 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:28.335990 15871 consensus_queue.cc:1059] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:19:28.401422  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:28.349040 15426 consensus_queue.cc:1059] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 13:19:28.384634  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.401113  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:28.464123  8790 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 25.
I20260709 13:19:28.340101 15870 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:28.348752 15791 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:28.610750  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:28.513510 15699 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:28.408946  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.397821 15858 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:28.351644 15861 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:28.355556 15781 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:28.361652 15789 consensus_queue.cc:1059] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:19:28.322309 15481 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.638640  8108 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 25.
I20260709 13:19:28.638688  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:28.596273  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:28.595348  8180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:28.606626  8099 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 24.
W20260709 13:19:28.615011  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 230444us
I20260709 13:19:28.624212  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:28.625209  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:28.634330  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:28.635274  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:19:28.639725  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 102338us
I20260709 13:19:28.640179  8180 raft_consensus.cc:606] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.641688  8149 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.643256  8072 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:28.650147  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:28.651636  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:28.652863  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:28.654985  8787 raft_consensus.cc:1240] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:19:28.659271  8791 raft_consensus.cc:2393] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:28.662185  8791 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:19:28.673624  8248 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 26: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:28.637049 15699 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:28.684931  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:28.685737  8785 raft_consensus.cc:3060] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:28.686868  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:28.683269  8787 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:28.637868 15723 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:28.634985 15870 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:28.646093 15481 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:19:28.670310 15697 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:28.653800 15742 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.684191 15819 consensus_queue.cc:1048] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:19:28.705214  8248 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:19:28.714228  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:28.671584 15426 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.039s
I20260709 13:19:28.684048 15707 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 13:19:28.737489  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 403489us
I20260709 13:19:28.699950 15833 consensus_queue.cc:1048] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.337s
I20260709 13:19:28.749984  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.736088  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:28.670614 15801 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:19:28.679893 15482 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:19:28.738096  8104 raft_consensus.cc:2468] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:28.716691 15697 raft_consensus.cc:697] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:28.732544 15862 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:28.757052  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:28.732406 15383 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.382093 15880 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:28.713322 15742 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:28.767254 15884 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 13:19:28.779249  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:28.833717  8785 raft_consensus.cc:2468] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:28.771122 15862 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:28.835580 15862 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:28.772933 15885 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 13:19:28.844501  8180 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 13:19:28.827656 15220 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.618s	user 0.004s	sys 0.006s
W20260709 13:19:28.848713 15676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.016s	sys 0.029s
W20260709 13:19:28.853623 15676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.016s	sys 0.029s
I20260709 13:19:28.869619 15697 consensus_queue.cc:237] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:28.872391 15610 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:28.874626 15737 raft_consensus.cc:3055] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:28.875166 15737 raft_consensus.cc:740] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:28.876288 15737 consensus_queue.cc:260] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:28.879472 15817 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:19:28.882428 15894 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:19:28.884305 15883 log.cc:927] Time spent T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.489s	user 0.003s	sys 0.033s
I20260709 13:19:28.885753  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:28.886345  8175 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:28.889539  8105 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:28.894555  8105 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:28.895241  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:28.833348 15426 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:28.849524 15886 log.cc:927] Time spent T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:19:28.904392  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:28.783344 15383 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:28.907274  8787 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260709 13:19:28.909876  8787 pending_rounds.cc:85] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 16
I20260709 13:19:28.910400  8787 pending_rounds.cc:107] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 13:19:28.910789  8787 raft_consensus.cc:2889] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:28.908717  8105 raft_consensus.cc:3060] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:19:28.912287  8107 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.027s	sys 0.056s
W20260709 13:19:28.912693  8107 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.027s	sys 0.056s
W20260709 13:19:28.914808  8106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.011s	sys 0.021s
W20260709 13:19:28.915436  8106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.012s	sys 0.021s
I20260709 13:19:28.965659  8785 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
W20260709 13:19:28.910130 15889 log.cc:927] Time spent T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:19:28.904601 15610 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:19:28.916013 15885 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:19:28.901063 15833 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:28.967720  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3695) took 1180 ms. Trace:
I20260709 13:19:28.897863 15220 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:28.909406 15436 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:28.917738 15477 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:29.029634  8107 rpcz_store.cc:276] 0709 13:19:27.787587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.789570 (+  1983us) service_pool.cc:224] Handling call
0709 13:19:28.096640 (+307070us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b5800002798. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd27a22 00007fa5a6c40c09 00007fa5a5d9aee0 00007fa5a5e640ab 00007fa5a5e64131 00007fa5a5e25fc0 00007fa5a5e10929 00007fa5a5e103d2 00007fa59f387bd4
0709 13:19:28.108566 (+ 11926us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.109019 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.109061 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:28.109719 (+   658us) log.cc:844] Serialized 26 byte log entry
0709 13:19:28.237519 (+127800us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:19:28.913120 (+675601us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.913402 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.913735 (+   333us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.913778 (+    43us) raft_consensus.cc:1685] finished
0709 13:19:28.967554 (+ 53776us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.967676 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":287134,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":1467,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":51220,"spinlock_wait_cycles":17610624,"thread_start_us":751593,"threads_started":2,"wal-append.queue_time_us":243997}
I20260709 13:19:28.913573 15893 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:28.903851 15858 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.118s
I20260709 13:19:28.985093 15610 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:28.909745 15426 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:28.984525 15781 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:28.967413 15737 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:29.078263  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.042479  8102 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:29.112505  8175 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:29.148212 15610 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:29.044245 15884 log.cc:927] Time spent T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 13:19:29.049535 15897 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:19:29.043565 15676 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:29.033732 15819 consensus_queue.cc:1059] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.133s
I20260709 13:19:29.036190 15870 consensus_queue.cc:1059] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.127s
I20260709 13:19:29.036805 15833 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.043975 15436 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:29.204088  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.204178  8101 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: []
W20260709 13:19:29.203928  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 287569us
I20260709 13:19:29.207602  8105 raft_consensus.cc:2468] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:29.191411 15791 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:29.210202  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 307638us
W20260709 13:19:29.211350  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 432192us
W20260709 13:19:29.212033  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.222034  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:29.187500 15676 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:29.218340 15834 consensus_meta.cc:287] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 1.054s	user 0.013s	sys 0.000s
I20260709 13:19:29.209534 15819 raft_consensus.cc:3055] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:29.219588 15742 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:29.246881  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:29.248853  8108 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:29.255582  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:29.242427 15819 raft_consensus.cc:740] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:29.263742  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:29.282038  8108 raft_consensus.cc:1275] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:19:29.265864  8101 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:19:29.266515 15858 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:29.232259 15871 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
W20260709 13:19:29.274171 15895 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:19:29.274796 15900 log.cc:927] Time spent T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:19:29.275136 15426 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:29.278118 15901 log.cc:927] Time spent T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:19:29.279527 15394 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:29.280177 15699 consensus_meta.cc:287] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.578s	user 0.004s	sys 0.004s
I20260709 13:19:29.284113  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:29.260445 15477 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:29.284442 15791 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:29.256161 15742 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.284593 15858 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:29.289907  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:29.290490  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:29.303362  8179 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
W20260709 13:19:29.281211 15719 consensus_meta.cc:287] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.974s	user 0.008s	sys 0.005s
I20260709 13:19:29.245420 15834 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.308781  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:29.291038  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 59028.3us
W20260709 13:19:29.300722  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 68212us
I20260709 13:19:29.307372  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:29.287331 15817 raft_consensus.cc:3055] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:29.308931  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:29.300304 15791 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:19:29.307605  8072 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.214.132:45917 timed out after 2.460s (SENT) [suppressed 8 similar messages]
I20260709 13:19:29.296676 15910 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:29.314317  8180 raft_consensus.cc:1240] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:29.305800 15858 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:29.323388  8182 raft_consensus.cc:1240] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:19:29.308069 15220 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:29.328162  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:29.299515 15394 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.301710 15699 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.312260 15817 raft_consensus.cc:740] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:29.316833 15791 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:29.339538  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:29.314289 15916 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:29.342485  8177 raft_consensus.cc:2393] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 26: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:29.321527 15676 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:29.308027 15742 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.333998 15833 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:29.355080 15676 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:19:29.356734 15909 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.105s	user 0.000s	sys 0.002s
I20260709 13:19:29.357043  8103 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 26: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:29.358071  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2483) took 1032 ms. Trace:
I20260709 13:19:29.358353  8183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:29.355181 15903 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 13:19:29.358976  8183 raft_consensus.cc:606] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Received request to transfer leadership to TS a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:29.359447 15903 consensus_queue.cc:1243] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer 9bd264598fd2483e9e17674bab9ba4e8 log is divergent from this leader: its last log entry 25.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:19:29.359640  8183 raft_consensus.cc:614] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:29.358448  8104 rpcz_store.cc:276] 0709 13:19:28.325415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.757345 (+431930us) service_pool.cc:224] Handling call
0709 13:19:28.757758 (+   413us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:28.758081 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.758109 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:28.765068 (+  6959us) log.cc:844] Serialized 52 byte log entry
0709 13:19:29.100594 (+335526us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:29.100684 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.100789 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:29.356146 (+255357us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:29.357786 (+  1640us) raft_consensus.cc:1685] finished
0709 13:19:29.357814 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:29.358016 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77282,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":8471296,"thread_start_us":277362,"threads_started":1,"wal-append.queue_time_us":429834}
I20260709 13:19:29.358570  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 2486) took 1032 ms. Trace:
I20260709 13:19:29.361280  8103 rpcz_store.cc:276] 0709 13:19:28.326115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.497201 (+171086us) service_pool.cc:224] Handling call
0709 13:19:29.358377 (+861176us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54001b9754. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:29.358515 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1931216768}
I20260709 13:19:29.361630 15898 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:29.362007 15898 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:29.362799 15898 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.363353  8183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4"
dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
mode: GRACEFUL
new_leader_uuid: "9480609eccc44250a4d7fcc9686e76cf"
 from {username='slave'} at 127.0.0.1:51044
I20260709 13:19:29.363883  8183 raft_consensus.cc:606] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Received request to transfer leadership to TS 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:29.364086 15898 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:29.364223  8183 raft_consensus.cc:614] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:29.364686 15481 consensus_meta.cc:287] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.000s
I20260709 13:19:29.337821 15436 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:29.341914 15880 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:29.304749 15819 consensus_queue.cc:260] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:29.370064  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 62484.4us
I20260709 13:19:29.365628  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:19:29.357089 15912 log.cc:927] Time spent T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:19:29.378862  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:29.383324 15812 consensus_queue.cc:260] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.384859 15812 raft_consensus.cc:3060] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:29.385967 15834 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:29.387543 15742 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:29.388348 15799 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:29.320971 15910 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.394164 15394 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:29.389490 15436 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:29.395063 15910 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:29.365233 15481 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:29.400729  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 76610.7us
I20260709 13:19:29.402369  8223 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:29.404302 15881 raft_consensus.cc:2804] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:29.404874 15881 raft_consensus.cc:697] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:29.414525  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:29.415426  8103 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:29.415880  8179 raft_consensus.cc:2368] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 28. Current term is 29.
I20260709 13:19:29.389108 15610 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.419579  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:29.370409 15858 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.399235 15799 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:29.422663  8103 raft_consensus.cc:1240] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:29.425374 15394 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:29.431138  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:29.423229 15742 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:29.432602 15742 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.434273 15858 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:29.434638 15742 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:29.428870 15394 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.436997 15394 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:29.437932 15699 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:29.397517 15817 consensus_queue.cc:260] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.438781 15817 raft_consensus.cc:3060] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:29.442270 15861 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:29.443285  8099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49218 (request call id 1145) took 1103 ms. Trace:
I20260709 13:19:29.443658  8099 rpcz_store.cc:276] 0709 13:19:28.339765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.382246 (+ 42481us) service_pool.cc:224] Handling call
0709 13:19:29.443085 (+1060839us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b5400211bd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:29.443202 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7643520}
I20260709 13:19:29.405812 15881 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.450985  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:29.451617  8105 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 25.
I20260709 13:19:29.451740  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:29.453495 15699 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.454207 15477 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:29.454169 15699 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.454818 15477 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.458531  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:29.459131  8784 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:29.460258  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:29.462827  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:29.464450  8784 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 26: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:29.452709 15791 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.427423 15799 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.472946 15791 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:29.479446 15603 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:29.479920 15603 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:29.480767 15603 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.482221  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:29.529328  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:29.594059  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 252851us
I20260709 13:19:29.490911 15737 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:29.599411  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:29.595716 15742 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:29.572232 15930 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.603566  8257 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 16. (term mismatch)
I20260709 13:19:29.606496  8257 pending_rounds.cc:85] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 15
I20260709 13:19:29.606743  8257 pending_rounds.cc:107] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 26.16
I20260709 13:19:29.606957  8257 raft_consensus.cc:2889] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:29.607316  8249 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:19:29.570464 15812 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:19:29.570276 15426 consensus_queue.cc:1048] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:19:29.599233 15737 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.615520  8174 raft_consensus.cc:1240] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:29.604233 15910 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:29.606207 15742 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.609551 15603 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:29.609529 15481 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 29 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:29.622988  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:29.626432 15610 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:29.626677 15923 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:19:29.616190 15737 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:29.629724  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 1152) took 1262 ms. Trace:
I20260709 13:19:29.630120  8102 rpcz_store.cc:276] 0709 13:19:28.367439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.175234 (+807795us) service_pool.cc:224] Handling call
0709 13:19:29.193053 (+ 17819us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:29.215533 (+ 22480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.221937 (+  6404us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:29.230964 (+  9027us) log.cc:844] Serialized 26 byte log entry
0709 13:19:29.343637 (+112673us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:29.343664 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.343706 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:29.629499 (+285793us) raft_consensus.cc:1685] finished
0709 13:19:29.629517 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:29.629653 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34657,"raft.queue_time_us":19808,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":7149,"thread_start_us":86917,"threads_started":1,"wal-append.queue_time_us":178179}
I20260709 13:19:29.614166 15930 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.633615 15799 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:29.633773  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:29.623594 15742 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:29.634641  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:29.635687 15930 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:29.620631 15910 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.638170 15910 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:29.639878  8103 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 25.
I20260709 13:19:29.621440 15791 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:29.646848 15791 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.648963 15791 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:29.648376 15742 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.650241  8249 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 26. Current term is 27. Ops: [26.16-26.16]
I20260709 13:19:29.664284  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:19:29.667071  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:29.667572 15908 log.cc:927] Time spent T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.419s	user 0.007s	sys 0.000s
I20260709 13:19:29.669224  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2482) took 1347 ms. Trace:
I20260709 13:19:29.669688  8100 rpcz_store.cc:276] 0709 13:19:28.321342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.730647 (+409305us) service_pool.cc:224] Handling call
0709 13:19:28.731067 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.731429 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.731469 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:28.734482 (+  3013us) log.cc:844] Serialized 26 byte log entry
0709 13:19:29.036440 (+301958us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:29.036499 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.036591 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:29.666764 (+630173us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:29.668876 (+  2112us) raft_consensus.cc:1685] finished
0709 13:19:29.668902 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:29.669147 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21038,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":6168,"spinlock_wait_cycles":6332800,"thread_start_us":277452,"threads_started":1,"wal-append.queue_time_us":461026}
I20260709 13:19:29.671265  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 29 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:29.671892  8250 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:19:29.672170 15790 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:29.672983 15790 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.676553 15790 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:29.681495  8250 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 29.
I20260709 13:19:29.683115  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:29.684917 15936 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
I20260709 13:19:29.687798  8253 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:29.693121 15481 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:29.693500 15800 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:19:29.695262  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.695091  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:29.703734 15910 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.696074 15914 raft_consensus.cc:993] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: : Instructing follower a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:19:29.705660  8251 raft_consensus.cc:2368] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 25. Current term is 26.
I20260709 13:19:29.708551 15916 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.709805 15701 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:29.709139  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:29.719050 15933 raft_consensus.cc:1081] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Signalling peer a0f96c12124b4e1a816d9fa970464091 to start an election
I20260709 13:19:29.696388 15790 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:29.708618 15913 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.424s	user 0.000s	sys 0.001s
I20260709 13:19:29.719586 15807 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:29.727631 15928 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.710436 15701 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.728259 15800 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:19:29.727681 15921 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:19:29.734753  8149 leader_election.cc:400] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 25. Current term is 26.
I20260709 13:19:29.735067  8149 leader_election.cc:403] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:29.736443  8786 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:29.741542  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:29.742470  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:29.743753  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:29.733155 15701 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:29.750721  8072 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:29.753988  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:29.756350  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:29.757686  8072 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:29.759945  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:29.760782  8782 raft_consensus.cc:2393] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 21: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:29.764214 15880 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:29.764686 15880 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:29.765209 15880 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:29.759405  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:29.770848  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 44402.1us
W20260709 13:19:29.780151  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.754945 15791 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:29.709142 15916 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.762881 15610 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:29.727970 15807 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.758553 15799 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:29.739171 15790 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.758226 15898 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:29.758406 15921 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 29 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:29.728263 15928 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.781322 15881 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:29.811249  8786 raft_consensus.cc:2410] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 23 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 13:19:29.806058 15922 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:19:29.797749  8252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
 from {username='slave'} at 127.0.0.1:57566
I20260709 13:19:29.816987  8252 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:29.817394  8252 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:29.822273 15833 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.822799 15833 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.824786 15833 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:29.807037 15799 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:29.809587 15742 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:29.796123 15898 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.802374 15881 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.817014 15817 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.854674 15790 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:29.856685 15477 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:29.858839  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:29.860553  8178 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:29.862387  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:29.818297 15834 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:19:29.867496  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:29.851279 15921 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 27.13, Last appended by leader: 13, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.869949 15880 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.871178 15881 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:29.866840 15790 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:29.887068  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:29.848816 15799 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.862463 15817 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.885268 15807 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:29.889708 15790 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.871976 15954 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:29.900576  8253 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:29.894918 15917 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:29.904353 15799 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:29.904908 15917 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.907039 15917 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:29.900626 15790 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:29.912475 15928 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:29.911803 15947 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:19:29.908097 15916 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:29.921746  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:29.925666  8783 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:29.927790  8182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2499) took 1707 ms. Trace:
I20260709 13:19:29.928514 15737 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:29.929641 15935 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.303s	user 0.002s	sys 0.000s
I20260709 13:19:29.931032 15880 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:29.932937 15817 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:29.929579 15898 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:29.928171  8182 rpcz_store.cc:276] 0709 13:19:28.220798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.223830 (+  3032us) service_pool.cc:224] Handling call
0709 13:19:28.224136 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:29.325944 (+1101808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.927532 (+601588us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400329454. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:29.927735 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2527563648}
I20260709 13:19:29.945158 15922 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 25. Current term is 26.
I20260709 13:19:29.940932  8252 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.951520  8250 raft_consensus.cc:2393] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 26: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:29.912720 15954 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.956110  8252 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:29.971817 15807 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:29.972661 15807 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:29.975276  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.977140 15699 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:29.977958  8221 connection.cc:256] RPC call timeout handler was delayed by -1.3775057399998332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
I20260709 13:19:29.978212 15859 raft_consensus.cc:3055] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:29.978844  8107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 1149) took 1632 ms. Trace:
I20260709 13:19:29.979292  8107 rpcz_store.cc:276] 0709 13:19:28.346203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.048239 (+702036us) service_pool.cc:224] Handling call
0709 13:19:29.048572 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.977916 (+929344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.977946 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:29.977987 (+    41us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:19:29.978022 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.978612 (+   590us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b540040bad4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:29.978653 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:29.978785 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2136874368}
I20260709 13:19:29.979918 15955 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:29.980626 15955 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.981638  8101 raft_consensus.cc:1275] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:29.982151  8174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2505) took 1098 ms. Trace:
I20260709 13:19:29.982537  8174 rpcz_store.cc:276] 0709 13:19:28.884147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.885303 (+  1156us) service_pool.cc:224] Handling call
0709 13:19:28.885714 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.618148 (+732434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.981921 (+363773us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54003408d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:29.982094 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675168512}
I20260709 13:19:29.983027 15699 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:29.983592 15699 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:29.984257 15789 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:29.984779 15789 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.987067 15789 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:29.990818 15955 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:29.983803 15807 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:29.978688 15859 raft_consensus.cc:740] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:29.992841 15859 consensus_queue.cc:260] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:29.994019 15859 raft_consensus.cc:3060] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:29.995448  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:29.996093  8105 raft_consensus.cc:3060] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:29.985046 15383 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:29.978726  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.014700  8221 connection.cc:256] RPC call timeout handler was delayed by -1.0820864939998955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 13:19:30.015084  8221 connection.cc:256] RPC call timeout handler was delayed by -1.0062737529999595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
I20260709 13:19:30.000910  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:30.020051  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:30.020838  8104 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:30.024242  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.026064  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:30.034327  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 124561us
W20260709 13:19:30.037755  8755 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.040637  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:30.043092  8105 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:30.054991  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.057322  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:30.060420  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:30.062382  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:30.063107  8790 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:30.054865  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.067571  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:30.067842  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:30.068480  8787 raft_consensus.cc:2393] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 25: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:30.036597 15914 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:30.036913 15482 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.080281  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.066952 15916 raft_consensus.cc:2749] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:30.088469  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 29 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:30.089135  8101 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:19:30.076025 15914 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.096112  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:30.066977 15789 consensus_queue.cc:1048] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:19:30.099682  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.101078  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.103061  8253 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:30.103204  8105 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:30.103331  8104 raft_consensus.cc:2468] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 27.
I20260709 13:19:30.104341  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.104517  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:30.105182  8105 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:30.093372 15914 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:30.105366  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.112959  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.114032  8105 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 25.
I20260709 13:19:30.114857  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:30.115635  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.099956 15699 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:30.078771 15482 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:30.133687  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.134970  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:30.135550 15482 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:30.100946 15715 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:30.109402 15737 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:30.145816  8174 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:30.151068  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:30.152056 15789 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:30.154560  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:30.111599 15834 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:30.155988  8790 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 25.
I20260709 13:19:30.157466 15954 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:30.157528  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:30.159020  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.160413  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.161793  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:30.162675  8251 raft_consensus.cc:2368] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 28. Current term is 29.
I20260709 13:19:30.163584  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.165664 15790 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:30.166338  8786 raft_consensus.cc:1275] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:19:30.168022 15790 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:30.169339  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:30.170008  8107 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:30.171164  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.172420  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.173624  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:30.178681  8223 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:30.179638 15954 raft_consensus.cc:2804] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:30.179777  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:30.180522 15954 raft_consensus.cc:697] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:30.180550  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:30.180864  8223 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:30.181382  8182 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:30.181797  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:30.181627 15954 consensus_queue.cc:237] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.182816 15940 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:30.182992 15737 raft_consensus.cc:2804] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:30.183348 15940 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:30.183662 15737 raft_consensus.cc:697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 27 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:30.183893 15940 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:30.184648 15737 consensus_queue.cc:237] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.098758 15921 consensus_queue.cc:1048] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:19:30.118922 15927 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.132143 15810 consensus_queue.cc:1059] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:19:30.187842 15927 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.188321 15810 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:30.188727 15810 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:30.182785  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:30.189640 15810 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:30.190649 15921 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:30.191010 15810 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:30.191998 15861 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.192605 15861 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:30.190171 15927 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:30.185657 15955 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:30.204836 15955 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:30.205089 15956 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:30.205335 15955 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:30.205861  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.205731 15956 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:30.207113  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:30.208083  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:30.208221  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.208853 15956 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:30.133132  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:30.194109  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:30.118880  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.201018  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:30.210789  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 77764us
I20260709 13:19:30.222506  8107 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:30.222615  8221 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:30.208894  8249 raft_consensus.cc:2393] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 26: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:30.214116  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:30.217294  8105 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:30.225544  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:30.225901  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.215438  8101 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 29.
I20260709 13:19:30.223954  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:30.229140  8107 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:30.224134  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:30.179596  8072 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:30.226708  8105 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
W20260709 13:19:30.232823  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 53309.5us
I20260709 13:19:30.232937  8252 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 27.
I20260709 13:19:30.233703  8072 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:30.234766  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:30.209379  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.239174  8755 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:30.240360  8182 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 24.
I20260709 13:19:30.242127  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.243054  8104 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 27.
I20260709 13:19:30.244350  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.245945  8249 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:30.234920  8072 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:30.247394  8253 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:30.245223  8099 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:30.250694  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.212755 15950 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:30.255537  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.249084  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:30.213150 15956 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:30.259862  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:30.260543  8105 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:19:30.254514  8221 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:30.218981 15910 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:30.243224 15862 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:30.271930 15862 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:30.272410 15862 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:30.237308 15699 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:30.221052 15880 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:30.263619 15881 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:30.275475 15881 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:30.276899  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.252756 15893 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:30.252385 15916 raft_consensus.cc:2804] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:30.237303 15817 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:30.240156 15810 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:30.263866  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:30.258137  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:30.286684  8104 raft_consensus.cc:3060] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:30.258886  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:30.237999 15859 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:30.265928 15955 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.251986 15928 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 13:19:30.267616 15742 raft_consensus.cc:2804] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:30.295218 15742 raft_consensus.cc:697] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:30.296151 15742 consensus_queue.cc:237] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:30.269905  8221 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:30.302345 15950 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:30.243392 15789 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:30.244395 15790 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:30.309197 15866 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:30.311178 15866 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.311589 15866 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:30.276479 15881 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.278332 15893 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:30.313868  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.314730  8248 raft_consensus.cc:2393] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 21: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:30.314496 15893 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:30.309662 15916 raft_consensus.cc:697] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 22 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:30.316016  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.316515 15916 consensus_queue.cc:237] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:30.321156  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.259295 15956 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:30.322922 15956 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:30.326399 15914 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.336077  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2492) took 1440 ms. Trace:
W20260709 13:19:30.336503  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.337291  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.282604  8103 raft_consensus.cc:2368] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 25. Current term is 26.
I20260709 13:19:30.343393  8103 raft_consensus.cc:1240] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 26. Current term is 27. Ops: [26.16-26.16]
I20260709 13:19:30.262537  8254 raft_consensus.cc:1240] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:30.282006  8100 raft_consensus.cc:1275] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:19:30.274113 15880 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.288188  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.290887  8074 leader_election.cc:400] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 28. Current term is 29.
I20260709 13:19:30.347884  8074 leader_election.cc:403] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 election: Cancelling election due to peer responding with higher term
W20260709 13:19:30.348393  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 60854.4us
I20260709 13:19:30.290778  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:30.292296 15810 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:30.294495 15955 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:30.362941  8104 raft_consensus.cc:2468] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 24.
I20260709 13:19:30.338343  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.280838 15940 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.339407  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.340328  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3787) took 2541 ms. Trace:
I20260709 13:19:30.336545  8106 rpcz_store.cc:276] 0709 13:19:28.895980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.277260 (+381280us) service_pool.cc:224] Handling call
0709 13:19:29.444903 (+167643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:29.445254 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.445282 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:29.445854 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 13:19:29.574139 (+128285us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:29.574198 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.574291 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:29.929045 (+354754us) spinlock_profiling.cc:243] Waited 9.33 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:29.934142 (+  5097us) raft_consensus.cc:1685] finished
0709 13:19:29.934164 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.335892 (+401728us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400211bd0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4b8ad 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:30.336012 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2474,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"spinlock_wait_cycles":406126336,"thread_start_us":127867,"threads_started":1,"wal-append.queue_time_us":171895}
I20260709 13:19:30.349334  8074 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:30.349792  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:30.357185  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 66476.4us
I20260709 13:19:30.257331  8107 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:30.364200  8104 raft_consensus.cc:1240] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 18. Current term is 19. Ops: []
W20260709 13:19:30.365350  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.365556  8248 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:30.366248  8105 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:30.379720  8074 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:30.382611  8074 leader_election.cc:400] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 28. Current term is 29.
I20260709 13:19:30.367477  8249 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 27.
I20260709 13:19:30.386859  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:30.381502  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:30.390514  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:30.394906  8182 raft_consensus.cc:2368] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 24. Current term is 25.
I20260709 13:19:30.391106  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.391148  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:30.391091  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.396451  8180 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:30.398447  8250 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:30.356899 15810 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:30.401970  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.402844 15927 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:30.403502  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:30.365164 15911 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Leader election lost for term 28. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 28. Current term is 29.
I20260709 13:19:30.407979  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:30.367928  8255 rpcz_store.cc:276] 0709 13:19:27.798617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.798727 (+   110us) service_pool.cc:224] Handling call
0709 13:19:27.828792 (+ 30065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.369036 (+540244us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:28.398048 (+ 29012us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.728916 (+330868us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:28.728971 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:28.729025 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.734174 (+1005149us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b180038cc20. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd2d2a6 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419
0709 13:19:30.340080 (+605906us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b5400268c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:30.340138 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.340251 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3169,"prepare.queue_time_us":31008,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":4277,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":15910,"spinlock_wait_cycles":1243511424,"thread_start_us":233263,"threads_started":1,"wal-append.queue_time_us":518385,"wal-append.run_cpu_time_us":2127,"wal-append.run_wall_time_us":1317386}
I20260709 13:19:30.384734 15781 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:30.444460  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.445736  8149 leader_election.cc:400] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Vote denied by peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123) with higher term. Message: Invalid argument: T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 25. Current term is 26.
I20260709 13:19:30.370867 15928 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:30.448931  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:30.481537  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.485852  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.359190 15859 consensus_queue.cc:1059] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:19:30.383512 15790 raft_consensus.cc:2764] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
W20260709 13:19:30.477957  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.493739  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 44921.5us
W20260709 13:19:30.498461  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.391943 15834 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:30.393060 15699 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:30.510119  8179 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:30.420455 15810 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:30.513607  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.525388  8177 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 25.
I20260709 13:19:30.513972  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.512115  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.526499  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.527832  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:30.411823 15902 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:30.531361  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.532275  8179 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:30.450150 15898 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.532111  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:30.449766 15482 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:30.449975 15926 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:30.480127 15928 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:30.556592  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.403908 15715 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.117s
I20260709 13:19:30.565716  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.567816  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:30.560330 15929 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:30.524683 15742 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:30.523051 15911 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:30.597944  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.444255 15955 consensus_queue.cc:1059] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.113s
I20260709 13:19:30.582289  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:30.581629  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 200219us
I20260709 13:19:30.520552 15699 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:30.587231  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.524379 15950 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.557494 15916 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:30.494585 15927 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:30.559916 15701 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:30.604635  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:30.579202 15928 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:30.648723  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:30.524849 15834 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.654320  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.606081 15548 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:30.578676 15482 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.618371  8789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50464 (request call id 1395) took 2490 ms. Trace:
I20260709 13:19:30.573704 15898 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.609699 15742 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:30.612859 15950 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.638026 15880 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:30.678153  8105 raft_consensus.cc:1275] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:19:30.583269 15926 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:30.680611 15926 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:30.619429  8099 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:30.682497  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:30.683297  8175 raft_consensus.cc:3055] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:30.683683  8175 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:30.684579  8175 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.608754  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.697088  8179 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:30.608016 15699 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:30.614776  8755 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:30.661693  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.611687 15919 raft_consensus.cc:3055] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:30.608982 15914 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:30.705253  8176 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:30.610945 15916 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:30.705924 15916 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:30.672681 15898 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:30.673718 15742 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:30.675031  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.676169 15950 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:30.642138 15940 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:30.629480 15927 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:30.655311  8223 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:30.650108 15701 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:30.632349 15862 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:30.663375 15548 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.663048 15954 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:30.708789  8178 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:30.664934  8789 rpcz_store.cc:276] 0709 13:19:28.127771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.127889 (+   118us) service_pool.cc:224] Handling call
0709 13:19:28.128179 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.130301 (+  2122us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:19:28.151578 (+ 21277us) log.cc:844] Serialized 14 byte log entry
0709 13:19:28.257527 (+105949us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:28.320059 (+ 62532us) log.cc:844] Serialized 26 byte log entry
0709 13:19:28.320195 (+   136us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:28.320244 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.320315 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.617573 (+2297258us) spinlock_profiling.cc:243] Waited 89.3 ms on lock 0x7b2400343508. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dbe59c4 00007fa59dbe3acb 00007fa59dd9edc9 00007fa59dd9ea55 00007fa59dd9dfb0 00007fa5a0a14488 00007fa5a0a14be8 00007fa5a09ec398 00007fa5a09e776a 00007fa5a09e6bb6
0709 13:19:30.618043 (+   470us) raft_consensus.cc:1685] finished
0709 13:19:30.618150 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.618291 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5032,"prepare.queue_time_us":21745,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":3047,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":56661,"spinlock_wait_cycles":205412608,"thread_start_us":105427,"threads_started":1,"wal-append.queue_time_us":221035}
I20260709 13:19:30.698235  8175 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:30.670178 15956 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.705444 15919 raft_consensus.cc:740] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:19:30.720425  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 65210us
I20260709 13:19:30.732080  8223 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:30.735585  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:30.744503  8104 raft_consensus.cc:1240] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:30.724829 15950 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:30.728792 15548 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:30.743297 15910 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:30.749254  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:30.764822  8176 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:19:30.764945  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:30.765851  8179 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:30.767951  8175 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:30.773766 15910 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:30.774492 15819 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:30.774435 15910 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.777729 15910 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:30.780694 15898 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:30.781297 15898 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:30.783725 15898 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:30.790854  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:30.792354  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 260347us
I20260709 13:19:30.795548  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.796572  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.797986  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:30.804574  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:30.806015  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:30.809193  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:30.810051  8175 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:30.817080 15426 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:30.825883 15861 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:30.840600  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:30.846975  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:30.847476  8179 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:30.848147  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:30.849777  8100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.861752  8248 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:30.862972  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:30.851828  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 443907us
I20260709 13:19:30.858183  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:30.864495  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:30.849299 15798 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:30.828716 15926 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.873646  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:30.871110  8177 raft_consensus.cc:2468] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:30.862078  8100 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:30.877087  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:30.878088  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.879010  8175 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:19:30.876586  8254 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 29 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 27 index: 13. Preceding OpId from leader: term: 29 index: 14. (index mismatch)
I20260709 13:19:30.877032  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:30.887106  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:30.759871 15866 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.902346 15861 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:30.906860  8101 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:19:30.876484 15979 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:30.919262  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:30.869086 15911 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:30.874706 15870 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:30.873754 15940 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:30.923645  8252 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:30.910574  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:30.925072  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 310398us
I20260709 13:19:30.830129 15919 consensus_queue.cc:260] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.889890 15707 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:30.890437 15807 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:30.935801  8174 raft_consensus.cc:2368] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 27. Current term is 28.
I20260709 13:19:30.889406 15881 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:30.960638  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51653.8us
I20260709 13:19:30.958880  8101 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:30.933979 15870 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.896297 15926 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:30.946955 15789 raft_consensus.cc:2804] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:30.972790 15834 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:30.961966  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:30.952953  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:30.970582 15983 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:30.967227 15870 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:30.981660 15983 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:30.983794 15983 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:30.974118 15862 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:30.986148 15968 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.507s	user 0.004s	sys 0.001s
I20260709 13:19:30.987178 15926 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:30.987830 15701 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:30.970903  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:30.988782 15977 log.cc:927] Time spent T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:19:30.978317 15989 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:30.963296 15898 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:19:31.008633  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 55768.6us
I20260709 13:19:31.010015  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3827) took 1226 ms. Trace:
I20260709 13:19:30.975234  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:30.969045 15972 log.cc:927] Time spent T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:19:30.988703  8785 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:30.964033 15482 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:31.010445  8256 rpcz_store.cc:276] 0709 13:19:29.784011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.784134 (+   123us) service_pool.cc:224] Handling call
0709 13:19:29.791455 (+  7321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.010768 (+219313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.010808 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.019465 (+  8657us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.222121 (+202656us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:30.222157 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.222223 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.985589 (+763366us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:30.989452 (+  3863us) raft_consensus.cc:1685] finished
0709 13:19:30.989473 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.009934 (+ 20461us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1734,"raft.queue_time_us":16823,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3391,"spinlock_wait_cycles":37758720,"thread_start_us":322086,"threads_started":2,"wal-append.queue_time_us":321458}
W20260709 13:19:31.019794  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 44606us
I20260709 13:19:31.021399  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:31.039511  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3723) took 1040 ms. Trace:
I20260709 13:19:31.042136  8103 rpcz_store.cc:276] 0709 13:19:29.998941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.344169 (+345228us) service_pool.cc:224] Handling call
0709 13:19:30.344443 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.344871 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.344900 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.356522 (+ 11622us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.704998 (+348476us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:30.705059 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.707120 (+  2061us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.039283 (+332163us) raft_consensus.cc:1685] finished
0709 13:19:31.039303 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.039450 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2371,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":2850,"thread_start_us":313323,"threads_started":1,"wal-append.queue_time_us":425428}
I20260709 13:19:31.014760 15989 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 27 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:31.031466 15956 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:31.030164 15911 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:30.992113 15910 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.050985 15898 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:19:31.043630 15862 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:31.063179  8074 leader_election.cc:400] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 24. Current term is 25.
I20260709 13:19:31.065022  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:31.073287  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:31.049786 15789 raft_consensus.cc:697] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 24 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:31.076683  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:31.077379  8785 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:31.056095 15861 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:30.452311  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:31.114283 15989 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:31.117892 15982 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:19:31.121497 15861 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:31.123664 15861 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:31.124169 15861 raft_consensus.cc:2764] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 13:19:31.130059 15985 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
W20260709 13:19:31.131867 15975 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.434s	user 0.001s	sys 0.000s
I20260709 13:19:31.069715 15880 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:31.113082 15866 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 28 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:31.137418 15976 raft_consensus.cc:3055] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:31.167616  8102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2504) took 1176 ms. Trace:
I20260709 13:19:31.147145 15916 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:31.152331  8103 raft_consensus.cc:1275] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
W20260709 13:19:31.156972  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.157874  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:31.167733 15976 raft_consensus.cc:740] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:31.178346 15976 consensus_queue.cc:260] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:31.179519 15976 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:31.182955 15916 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:31.183909  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:31.184744  8789 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 24: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:19:31.163064 15810 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.000s
I20260709 13:19:31.185945 15810 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.187253  8255 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 25: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:19:31.187592 16000 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:19:31.167074  8257 raft_consensus.cc:1275] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:31.137887 15880 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:31.192118 15880 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:31.194839  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:31.147491  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:31.198735  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 51329.3us
I20260709 13:19:31.202597  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:31.203083  8754 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.207398  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:19:31.161114 15928 consensus_meta.cc:287] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.504s	user 0.003s	sys 0.005s
I20260709 13:19:31.049363 15999 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:31.227646  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:31.228471  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:31.222672  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:31.223376  8107 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:19:31.223845  8101 raft_consensus.cc:1240] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:31.230440  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:31.168299  8102 rpcz_store.cc:276] 0709 13:19:29.990740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.992527 (+  1787us) service_pool.cc:224] Handling call
0709 13:19:29.992875 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.993082 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:19:30.087753 (+ 94671us) log.cc:844] Serialized 14 byte log entry
0709 13:19:30.088899 (+  1146us) log.cc:844] Serialized 14 byte log entry
0709 13:19:31.166901 (+1078002us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b180026fa40. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dcd9c0a 00007fa5a7419219 00007fa5a0a02d70 00007fa5a09f6293 00007fa5a09ebcea 00007fa5a09ec23a 00007fa5a0e56a2a 00007fa5a0e660bf 00007fa5a0e66038
0709 13:19:31.167193 (+   292us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:31.167262 (+    69us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:31.167323 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.167408 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.167550 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1436,"prepare.queue_time_us":164692,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":63,"raft.queue_time_us":27575,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":6520,"spinlock_wait_cycles":2467072,"thread_start_us":94277,"threads_started":1}
I20260709 13:19:31.233321  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.235617  8255 raft_consensus.cc:1275] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:19:31.236997  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:31.238052  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:31.238991  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:31.242674  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:31.241508  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:31.249240  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3831) took 1248 ms. Trace:
I20260709 13:19:31.110809 15902 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:31.249814  8250 rpcz_store.cc:276] 0709 13:19:30.000732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.237210 (+236478us) service_pool.cc:224] Handling call
0709 13:19:30.237557 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.398943 (+161386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.248929 (+849986us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54002e9354. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:31.249166 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369468160}
I20260709 13:19:31.195916 15383 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.111732 15862 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 24 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:19:31.262070  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 57212.2us
I20260709 13:19:31.234839 15950 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:31.274914  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.280434  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:31.241889 15956 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:31.263830 15916 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:31.290205 15600 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.293134 15807 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.293321 15600 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:31.293884 15807 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:31.294835  8181 raft_consensus.cc:2410] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 13:19:31.295522 15862 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.247988 15999 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:31.292014  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.247871 15819 consensus_queue.cc:1048] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 13:19:31.301319  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:31.227504 15928 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.302603  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:31.308091  8174 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 24: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:31.299166 15789 consensus_queue.cc:237] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:31.309638  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 236411us
I20260709 13:19:31.243099 15940 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:19:31.264858 15951 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.043s
I20260709 13:19:31.311785  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:31.306357 16001 log.cc:927] Time spent T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:19:31.272250 15954 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:19:31.264412 15383 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.336555  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:31.325790 15916 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:31.334180  8251 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:31.323920 15902 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:31.339486  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.312732 15979 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:31.320055 15699 consensus_meta.cc:287] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.000s
I20260709 13:19:31.342603  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.344311  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:31.344627  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:31.346108  8788 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 24. Current term is 25. Ops: [24.18-24.18]
I20260709 13:19:31.372197  8791 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:19:31.301604 15956 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.365202  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:31.347234  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:31.368604  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:31.338546 15880 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.347677  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:31.338333 15715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.016s	sys 0.027s
I20260709 13:19:31.376982  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.339630 15951 consensus_queue.cc:1243] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer 9480609eccc44250a4d7fcc9686e76cf log is divergent from this leader: its last log entry 25.19 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
W20260709 13:19:31.381259  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 98191us
I20260709 13:19:31.345909 15911 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:31.377864  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:31.341886 15898 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:31.341732 15916 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:31.375902 15807 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:31.392159  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.405648  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:31.387852 15715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.016s	sys 0.027s
I20260709 13:19:31.389158 15790 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:31.373008 15699 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:31.377630 15902 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:19:31.389619 15910 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:31.394614 16005 log.cc:927] Time spent T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:19:31.377920 15742 consensus_queue.cc:1048] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.036s
W20260709 13:19:31.412218 15548 consensus_meta.cc:287] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.654s	user 0.012s	sys 0.001s
I20260709 13:19:31.387336 15880 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:31.452172 15548 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:31.453858 15880 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:31.454723 15880 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.413334 16004 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:31.455173 15548 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:31.407549 15426 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.443481  8108 raft_consensus.cc:1240] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:31.436264 15790 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:31.456395 15426 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.456885 15790 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:31.458808 15426 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:31.412683  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.455219 15880 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.430438 15921 consensus_queue.cc:1059] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.035s
I20260709 13:19:31.392284 16008 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:31.472724 15916 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:31.411476 15979 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.052s
I20260709 13:19:31.388962 15999 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:31.476229  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 103991us
I20260709 13:19:31.478739  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.480984  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:31.484687  8074 leader_election.cc:400] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 27. Current term is 28.
I20260709 13:19:31.489640  8221 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:31.488207  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.493342  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:31.477029 15997 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:31.486699 16002 log.cc:927] Time spent T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:19:31.486234 15784 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:31.511919  8254 raft_consensus.cc:1240] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:19:31.497915 15707 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:31.484872 15916 consensus_queue.cc:1048] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:19:31.500376 15928 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:31.548197 15784 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:31.556937  8181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 1068) took 3211 ms (client timeout 1573 ms). Trace:
W20260709 13:19:31.557690 16011 log.cc:927] Time spent T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:19:31.548235 16015 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:31.558634 16015 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:31.558998 16015 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:19:31.557471  8181 rpcz_store.cc:269] 0709 13:19:28.345346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.345618 (+   272us) service_pool.cc:224] Handling call
0709 13:19:31.556677 (+3211059us) spinlock_profiling.cc:243] Waited 2.85 s on lock 0x7b5400248bd4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:31.556827 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6556482432}
I20260709 13:19:31.562546  8104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2519) took 1462 ms. Trace:
I20260709 13:19:31.563242  8104 rpcz_store.cc:276] 0709 13:19:30.100422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.651832 (+551410us) service_pool.cc:224] Handling call
0709 13:19:30.652133 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.745066 (+ 92933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.562221 (+817155us) spinlock_profiling.cc:243] Waited 92.1 ms on lock 0x7b54003f3c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:31.562474 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211886848}
I20260709 13:19:31.567821 15810 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:31.570163 15919 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:31.576192 15600 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:31.579319  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3828) took 1755 ms. Trace:
I20260709 13:19:31.579895  8257 rpcz_store.cc:276] 0709 13:19:29.823856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.824109 (+   253us) service_pool.cc:224] Handling call
0709 13:19:29.824420 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.193476 (+1369056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.579072 (+385596us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54002af3d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:31.579256 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3087011072}
I20260709 13:19:31.581753 15699 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:31.583024 16016 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:31.583750 16016 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:31.584388 16016 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.502796 16013 consensus_queue.cc:1059] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.093s
I20260709 13:19:31.585803 15880 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:31.587821 15699 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
W20260709 13:19:31.610625 15870 consensus_meta.cc:287] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.000s
I20260709 13:19:31.611179 15870 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.612707  8252 raft_consensus.cc:2368] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 24. Current term is 25.
I20260709 13:19:31.627848  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:31.629343  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:31.630028  8106 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:31.631587  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:31.632170  8250 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:31.634204  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:31.634323  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:31.635054  8255 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:31.638105  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:31.638283  8257 raft_consensus.cc:1240] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:31.631484  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:31.642938  8100 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 27 index: 13. Preceding OpId from leader: term: 29 index: 14. (index mismatch)
I20260709 13:19:31.648424  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:31.650005  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:31.608174 15699 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.658123  8248 raft_consensus.cc:3055] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:31.658758  8248 raft_consensus.cc:740] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:31.659206  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:31.661625  8248 consensus_queue.cc:260] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:31.667032  8180 raft_consensus.cc:3055] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:19:31.667456  8180 raft_consensus.cc:740] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:31.673241  8250 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 28.
I20260709 13:19:31.668138  8180 consensus_queue.cc:260] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.659305 16019 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.677865  8180 raft_consensus.cc:3060] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:31.655045 15834 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:19:31.679500 15784 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:31.683951 15715 consensus_queue.cc:1059] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 25.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:31.679672 15873 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:19:31.684970 16010 raft_consensus.cc:3055] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:31.682371  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.669879 15866 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:31.685339 16010 raft_consensus.cc:740] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:31.685709 15866 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:31.685878 15922 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:31.686185 15866 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:31.686311 16010 consensus_queue.cc:260] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.11, Last appended by leader: 11, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.687640 16010 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:31.690819 15834 consensus_queue.cc:1059] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:31.678994 15719 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:19:31.691896 15834 raft_consensus.cc:3055] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:31.692565 15834 raft_consensus.cc:740] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:31.693190  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57566 (request call id 3841) took 1166 ms. Trace:
I20260709 13:19:31.693882 15834 consensus_queue.cc:260] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.694784  8108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 1155) took 1479 ms. Trace:
I20260709 13:19:31.695536 15834 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:31.696447 15790 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:31.693013 15922 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:31.671674 15898 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:31.695158  8108 rpcz_store.cc:276] 0709 13:19:30.215004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.700811 (+485807us) service_pool.cc:224] Handling call
0709 13:19:30.712200 (+ 11389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.456478 (+744278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.694577 (+238099us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b540022fe54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:31.694729 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1681231616}
I20260709 13:19:31.693709  8251 rpcz_store.cc:276] 0709 13:19:30.526739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.632470 (+105731us) service_pool.cc:224] Handling call
0709 13:19:30.632751 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.338578 (+705827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.692968 (+354390us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54001e6c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:31.693138 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1612543872}
I20260709 13:19:31.697574 15922 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:31.704926  8180 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 16. (term mismatch)
I20260709 13:19:31.705466  8180 pending_rounds.cc:85] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 15
I20260709 13:19:31.705976  8180 pending_rounds.cc:107] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 26.16
I20260709 13:19:31.708065  8102 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:31.706277  8180 raft_consensus.cc:2889] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:31.725927 16024 log.cc:927] Time spent T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:19:31.759325 15905 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 27 current term: 27 is higher.
I20260709 13:19:31.758775  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.762869 15715 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:31.763320 15715 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:31.763697 15715 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:31.764796 15383 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:31.765583  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 57437.5us
I20260709 13:19:31.770432  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:31.771622  8248 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:31.771678 15954 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:19:31.783231 15383 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:31.786187  8255 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:31.788239 15548 consensus_queue.cc:1048] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:31.788666 15719 consensus_queue.cc:1048] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:31.789685 15600 consensus_queue.cc:1048] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:31.790596 15915 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:31.791216 15915 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.793629 15915 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:31.799564  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:31.799970  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:31.709023 16022 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:19:31.801537  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:31.801690  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:31.722487 15699 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:31.713084 15996 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.405s	user 0.000s	sys 0.006s
I20260709 13:19:31.726820 16015 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.804629 16015 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:31.735575 16016 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:31.728915 15870 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:31.727823 15922 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.742713 15790 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:31.806281 15922 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:31.806582  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.683007 16019 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:31.811801 16019 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:31.721763  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:31.744215  8072 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:31.813215  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 69080us
I20260709 13:19:31.815088  8072 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.739015 15919 consensus_queue.cc:1059] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:31.721333  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.823558 15742 raft_consensus.cc:3055] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:31.823832  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:31.824004 15742 raft_consensus.cc:740] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:19:31.824134  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 102893us
I20260709 13:19:31.825094  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.826004 16004 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:31.825989  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 30 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:31.815368  8180 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 27. Current term is 28. Ops: []
I20260709 13:19:31.826838 16004 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:31.826962  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:31.828624  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:31.829231 16004 consensus_queue.cc:1059] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:19:31.830295 16004 raft_consensus.cc:3055] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:31.830591 16004 raft_consensus.cc:740] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:31.816511  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:31.831519  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:31.816440  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:31.817188  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:31.745609 15902 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.832453 15902 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:31.833040  8174 raft_consensus.cc:1240] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:31.834414  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:31.834831 15902 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:31.835116  8787 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:31.832455  8183 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 22: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:31.831388 16004 consensus_queue.cc:260] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:31.837685 16004 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:31.845536  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:31.846437  8182 raft_consensus.cc:2368] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22.
I20260709 13:19:31.849797  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:31.851122  8257 raft_consensus.cc:1240] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 27. Current term is 28. Ops: []
I20260709 13:19:31.851593  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:31.852183  8104 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:31.853363  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 30 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:31.854175  8106 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 29.
I20260709 13:19:31.855732  8755 leader_election.cc:400] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22.
I20260709 13:19:31.856206  8755 leader_election.cc:403] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:19:31.857447  8074 leader_election.cc:400] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 24. Current term is 25.
I20260709 13:19:31.857669  8101 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:19:31.857889  8074 leader_election.cc:403] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:31.853487  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:31.861876  8248 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
W20260709 13:19:31.862357  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 55640.7us
I20260709 13:19:31.864528  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:31.856819  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:31.897926  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:31.898803  8256 raft_consensus.cc:2368] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22.
I20260709 13:19:31.898557  8074 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:31.859393  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:31.900033  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:31.897926  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:31.902479  8102 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:19:31.902590  8249 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
W20260709 13:19:31.904701  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 49124.2us
I20260709 13:19:31.906536  8787 raft_consensus.cc:1275] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:19:31.901697  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:31.917001  8786 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 24. Current term is 25. Ops: [24.18-24.18]
I20260709 13:19:31.908706  8257 raft_consensus.cc:2468] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 25.
I20260709 13:19:31.924873  8099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:31.925611  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 62402us
I20260709 13:19:31.926069  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:31.926553  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:31.914129  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 100176us
I20260709 13:19:31.932384  8786 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:31.933745  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:31.936964  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:31.937181  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:31.938207  8250 raft_consensus.cc:2393] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 26: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:31.939976  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.942864  8108 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:31.947263  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.948225  8104 raft_consensus.cc:2468] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:31.898190 16015 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:31.859546 15911 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:31.858608 15930 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.857445 15989 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:31.960340  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:31.988315  8783 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:31.901114 16003 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:31.989733 16003 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:31.989754  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:31.936462 15954 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:19:31.990792 15954 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.991269 15954 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:19:31.904443 15383 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:31.982607  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:31.924294 15707 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:31.993221 15707 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:31.995859 15707 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:31.937870 15976 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:31.998238  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:31.936370 15861 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:19:31.949532 15915 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:31.898802 15699 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 13:19:31.956480 16020 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:31.957216 15834 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:31.949314 16026 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:31.957096 15880 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:31.960548 15862 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.936149 15807 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:19:31.936913 15902 consensus_queue.cc:1059] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:19:32.019968  8182 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:19:32.004225 15915 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.956712 15898 consensus_queue.cc:1059] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:19:31.951717 15910 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.062s
I20260709 13:19:31.999938 15951 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:31.959018 15603 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:19:31.825114 15742 consensus_queue.cc:260] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.000491 16015 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:31.955847 15866 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.046785 15866 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:31.965080 16019 consensus_queue.cc:1059] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:19:32.009793 16020 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.053610 16020 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:32.028774 16016 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:32.057767 16016 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.058902 15873 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:32.059801 16016 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:32.028251 15880 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.061489 15898 raft_consensus.cc:3055] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:19:32.061926 15898 raft_consensus.cc:740] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:32.062726 15898 consensus_queue.cc:260] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.063164 15880 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:32.063889 15898 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:32.032913 15915 raft_consensus.cc:3060] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:32.066033 16019 raft_consensus.cc:3055] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:32.066460 16019 raft_consensus.cc:740] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:32.067250 16019 consensus_queue.cc:260] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.068441 16019 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:32.024722 16036 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:32.044786 15999 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.998958 15930 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.049233  8108 raft_consensus.cc:1275] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:19:32.073115  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:32.095721  8183 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:32.072868  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:32.100636  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:32.101672 15902 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:32.102101 15902 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:32.071805 16015 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.102559 15902 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:32.030313 15862 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.120143  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:32.093214 16008 consensus_queue.cc:1175] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a0f96c12124b4e1a816d9fa970464091" responder_term: 28 status { last_received { term: 26 index: 15 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 27. Current term is 28. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:32.128883 15976 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22.
I20260709 13:19:32.130928  8147 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:32.134734 15921 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:32.135391 15921 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.135742 15989 raft_consensus.cc:3055] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:32.135833 15921 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:32.133227  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:32.136302 15989 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:32.131060 15862 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:32.143494 15930 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:32.147233 15921 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.148754 15915 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.151328 15915 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:32.154419 15921 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:32.070271 15951 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.162314 15951 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:32.163419 15954 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.165814 15954 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 30 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:32.115761 15999 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.170842 15999 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:32.171984  8791 raft_consensus.cc:2393] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 24: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:32.070540 15998 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.119s
I20260709 13:19:32.173655  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:32.174383 15997 consensus_queue.cc:1048] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:32.176259  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:32.176806  8788 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:32.179486 15715 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.181555 15715 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:32.137172 15989 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:32.183059 16040 log.cc:927] Time spent T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:19:32.195001  8788 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 26.
I20260709 13:19:32.195809  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:32.197539  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.216339  8183 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:32.113545 16015 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:32.199203  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:32.221309  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:32.207163  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 259973us
I20260709 13:19:32.177996 15861 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 24. Current term is 25.
I20260709 13:19:32.216755  8147 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:32.226048  8255 raft_consensus.cc:1240] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:19:32.227582  8256 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 30 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 29. Current term is 30. Ops: [29.14-29.14]
I20260709 13:19:32.140789 16020 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.238364  8149 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:32.240223  8108 raft_consensus.cc:1240] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 13:19:32.254459  8149 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:32.255409  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:32.246807 15798 raft_consensus.cc:2804] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:32.239816 16035 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:32.231204 15954 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:32.248859 15989 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:32.266425  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:32.270072  8108 raft_consensus.cc:2410] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:19:32.265591 15798 raft_consensus.cc:697] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:32.271311  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:32.259764 15930 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:32.277343  8784 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:32.258865 16037 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:19:32.258898 15915 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:19:32.265144 16035 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.278932  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:32.307405  8108 raft_consensus.cc:3060] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:32.337697  8103 raft_consensus.cc:2468] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:32.273180 15954 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.309269 16035 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:32.331676 16017 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.728s	user 0.002s	sys 0.010s
I20260709 13:19:32.352520 16016 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:32.353348 16004 consensus_meta.cc:287] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.004s
I20260709 13:19:32.387317  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:32.389922  8223 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:32.386655  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:32.392436  8788 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 22: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:19:32.393242  8074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.395155  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:32.391623  8783 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:32.391042  8108 raft_consensus.cc:2468] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 26.
I20260709 13:19:32.396561  8223 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:32.352506 15951 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:32.395979  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 113297us
I20260709 13:19:32.381222 16020 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:32.383092 15817 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:32.408424  8790 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:32.401127 15861 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:32.401958 15807 raft_consensus.cc:2804] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:32.405390 15919 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:32.394565 15910 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:19:32.380017 15798 consensus_queue.cc:237] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.410599  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:32.403620 15870 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:32.404398 15951 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.394819 16016 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.439513  8176 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:32.441258  8183 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:32.442715  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:32.443550  8182 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:32.444834  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:32.450057  8103 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 19: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:32.455866  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:32.456467  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:32.457401  8180 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:32.466323  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:32.445811  8101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:32.501863  8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:32.497674 16037 raft_consensus.cc:697] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:32.513903  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
W20260709 13:19:32.516047 16017 log.cc:927] Time spent T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:19:32.497498 15911 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:32.523085 15954 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:32.526055 15951 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:32.489733 15930 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
W20260709 13:19:32.529789  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 44261.6us
I20260709 13:19:32.499042 15862 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:32.432554 16020 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:32.544345  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:32.493393 16015 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.411710 15817 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.555445  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:32.556892  8103 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 25: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:32.556942  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 30 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf"
I20260709 13:19:32.558313  8149 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:32.558445  8108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:32.486466 15870 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.561574  8108 raft_consensus.cc:1240] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:32.542464 16048 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:32.565901  8108 raft_consensus.cc:1217] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 LEADER]: Deduplicated request from leader. Original: 23.17->[24.18-24.18]   Dedup: 24.18->[]
I20260709 13:19:32.568094  8108 raft_consensus.cc:1240] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 LEADER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 24. Current term is 25. Ops: [24.18-24.18]
I20260709 13:19:32.552546 15911 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.570580 15911 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:32.573439 16055 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:32.574065 15956 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:32.555940 15862 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.576318 15862 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:32.577723  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:32.577787 16037 consensus_queue.cc:237] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.578902 15742 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:32.583009 15817 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:32.587498  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:32.590610  8783 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:32.592137  8072 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:32.554016 16016 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:32.565560 15905 raft_consensus.cc:2804] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:32.616637  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:32.553834 15910 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
W20260709 13:19:32.607760 15898 consensus_meta.cc:287] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.538s	user 0.012s	sys 0.000s
W20260709 13:19:32.607556 16050 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.289s	user 0.001s	sys 0.002s
I20260709 13:19:32.613106 15699 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:32.558413 16020 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.563450 16015 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.565800 15902 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.564589 15951 consensus_queue.cc:1059] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.058s
I20260709 13:19:32.616060 15862 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:32.633384  8787 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:32.611126 15861 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:32.648802  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:32.652684 15862 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.655077 15862 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:32.658435 16020 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:32.627780 15905 raft_consensus.cc:697] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:32.625799 15807 raft_consensus.cc:697] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:32.666858  8107 raft_consensus.cc:1275] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:19:32.667388  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:32.603012 16048 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.670550 15870 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:32.671140 15902 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:32.671660 15905 consensus_queue.cc:237] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.633909 15699 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:32.674139 16048 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:32.674670 15699 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.679986  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:32.683683  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:32.681279 16059 log.cc:927] Time spent T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:32.684371 15807 consensus_queue.cc:237] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.696043  8072 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:32.698416 15902 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:32.699157 15902 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:32.701228  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:32.702420  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 30 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:32.703859 16015 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:32.666777 15956 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:32.702934 15902 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.704631 15956 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.628973 15930 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.706566 15956 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:32.707062  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:32.707247 15976 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:32.707698 15976 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.669348  8174 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 26.
W20260709 13:19:32.709384  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 74215.4us
I20260709 13:19:32.742636  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:32.743948  8250 raft_consensus.cc:2410] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:19:32.755702  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:32.762840  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.764377  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:32.738281 15676 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.774202  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:32.778237  8251 raft_consensus.cc:2393] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 25: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:19:32.770222 16019 consensus_meta.cc:287] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.701s	user 0.013s	sys 0.000s
I20260709 13:19:32.837642  8101 raft_consensus.cc:2410] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 25 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 12.
I20260709 13:19:32.744866 16035 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.822198 15707 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:32.851604  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 77283.3us
I20260709 13:19:32.839962 15715 consensus_queue.cc:1059] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:19:32.859807  8105 raft_consensus.cc:1240] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:19:32.806519 15676 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.848621 15997 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:32.874269  8254 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:32.838423 15482 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 13:19:32.850090 15998 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:32.857787 15976 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:32.883024  8174 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:32.859879 15548 consensus_queue.cc:1059] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:19:32.872413 16063 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 27.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:19:32.877184 16019 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.878855 15997 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.885871 15998 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.891224 15997 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:32.892452 15998 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:32.889756 16019 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:32.895908 16019 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:32.897058  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:32.897959 16065 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:32.898453  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:32.899610  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:32.900314 16020 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:32.900548  8103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:32.900693 16020 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:32.901146 16020 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:32.901211 15676 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:32.903172 15911 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:32.903895 15911 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:32.906989  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:32.908787  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:32.860239 15707 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:32.919800  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57556 (request call id 3303) took 1705 ms. Trace:
I20260709 13:19:32.923553  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:32.909305  8105 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:32.920367  8248 rpcz_store.cc:276] 0709 13:19:31.214282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.214444 (+   162us) service_pool.cc:224] Handling call
0709 13:19:31.242674 (+ 28230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.771388 (+528714us) spinlock_profiling.cc:243] Waited 9.3 ms on lock 0x7b58008753d0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0da80aa 00007fa5a0e2a447 00007fa5a0e42fe7 00007fa5a0e447de 00007fa5a0e4eb49 00007fa5a0e4f416 00007fa5a0e4bd8f 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4
0709 13:19:31.862238 (+ 90850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.919503 (+1057265us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b5400208d54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:32.919726 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976424832}
I20260709 13:19:32.935778  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:32.939987  8755 leader_election.cc:400] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22.
I20260709 13:19:32.944821  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:32.948791  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.950928  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:32.951717  8248 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 24.
I20260709 13:19:32.927188 16019 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:32.955694  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:32.921620 15986 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:32.957096  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:32.991958  8790 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:32.985366  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:32.995410  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:32.999912  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:32.998957  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:33.010771  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.013998  8105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:33.015599  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:32.991355 16048 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:33.000113 15548 consensus_queue.cc:1243] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:33.008812 15898 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.058460  8074 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:33.010569 16004 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:33.059609  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:33.018373 16035 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:33.071219  8221 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:33.066146  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:32.993223 15862 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.030s
I20260709 13:19:32.995067 15919 consensus_queue.cc:1048] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
I20260709 13:19:33.090371  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.092604  8256 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 21: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:19:33.092741  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 313199us
I20260709 13:19:33.066944 16067 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.089270 15911 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:33.081182 15910 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:33.139775 16067 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.140225 15910 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:33.140910 15910 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:33.142190 16067 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:33.000193 15986 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.143551 15707 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:33.144419 15998 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:33.144636 15986 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:33.145313  8783 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 20.
I20260709 13:19:33.137058 16020 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.146960 15999 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:33.147655 15999 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.148949 16020 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:33.150652 16068 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 13:19:33.160293  8106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 1169) took 1305 ms. Trace:
I20260709 13:19:33.170809  8181 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:19:33.175691  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.180123 15707 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.180858 15707 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.183516 15707 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:33.184270  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.186812  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:33.188097 15603 raft_consensus.cc:3055] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:33.188612 15603 raft_consensus.cc:740] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:33.188828 16020 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:33.189527  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.190407  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48110 (request call id 2193) took 1258 ms. Trace:
I20260709 13:19:33.190877  8784 rpcz_store.cc:276] 0709 13:19:31.932357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.933418 (+  1061us) service_pool.cc:224] Handling call
0709 13:19:33.190175 (+1256757us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400362c54. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:33.190306 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646179968}
I20260709 13:19:33.195317 15914 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:33.196075 15914 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.199251 15914 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:33.199402  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:33.202212  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.130388 15600 raft_consensus.cc:3055] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:33.069756 16004 raft_consensus.cc:493] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:33.134562 16074 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:19:33.226848  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:33.160835  8106 rpcz_store.cc:276] 0709 13:19:31.854771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.854918 (+   147us) service_pool.cc:224] Handling call
0709 13:19:31.855196 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.141663 (+286467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.141693 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:32.141734 (+    41us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:32.141764 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.159986 (+1018222us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b540036f1d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4ce01 00007fa5a0e4b83e 00007fa5a5e10419 00007fa59f387bd4 00007fa59f387b62 00007fa59f387a91 00007fa59f387a0c 00007fa59f386cc2 00007fa59f18748c 00007fa59f1868c6
0709 13:19:33.160051 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.160220 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":658218752}
I20260709 13:19:33.136672  8101 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:19:33.136979 16077 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
I20260709 13:19:33.079946 15898 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.142264 16044 raft_consensus.cc:3055] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:33.209141  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:33.233304  8254 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 21: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:33.177178  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.201040  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.224509 16004 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:33.240012  8102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:33.241859  8106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:33.247983  8106 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:33.260031 16066 raft_consensus.cc:476] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Not starting pre-election -- already a leader
I20260709 13:19:33.265549  8223 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:33.097290  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.225169 15989 raft_consensus.cc:2804] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:33.214968 15600 raft_consensus.cc:740] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:33.289090  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:33.294389  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:33.287250  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 61553.2us
I20260709 13:19:33.300935  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:33.202956 16048 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.310015  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:33.310907  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:33.305069  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:33.319219  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:33.319926  8183 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 23: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:33.316131  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:33.232728 16044 raft_consensus.cc:740] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:33.334779 16044 consensus_queue.cc:260] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.338665 15898 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:33.297806 16067 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:33.317613 16020 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:33.330933 15600 consensus_queue.cc:260] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.333292  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:33.333520 15956 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:33.347697  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:33.347867 15956 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:33.348569 15956 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:33.344091  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:33.349994 16071 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:19:33.331960 15817 raft_consensus.cc:3055] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:33.351102 15817 raft_consensus.cc:740] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:33.352025 15817 consensus_queue.cc:260] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.352603 15873 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.353134 16082 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.353314 15873 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.353801 16082 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:33.355738  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 57484.2us
I20260709 13:19:33.358726  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:33.359331  8177 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:33.362753 15989 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:33.363338 15989 raft_consensus.cc:3060] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:33.367735  8100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 3757) took 1134 ms. Trace:
I20260709 13:19:33.368213  8100 rpcz_store.cc:276] 0709 13:19:32.232986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.245482 (+ 12496us) service_pool.cc:224] Handling call
0709 13:19:32.245859 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.246255 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.246294 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:32.255018 (+  8724us) log.cc:844] Serialized 26 byte log entry
0709 13:19:32.911725 (+656707us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b1800289780. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:19:33.209235 (+297510us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:33.209275 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.213319 (+  4044us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.367371 (+154052us) raft_consensus.cc:1685] finished
0709 13:19:33.367396 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.367666 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":6055,"spinlock_wait_cycles":9417088,"thread_start_us":297317,"threads_started":1,"wal-append.queue_time_us":1062794}
I20260709 13:19:33.344455 15870 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:33.402257  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 80568.9us
W20260709 13:19:33.402402  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 54813us
I20260709 13:19:33.403694  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:33.405318  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:33.322402  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:33.406188  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:33.353184 15817 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:33.409263 16067 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 13:19:33.413686  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:33.413791  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 354272us
I20260709 13:19:33.414420  8177 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
I20260709 13:19:33.344710  8002 catalog_manager.cc:5697] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 13 to 19, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 19 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:33.417900  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:33.417675  8223 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:33.403652 16035 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:33.406778 16044 raft_consensus.cc:3060] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:33.421111  8104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9480609eccc44250a4d7fcc9686e76cf" is_pre_election: true
I20260709 13:19:33.406450 15956 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:33.412953 15870 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:33.236162 15603 consensus_queue.cc:260] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 13:19:33.427232  8104 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:33.447705  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:33.449012  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:33.421819 16035 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:33.444739 15979 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:33.451216 16035 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:19:33.421876 15930 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.040s	sys 0.052s
I20260709 13:19:33.434689  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:33.428548 15976 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:33.454144 15930 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.046s	sys 0.057s
I20260709 13:19:33.423718 15784 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:19:33.460827  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:33.466508  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:33.467432  8784 raft_consensus.cc:2368] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21.
I20260709 13:19:33.423920 15999 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:33.451422 15979 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.471374  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:33.421888 15742 consensus_queue.cc:1059] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:19:33.475778  8183 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:33.469951  8221 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:33.473358  8176 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 21.
I20260709 13:19:33.481973  8252 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
W20260709 13:19:33.483644  8149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.048s	sys 0.151s
W20260709 13:19:33.484360  8149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.049s	sys 0.151s
I20260709 13:19:33.485831  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:33.486649  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 619207us
I20260709 13:19:33.444726 15956 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.456224 15807 consensus_queue.cc:1059] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:19:33.459194 15976 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.491003  8074 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:33.505576  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:33.491387  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:33.491742  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:33.506425  8183 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 19.
I20260709 13:19:33.486646  8256 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 18.
I20260709 13:19:33.493172  8784 raft_consensus.cc:1275] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:19:33.494544  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:33.470630 15873 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:33.507874  8176 raft_consensus.cc:2393] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 22: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:33.510006  8181 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:19:33.496593  7002 tablet_server.cc:179] TabletServer@127.6.214.129:0 shutting down...
I20260709 13:19:33.510759  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:33.494680  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.512310 16034 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:33.512629 15862 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:33.512956 16034 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:33.514120 16034 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.518115 15707 raft_consensus.cc:3055] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:33.490669 15784 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:33.494626 16048 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:33.519531  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:33.519520  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:33.520352  8147 leader_election.cc:400] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21.
I20260709 13:19:33.521004  8248 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:33.531476  8147 leader_election.cc:403] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:33.535354  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:33.506796 16082 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:33.539744  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:33.520979 16016 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:33.526914 15707 raft_consensus.cc:740] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:33.534729 15784 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:33.535992 15915 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:33.536134 16019 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:33.542544 15862 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:19:33.546039 16090 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:19:33.550637 15784 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:33.556861 15862 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.575042 15862 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:33.578418  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:33.540805 16091 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.579344 16091 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.580163 16063 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:33.581982 15979 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:33.585938 15956 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:33.563232 15976 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:33.548871 16004 raft_consensus.cc:515] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.604390  8181 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:33.579660  8149 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:33.613605  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 73931.5us
I20260709 13:19:33.621950  8784 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:19:33.625358  8248 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
W20260709 13:19:33.630555  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 50966.7us
I20260709 13:19:33.632853  8149 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:33.633905  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:33.639434 16085 log.cc:927] Time spent T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.139s	user 0.006s	sys 0.000s
W20260709 13:19:33.646283 16088 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.164s	user 0.002s	sys 0.002s
I20260709 13:19:33.638140 15866 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:19:33.645120  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 216272us
I20260709 13:19:33.625694 15902 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:33.607798 16091 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:33.597240 16004 leader_election.cc:290] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:33.663530  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:33.643631 16056 log.cc:927] Time spent T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 1.108s	user 0.008s	sys 0.010s
I20260709 13:19:33.631657 15834 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21.
I20260709 13:19:33.675781  8252 raft_consensus.cc:1275] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:19:33.677862  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:33.678331  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.684717  8256 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 18.
I20260709 13:19:33.638265 15976 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:33.659696 16016 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.659569 16063 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:33.638850 16082 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:33.683228  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.698066  8254 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 26.
I20260709 13:19:33.665371 16020 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:33.639788 16019 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:33.670634  8253 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:19:33.646377 16010 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.050s
I20260709 13:19:33.639994 16037 consensus_queue.cc:1048] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 13:19:33.626910 15707 consensus_queue.cc:260] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.715802 15866 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:19:33.739109 16087 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.281s	user 0.005s	sys 0.000s
I20260709 13:19:33.738782 15866 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.742767 15898 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:33.743319 15898 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.743733 15898 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:33.743945 15921 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 13:19:33.744380 15921 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:33.705973 16066 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:33.705749 16082 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:33.767434  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.759464 15910 consensus_meta.cc:287] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.002s
I20260709 13:19:33.700094 15976 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.710752 16020 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.792097 16020 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:33.754590 15707 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:33.797737 16096 log.cc:927] Time spent T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:19:33.797967  8002 catalog_manager.cc:5697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 20 to 23, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 23 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:33.798900 15919 raft_consensus.cc:3055] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:19:33.799187 16099 log.cc:927] Time spent T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:19:33.799571 15919 raft_consensus.cc:740] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:33.799628  8002 catalog_manager.cc:5697] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:33.803359  8103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49218 (request call id 1174) took 1109 ms. Trace:
I20260709 13:19:33.802641  8002 catalog_manager.cc:5697] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 17 to 22, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 22 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:19:33.805693 16075 log.cc:927] Time spent T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.947s	user 0.004s	sys 0.000s
I20260709 13:19:33.751628 16063 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:33.713979 16019 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.712095 16016 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.745277 15921 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 29.14, Last appended by leader: 14, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.777132 16103 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.778714 15989 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.781834 16082 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:33.773747 15910 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.789561 15976 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:33.793095 16066 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:33.774860 16097 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:19:33.803783  8103 rpcz_store.cc:276] 0709 13:19:32.693643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.902455 (+208812us) service_pool.cc:224] Handling call
0709 13:19:32.902768 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:32.903077 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.903103 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:32.903619 (+   516us) log.cc:844] Serialized 52 byte log entry
0709 13:19:33.287279 (+383660us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:19:33.329664 (+ 42385us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.402917 (+ 73253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.403005 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.598748 (+195743us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:33.803055 (+204307us) raft_consensus.cc:1685] finished
0709 13:19:33.803155 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.803300 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74087,"prepare.queue_time_us":42454,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":78011,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":5625,"spinlock_wait_cycles":4566784,"thread_start_us":383287,"threads_started":1,"wal-append.queue_time_us":541527}
I20260709 13:19:33.820180  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 2555) took 1351 ms. Trace:
I20260709 13:19:33.838932  8175 rpcz_store.cc:276] 0709 13:19:32.468286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.703251 (+234965us) service_pool.cc:224] Handling call
0709 13:19:32.703512 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.703844 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:19:32.703872 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:32.704281 (+   409us) log.cc:844] Serialized 26 byte log entry
0709 13:19:32.799136 (+ 94855us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:32.799198 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.799301 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.697572 (+898271us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa5a09e786e 00007fa5a09e6bb6 00007fa5a09e67d8 00007fa5a09f0221 00007fa5a09f01d9 00007fa5a09f0169
0709 13:19:33.808459 (+110887us) raft_consensus.cc:1685] finished
0709 13:19:33.808493 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.820096 (+ 11603us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1723,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":8459648,"thread_start_us":94491,"threads_started":1,"wal-append.queue_time_us":152020}
I20260709 13:19:33.842773  8257 raft_consensus.cc:1240] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:33.838481 16036 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:33.843636 15910 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:33.822983  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 159547us
I20260709 13:19:33.848529  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:33.852802  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:33.816984 15784 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.849105 16020 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:33.772620 16034 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:19:33.862629  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 163360us
I20260709 13:19:33.863181  8787 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:19:33.871191  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 112398us
I20260709 13:19:33.877105  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:33.859603  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:33.801115 15919 consensus_queue.cc:260] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.836109 15921 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:19:33.892822  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.895072  8253 raft_consensus.cc:2393] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 25: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:33.863782 15989 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:33.865564 16004 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:33.862069 16091 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:33.901927  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.864312 16015 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:33.893790 16098 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:33.910831  8249 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 30 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 29. Current term is 30. Ops: [29.14-29.14]
I20260709 13:19:33.930441  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:33.920351  8251 raft_consensus.cc:1275] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:33.887010 15997 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:33.911397  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.929207  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:33.912774 15902 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:33.934413 15902 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.935472  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.936223  8251 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 20.
I20260709 13:19:33.938717  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.865098 15998 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:19:33.942045  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:33.943606  8783 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 19.
I20260709 13:19:33.930655 16098 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.897794 16034 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:33.905241 15919 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:33.893728 15742 consensus_queue.cc:1048] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
W20260709 13:19:33.948352  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 58392.3us
I20260709 13:19:33.949991  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:33.955818  8253 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:33.955854  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:33.899777 16035 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.959774  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.961082  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.962255  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.960862  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:33.964896  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.965694  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:33.947170 16098 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:33.942277 16015 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.947477 15979 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:19:34.001004  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:34.001397  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:33.992444 16092 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:33.949668 15862 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.007512  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a82de7cb524bf996a9df256baca3fd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:34.008476  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:34.008747  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.009703 16019 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.010715 15997 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:34.003744 15784 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.011183 15997 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:34.011617 15997 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:33.950809 16034 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.011837 16086 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:34.013684 16034 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.014882  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.018882 16015 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.019675 16121 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.020205 16121 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.009222  8221 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:33.941923 16063 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.833719 16103 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:33.843906 16036 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:33.990971 15930 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:34.027235  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:33.997021 15798 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:34.030172  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:34.032749 16035 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:33.839766 16066 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.035496  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.046522  8254 raft_consensus.cc:2393] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 26: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:34.035717  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.039175  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.047641  8256 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 30: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:33.990393 15548 consensus_queue.cc:1048] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:19:34.050303  8249 raft_consensus.cc:2393] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 21: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:19:34.043927  8149 consensus_peers.cc:597] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:34.052376  8149 consensus_peers.cc:597] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:34.036684 15898 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.055063 16034 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:34.055305 16066 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:34.055655 15898 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.055627 16034 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.030102 15989 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 13:19:34.038445 15798 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.057615 16112 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.058070 15798 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:34.058252 16112 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.060484 16112 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.034075 15930 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.061175 15930 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:34.061537 16034 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.029906 16113 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:34.065701  8253 raft_consensus.cc:2468] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 25.
W20260709 13:19:34.066151  8149 leader_election.cc:336] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:34.072582  8149 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:34.080317  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:34.082579  8149 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:34.079021 16113 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.084587 16113 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:34.086632 16103 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.076643  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.079835 15989 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.017s
I20260709 13:19:34.092752  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.075659  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:34.094246  8249 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:19:34.094513 15989 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:34.095033 15989 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.097054 15989 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.093376  8251 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 25.
I20260709 13:19:34.099083  8256 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:19:34.100461 16004 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:34.100647  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.090036  8254 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 25.
I20260709 13:19:34.065532 16035 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:34.102640 15862 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.100013  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:34.102931 16035 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:34.103881 16114 log.cc:927] Time spent T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:19:34.106484 15898 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:34.107031 15898 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.107487 15898 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:34.080811 16034 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:34.108434 16034 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:34.110072 16102 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 13:19:34.111660 16104 log.cc:927] Time spent T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:19:34.104635  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:34.115190 15989 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:34.116251 16034 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.118629 16034 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:34.119128 16034 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:34.119369 16083 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.636s	user 0.003s	sys 0.002s
I20260709 13:19:34.119484 16034 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:34.119481 16098 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.121765  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.122377 16036 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.104753 15798 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.124619 16016 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.067324 15873 consensus_queue.cc:1059] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.058s
I20260709 13:19:34.125063 16098 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:34.128804 15798 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.133602  8249 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 20.
I20260709 13:19:34.129458 15866 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.130263 16094 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:34.136767  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.137567  8254 raft_consensus.cc:2468] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 28.
I20260709 13:19:34.137916  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:34.129184  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.111246 16112 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:19:34.146126  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 63559.8us
I20260709 13:19:34.146783  8074 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:34.159085  8149 consensus_peers.cc:597] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:34.166388  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:34.163967  8149 consensus_peers.cc:597] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:34.172230  8149 leader_election.cc:336] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:34.180826  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.181587  8180 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 30.
I20260709 13:19:34.170742 16036 raft_consensus.cc:2804] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:19:34.124637 16121 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.115769 15989 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.164963 15862 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:34.170624 15911 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:19:34.186368  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 179216us
I20260709 13:19:34.177048  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.177754  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:34.178859  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.180483  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.189383  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.168872 16016 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:34.190352  8072 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:34.189381  8182 raft_consensus.cc:2368] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 26. Current term is 27.
I20260709 13:19:34.191946  8177 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:19:34.192458  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:34.185292  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:34.189481  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.192799  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:34.193591  8180 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:34.193814  8176 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 25.
I20260709 13:19:34.156071 16122 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:34.197751  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:34.182116  8149 consensus_peers.cc:597] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:34.196834  8755 leader_election.cc:304] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:34.196394  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:34.197045  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:34.197340  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:34.200049  8785 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 25.
I20260709 13:19:34.200448  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.200173  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:34.201857  8149 consensus_peers.cc:597] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:34.202396  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:34.203454  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:34.144218 16094 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.193476 15862 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.206566 16094 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.207012 15862 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.208381  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.209146  8178 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:34.208437 15989 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.198257 15902 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:34.201268 15997 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.215248 15986 raft_consensus.cc:2804] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:34.215835 15986 raft_consensus.cc:697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 25 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:34.216081 15997 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.201515 16016 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.216799 15986 consensus_queue.cc:237] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.219362 16016 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.201227 15911 raft_consensus.cc:697] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:34.220860 15911 consensus_queue.cc:237] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.184295 16036 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.215834  8180 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 27.
I20260709 13:19:34.231359  8176 raft_consensus.cc:1240] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:34.231647  8179 raft_consensus.cc:1240] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Rejecting Update request from peer a0f96c12124b4e1a816d9fa970464091 for earlier term 26. Current term is 27. Ops: [26.13-26.13]
I20260709 13:19:34.229772  8177 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:34.222347  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.234230  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.236229  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.233206  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:34.236498  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:34.236878  8251 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:34.236532  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:34.237874  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:34.238595  8254 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:34.242211  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.242556  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.244127  8072 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:34.241739  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.184255 16035 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:34.227547  8149 leader_election.cc:336] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:34.254581  8149 consensus_peers.cc:597] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:34.255283  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.256229  8249 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
W20260709 13:19:34.255300  8149 consensus_peers.cc:597] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:34.222072 15999 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:34.262737  8149 leader_election.cc:336] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:34.278857  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.260978  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:34.262442  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:34.274902  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
W20260709 13:19:34.281486  8149 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:34.282907  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:34.283212  8149 consensus_peers.cc:597] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:34.222383 16048 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:34.264174  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:34.237315 16036 raft_consensus.cc:3060] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:19:34.285619  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:34.287218  8254 raft_consensus.cc:2468] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 27.
I20260709 13:19:34.298274  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:34.327171  8177 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:34.279254 16035 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:34.336086  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.251564 16063 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:34.331660  8074 leader_election.cc:400] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 26. Current term is 27.
I20260709 13:19:34.330819 16019 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:19:34.225384 16034 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.272205 15910 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:34.302163  8149 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.284835 15902 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:34.291509 15861 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:34.260371 16016 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:34.347144  8074 leader_election.cc:403] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:34.290158 15956 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:34.324286 16112 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:19:34.352649 16063 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:34.361249  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.362115  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:34.324524 15986 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:34.332091 16004 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:34.301303 15976 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:34.328421 16091 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:34.364903  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:34.378585 15834 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:34.386929 15976 raft_consensus.cc:493] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:34.400027 16106 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:19:34.400641 16063 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.400938 15866 consensus_queue.cc:1048] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:34.403136 16070 consensus_queue.cc:1059] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:34.404201 16070 raft_consensus.cc:3055] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:34.404513  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:34.405284 16129 log.cc:927] Time spent T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:19:34.406138 16128 log.cc:927] Time spent T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:19:34.406051  8149 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:34.406720 15927 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:34.407146 15927 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.407495 15927 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:19:34.408149  8149 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 29 similar messages]
I20260709 13:19:34.409145  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.411321 15921 raft_consensus.cc:2804] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:34.404532 16070 raft_consensus.cc:740] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:34.411890 15921 raft_consensus.cc:697] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:34.412683 16070 consensus_queue.cc:260] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.412938 15921 consensus_queue.cc:237] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.11, Last appended by leader: 11, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.371294 16112 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:34.423115 16112 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:19:34.420584  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:34.420195  8790 raft_consensus.cc:1240] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:34.366437 15902 raft_consensus.cc:3060] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Advancing to term 27
W20260709 13:19:34.430200  8755 leader_election.cc:336] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:34.431722  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:34.433015  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.434532  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 69690.8us
I20260709 13:19:34.345803 16035 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:34.447676  8149 leader_election.cc:336] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:34.392927 15898 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:34.450224  8149 leader_election.cc:336] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:34.365756 15910 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.448165 16008 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:34.377768 15956 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.446187 16094 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:34.445930 16106 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:34.445784 16019 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:34.488775  8147 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:34.381934 16004 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.448932 15861 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:34.484869  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:34.479466 16008 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.485232  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:34.499226  8755 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:34.505131  8755 leader_election.cc:336] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:34.505213  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 49394.8us
I20260709 13:19:34.505666  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:34.506655  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:34.398212 16091 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.379516 15986 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:34.525792  8755 leader_election.cc:336] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:34.429991 15976 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:34.527961  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:34.531603  8074 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:34.530223  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:34.535444  8755 leader_election.cc:336] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:34.527230 16016 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:34.543617 16003 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:34.505757 16019 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.508479 15861 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.527029 15930 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:34.604475  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:34.550223 15911 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:34.593741 15989 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.618568  8182 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 20: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:34.599074 15898 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.598688 16106 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:34.621971 16111 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:34.633639 16113 consensus_meta.cc:287] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091: Time spent flushing consensus metadata: real 0.549s	user 0.006s	sys 0.007s
I20260709 13:19:34.634179 16113 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.635464  8249 raft_consensus.cc:2368] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 20. Current term is 21.
I20260709 13:19:34.637324 16113 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.636976 16106 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.638818 16091 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.630128 15911 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 27 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:19:34.641646 16131 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.270s	user 0.004s	sys 0.000s
I20260709 13:19:34.641286 15911 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.643327 15930 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.644563  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:34.616501 16034 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.626406 15989 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.645408  8788 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:34.640093 16106 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.656641  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:34.670198  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:34.672063  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:34.673897  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:34.678407  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 146950us
W20260709 13:19:34.660738  8149 consensus_peers.cc:597] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:34.692077  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 238858us
I20260709 13:19:34.698730  8074 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:34.704155  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:34.705343  8250 raft_consensus.cc:2393] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 20: Already voted for candidate 9480609eccc44250a4d7fcc9686e76cf in this term.
I20260709 13:19:34.647123 16035 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.647579 16004 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:34.702701  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:34.660174 16111 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:34.654471 15834 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:34.648036 16008 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.654024 15910 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:34.654371 15956 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:34.667037 16034 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
W20260709 13:19:34.725114  8149 leader_election.cc:336] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:34.656311 15989 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:34.757113  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 268411us
I20260709 13:19:34.661970 16019 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.754639  8177 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:19:34.700523 16106 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:34.756044  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.677450 16036 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.756907  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:34.653147 16112 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.752625 16113 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:19:34.787798  8755 leader_election.cc:336] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:34.775473  8788 raft_consensus.cc:2468] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
W20260709 13:19:34.786675  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 63157.2us
W20260709 13:19:34.784082 15870 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.028s	user 0.016s	sys 0.009s
I20260709 13:19:34.771901 15989 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:34.796734  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.799363 15986 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:34.784907 16004 consensus_queue.cc:1059] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 13:19:34.769726 16034 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:34.815441  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 112868us
I20260709 13:19:34.771684 16019 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:34.751430 16111 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.814371  8785 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 25 LEADER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 24. Current term is 25. Ops: []
W20260709 13:19:34.805722 16130 log.cc:927] Time spent T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:19:34.798731 15870 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.016s	sys 0.010s
I20260709 13:19:34.794059 16003 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:19:34.818696  8755 leader_election.cc:336] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:34.821201  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:34.795012  8149 consensus_peers.cc:597] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:34.822546  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.819876 16137 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:19:34.834784  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:34.839771  8786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:34.841447  8256 raft_consensus.cc:1240] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:34.795710 16113 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:34.843799  8148 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.845708 16111 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.824396 15861 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.810835 15927 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.820359 16016 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:34.823438 16048 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:34.841567 16091 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:34.871518 16138 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:19:34.847244 16106 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:34.875530  8791 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48110 (request call id 2232) took 1063 ms. Trace:
I20260709 13:19:34.827271 16019 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.864005 16035 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:34.877305  8791 rpcz_store.cc:276] 0709 13:19:33.811762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.813308 (+  1546us) service_pool.cc:224] Handling call
0709 13:19:33.813733 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.820745 (+  7012us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:19:33.820793 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:33.821384 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.415527 (+594143us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b180024f280. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b 00007fa5a09ebd23 00007fa5a09ec0d1 00007fa5a0e07a0f
0709 13:19:34.504642 (+ 89115us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:34.504683 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.504757 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:34.875171 (+370414us) raft_consensus.cc:1685] finished
0709 13:19:34.875192 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:34.875456 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6597,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":8767,"spinlock_wait_cycles":4645120,"thread_start_us":88928,"threads_started":1,"wal-append.queue_time_us":781007}
W20260709 13:19:34.873731  8755 leader_election.cc:336] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:34.884500  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:34.866762 15861 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.892586  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:34.893386  8183 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 26: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:34.893620 15930 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:34.893862  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.894320  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.894572  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.895444  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:34.895584  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.896005  8177 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:34.905167  8180 raft_consensus.cc:3055] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:34.905604  8180 raft_consensus.cc:740] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:34.905758  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.906302  8180 consensus_queue.cc:260] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.907212  8180 raft_consensus.cc:3060] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:34.909494  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.910413  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.872992 15989 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:34.919345  8180 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 18. (term mismatch)
I20260709 13:19:34.921685  8180 pending_rounds.cc:85] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Aborting all ops after (but not including) 17
I20260709 13:19:34.922453  8180 pending_rounds.cc:107] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: Aborting uncommitted NO_OP operation due to leader change: 24.18
I20260709 13:19:34.888988 16091 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:34.941900 16019 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.943836 16113 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.944447 16070 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:34.944718 16112 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 30 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.910295 15861 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.946058 16034 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.948954  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:34.951284 16106 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:34.951876 16106 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.955986 16106 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:34.956804 16127 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.466s	user 0.002s	sys 0.000s
I20260709 13:19:34.918614 15989 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.915688 15902 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389) with higher term. Message: Invalid argument: T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for earlier term 26. Current term is 27.
W20260709 13:19:34.961503 16135 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.374s	user 0.002s	sys 0.000s
I20260709 13:19:34.912686 15930 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:34.963109  8177 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 26.
I20260709 13:19:34.964862 15930 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.967048 15861 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.923909  8180 raft_consensus.cc:2889] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:34.926381 16145 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:19:34.929273 15927 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.899042 16035 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:34.934474 16134 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.476s	user 0.003s	sys 0.000s
W20260709 13:19:34.935786 16133 log.cc:927] Time spent T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.533s	user 0.002s	sys 0.000s
I20260709 13:19:34.920300 15676 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:34.967092 15600 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:34.938535 16144 log.cc:927] Time spent T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:19:34.940456 16036 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 29 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:34.972983  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:34.973464  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:34.979655 15676 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:34.974591  8182 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:19:34.980923  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:34.976670  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.975216  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:34.976794  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:34.971889  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:34.988440  8784 raft_consensus.cc:2393] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 21: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:34.987950  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:34.974012  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:34.991561  8074 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:34.969769 15986 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:34.981479 16034 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.969393 15989 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:34.990554 15902 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:34.998581  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:35.022716  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:35.023272  8223 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:35.064350  8177 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 30.
I20260709 13:19:34.977496 15976 raft_consensus.cc:515] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:35.092939  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 70320.7us
I20260709 13:19:34.995193 16036 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:35.048079  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:34.980918 16094 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.038s
I20260709 13:19:34.996168 15986 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:19:35.096001  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 48007.2us
I20260709 13:19:34.997972 16019 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:35.097014  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:35.094333  8074 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:35.107370  8074 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:35.042297 15898 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:35.099582 16115 log.cc:927] Time spent T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:19:35.116253  8782 raft_consensus.cc:1240] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:35.084780 15603 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:35.077212 15902 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:35.115885  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:35.091224 16146 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:35.095579 16111 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:35.096236 16112 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.129050 15898 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:19:35.129684 15898 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 30 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:35.130657 15898 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 29.14, Last appended by leader: 14, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:35.131989 15676 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:35.114002 16153 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.132781 16153 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.133519 15976 leader_election.cc:290] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:35.134618  8146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.125841  8177 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:19:35.135438  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:35.103879 16066 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:35.110956 15989 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:35.018743 16034 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.111634 15910 raft_consensus.cc:2764] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:19:35.118443 16019 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:35.113683 16016 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 13:19:35.140431 16139 log.cc:927] Time spent T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:35.148986 15989 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 26 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:35.137799 16112 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:35.147243 16106 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:19:35.188192 16153 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:35.172216 16117 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.004s	sys 0.032s
W20260709 13:19:35.191519 16117 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.004s	sys 0.033s
I20260709 13:19:35.194921 16034 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:35.197386 16112 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:35.228813  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 318522us
W20260709 13:19:35.232961  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 127620us
I20260709 13:19:35.174372 15902 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.246084 16106 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:35.247354 16106 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:35.183936 15989 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:35.280179  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:35.281755  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:35.281317  8784 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
W20260709 13:19:35.297842  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 64487.3us
W20260709 13:19:35.311617  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 51134us
I20260709 13:19:35.312863  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:35.315141 16162 consensus_queue.cc:1059] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:35.315845 16094 raft_consensus.cc:2749] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:35.316231 16125 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:35.317564 16125 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.320899 16125 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:35.322815 16066 raft_consensus.cc:3055] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:19:35.323393 16066 raft_consensus.cc:740] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:35.326905 16048 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:35.327832  8255 raft_consensus.cc:1275] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 25 index: 11. Preceding OpId from leader: term: 27 index: 12. (index mismatch)
I20260709 13:19:35.327783 16048 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.331619  8755 leader_election.cc:400] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 20. Current term is 21.
I20260709 13:19:35.333014 15986 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.335985  8755 leader_election.cc:403] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:19:35.335243 16048 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:35.325049 16066 consensus_queue.cc:260] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:35.379172 16143 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.380106 16143 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:35.381587 16159 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:35.382515 16159 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:35.383863 16064 consensus_queue.cc:1059] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:35.386461 16086 raft_consensus.cc:3055] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:35.386803 16159 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:35.386897 16086 raft_consensus.cc:740] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:35.388649 16086 consensus_queue.cc:260] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.390496 16086 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:35.393596 16143 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:35.395812 15986 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:35.400918  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.401595 16035 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:35.402586  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:35.403550  8250 raft_consensus.cc:3060] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:35.410326  8002 catalog_manager.cc:5697] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:35.414474 16066 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:35.369259 16106 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:35.368240 16048 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f for earlier term 20. Current term is 21.
I20260709 13:19:35.412580  8002 catalog_manager.cc:5697] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 17 to 21, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 21 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:19:35.426668  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 96596us
I20260709 13:19:35.434788 16125 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:35.435591 15870 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.435858 16125 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.436538 15870 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:35.443706 16113 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:35.450901  8248 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Rejecting Update request from peer 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:35.452445  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:35.453781  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 83078.3us
I20260709 13:19:35.462206  8223 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:35.470103  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.483119  8250 raft_consensus.cc:2468] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 26.
I20260709 13:19:35.485911 15910 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.486769 15910 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:35.478364 15870 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:35.503124 16170 raft_consensus.cc:2749] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:35.499529  8253 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:35.508428  8178 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:19:35.509510  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:35.515933 16121 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:35.516777  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:35.516741 16121 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:35.518419  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:35.519296 16121 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:35.495172 15910 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:35.519690  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:35.521036  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:35.522881  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:35.522689  8002 catalog_manager.cc:5697] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 20 to 22, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 22 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:35.526968 15898 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:35.528211  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:35.530838  8253 raft_consensus.cc:1240] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:35.532614  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:35.533324  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.535795 16158 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:35.535990  7999 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39814 (request call id 281) took 85424 ms (client timeout 15000 ms). Trace:
I20260709 13:19:35.537539 16113 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.538244 16125 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:35.538589  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.539887  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:35.547461  8179 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:35.555495  8250 raft_consensus.cc:2393] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 26: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:35.525296  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:35.558588 16158 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.554778  8255 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 25.
I20260709 13:19:35.565111  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:35.565584  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:35.560154 16113 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:35.574366  8072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 46477.9us
I20260709 13:19:35.567198  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.576387  8254 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:35.566377 16094 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:35.587335  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.595818 16105 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:35.596693 16105 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:35.600389 16105 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:35.601972  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:35.602857  8253 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 30: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:35.603513  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:35.591686 15902 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:35.606555 15902 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.607059 15902 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:35.609480  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.564836 15898 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:35.612172  8753 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.612782  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:35.619181  8074 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:35.625735  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.592185  8002 catalog_manager.cc:5697] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 18 to 19, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 19 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:35.628742  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 107901us
I20260709 13:19:35.595830 15873 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:35.634567  8149 consensus_peers.cc:597] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:35.635250  8149 leader_election.cc:336] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:35.635747 16168 log.cc:927] Time spent T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.202s	user 0.003s	sys 0.000s
I20260709 13:19:35.635681  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:35.644891  8221 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:35.645685 15861 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:35.647782  8255 raft_consensus.cc:1275] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:19:35.647855 16158 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:35.648823  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.634578 15873 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:35.650350  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:35.652539 16125 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:35.653012 16125 raft_consensus.cc:493] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:35.654841 16125 raft_consensus.cc:3060] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:35.658111  8174 raft_consensus.cc:2410] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
W20260709 13:19:35.660068  8174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46060 (request call id 2570) took 2338 ms (client timeout 2421 ms). Trace:
W20260709 13:19:35.660475  8174 rpcz_store.cc:269] 0709 13:19:33.321959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.322155 (+   196us) service_pool.cc:224] Handling call
0709 13:19:35.659806 (+2337651us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b5400331654. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:35.659975 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5163489152}
I20260709 13:19:35.662117 16113 raft_consensus.cc:2804] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:35.662701 16113 raft_consensus.cc:697] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:35.664814 16158 consensus_queue.cc:1048] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:35.664026 16113 consensus_queue.cc:237] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:35.670406 15600 consensus_meta.cc:287] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.574s	user 0.021s	sys 0.014s
I20260709 13:19:35.686452  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:35.699987 16125 raft_consensus.cc:515] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.703063  8250 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:19:35.704924 15898 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:35.707701  8149 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:35.708434 16010 consensus_queue.cc:1059] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:19:35.693262  8755 leader_election.cc:336] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:35.712576  8179 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:19:35.682461  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:35.730105  8784 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:35.721789  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:35.740662  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:35.734247  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.741007  8248 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:19:35.744068  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.753898 16125 leader_election.cc:290] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:35.711144 16094 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.757591 16117 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:35.757781  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:35.758575  8178 raft_consensus.cc:2468] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:35.759654  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:35.760316 16091 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.760805  8175 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:35.760949 16091 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.762363  8175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37206 (request call id 1095) took 1761 ms. Trace:
I20260709 13:19:35.762789  8175 rpcz_store.cc:276] 0709 13:19:34.000558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.001183 (+   625us) service_pool.cc:224] Handling call
0709 13:19:35.762115 (+1760932us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b5400014354. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e502fa 00007fa5a5e11b17 00007fa59f38c6d4 00007fa59f38c662 00007fa59f38c591 00007fa59f38c50c 00007fa59f38b7c2 00007fa59f18748c 00007fa59f1868c6 00007fa59f18626f
0709 13:19:35.762269 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3998029056}
I20260709 13:19:35.763563 16091 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:35.743710 15898 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.764087  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:35.764490 15898 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:35.767114 15866 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:35.767577 15866 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:35.767702 15898 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:35.773360  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 65850.5us
I20260709 13:19:35.773469  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05ca9fb2b7a4b46851675643729339f" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:35.753319  8002 catalog_manager.cc:5697] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 18 to 19, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 19 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:35.774354 16121 raft_consensus.cc:2804] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:35.781062  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.775882  8783 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:35.751468  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.790980 15914 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.791571 15914 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.786934  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:35.795457  8251 raft_consensus.cc:2393] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 22: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:35.798640  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.800073 15873 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:35.797261  8174 raft_consensus.cc:2468] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:35.795941  8250 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:35.795255  8147 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:35.757225 16094 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:35.797379  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.768755 15866 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.808944  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:35.813616  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.814507  8249 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:35.811133  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.816329  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.788249 16159 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:35.818289  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.800745  8002 catalog_manager.cc:5697] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 12 to 16, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 16 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:35.826013  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:35.830510  8177 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:35.833478  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:35.822147  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.838891  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.838313  8251 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:35.850564  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.807312 16091 consensus_queue.cc:1048] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 13:19:35.853606  8254 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 26.
I20260709 13:19:35.854986  8253 raft_consensus.cc:2410] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:19:35.855208  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.860603  8248 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 23: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:19:35.879522  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 88886.4us
I20260709 13:19:35.879599 15914 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:35.881318 15914 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:35.881773 15914 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.882159 15914 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:35.883803  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:35.884634  8782 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:35.885183  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f32037b7b54a0c991d35bbea1b786b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:35.886062  8256 raft_consensus.cc:2393] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 23: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:35.889693 16105 consensus_queue.cc:1059] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:35.890728 16105 raft_consensus.cc:3055] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:35.891083 16105 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:19:35.894151  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 65092.8us
I20260709 13:19:35.898784  8175 raft_consensus.cc:2468] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:35.892055 16105 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:35.906324  8002 catalog_manager.cc:5697] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 14 to 17, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 17 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:35.908670 15873 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:35.909401 15873 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:35.911990 15873 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:35.848404 16121 raft_consensus.cc:697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:35.908725  8002 catalog_manager.cc:5697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 18 to 22, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 22 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:35.914585  8147 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:35.893846 16086 consensus_meta.cc:287] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.003s
W20260709 13:19:35.914175  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 81893.6us
I20260709 13:19:35.922596 16110 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:35.923446 16110 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:35.926862  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:35.929487  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:35.935230  8002 catalog_manager.cc:5697] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:35.946028  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:35.922645 15866 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:35.953451  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:35.944595  8002 catalog_manager.cc:5697] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 20 to 21, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 21 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:35.947333 16010 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:35.952512 16105 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:35.971232 15790 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:35.976732  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 57812.8us
I20260709 13:19:35.980849 16117 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:35.981539 15603 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:35.981740 16070 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:35.962044 16113 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:35.956990  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:36.001809  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:35.935339 16159 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:36.008041  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 51138.4us
I20260709 13:19:35.963382 15986 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:36.000942  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:35.966914 16106 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:19:35.988413 16010 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.017217  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:36.019060  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:36.019263  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:36.019878 16070 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.022136 16110 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:36.022397 15603 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.016628  8002 catalog_manager.cc:5697] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:36.035548  8256 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:19:36.037720  8249 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:36.038162  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:36.040294  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.030737 16010 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:36.045589 15910 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:36.046166 15910 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.047086 16113 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.049826  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:36.049708 16121 consensus_queue.cc:237] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:35.549703  7999 rpcz_store.cc:269] 0709 13:18:10.111506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.184820 (+ 73314us) service_pool.cc:224] Handling call
0709 13:19:35.535659 (+85350839us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:26.602405 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:26.823320 (+220915us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:26.844278 (+ 20958us) write_op.cc:435] Acquired schema lock
0709 13:19:26.871470 (+ 27192us) tablet.cc:662] Decoding operations
0709 13:19:27.001823 (+130353us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:27.001914 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:27.001953 (+    39us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:19:27.002416 (+   463us) tablet.cc:701] Row locks acquired
0709 13:19:27.002467 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:19:27.002661 (+   194us) write_op.cc:270] Start()
0709 13:19:27.002828 (+   167us) write_op.cc:276] Timestamp: P: 1783603167002588 usec, L: 0
0709 13:19:27.002869 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:19:27.003718 (+   849us) log.cc:844] Serialized 1317 byte log entry
0709 13:19:27.412467 (+408749us) spinlock_profiling.cc:243] Waited 80.3 ms on lock 0x7b4400022b4c. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dc85c85 00007fa59dc866a2 00007fa5a09f81db 00007fa5a09f3aaf 00007fa59dd420ac 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5ec02 00007fa5a09e620b
0709 13:19:27.899567 (+487100us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b180036e1a0. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd5f3f3 00007fa59dd617c1 00007fa59dd61779 00007fa59dd61709 00007fa59dd616d1 00007fa59dd609cd 000000000038f354 000000000038f199 00007fa59dd4283a
0709 13:19:28.349566 (+449999us) op_driver.cc:464] REPLICATION: finished
0709 13:19:29.036736 (+687170us) write_op.cc:301] APPLY: starting
0709 13:19:29.053145 (+ 16409us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:29.403193 (+350048us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:29.403240 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:29.423021 (+ 19781us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:29.448654 (+ 25633us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:19:29.448714 (+    60us) write_op.cc:312] APPLY: finished
0709 13:19:29.449012 (+   298us) log.cc:844] Serialized 41 byte log entry
0709 13:19:29.603876 (+154864us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:29.606251 (+  2375us) write_op.cc:454] Released schema lock
0709 13:19:29.615275 (+  9024us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:29.696702 (+ 81427us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:29.697169 (+   467us) write_op.cc:454] Released schema lock
0709 13:19:30.270347 (+573178us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b540006a9d4. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a0db5571 00007fa5a0e4932a 00007fa5a0dcef14 00007fa5a0dceec3 00007fa5a0dcee38 00007fa5a0dcedf3 00007fa5a0dce0dc 00007fa5a0df7e16 00007fa5a0ddfcbb 00007fa5a0dca39d 00007fa5a0dcdd75
Metrics: {"mutex_wait_us":639889,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":549058,"apply.run_cpu_time_us":18039,"apply.run_wall_time_us":666310,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16661,"num_ops":3,"prepare.queue_time_us":840772,"prepare.run_cpu_time_us":22359,"prepare.run_wall_time_us":973557,"raft.queue_time_us":214727,"raft.run_cpu_time_us":49213,"raft.run_wall_time_us":1984411,"replication_time_us":1317708,"spinlock_wait_cycles":302128640,"thread_start_us":1750875,"threads_started":5,"wal-append.queue_time_us":790008,"wal-append.run_cpu_time_us":9460,"wal-append.run_wall_time_us":2332874}]]}
I20260709 13:19:36.041678 16110 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:36.052150 16153 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:36.008338 16117 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:36.078053 16117 raft_consensus.cc:3060] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:36.080677  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:36.070952 16159 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:36.083940  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:36.085387  8755 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:36.085882  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 45738.8us
I20260709 13:19:36.091209 16125 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:36.091650 16125 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.091984 16125 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:36.062340  8181 raft_consensus.cc:2468] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:36.049218 16113 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:36.070952 16070 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:36.075060  8174 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:36.076040 15603 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:36.076396  8149 consensus_peers.cc:597] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:36.098328  8149 leader_election.cc:336] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:36.099774  8149 consensus_peers.cc:597] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:36.100528  8149 leader_election.cc:336] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:36.100930  8149 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.076957 16118 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:36.102792 16118 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.103299 16125 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.108528 16125 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:36.105158 16118 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:36.105902 15603 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:36.106287  8149 consensus_peers.cc:597] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.101290  8755 leader_election.cc:304] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:36.024055 16094 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:36.058322  8002 catalog_manager.cc:5697] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 21 to 22, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 22 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:36.095098 15790 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:36.123109  8149 leader_election.cc:336] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:36.062620 16110 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.132339  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:36.134588 16091 raft_consensus.cc:2804] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:36.137723  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:36.141019 15914 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.155252  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.156008  8787 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:19:36.156375  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:36.156409  8787 pending_rounds.cc:85] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: Aborting all ops after (but not including) 15
W20260709 13:19:36.123003 15902 consensus_meta.cc:287] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.004s
I20260709 13:19:36.158016  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:36.125761 16094 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.144572 16110 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:36.157474  8787 pending_rounds.cc:107] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:19:36.170837  8787 raft_consensus.cc:2889] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:36.166630 16036 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:36.177479  8002 catalog_manager.cc:5697] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 20 to 23, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 23 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:36.178659 15910 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:36.180096  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 57034.1us
I20260709 13:19:36.156384 16106 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:36.165498 16118 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:36.181799 16106 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.163822 15902 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.183800 16106 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:36.184513 15902 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:36.170491 16094 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:36.197729  8755 leader_election.cc:336] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:36.200457  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55374.3us
I20260709 13:19:36.200661 16036 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.201361  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.218297  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:36.204988 16035 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 13:19:36.239197 16110 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.241546 15600 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:36.241770 16105 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.244976 16094 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.269887  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:36.270366  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 69150.6us
I20260709 13:19:36.270630  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:36.271011  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 71562.1us
I20260709 13:19:36.272948  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:36.293115  8249 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:36.294976  8255 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:36.207312 15861 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:19:36.228222 16010 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:36.280857  8149 leader_election.cc:336] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:36.234927 15914 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Requested vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:36.291039  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:36.303419  8149 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:36.312292  8149 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:36.280138 15600 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.312726  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:36.315734  8149 leader_election.cc:336] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:36.315661  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
W20260709 13:19:36.322535  8149 consensus_peers.cc:597] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.322082 16086 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:36.327196  8784 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 23: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:19:36.323285  8149 leader_election.cc:336] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:36.318264 15600 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:36.332093  8149 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:36.344707  8178 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 23: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:36.346550  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:36.344408  8149 leader_election.cc:336] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:36.349848  8149 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.342988  8755 leader_election.cc:304] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.316673 16105 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:36.361730  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 131838us
I20260709 13:19:36.358501 16091 raft_consensus.cc:697] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:36.418076 15989 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:36.502758 15986 raft_consensus.cc:2804] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:19:36.505856 16182 log.cc:927] Time spent T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: Append to log took a long time: real 0.193s	user 0.000s	sys 0.007s
I20260709 13:19:36.356491 16121 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:36.505448 15600 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.506917 16094 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:36.508028 16036 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:36.540264  8255 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:36.434392 16008 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:36.515508 15861 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:36.544008 15600 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:36.544368 15861 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.533022 16105 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:36.546693 15861 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:36.516525 16117 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.548542  8180 raft_consensus.cc:2410] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:19:36.549324 16117 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:36.362118  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 155949us
I20260709 13:19:36.554636 15930 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:36.530738  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 202801us
I20260709 13:19:36.558239  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:36.558959  8784 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 24: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:36.532687 16091 consensus_queue.cc:237] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.536116 16170 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:36.559782 16170 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:36.534554  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 215729us
I20260709 13:19:36.537806 16048 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.537173 15989 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.540589 16110 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:36.541231 16035 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:36.541981 15986 raft_consensus.cc:697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:36.573514 15989 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.574121 16035 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.574635 15986 consensus_queue.cc:237] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.575896 15989 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:36.576159 16035 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:36.510632 16086 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:36.561544 16048 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.578562  8074 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.579458 16035 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:36.579751 16048 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:36.580667  8074 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.564051 16170 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:36.568401  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:36.568687  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:36.568838  8755 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:36.571146  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:36.588176  8254 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 24: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:36.589293  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:36.601751 16048 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:36.621016  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:36.604183 15989 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.632424  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:36.621948  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:36.635855  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 55266us
I20260709 13:19:36.613884 16035 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:36.640684  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:36.641569  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:36.647771  8183 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:36.651276  8174 raft_consensus.cc:2393] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 24: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:36.620738 16110 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:36.657486  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 31 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:36.668499  8182 raft_consensus.cc:2410] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 for term 31 because replica has last-logged OpId of term: 29 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 13.
W20260709 13:19:36.673835  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.677207  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 62902.5us
I20260709 13:19:36.673506  8074 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.682184  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:36.686002  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:36.669169 16010 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:36.650342 15989 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.692281  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:36.693224  8784 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 23: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
I20260709 13:19:36.696264  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:36.679340 16110 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.700433  8149 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:36.689392 16035 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:36.694986 16113 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:36.698206 16010 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:19:36.706502  8755 leader_election.cc:336] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:36.712591  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 60849.5us
I20260709 13:19:36.713784 16035 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:36.714557  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.715742 16035 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:36.715950  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.718490 15861 raft_consensus.cc:3060] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:36.723361 16110 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:36.710037 16010 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:36.724473 16010 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:36.717224 16035 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:36.727978  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:36.731287 15989 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:36.734046 16066 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:36.734472 16066 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.734789 16066 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:36.735658 16010 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.742911 16010 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:36.745641  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:36.751809  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.750408  8223 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:36.753505 15790 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:19:36.755321  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 54974.6us
I20260709 13:19:36.758209 16086 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:36.758491 16200 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:36.759029 16200 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:36.759408 16200 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:36.760162 16183 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:36.765699 16196 log.cc:927] Time spent T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260709 13:19:36.767508 15989 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:36.781101  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:36.781996  8254 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:36.784425 16152 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:36.785317 16086 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:36.786525 16086 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.795718  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:36.786497  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.803092  8248 raft_consensus.cc:1275] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:19:36.810194 16152 raft_consensus.cc:2804] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:36.810633 16152 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:36.810992 16152 raft_consensus.cc:3060] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:36.815537  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.816363  8254 raft_consensus.cc:2468] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:36.817080  8255 raft_consensus.cc:2468] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:36.818331  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.819561 15989 raft_consensus.cc:2804] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:36.819967 15989 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting leader election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:36.820390 15989 raft_consensus.cc:3060] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:36.823187 16035 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:36.828256 15861 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:36.828634 16035 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:36.829234 16035 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.831468 16035 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:36.833886  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:36.834065 16066 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.836330 16066 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:36.847383 15989 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.852633  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:36.856405  8255 raft_consensus.cc:2368] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 25. Current term is 26.
I20260709 13:19:36.859093 15989 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:36.868637 15866 consensus_queue.cc:1048] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:36.870697  8149 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:36.871642 16200 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.872954  8787 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 22. Current term is 23. Ops: []
W20260709 13:19:36.874593  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 124285us
I20260709 13:19:36.877238 15930 raft_consensus.cc:2804] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:36.878580 16036 consensus_queue.cc:1059] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:19:36.876667  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 55715.5us
I20260709 13:19:36.874828  8149 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:36.882540  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.886305  8223 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:36.886412 16117 raft_consensus.cc:2804] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:36.890633  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:36.891265 16066 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:36.895123  8181 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:19:36.895649  8180 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 30 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 29 index: 14. Preceding OpId from leader: term: 30 index: 15. (index mismatch)
I20260709 13:19:36.901367  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:36.881664 15930 raft_consensus.cc:697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:36.905516  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:36.906275  8254 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 30 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 27 index: 13. Preceding OpId from leader: term: 30 index: 15. (index mismatch)
I20260709 13:19:36.907353  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:36.895802 16117 raft_consensus.cc:697] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:36.909696  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:36.910552  8252 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 26: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:36.905284  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:36.911208  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:36.912515 16117 consensus_queue.cc:237] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.914156  8149 leader_election.cc:400] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 25. Current term is 26.
I20260709 13:19:36.914465  8149 leader_election.cc:403] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:19:36.915001 16010 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:36.905833 15930 consensus_queue.cc:237] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:36.917907 16200 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:36.888342 16152 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:36.920832  8755 leader_election.cc:336] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:36.924409  8149 leader_election.cc:336] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:36.925806  8175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:36.926453  8183 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:19:36.927141  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:36.928764  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:36.931816  8149 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:36.933194  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:36.934372 16152 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:36.934475  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:36.935547 15790 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:36.936079 15790 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.894310 16212 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:36.938320 15790 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:36.939250  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:36.939981  8174 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:36.940470  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:36.941246  8252 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 21: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:36.941447  8180 raft_consensus.cc:2393] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 23: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:36.941783  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:36.943805  8149 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:36.944387  8149 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:36.945343  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:36.946982  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:36.942667  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:36.948092  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:36.948633  8182 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:36.950531  8149 leader_election.cc:336] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:36.949839  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:36.961304  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:36.964699  8149 leader_election.cc:336] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:36.967408  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:36.968449  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:36.965948  8149 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:36.969635  8223 leader_election.cc:336] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:36.970491  8174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:36.976208  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:36.977358  8183 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:19:36.979008  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:36.980337 16200 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:36.985105  8256 raft_consensus.cc:2393] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9480609eccc44250a4d7fcc9686e76cf in current term 22: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:36.984055  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:36.949018 15790 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:36.987690  8179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:36.989094 16212 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:36.989207 16152 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:36.989852 16152 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:36.986119 16158 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:36.947723 16086 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:36.957778 16195 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:36.989852 16212 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:37.001376  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:37.001569  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:37.003775 16152 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:37.004285 16212 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:37.005534 16152 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:37.006145 16152 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:37.029647 16203 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.030383 16203 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:37.032763 16203 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:37.037895  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 50999.6us
W20260709 13:19:37.039366  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 74389.5us
W20260709 13:19:37.040177  8223 consensus_peers.cc:597] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:37.040611  8182 raft_consensus.cc:2468] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:36.992645 15790 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:37.044055  8256 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:19:37.046207  8755 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:19:37.040992  8223 consensus_peers.cc:597] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:37.062515  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:37.055114  8223 leader_election.cc:336] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:37.053073 16200 raft_consensus.cc:2804] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:37.069515 16125 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:37.070237  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:37.049038 16212 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:37.071096 16200 raft_consensus.cc:697] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:37.068205 16036 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:37.071796 16212 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:37.072311 16200 consensus_queue.cc:237] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:37.072471 16036 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:37.074188 16212 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:37.074867 16036 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:37.079515  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:37.081305 16152 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:37.082933  8182 raft_consensus.cc:1275] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:19:37.059350  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:37.086615  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:37.046586 15790 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:37.065834  8223 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:37.095255 16212 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:37.097236  8252 raft_consensus.cc:3060] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:37.100602  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:37.109719  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:37.105418  8074 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:37.119586  8074 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:37.100941 16170 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:37.124881  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:37.111960 16152 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:19:37.150514 16152 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:37.133726  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 84179.1us
W20260709 13:19:37.153921  8223 consensus_peers.cc:597] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:37.154186 16010 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561) with higher term. Message: Invalid argument: T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 25. Current term is 26.
W20260709 13:19:37.154701  8223 consensus_peers.cc:597] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.155725  8223 consensus_peers.cc:597] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:37.127005 15989 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:37.158982  8223 consensus_peers.cc:597] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:37.127231 16035 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:37.101081 16008 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:19:37.161788  8175 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 26.
W20260709 13:19:37.160725  8223 leader_election.cc:336] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:37.167182 16110 raft_consensus.cc:3055] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:37.167644 16110 raft_consensus.cc:740] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:37.168413 16110 consensus_queue.cc:260] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:37.169979 16110 raft_consensus.cc:3060] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:37.104326 16200 consensus_queue.cc:1048] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 13:19:37.178418  8074 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:37.202943  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:37.164099  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:37.209652  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:37.210342  8249 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 30.
I20260709 13:19:37.213058 15989 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:37.215859 15989 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:37.267390  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 106900us
I20260709 13:19:37.211436 16035 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:37.213541 16183 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:37.293004  8223 consensus_peers.cc:597] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.299264  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 84001.5us
I20260709 13:19:37.294135  8252 raft_consensus.cc:1275] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:19:37.302700  8223 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:37.306605  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:37.320624  8074 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:37.326646  8002 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36106 (request call id 207) took 11885 ms (client timeout 15000 ms). Trace:
I20260709 13:19:37.298967 16212 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:37.332181 15790 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:37.354321 16201 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:37.322109 16105 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:19:37.340088 16035 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:37.327407  8002 rpcz_store.cc:269] 0709 13:19:25.436633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.436904 (+   271us) service_pool.cc:224] Handling call
0709 13:19:37.321885 (+11884981us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:36.512077 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:36.512945 (+   868us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:36.512993 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:19:36.513009 (+    16us) tablet.cc:662] Decoding operations
0709 13:19:36.534968 (+ 21959us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:36.535063 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:36.535100 (+    37us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:19:36.536528 (+  1428us) tablet.cc:701] Row locks acquired
0709 13:19:36.536588 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:19:36.536754 (+   166us) write_op.cc:270] Start()
0709 13:19:36.536924 (+   170us) write_op.cc:276] Timestamp: P: 1783603176536684 usec, L: 0
0709 13:19:36.536957 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:19:36.542405 (+  5448us) log.cc:844] Serialized 6661 byte log entry
0709 13:19:36.801175 (+258770us) op_driver.cc:464] REPLICATION: finished
0709 13:19:36.803359 (+  2184us) write_op.cc:301] APPLY: starting
0709 13:19:36.804366 (+  1007us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:36.853509 (+ 49143us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:36.853639 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:37.008512 (+154873us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:37.008879 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:19:37.008938 (+    59us) write_op.cc:312] APPLY: finished
0709 13:19:37.009532 (+   594us) log.cc:844] Serialized 156 byte log entry
0709 13:19:37.011441 (+  1909us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:37.011606 (+   165us) write_op.cc:454] Released schema lock
0709 13:19:37.011677 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:37.047481 (+ 35804us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:37.050002 (+  2521us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3060852,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":1901,"apply.run_cpu_time_us":26283,"apply.run_wall_time_us":224370,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75153,"num_ops":17,"prepare.queue_time_us":273054,"prepare.run_cpu_time_us":47933,"prepare.run_wall_time_us":157472,"raft.queue_time_us":33470,"raft.run_cpu_time_us":1319,"raft.run_wall_time_us":41912,"replication_time_us":264029,"thread_start_us":449961,"threads_started":4,"wal-append.queue_time_us":140916}]]}
W20260709 13:19:37.398279 16218 log.cc:927] Time spent T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:19:37.353605 16086 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:37.424549 16086 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:37.426666 16086 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:37.428871 16222 log.cc:927] Time spent T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:19:37.355016 16201 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:37.432153 16201 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:37.352841 15989 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:37.373618 16206 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:19:37.452193 16215 log.cc:927] Time spent T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 13:19:37.471248  8074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 150618us
I20260709 13:19:37.479549  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:37.512830  8787 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:19:37.515872  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:37.521420  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:37.469115 15790 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:37.526919  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:37.527326  8149 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:37.532888  8149 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
W20260709 13:19:37.535429  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 232749us
W20260709 13:19:37.536471  8223 consensus_peers.cc:597] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.530193 16198 log.cc:927] Time spent T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:37.526813 16232 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:37.531507 16105 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:37.529726 15989 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:37.542590  7002 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 8133)
I20260709 13:19:37.538329  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:37.539103  8223 leader_election.cc:336] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:37.549813 16233 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:37.551441 16233 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:37.542323 16234 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:37.554304 15861 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:37.556052 16233 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:37.557138  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:37.558022 16234 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:37.559391  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:37.560261 16234 raft_consensus.cc:3060] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:37.549152 16235 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:37.564602  8074 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:37.567044  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:37.565907  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:37.568182  8149 leader_election.cc:336] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:37.588513  8149 leader_election.cc:336] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:37.566447 15861 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:37.592006 16232 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:37.597957 16236 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:37.599110  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:37.604295  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:37.604555  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:37.607935  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:37.609998  8174 raft_consensus.cc:1240] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 22. Current term is 23. Ops: [22.16-22.16]
W20260709 13:19:37.610278 16221 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.344s	user 0.015s	sys 0.005s
I20260709 13:19:37.612931  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:37.617592  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:37.618340  8254 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5033fc7e66374940a203908ea8b0078f in current term 21: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:37.625391 16189 consensus_queue.cc:1048] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:37.626751 16152 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:37.627486 16152 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:37.630267  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:37.630290 16035 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:37.631268 16035 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:37.632958  8149 leader_election.cc:336] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:37.638711 15986 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:37.639319 15986 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:37.640537  8074 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:37.641850 15986 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:37.642936 16152 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:37.644223 16035 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:37.652850  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:37.667712 15861 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:19:37.653673  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 114588us
I20260709 13:19:37.654001  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:37.633890  8149 consensus_peers.cc:597] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.666149  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:37.672991  8223 leader_election.cc:336] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:37.678730  8176 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:37.679669  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:37.680020  8074 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:37.681388  8223 leader_election.cc:336] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:37.682328  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:37.684777  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:37.689406 16152 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:37.693142  8176 raft_consensus.cc:1275] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:19:37.694454  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:37.695019  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:37.702525  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:37.670183 15861 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 26 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:37.703755 16094 consensus_queue.cc:1048] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:37.692919 16152 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.808146 16152 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:37.811048 16152 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:37.717022  8183 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.027s	sys 0.063s
W20260709 13:19:37.811811  8183 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.028s	sys 0.063s
I20260709 13:19:37.692546 15986 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:37.721529 16237 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:37.727885  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 46538us
I20260709 13:19:37.814664 15986 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:19:37.815331  8223 consensus_peers.cc:597] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.815928  8223 leader_election.cc:336] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:37.815625 15986 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:37.816335  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:37.817543  8223 leader_election.cc:336] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:37.818826 16237 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:37.727437 16234 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:37.794917  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 65022.7us
I20260709 13:19:37.821254 15790 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.798689  8181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:37.785410  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 107177us
I20260709 13:19:37.823303  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:37.803629  8074 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:37.778506 16035 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:37.798280  8176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:37.834213  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:37.834713  8177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:37.831765  8755 leader_election.cc:336] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:37.854341  8074 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:37.857532  8074 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:37.845328  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:37.821894 15790 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:37.869870  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:37.876243  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 52031.8us
I20260709 13:19:37.878031  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:37.880115  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:37.839937 15989 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:37.872150 16158 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:19:37.892692  8248 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:19:37.891515  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:37.900143  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:37.900761 15861 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:37.912537  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:37.909638 15989 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.911455 16234 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:37.912900 16152 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:37.981911  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 302577us
I20260709 13:19:37.998114 16246 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:37.998673 16252 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:38.004041 16117 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:37.959241 16008 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:38.018572 16253 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:38.030198  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 156027us
I20260709 13:19:37.986622 15989 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:38.057163 16262 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:38.067512 15989 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:38.069840  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:38.073006  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:38.036722 16253 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:38.079037  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:38.079613 16253 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:38.080164 16253 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:38.081881  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:38.082557  8252 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
W20260709 13:19:38.085875  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 45194.3us
I20260709 13:19:38.103108  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:38.103801  8183 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 22.
I20260709 13:19:38.088313  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:38.111843 16035 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:38.112298 16035 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.112632 16035 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:38.144800 16240 log.cc:927] Time spent T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.173s	user 0.003s	sys 0.000s
I20260709 13:19:38.155306  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:38.156157 15790 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:38.172447 16228 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:38.203286 16152 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.204100 16152 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:38.206583 16105 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.207369 16105 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:38.211889 16105 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:38.212275 16035 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:38.215792 16035 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:38.223361  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 91038.3us
W20260709 13:19:38.231400  8755 leader_election.cc:336] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:38.233948 16152 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:38.242087 16158 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 30 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:38.242645 16158 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:19:38.250887 16229 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.251556 16229 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:38.254108 16229 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:38.259104  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 102058us
W20260709 13:19:38.259428  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 168385us
I20260709 13:19:38.261010  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:38.266525  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:38.267184  8178 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
W20260709 13:19:38.269886  8223 leader_election.cc:336] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:38.270390  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:38.271278  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:38.272569  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:38.277832  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 145903us
W20260709 13:19:38.272794  8223 consensus_peers.cc:597] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.272017 16229 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:19:38.282033  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:38.284593  8182 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:38.285707  8782 raft_consensus.cc:1275] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:38.287732  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:38.291198  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:38.282034  8223 consensus_peers.cc:597] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.277772 16158 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:38.296160 16158 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 31 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:38.296900  8223 leader_election.cc:336] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:38.297372  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:38.298352  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:38.300359  8251 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:38.304723  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:38.305401  8251 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:38.310395 16066 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:38.311935  8223 consensus_peers.cc:597] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.317909  8223 leader_election.cc:336] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:38.318585 16232 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:38.318696  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:38.324816  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:38.335089  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:38.332317  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:38.335146  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:38.317018  8251 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:38.340380  8074 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:38.341751  8182 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:38.323307  7997 catalog_manager.cc:5697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 15 to 21, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 21 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.346632 16113 consensus_queue.cc:1048] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:38.347613 16189 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:38.349138 16152 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:38.349879 16226 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:38.350775 16232 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:19:38.353127 16066 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:38.355217 16183 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:38.398313 16183 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:38.400935 16183 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:38.367084 16274 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:38.404790 16274 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:38.409516 16274 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:38.391031  8223 leader_election.cc:336] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:38.393009 16152 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:38.432938  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:38.439713  8178 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:19:38.440223 16152 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:38.440860 16259 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:38.441490 16259 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:38.443800 16259 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:38.446346  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:38.447578  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:38.450553  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 59555.6us
I20260709 13:19:38.456058  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f
W20260709 13:19:38.477531  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 196266us
I20260709 13:19:38.486387  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 27 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:38.488658  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:38.491850  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:38.488962  8149 leader_election.cc:336] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:38.458108 16183 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:19:38.427068  7997 catalog_manager.cc:5697] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 19 to 22, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 22 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:38.490077 16066 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.498699 16066 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:38.501063 16066 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:38.490324 16232 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:38.494467 16113 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:38.478442 16226 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:19:38.511049 16259 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:38.525967  8251 raft_consensus.cc:1275] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:19:38.543324  8255 raft_consensus.cc:1275] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:19:38.544335 16259 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:38.497231  7997 catalog_manager.cc:5697] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
W20260709 13:19:38.548010  7002 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 8133)
I20260709 13:19:38.564481  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 31 candidate_status { last_received { term: 30 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:19:38.564860  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 73123.6us
I20260709 13:19:38.562671 16158 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:38.571209 16158 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:38.578893 16113 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:38.579592 16113 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:38.585930 16158 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:38.589979 16152 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:38.590690 16152 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:38.593909  8178 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:19:38.580638  8253 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:19:38.596199  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:38.598433  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:38.603037  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:38.604120  8223 leader_election.cc:336] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:38.606312  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 46370.8us
I20260709 13:19:38.604760  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:38.609475 16256 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.610095 16256 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:38.611380 16110 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:38.612468 16256 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:38.613766  8223 leader_election.cc:336] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:38.614838  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:38.614346  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:38.620216  8072 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:38.621309  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:38.627868 16232 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.633706 16232 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:38.634632  7997 catalog_manager.cc:5697] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 9 to 16, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 16 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:38.636065 16232 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:38.603542 16152 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:38.638630  8149 leader_election.cc:336] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:38.620031 16170 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:38.643316  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e54e69639dd478bb5f966d86c83c95d" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:38.615558 16274 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:38.645749  8149 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:38.648082  8149 leader_election.cc:336] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:38.631740 16105 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:38.653488  8074 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:38.653926  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:38.654217  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:38.654692  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:38.655694  8149 leader_election.cc:336] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:38.656168  8149 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:38.656563  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:38.663473  8149 consensus_peers.cc:597] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.666632  8223 leader_election.cc:336] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:38.667088  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:38.648447 16259 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:38.650722 16121 raft_consensus.cc:2749] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:38.638936 15914 consensus_queue.cc:1048] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:19:38.671957 15914 consensus_queue.cc:1243] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Peer a0f96c12124b4e1a816d9fa970464091 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:38.677943  8072 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:38.679251 16255 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:38.665228 16269 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:38.648825 16036 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:19:38.694396  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:38.658929 16105 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:38.659497 16159 raft_consensus.cc:2749] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:38.708038  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:38.712901  8175 raft_consensus.cc:1240] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 31 FOLLOWER]: Rejecting Update request from peer 9480609eccc44250a4d7fcc9686e76cf for earlier term 30. Current term is 31. Ops: []
I20260709 13:19:38.708520  8253 pending_rounds.cc:85] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Aborting all ops after (but not including) 10
I20260709 13:19:38.715390  8253 pending_rounds.cc:107] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:19:38.715557  8253 raft_consensus.cc:2889] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:38.696220 16036 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:38.721524 16235 consensus_queue.cc:1048] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:38.702704 16232 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:38.710031 16274 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:38.731942 16255 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.637269  7997 catalog_manager.cc:5697] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 14 to 19, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 19 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:38.798106 16282 log.cc:927] Time spent T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:38.810184 16256 consensus_queue.cc:1059] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: INVALID_TERM, Last received: 30.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:38.811535 16256 raft_consensus.cc:3055] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 30 LEADER]: Stepping down as leader of term 30
I20260709 13:19:38.811954 16256 raft_consensus.cc:740] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
W20260709 13:19:38.833760 16287 log.cc:927] Time spent T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:19:38.834194 16170 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:38.834738 16170 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:38.836796 16170 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:38.773205 16036 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:38.839013  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 46440.7us
I20260709 13:19:38.839946 16036 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:38.857250  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:38.793479 16255 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:38.872110 16105 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:38.812969 16256 consensus_queue.cc:260] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 30.15, Last appended by leader: 15, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:38.898615  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 56363.7us
W20260709 13:19:38.899398  8149 consensus_peers.cc:597] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.905579  8149 leader_election.cc:336] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:38.907438  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:38.916460  8149 leader_election.cc:336] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:38.920657  8149 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:38.924800 16264 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:38.924371  7997 catalog_manager.cc:5697] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 11 to 20, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 20 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.930825  7997 catalog_manager.cc:5697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 12 to 25, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 25 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.914637 16159 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 13:19:38.916237 16256 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:19:38.937644 16255 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:38.940186  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:38.900827 16105 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:38.947686  8149 consensus_peers.cc:597] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:39.002303  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:39.013883 16105 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:39.017369  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:39.031859  8223 leader_election.cc:336] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:39.017107 16113 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:39.041356  7997 catalog_manager.cc:5697] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 11 to 19, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 19 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:39.043522  7997 catalog_manager.cc:5697] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 17 to 23, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 23 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:39.042304  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c962bcd58c74013abdb370fa758d500" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:39.050573  8180 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:19:39.053334  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:39.055918  8251 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:19:39.058774 16113 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:39.059422  8252 raft_consensus.cc:1240] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Rejecting Update request from peer 5033fc7e66374940a203908ea8b0078f for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:39.060750 16008 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:39.073386  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:39.074613 15790 consensus_queue.cc:1059] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:39.075460 15790 raft_consensus.cc:3055] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:39.075748 15790 raft_consensus.cc:740] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:39.076542 15790 consensus_queue.cc:260] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:39.078429  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:39.090265  8074 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:39.096232  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:39.094400  7997 catalog_manager.cc:5697] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 14 to 18, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 18 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:39.099185  7997 catalog_manager.cc:5697] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 12 to 20, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 20 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:39.100147 15790 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:39.101887 16008 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:39.103826  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:39.108490 16256 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:39.108773  8074 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:39.109791  7997 catalog_manager.cc:5697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 13 to 22, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 22 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:39.126767 16113 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:39.139998  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:39.143513  8223 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:39.147641  8149 consensus_peers.cc:597] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:39.136015 16252 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:39.159183 16274 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:19:39.158344  8149 consensus_peers.cc:597] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:39.157547 16110 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:39.183369  7997 catalog_manager.cc:5697] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 17 to 20, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 20 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:39.186568  7997 catalog_manager.cc:5697] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 15 to 19, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 19 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:39.190647  7997 catalog_manager.cc:5697] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 8 to 17, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 17 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:39.240434 16252 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:39.241025 16252 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:39.251684  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:39.254422  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:39.258175 16252 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:39.261876  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:39.278855  8074 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:39.281812 16036 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.282356 16036 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:39.284379 16036 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:39.284874 16036 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:39.287230 16297 log.cc:927] Time spent T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:19:39.292838  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:39.293545  8182 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:39.303865  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:39.304754  8783 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 23.
I20260709 13:19:39.311074  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:39.305757 16105 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.337455 16255 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:39.338160 16255 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.338660 16255 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:39.350726 16105 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:39.403894 16256 raft_consensus.cc:493] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.406859 16105 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:39.407518  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:39.410612  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f981ef6ec7847cf851489769fac4dff" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:39.413141  8074 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:39.420722 16232 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:39.404659 16256 raft_consensus.cc:515] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:39.432933 16256 leader_election.cc:290] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:39.435655  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:39.437498  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d3bfbbaf542b5aa9ecd4e865ff155" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:39.462003  8074 leader_election.cc:304] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:39.463220 16008 raft_consensus.cc:2749] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:39.466701 16255 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:39.446973  8223 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 205 similar messages]
I20260709 13:19:39.449100 16232 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:39.470980 16232 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:39.473259 16232 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:39.449574 16036 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:39.473959  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:39.473927 16036 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:39.475447  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:39.475731  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:39.476154  8783 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:39.477340 16036 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:39.478012  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e531fcf0742cd8db17f008824d588" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:39.480906  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:39.483268  8783 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:39.486059  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247aeecdc5c4ebf8516da3b94073f35" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:39.486778  8072 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:39.487840 16105 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:39.474551  8182 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:39.495965  8149 consensus_peers.cc:597] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:39.491570  8074 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:39.505045  8182 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 24.
I20260709 13:19:39.507516  8072 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf; no voters: 
I20260709 13:19:39.510733 16255 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:39.513649  8149 consensus_peers.cc:597] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:39.513621 16105 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:39.515869 16255 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:39.516629 16255 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 24 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:39.530328 16105 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:39.518466 16255 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:39.530972 16105 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:39.534649 16105 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:39.535053  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:39.537181  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:39.538918  8072 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:39.539841 16105 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:39.552835  7002 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 8133)
I20260709 13:19:39.557238 16105 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:39.557840 16105 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:39.559927 16105 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:39.563423  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:39.564885  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:39.567929  8074 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:39.569906 16232 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:39.579002  8149 consensus_peers.cc:597] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:39.610283  8149 consensus_peers.cc:597] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:39.664956 16105 raft_consensus.cc:493] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.673027 16105 raft_consensus.cc:515] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:39.677333 16105 leader_election.cc:290] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:39.679373  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:39.679795  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba766a24d6d541fcbbc260fd5545d9ca" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:39.681885  8074 leader_election.cc:304] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:39.682921 16255 raft_consensus.cc:2749] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:39.696152  8149 consensus_peers.cc:597] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:39.724596 16255 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:39.725138 16255 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:39.729703 16255 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:39.730605  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:39.729756  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:39.734236  8072 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:39.736667 16255 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:39.806195  8149 consensus_peers.cc:597] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:39.803635 16255 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:39.808761 16255 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:39.811087 16255 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:39.812469  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:39.816654  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:39.822057  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:39.824395 16255 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:39.830101  7997 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39828 (request call id 280) took 37142 ms (client timeout 15000 ms). Trace:
W20260709 13:19:39.830567  7997 rpcz_store.cc:269] 0709 13:19:02.688133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.688341 (+   208us) service_pool.cc:224] Handling call
0709 13:19:39.830004 (+37141663us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:39.469907 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:39.470536 (+   629us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:39.470586 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:19:39.470604 (+    18us) tablet.cc:662] Decoding operations
0709 13:19:39.471899 (+  1295us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:39.471989 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:39.472018 (+    29us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:19:39.473109 (+  1091us) tablet.cc:701] Row locks acquired
0709 13:19:39.473129 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:19:39.505581 (+ 32452us) write_op.cc:270] Start()
0709 13:19:39.505716 (+   135us) write_op.cc:276] Timestamp: P: 1783603179505517 usec, L: 0
0709 13:19:39.505738 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:39.506480 (+   742us) log.cc:844] Serialized 5969 byte log entry
0709 13:19:39.586697 (+ 80217us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b18003b6c80. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c345b1 00007fa59dd41e07 00007fa5a6b9cab9 00007fa59dd5e69b 00007fa59dd5c93f 00007fa59dd5c455 00007fa5a0dc9190 00007fa5a0dc2ae7 00007fa5a0dc1dd9 00007fa5a0dcc930
0709 13:19:39.588830 (+  2133us) op_driver.cc:464] REPLICATION: finished
0709 13:19:39.669846 (+ 81016us) write_op.cc:301] APPLY: starting
0709 13:19:39.669954 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:39.718908 (+ 48954us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:39.718937 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:39.740289 (+ 21352us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:39.740565 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:19:39.740614 (+    49us) write_op.cc:312] APPLY: finished
0709 13:19:39.740986 (+   372us) log.cc:844] Serialized 139 byte log entry
0709 13:19:39.741172 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:39.741347 (+   175us) write_op.cc:454] Released schema lock
0709 13:19:39.741410 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:39.769489 (+ 28079us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:39.774673 (+  5184us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":955367,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":80732,"apply.run_cpu_time_us":18560,"apply.run_wall_time_us":99581,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66797,"num_ops":15,"prepare.queue_time_us":133995,"prepare.run_cpu_time_us":19605,"prepare.run_wall_time_us":75835,"raft.queue_time_us":15485,"raft.run_cpu_time_us":26935,"raft.run_wall_time_us":91020,"replication_time_us":82913,"spinlock_wait_cycles":14995200,"thread_start_us":252541,"threads_started":4,"wal-append.queue_time_us":54022}]]}
I20260709 13:19:39.836047  8005 catalog_manager.cc:5697] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 14 to 16, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 16 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:39.841054  8005 catalog_manager.cc:5697] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 10 to 14, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 14 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
W20260709 13:19:39.850386  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:39.854979 16105 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:39.855691 16105 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:39.845309  8005 catalog_manager.cc:5697] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:39.859234 16105 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:39.860728  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:39.860426  8005 catalog_manager.cc:5697] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 7 to 18, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 18 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:39.863755  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c362335b215641d38dd0c651acfb8fbb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:39.865314  8072 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:39.867238 16255 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:39.928555  8783 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:19:39.929620 16105 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.930186 16255 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:39.930222 16105 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:39.934916  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:39.936609 16105 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:39.940764  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be8c836876cb41918064b2082dd48efe" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:39.942375  8074 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:39.943526 16105 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:39.950760  8000 catalog_manager.cc:5697] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 18 to 19, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 19 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:39.956768  8149 consensus_peers.cc:597] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:39.957932  8000 catalog_manager.cc:5697] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 12 to 19, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 19 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:39.960886  8005 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39810 (request call id 297) took 56537 ms (client timeout 15000 ms). Trace:
W20260709 13:19:39.962503  8005 rpcz_store.cc:269] 0709 13:18:43.423396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.423600 (+   204us) service_pool.cc:224] Handling call
0709 13:19:39.960816 (+56537216us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:39.874748 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:39.875254 (+   506us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:39.875288 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:19:39.875304 (+    16us) tablet.cc:662] Decoding operations
0709 13:19:39.875827 (+   523us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:39.875881 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:39.875912 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:19:39.876324 (+   412us) tablet.cc:701] Row locks acquired
0709 13:19:39.876342 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:19:39.876477 (+   135us) write_op.cc:270] Start()
0709 13:19:39.876583 (+   106us) write_op.cc:276] Timestamp: P: 1783603179876437 usec, L: 0
0709 13:19:39.876605 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:39.877223 (+   618us) log.cc:844] Serialized 1706 byte log entry
0709 13:19:39.879249 (+  2026us) op_driver.cc:464] REPLICATION: finished
0709 13:19:39.879704 (+   455us) write_op.cc:301] APPLY: starting
0709 13:19:39.879788 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:39.882182 (+  2394us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:39.882294 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:39.884829 (+  2535us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:39.885033 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:19:39.885086 (+    53us) write_op.cc:312] APPLY: finished
0709 13:19:39.885322 (+   236us) log.cc:844] Serialized 49 byte log entry
0709 13:19:39.887643 (+  2321us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:39.887756 (+   113us) write_op.cc:454] Released schema lock
0709 13:19:39.887804 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:39.888388 (+   584us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:39.888419 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11843,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":235,"apply.run_cpu_time_us":6322,"apply.run_wall_time_us":8630,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16712,"num_ops":4,"prepare.queue_time_us":125,"prepare.run_cpu_time_us":2744,"prepare.run_wall_time_us":2743,"replication_time_us":2522}]]}
I20260709 13:19:39.967907 16105 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.969310 16105 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:39.971735 16105 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:39.967134  8000 catalog_manager.cc:5697] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 16 to 19, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 19 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:39.974237  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:39.981246  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3456040ac8e456eabcfa4db8a2b5510" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:39.984306  8074 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:39.985595 16036 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:19:39.978615  8000 catalog_manager.cc:5697] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 16 to 17, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 17 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:39.995066  8000 catalog_manager.cc:5697] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 19 to 20, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 20 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:39.996902  8000 catalog_manager.cc:5697] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:40.003309  8000 catalog_manager.cc:5697] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:40.004732 16170 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:40.006018 16170 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:40.008183 16170 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:40.021744  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 31 candidate_status { last_received { term: 30 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:40.022603  8182 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 31: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:40.021968  8000 catalog_manager.cc:5697] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 18 to 21, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 21 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.023684  8000 catalog_manager.cc:5697] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 20 to 21, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 21 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.031152  8000 catalog_manager.cc:5697] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 20 to 21, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 21 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.038450  8000 catalog_manager.cc:5697] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf reported cstate change: term changed from 17 to 19, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 19 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:40.069416  8223 leader_election.cc:336] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:40.070773  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:40.071655 16170 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:19:40.080049 16170 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:19:40.112607  8182 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:19:40.114147 16036 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:19:40.126209  8223 consensus_peers.cc:597] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.139580  8223 consensus_peers.cc:597] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.150907  7997 catalog_manager.cc:5697] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 15 to 17, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 17 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:40.152472  7997 catalog_manager.cc:5697] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 23 to 25, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 25 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:40.153945  7997 catalog_manager.cc:5697] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:40.155186  7997 catalog_manager.cc:5697] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 17 to 21, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 21 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:40.156466  7997 catalog_manager.cc:5697] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 22 to 23, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 23 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:40.159475  8000 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39810 (request call id 298) took 32458 ms (client timeout 15000 ms). Trace:
I20260709 13:19:40.163539  7997 catalog_manager.cc:5697] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:19:40.159889  8000 rpcz_store.cc:269] 0709 13:19:07.701010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.701185 (+   175us) service_pool.cc:224] Handling call
0709 13:19:40.159397 (+32458212us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:40.046757 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:40.047261 (+   504us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:40.047292 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:19:40.047308 (+    16us) tablet.cc:662] Decoding operations
0709 13:19:40.048242 (+   934us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:40.048292 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:40.048321 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:19:40.049239 (+   918us) tablet.cc:701] Row locks acquired
0709 13:19:40.049258 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:19:40.049377 (+   119us) write_op.cc:270] Start()
0709 13:19:40.049529 (+   152us) write_op.cc:276] Timestamp: P: 1783603180049337 usec, L: 0
0709 13:19:40.049555 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:19:40.050178 (+   623us) log.cc:844] Serialized 4422 byte log entry
0709 13:19:40.054039 (+  3861us) op_driver.cc:464] REPLICATION: finished
0709 13:19:40.056881 (+  2842us) write_op.cc:301] APPLY: starting
0709 13:19:40.056980 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:40.065237 (+  8257us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:40.065354 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:40.090949 (+ 25595us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:40.091213 (+   264us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:19:40.091269 (+    56us) write_op.cc:312] APPLY: finished
0709 13:19:40.091633 (+   364us) log.cc:844] Serialized 105 byte log entry
0709 13:19:40.092508 (+   875us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:40.092655 (+   147us) write_op.cc:454] Released schema lock
0709 13:19:40.092711 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:40.105970 (+ 13259us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:40.106009 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":102619,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":2600,"apply.run_cpu_time_us":16342,"apply.run_wall_time_us":36194,"cfile_cache_hit":44,"cfile_cache_hit_bytes":45958,"num_ops":11,"prepare.queue_time_us":90,"prepare.run_cpu_time_us":3715,"prepare.run_wall_time_us":6733,"replication_time_us":4328}]]}
I20260709 13:19:40.164880  7997 catalog_manager.cc:5697] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 19 to 23, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 23 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.209718  7997 catalog_manager.cc:5697] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 21 to 22, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 22 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.216337  7997 catalog_manager.cc:5697] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 19 to 21, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 21 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:19:40.214699  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:40.173522  8223 consensus_peers.cc:597] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.225575  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 50261.5us
W20260709 13:19:40.234404  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 60954.1us
W20260709 13:19:40.251391  8149 consensus_peers.cc:597] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.238817  7997 catalog_manager.cc:5697] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 18 to 23. New cstate: current_term: 23 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:40.255781  7997 catalog_manager.cc:5697] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 21 to 22, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 22 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:40.257175  7997 catalog_manager.cc:5697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 22 to 23, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 23 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:19:40.261225  8149 consensus_peers.cc:597] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.261996  8149 consensus_peers.cc:597] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.263025  8149 consensus_peers.cc:597] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.262159  7997 catalog_manager.cc:5697] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 19 to 21, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 21 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.265654  7997 catalog_manager.cc:5697] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 18 to 22, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 22 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:40.266932  7997 catalog_manager.cc:5697] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 22 to 26, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 26 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:40.270010 16036 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:40.270556 16036 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:40.272645 16036 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:40.268208  7997 catalog_manager.cc:5697] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 22 to 25. New cstate: current_term: 25 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:40.274143  7997 catalog_manager.cc:5697] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 20 to 23, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 23 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.274984  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:40.275589  7997 catalog_manager.cc:5697] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 23 to 25, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 25 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.277125  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea7d5dc3d1d486a8f4ff9478d8fcefb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:40.279699  8074 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:40.281931 16255 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:40.277168  7997 catalog_manager.cc:5697] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 17 to 21, leader changed from 5033fc7e66374940a203908ea8b0078f (127.6.214.132) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 21 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:40.295955  7997 catalog_manager.cc:5697] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.298707  7997 catalog_manager.cc:5697] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:19:40.317919  8223 consensus_peers.cc:597] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.318720  8223 consensus_peers.cc:597] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.329984 16255 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.330654 16255 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:40.332964 16255 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:40.333389  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:40.335815  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:40.337299  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:40.338018 16255 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:19:40.340128  8223 consensus_peers.cc:597] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.347071 16305 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.347765 16305 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:40.352223  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:40.354705  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:40.355264  8253 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:40.356902 16305 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:40.357918  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:40.359167 16305 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:40.359579 16305 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.360044 16305 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:40.367169 16159 raft_consensus.cc:493] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:40.367820 16159 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:40.371927  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:40.372826  8252 raft_consensus.cc:2393] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 22: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:40.374972 16159 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:40.376013  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
W20260709 13:19:40.381699  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.392637 16036 raft_consensus.cc:493] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:40.393254 16036 raft_consensus.cc:515] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:40.395757 16036 leader_election.cc:290] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:40.396903  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:40.401957  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c332ea272c465d9e07083a06e802e7" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:40.404035  8074 leader_election.cc:304] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:40.406224 16036 raft_consensus.cc:2749] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:40.418128  8223 consensus_peers.cc:597] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.391287 16305 raft_consensus.cc:515] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:40.421923  8783 raft_consensus.cc:2368] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
I20260709 13:19:40.424966  8147 leader_election.cc:400] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
I20260709 13:19:40.425379  8147 leader_election.cc:403] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:40.426340 16159 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 23
W20260709 13:19:40.422230  8223 consensus_peers.cc:597] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.436028 16036 raft_consensus.cc:493] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.436653 16036 raft_consensus.cc:515] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:40.438916  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:40.436094  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e96746d2ece4e52ab82eca0737daf2e" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:40.439599 16305 leader_election.cc:290] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:40.438987 16036 leader_election.cc:290] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:40.439647  8252 raft_consensus.cc:3060] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:40.443260  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:40.444514  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09ff07a1f02d49f0923422e378a20d4a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:40.446679  8074 leader_election.cc:304] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:40.447582  8252 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:40.447950 16036 raft_consensus.cc:2749] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:40.451319  8755 leader_election.cc:304] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:40.452675 16189 raft_consensus.cc:2804] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:40.461591 16036 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:40.462467 16189 raft_consensus.cc:697] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:40.462265 16036 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:40.463505 16189 consensus_queue.cc:237] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:40.470024  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:40.479646  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:40.479466 16036 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:40.481894  8072 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:40.482064  8149 consensus_peers.cc:597] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.466313 16159 raft_consensus.cc:2749] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917) with higher term. Message: Invalid argument: T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 for earlier term 22. Current term is 23.
I20260709 13:19:40.483141 16036 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:40.482756  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:40.503010  8180 raft_consensus.cc:2468] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:40.526173 16036 raft_consensus.cc:493] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:40.526827 16036 raft_consensus.cc:515] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:40.531531 16036 leader_election.cc:290] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:40.533766  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:40.536244  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3439ee9684744c187e7b7e3627aecda" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:40.538349  8074 leader_election.cc:304] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:40.539497 16255 raft_consensus.cc:2749] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:40.539695  8149 consensus_peers.cc:597] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.544487  7997 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36106 (request call id 208) took 2820 ms. Trace:
I20260709 13:19:40.545044  7997 rpcz_store.cc:276] 0709 13:19:37.724561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.851313 (+2126752us) service_pool.cc:224] Handling call
0709 13:19:40.544377 (+693064us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:40.378800 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:40.379408 (+   608us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:40.379449 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:19:40.379467 (+    18us) tablet.cc:662] Decoding operations
0709 13:19:40.381321 (+  1854us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:40.381381 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:40.381415 (+    34us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:19:40.383243 (+  1828us) tablet.cc:701] Row locks acquired
0709 13:19:40.383267 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:19:40.383424 (+   157us) write_op.cc:270] Start()
0709 13:19:40.383554 (+   130us) write_op.cc:276] Timestamp: P: 1783603180383379 usec, L: 0
0709 13:19:40.383581 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:19:40.384420 (+   839us) log.cc:844] Serialized 8315 byte log entry
0709 13:19:40.393544 (+  9124us) op_driver.cc:464] REPLICATION: finished
0709 13:19:40.394654 (+  1110us) write_op.cc:301] APPLY: starting
0709 13:19:40.394748 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:40.420996 (+ 26248us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:40.421120 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:40.499379 (+ 78259us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:40.499683 (+   304us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:19:40.499737 (+    54us) write_op.cc:312] APPLY: finished
0709 13:19:40.500155 (+   418us) log.cc:844] Serialized 188 byte log entry
0709 13:19:40.500337 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:40.500521 (+   184us) write_op.cc:454] Released schema lock
0709 13:19:40.500590 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:40.500977 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:40.501014 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14874,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":871,"apply.run_cpu_time_us":28467,"apply.run_wall_time_us":106288,"cfile_cache_hit":84,"cfile_cache_hit_bytes":87738,"num_ops":21,"prepare.queue_time_us":12713,"prepare.run_cpu_time_us":5903,"prepare.run_wall_time_us":24818,"replication_time_us":9780,"spinlock_wait_cycles":79104}]]}
W20260709 13:19:40.553324  7002 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 8133)
I20260709 13:19:40.560053 16036 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:40.560736 16036 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:40.579782  8004 catalog_manager.cc:5697] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 17 to 18, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 18 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.603637  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:40.603183  8004 catalog_manager.cc:5697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.593912 16232 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.606127 16036 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:40.605882 16232 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:40.609848 16232 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:40.612738  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 32 candidate_status { last_received { term: 30 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:40.610764  8004 catalog_manager.cc:5697] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.613408  8180 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 31.
I20260709 13:19:40.614743  8004 catalog_manager.cc:5697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 25 to 27, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 27 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.617185  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 32 candidate_status { last_received { term: 30 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:40.618372  8252 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 31.
I20260709 13:19:40.619400  8004 catalog_manager.cc:5697] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 19 to 22, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 22 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:40.620287  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:40.620764  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:40.638113 16255 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 13:19:40.638598 16255 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.638939 16255 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:19:40.639623 16232 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.640221 16232 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:40.642654 16232 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:40.637666  8004 catalog_manager.cc:5697] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 16 to 23. New cstate: current_term: 23 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.644495  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:40.644855  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b491e7c261394e498f940b0169e957b6" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:40.646327  8074 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:40.647902 16232 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:40.649587  8004 catalog_manager.cc:5697] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 21 to 22, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 22 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:40.652248  8004 catalog_manager.cc:5697] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 19 to 20, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 20 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:40.654004  8004 catalog_manager.cc:5697] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.655741  8004 catalog_manager.cc:5697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 22 to 25, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 25 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.668968  8004 catalog_manager.cc:5697] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 21 to 22, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 22 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:40.679493  8004 catalog_manager.cc:5697] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 15 to 16, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 16 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:40.727797 16232 raft_consensus.cc:493] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.728389 16232 raft_consensus.cc:515] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:40.730669 16232 leader_election.cc:290] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:40.732844  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:40.735394  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21cda219d2624c108a6700de24d60d86" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:40.737259  8074 leader_election.cc:304] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:40.738495 16232 raft_consensus.cc:2749] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:40.752833  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e624c9e6425410d86ead659c0c8db59" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:40.692687 16255 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:40.787132  8072 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:40.787915 16232 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:40.788950  8223 consensus_peers.cc:597] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.791654  8223 consensus_peers.cc:597] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.805193  8223 consensus_peers.cc:597] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.809855  7998 catalog_manager.cc:5697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.811905  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 32 candidate_status { last_received { term: 30 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:40.817775  8180 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:19:40.827032  8180 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 32.
I20260709 13:19:40.828385  7998 catalog_manager.cc:5697] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 14 to 24. New cstate: current_term: 24 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:40.839778 16036 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:40.843485  8004 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39814 (request call id 284) took 23380 ms (client timeout 15000 ms). Trace:
I20260709 13:19:40.843559 16036 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:40.844020  8004 rpcz_store.cc:269] 0709 13:19:17.463217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.463374 (+   157us) service_pool.cc:224] Handling call
0709 13:19:17.472005 (+  8631us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b540006a828. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a703e331 00007fa5a70393fc 00007fa5a6c0b1b4 00007fa5a6d0937e 00007fa5a51ca2a4 00007fa5a51ca232 00007fa5a51ca161 00007fa5a51ca0dc 00007fa5a51c9392 00007fa59f18748c 00007fa59f1868c6
0709 13:19:40.817410 (+23345405us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:40.703448 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:40.704019 (+   571us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:40.704058 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:19:40.704077 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:40.705158 (+  1081us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:40.705225 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:40.705258 (+    33us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:19:40.706399 (+  1141us) tablet.cc:701] Row locks acquired
0709 13:19:40.706421 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:19:40.706573 (+   152us) write_op.cc:270] Start()
0709 13:19:40.706695 (+   122us) write_op.cc:276] Timestamp: P: 1783603180706530 usec, L: 0
0709 13:19:40.706730 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:19:40.707436 (+   706us) log.cc:844] Serialized 4810 byte log entry
0709 13:19:40.712792 (+  5356us) op_driver.cc:464] REPLICATION: finished
0709 13:19:40.714040 (+  1248us) write_op.cc:301] APPLY: starting
0709 13:19:40.714124 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:40.720719 (+  6595us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:40.720825 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:40.737251 (+ 16426us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:40.745560 (+  8309us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:19:40.745626 (+    66us) write_op.cc:312] APPLY: finished
0709 13:19:40.746010 (+   384us) log.cc:844] Serialized 113 byte log entry
0709 13:19:40.746878 (+   868us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:40.747045 (+   167us) write_op.cc:454] Released schema lock
0709 13:19:40.747102 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:40.768288 (+ 21186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:40.768318 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10,"reported_tablets":49,"spinlock_wait_cycles":3343232,"child_traces":[["op",{"apply.queue_time_us":1032,"apply.run_cpu_time_us":15645,"apply.run_wall_time_us":54220,"cfile_cache_hit":48,"cfile_cache_hit_bytes":50136,"num_ops":12,"prepare.queue_time_us":99,"prepare.run_cpu_time_us":4327,"prepare.run_wall_time_us":7538,"replication_time_us":5931}]]}
I20260709 13:19:40.846164  7998 catalog_manager.cc:5697] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 22 to 26, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 26 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.854734  8074 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:40.854494  7998 catalog_manager.cc:5697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 17 to 19, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 19 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.857051 16232 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 32 FOLLOWER]: Leader election won for term 32
I20260709 13:19:40.857587 16232 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 32 LEADER]: Becoming Leader. State: Replica: 9480609eccc44250a4d7fcc9686e76cf, State: Running, Role: LEADER
I20260709 13:19:40.858448 16232 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 30.15, Last appended by leader: 15, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:40.859064  7998 catalog_manager.cc:5697] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.861651  7998 catalog_manager.cc:5697] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 19 to 20, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 20 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:40.863278  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:40.848379 16036 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:40.863765  7998 catalog_manager.cc:5697] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 16 to 22, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 22 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.888494  7998 catalog_manager.cc:5697] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 20 to 23, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 23 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.895946  7998 catalog_manager.cc:5697] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:40.897836  7998 catalog_manager.cc:5697] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 20 to 24, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 24 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.900409  7998 catalog_manager.cc:5697] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.913704  7998 catalog_manager.cc:5697] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 21 to 24, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 24 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.915664 16255 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 32 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:40.902654  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 48559.9us
I20260709 13:19:40.917207  7998 catalog_manager.cc:5697] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 22 to 23, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 23 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.926889  7998 catalog_manager.cc:5697] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 14 to 22. New cstate: current_term: 22 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:40.930302  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d160e7dbe4ab091e90aaddec43a43" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:40.933684  7998 catalog_manager.cc:5697] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 23 to 24, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 24 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:40.947082  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 59209.4us
I20260709 13:19:40.955376  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 32 candidate_status { last_received { term: 30 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:40.956001  8252 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:19:40.959272  8074 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:40.960608 16232 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:40.965335  8253 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:19:40.966220  8252 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9480609eccc44250a4d7fcc9686e76cf in term 32.
I20260709 13:19:40.970475 16189 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:41.037343 16232 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:41.038034 16232 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:41.041666  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:41.052618  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5590746c03af49c9a057629ee7fe6bfb" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:41.055136 16255 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.055855 16255 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:41.071270  8180 raft_consensus.cc:1275] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:19:41.073621  8074 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:41.075022 16315 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:41.076951 16232 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:41.078775 16255 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:41.087143  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:41.089679  8223 consensus_peers.cc:597] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:41.089964 16232 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.090565 16232 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:41.096532 16232 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:41.099337  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:41.100817  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0aa1a34518f4bbdb1d1676b4a1541d8" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:41.102696  8074 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:41.117034 16232 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:41.119655  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6353b347875648eda7077a6a3bc633fd" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:41.129837 16232 raft_consensus.cc:493] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.130503 16232 raft_consensus.cc:515] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:41.132822  8072 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:41.133327 16312 consensus_queue.cc:1048] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:41.134444 16315 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:41.146092  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:41.169525 16232 leader_election.cc:290] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:41.170081  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd035b4a624c4c7aa2257c2821868021" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:41.171686  8072 leader_election.cc:304] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:41.174079 16232 raft_consensus.cc:2749] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:41.194366 16232 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:41.195035 16232 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:41.198077  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:41.201663  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e424b91f5394cedb3ad1923bab01174" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:41.206169  8072 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:41.208555 16315 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:41.209196  7998 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39828 (request call id 281) took 15772 ms (client timeout 15000 ms). Trace:
I20260709 13:19:41.211527  7997 catalog_manager.cc:5697] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:41.213389 16232 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:41.213104  7997 catalog_manager.cc:5697] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 24 to 26, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 26 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:41.214874  7997 catalog_manager.cc:5697] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 17 to 26, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 26 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.216352  7997 catalog_manager.cc:5697] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 23 to 24, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 24 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:41.218026  7997 catalog_manager.cc:5697] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 26 to 28, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 28 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.219461  7997 catalog_manager.cc:5697] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:41.209628  7998 rpcz_store.cc:269] 0709 13:19:25.437129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.510993 (+ 73864us) service_pool.cc:224] Handling call
0709 13:19:41.209131 (+15698138us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:41.025765 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:41.026405 (+   640us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:41.026446 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:19:41.026467 (+    21us) tablet.cc:662] Decoding operations
0709 13:19:41.027946 (+  1479us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:41.028023 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:41.028068 (+    45us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:19:41.029344 (+  1276us) tablet.cc:701] Row locks acquired
0709 13:19:41.029362 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:19:41.029575 (+   213us) write_op.cc:270] Start()
0709 13:19:41.029738 (+   163us) write_op.cc:276] Timestamp: P: 1783603181029509 usec, L: 0
0709 13:19:41.029766 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:19:41.030532 (+   766us) log.cc:844] Serialized 5969 byte log entry
0709 13:19:41.034710 (+  4178us) op_driver.cc:464] REPLICATION: finished
0709 13:19:41.035483 (+   773us) write_op.cc:301] APPLY: starting
0709 13:19:41.035570 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:41.048929 (+ 13359us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:41.049025 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:41.143767 (+ 94742us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:41.149657 (+  5890us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:19:41.149723 (+    66us) write_op.cc:312] APPLY: finished
0709 13:19:41.150187 (+   464us) log.cc:844] Serialized 139 byte log entry
0709 13:19:41.150402 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:41.150614 (+   212us) write_op.cc:454] Released schema lock
0709 13:19:41.150684 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:41.151107 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:41.151138 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":556,"apply.run_cpu_time_us":20423,"apply.run_wall_time_us":115567,"cfile_cache_hit":60,"cfile_cache_hit_bytes":62670,"num_ops":15,"prepare.queue_time_us":7449,"prepare.run_cpu_time_us":5282,"prepare.run_wall_time_us":8493,"replication_time_us":4812}]]}
I20260709 13:19:41.221009  7997 catalog_manager.cc:5697] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.234448  7997 catalog_manager.cc:5697] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 19 to 22, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 22 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.236208  7997 catalog_manager.cc:5697] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.239099  7997 catalog_manager.cc:5697] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:41.240687  7997 catalog_manager.cc:5697] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:41.242525  7997 catalog_manager.cc:5697] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 20 to 23, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 23 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.244536  7997 catalog_manager.cc:5697] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 22 to 24, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 24 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:41.260497  7997 catalog_manager.cc:5697] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 16 to 26, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 26 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.262138  7997 catalog_manager.cc:5697] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 23 to 25, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 25 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.263482  7997 catalog_manager.cc:5697] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 23 to 27, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 27 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.264902  7997 catalog_manager.cc:5697] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 18 to 20, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 20 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.266244  7997 catalog_manager.cc:5697] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 24 to 25, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 25 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.267504  7997 catalog_manager.cc:5697] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.268910  7997 catalog_manager.cc:5697] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 24 to 27, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 27 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.275238  7997 catalog_manager.cc:5697] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 23 to 26, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 26 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.276575  7997 catalog_manager.cc:5697] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 22 to 26. New cstate: current_term: 26 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.277809  7997 catalog_manager.cc:5697] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 16 to 18, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 18 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.279040  7997 catalog_manager.cc:5697] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:41.280376  7997 catalog_manager.cc:5697] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 19 to 21, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 21 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
W20260709 13:19:41.288702  8149 consensus_peers.cc:597] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:41.301822  8254 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 32 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 30 index: 15. Preceding OpId from leader: term: 32 index: 16. (index mismatch)
I20260709 13:19:41.306207 16315 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:41.326928 16232 raft_consensus.cc:493] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:41.327515 16232 raft_consensus.cc:515] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:41.330403  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:41.330989 16232 leader_election.cc:290] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:41.332993  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3393bfbad81242a2a3374049ddfa0b63" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:41.334707  8074 leader_election.cc:304] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:41.335642 16232 raft_consensus.cc:2749] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:41.356107 16315 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:41.356966 16315 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:41.360667  8178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:41.360957 16315 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:41.362912  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6855110231054b5fa91235e8a822e101" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:41.370934  8074 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:41.372363 16255 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:41.364795  8149 consensus_peers.cc:597] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:41.393059  8178 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 32 FOLLOWER]: Refusing update from remote peer 9480609eccc44250a4d7fcc9686e76cf: Log matching property violated. Preceding OpId in replica: term: 30 index: 15. Preceding OpId from leader: term: 32 index: 16. (index mismatch)
I20260709 13:19:41.394593 16317 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:19:41.450639  8149 consensus_peers.cc:597] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:41.522490  8000 catalog_manager.cc:5697] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 19 to 24. New cstate: current_term: 24 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:41.527036  8000 catalog_manager.cc:5697] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 16 to 23, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 23 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:41.553943  7002 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 8133)
I20260709 13:19:41.569703  8000 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36106 (request call id 209) took 1011 ms. Trace:
I20260709 13:19:41.570288  8000 rpcz_store.cc:276] 0709 13:19:40.558775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.561548 (+  2773us) service_pool.cc:224] Handling call
0709 13:19:41.569637 (+1008089us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:41.532044 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:41.532589 (+   545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:41.532623 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:19:41.532639 (+    16us) tablet.cc:662] Decoding operations
0709 13:19:41.533022 (+   383us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:41.533075 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:41.533105 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:19:41.533416 (+   311us) tablet.cc:701] Row locks acquired
0709 13:19:41.533457 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:19:41.533605 (+   148us) write_op.cc:270] Start()
0709 13:19:41.533729 (+   124us) write_op.cc:276] Timestamp: P: 1783603181533560 usec, L: 0
0709 13:19:41.533752 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:19:41.534244 (+   492us) log.cc:844] Serialized 919 byte log entry
0709 13:19:41.536435 (+  2191us) op_driver.cc:464] REPLICATION: finished
0709 13:19:41.536801 (+   366us) write_op.cc:301] APPLY: starting
0709 13:19:41.536884 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:41.538169 (+  1285us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:41.538259 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:41.539411 (+  1152us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:41.539556 (+   145us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:19:41.539598 (+    42us) write_op.cc:312] APPLY: finished
0709 13:19:41.539780 (+   182us) log.cc:844] Serialized 33 byte log entry
0709 13:19:41.540591 (+   811us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:41.540675 (+    84us) write_op.cc:454] Released schema lock
0709 13:19:41.540712 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:41.541174 (+   462us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:41.541200 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5076,"reported_tablets":7,"spinlock_wait_cycles":76032,"child_traces":[["op",{"apply.queue_time_us":139,"apply.run_cpu_time_us":3624,"apply.run_wall_time_us":4336,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8356,"num_ops":2,"prepare.queue_time_us":98,"prepare.run_cpu_time_us":2501,"prepare.run_wall_time_us":2499,"replication_time_us":2557}]]}
I20260709 13:19:41.594894  7997 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39828 (request call id 282) took 1042 ms. Trace:
I20260709 13:19:41.607686  7997 rpcz_store.cc:276] 0709 13:19:40.552506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.552754 (+   248us) service_pool.cc:224] Handling call
0709 13:19:41.594826 (+1042072us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:41.318837 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:41.319429 (+   592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:41.319467 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:19:41.319486 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:41.321446 (+  1960us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:41.321508 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:41.321540 (+    32us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:19:41.332652 (+ 11112us) tablet.cc:701] Row locks acquired
0709 13:19:41.332673 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:19:41.332802 (+   129us) write_op.cc:270] Start()
0709 13:19:41.332912 (+   110us) write_op.cc:276] Timestamp: P: 1783603181332768 usec, L: 0
0709 13:19:41.332933 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:19:41.333745 (+   812us) log.cc:844] Serialized 9844 byte log entry
0709 13:19:41.337955 (+  4210us) op_driver.cc:464] REPLICATION: finished
0709 13:19:41.338334 (+   379us) write_op.cc:301] APPLY: starting
0709 13:19:41.338495 (+   161us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:41.392192 (+ 53697us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:41.392286 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:41.489778 (+ 97492us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:41.490118 (+   340us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:19:41.490168 (+    50us) write_op.cc:312] APPLY: finished
0709 13:19:41.490664 (+   496us) log.cc:844] Serialized 220 byte log entry
0709 13:19:41.507891 (+ 17227us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:41.508133 (+   242us) write_op.cc:454] Released schema lock
0709 13:19:41.508184 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:41.508451 (+   267us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:41.508466 (+    15us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38608,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":132,"apply.run_cpu_time_us":33166,"apply.run_wall_time_us":170117,"cfile_cache_hit":100,"cfile_cache_hit_bytes":104450,"num_ops":25,"prepare.queue_time_us":122,"prepare.run_cpu_time_us":6261,"prepare.run_wall_time_us":16584,"replication_time_us":4639,"spinlock_wait_cycles":524672}]]}
I20260709 13:19:41.636169  7997 catalog_manager.cc:5697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 27 to 32, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129). New cstate: current_term: 32 leader_uuid: "9480609eccc44250a4d7fcc9686e76cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } }
I20260709 13:19:41.639822 16232 raft_consensus.cc:493] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:41.640442 16232 raft_consensus.cc:515] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:41.643507  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:41.655390 16317 raft_consensus.cc:493] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:41.656013 16317 raft_consensus.cc:515] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:41.659147 16232 leader_election.cc:290] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:41.660359  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e4649131cb4b10a82b13d0d2b8e85a" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:41.660862 16317 leader_election.cc:290] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:41.661681  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:41.662117  8072 leader_election.cc:304] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:41.663160 16317 raft_consensus.cc:2749] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:41.664026  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8584c73fd4f14469baaaebe16617e775" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:41.665448  8072 leader_election.cc:304] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:41.666684 16317 raft_consensus.cc:2749] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:41.690371  8149 consensus_peers.cc:597] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:41.773577  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:41.784391  8003 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39828 (request call id 277) took 98192 ms (client timeout 15000 ms). Trace:
W20260709 13:19:41.788014  8149 consensus_peers.cc:597] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:41.799489  8003 rpcz_store.cc:269] 0709 13:18:03.591525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.591778 (+   253us) service_pool.cc:224] Handling call
0709 13:19:41.742290 (+98150512us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b680011e160. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa5a6c27de1 00007fa5a6c050ca 00007fa5a6c03808 00007fa5a6c01e40 00007fa5a6d09c3e 00007fa5a51ca2a4 00007fa5a51ca232 00007fa5a51ca161 00007fa5a51ca0dc 00007fa5a51c9392 00007fa59f18748c
0709 13:19:41.784196 (+ 41906us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4125,"reported_tablets":49,"spinlock_wait_cycles":28285696}
I20260709 13:19:41.800915 16317 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:41.801505 16317 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:41.803607 16317 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:41.806214  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:41.806274  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0adcb7796ea47a4be5ddd094575ed19" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:41.811076  8074 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:41.813930 16317 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:41.827935  8149 consensus_peers.cc:597] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:41.868619  8006 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39814 (request call id 283) took 47529 ms (client timeout 15000 ms). Trace:
W20260709 13:19:41.873107  8006 rpcz_store.cc:269] 0709 13:18:54.374076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.429923 (+ 55847us) service_pool.cc:224] Handling call
0709 13:19:41.868424 (+47438501us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32241,"reported_tablets":49}
I20260709 13:19:41.912302 16315 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:41.912868 16315 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:41.915158 16315 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:41.916973  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:41.918891  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9e97576a934b9dbf18f6ee6cc670af" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:41.921396  8074 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:41.922789 16232 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:41.928784  7999 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39810 (request call id 299) took 14323 ms (client timeout 15000 ms). Trace:
W20260709 13:19:41.948977  7999 rpcz_store.cc:269] 0709 13:19:27.605131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.089543 (+8484412us) service_pool.cc:224] Handling call
0709 13:19:36.541779 (+452236us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b5400300110. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd28640 00007fa5a6bffb76 00007fa5a6d09c3e 00007fa5a51ca2a4 00007fa5a51ca232 00007fa5a51ca161 00007fa5a51ca0dc 00007fa5a51c9392 00007fa59f18748c 00007fa59f1868c6
0709 13:19:41.928703 (+5386924us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31128,"reported_tablets":48,"spinlock_wait_cycles":64582912}
I20260709 13:19:41.956496  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:41.958405  7002 tablet_replica.cc:333] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:41.959340  7002 raft_consensus.cc:2243] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.959995  7002 pending_rounds.cc:70] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Trying to abort 1 pending ops.
I20260709 13:19:41.960276  7002 pending_rounds.cc:77] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf: Aborting op as it isn't in flight: id { term: 24 index: 13 } timestamp: 7305638590355591168 op_type: NO_OP noop_request { }
I20260709 13:19:41.960824  7002 raft_consensus.cc:2889] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:41.961164  7002 raft_consensus.cc:2272] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:41.962247  8149 consensus_peers.cc:597] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:41.964213  7002 tablet_replica.cc:333] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:41.965226  7002 raft_consensus.cc:2243] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.965772  7002 raft_consensus.cc:2272] T ba766a24d6d541fcbbc260fd5545d9ca P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.968724  7002 tablet_replica.cc:333] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:41.969628  7002 raft_consensus.cc:2243] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.970263  7002 raft_consensus.cc:2272] T ff9e97576a934b9dbf18f6ee6cc670af P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.972992  7002 tablet_replica.cc:333] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:41.979262 16317 raft_consensus.cc:493] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5033fc7e66374940a203908ea8b0078f)
I20260709 13:19:41.979915 16317 raft_consensus.cc:515] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:41.983009  7002 raft_consensus.cc:2243] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.983664  7002 raft_consensus.cc:2272] T 43e4649131cb4b10a82b13d0d2b8e85a P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.983620  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:41.984122 16317 leader_election.cc:290] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:41.985710  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dded0a12a5b14bc38c2b5ac21e951545" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:41.986675  7002 tablet_replica.cc:333] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:41.987330  8072 leader_election.cc:304] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:41.987671  7002 raft_consensus.cc:2243] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.988245  7002 raft_consensus.cc:2272] T b3279fc005d149f8aad5d0df46e09fda P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.997632 16317 raft_consensus.cc:2749] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:41.999900  7002 tablet_replica.cc:333] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.000938  7002 raft_consensus.cc:2243] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.001748  7002 raft_consensus.cc:2272] T 21cda219d2624c108a6700de24d60d86 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.004539  7002 tablet_replica.cc:333] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.005396  7002 raft_consensus.cc:2243] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.013684  8002 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39814 (request call id 285) took 5268 ms. Trace:
I20260709 13:19:42.026409  7002 raft_consensus.cc:2272] T b491e7c261394e498f940b0169e957b6 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.029505  7002 tablet_replica.cc:333] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.030332  7002 raft_consensus.cc:2243] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.031005  7002 raft_consensus.cc:2272] T 9abaa411847e4bf9907f7af5e2689c7b P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.033757  7002 tablet_replica.cc:333] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.026211  8002 rpcz_store.cc:276] 0709 13:19:36.745329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.437047 (+691718us) service_pool.cc:224] Handling call
0709 13:19:42.013608 (+4576561us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55504,"reported_tablets":49}
I20260709 13:19:42.034621  7002 raft_consensus.cc:2243] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.035387  7002 raft_consensus.cc:2272] T d3439ee9684744c187e7b7e3627aecda P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.050410  7002 tablet_replica.cc:333] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.054195  7002 raft_consensus.cc:2243] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.055266  7002 raft_consensus.cc:2272] T d092bc636e5347e5a3f10441d996ec96 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.076565  7002 tablet_replica.cc:333] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.077643  7002 raft_consensus.cc:2243] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.078537  7002 raft_consensus.cc:2272] T 7c962bcd58c74013abdb370fa758d500 P 9480609eccc44250a4d7fcc9686e76cf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.081977  7002 tablet_replica.cc:333] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.082937  7002 raft_consensus.cc:2243] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.105474  7002 raft_consensus.cc:2272] T a64e531fcf0742cd8db17f008824d588 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.108353  7002 tablet_replica.cc:333] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.109123  7002 raft_consensus.cc:2243] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.109712  7002 raft_consensus.cc:2272] T 5590746c03af49c9a057629ee7fe6bfb P 9480609eccc44250a4d7fcc9686e76cf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.112301  7002 tablet_replica.cc:333] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.113056  7002 raft_consensus.cc:2243] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.133737  7002 raft_consensus.cc:2272] T d0adcb7796ea47a4be5ddd094575ed19 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.136613  7002 tablet_replica.cc:333] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.137406  7002 raft_consensus.cc:2243] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.138064  7002 raft_consensus.cc:2272] T 7f981ef6ec7847cf851489769fac4dff P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.140682  7002 tablet_replica.cc:333] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.151598  7002 raft_consensus.cc:2243] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.152215  7002 raft_consensus.cc:2272] T 6e624c9e6425410d86ead659c0c8db59 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.154860  7002 tablet_replica.cc:333] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.155629  7002 raft_consensus.cc:2243] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.156275  7002 raft_consensus.cc:2272] T cd035b4a624c4c7aa2257c2821868021 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.178709  7002 tablet_replica.cc:333] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.179551  7002 raft_consensus.cc:2243] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.180615  7002 raft_consensus.cc:2272] T c239eb8b961c4362b6e905c0fa6fbd98 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.183230  7002 tablet_replica.cc:333] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.184002  7002 raft_consensus.cc:2243] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.184628  7002 pending_rounds.cc:70] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Trying to abort 1 pending ops.
I20260709 13:19:42.184849  7002 pending_rounds.cc:77] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf: Aborting op as it isn't in flight: id { term: 24 index: 18 } timestamp: 7305638589778735104 op_type: NO_OP noop_request { }
I20260709 13:19:42.185186  7002 raft_consensus.cc:2889] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:42.209597  7002 raft_consensus.cc:2272] T 45c332ea272c465d9e07083a06e802e7 P 9480609eccc44250a4d7fcc9686e76cf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.212713  7002 tablet_replica.cc:333] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.213609  7002 raft_consensus.cc:2243] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.214824  7002 raft_consensus.cc:2272] T 98857d2610494fdda88f0508d2370cd7 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.230219  7002 tablet_replica.cc:333] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.231137  7002 raft_consensus.cc:2243] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.232012  7002 raft_consensus.cc:2272] T 09ff07a1f02d49f0923422e378a20d4a P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.241060  7002 tablet_replica.cc:333] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.241875  7002 raft_consensus.cc:2243] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.242447  7002 raft_consensus.cc:2272] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.245023  7002 tablet_replica.cc:333] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.245798  7002 raft_consensus.cc:2243] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.246359  7002 pending_rounds.cc:70] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Trying to abort 1 pending ops.
I20260709 13:19:42.246627  7002 pending_rounds.cc:77] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf: Aborting op as it isn't in flight: id { term: 25 index: 15 } timestamp: 7305638580394094592 op_type: NO_OP noop_request { }
I20260709 13:19:42.246968  7002 raft_consensus.cc:2889] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:42.247311  7002 raft_consensus.cc:2272] T be8c836876cb41918064b2082dd48efe P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:42.251315  8149 consensus_peers.cc:597] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:42.263155  7002 tablet_replica.cc:333] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.281471  7002 raft_consensus.cc:2243] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.282614  7002 raft_consensus.cc:2272] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.285310  7002 tablet_replica.cc:333] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.286147  7002 raft_consensus.cc:2243] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.287354  7002 raft_consensus.cc:2272] T 264ed863486e43df8dfe1478dfb034ee P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.297246  7002 tablet_replica.cc:333] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.298074  7002 raft_consensus.cc:2243] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.298626  7002 pending_rounds.cc:70] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Trying to abort 1 pending ops.
I20260709 13:19:42.298859  7002 pending_rounds.cc:77] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf: Aborting op as it isn't in flight: id { term: 27 index: 16 } timestamp: 7305638589273452544 op_type: NO_OP noop_request { }
I20260709 13:19:42.299221  7002 raft_consensus.cc:2889] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:42.299548  7002 raft_consensus.cc:2272] T d3456040ac8e456eabcfa4db8a2b5510 P 9480609eccc44250a4d7fcc9686e76cf [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:42.309362  8001 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39828 (request call id 279) took 60931 ms (client timeout 15000 ms). Trace:
I20260709 13:19:42.316708  7002 tablet_replica.cc:333] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.317662  7002 raft_consensus.cc:2243] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.319535  7002 raft_consensus.cc:2272] T e1e020840d414fa992e8afcd5cffaad4 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:42.320701  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:42.317854  8001 rpcz_store.cc:269] 0709 13:18:41.377936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.378081 (+   145us) service_pool.cc:224] Handling call
0709 13:18:41.703376 (+325295us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b5400300110. stack: 00007fa59dd2d343 00007fa59dd2d240 00007fa59d6bc1d4 00007fa5a73fa304 00007fa5a73fa299 00007fa59dbe7db1 00007fa59dd27b71 00007fa59dd280b2 00007fa5a6ca1a89 00007fa5a6c39da6 00007fa5a6c0b088 00007fa5a6d0937e 00007fa5a51ca2a4 00007fa5a51ca232 00007fa5a51ca161 00007fa5a51ca0dc
0709 13:19:42.309156 (+60605780us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":959050,"reported_tablets":49,"spinlock_wait_cycles":5774720}
I20260709 13:19:42.322208  7002 tablet_replica.cc:333] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.349023  7002 raft_consensus.cc:2243] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.350229  7002 raft_consensus.cc:2272] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.353027  7002 tablet_replica.cc:333] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.353922  7002 raft_consensus.cc:2243] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.354522  7002 raft_consensus.cc:2272] T 5247aeecdc5c4ebf8516da3b94073f35 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.363296  7002 tablet_replica.cc:333] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.364161  7002 raft_consensus.cc:2243] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.364832  7002 raft_consensus.cc:2272] T 6855110231054b5fa91235e8a822e101 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.367362  7002 tablet_replica.cc:333] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
W20260709 13:19:42.367698  8149 consensus_peers.cc:597] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:42.368115  7002 raft_consensus.cc:2243] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.368647  7002 pending_rounds.cc:70] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Trying to abort 1 pending ops.
I20260709 13:19:42.368830  7002 pending_rounds.cc:77] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf: Aborting op as it isn't in flight: id { term: 24 index: 16 } timestamp: 7305638566741581824 op_type: NO_OP noop_request { }
I20260709 13:19:42.369102  7002 raft_consensus.cc:2889] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:42.388737 16232 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.389492  7002 raft_consensus.cc:2272] T 6353b347875648eda7077a6a3bc633fd P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.389312 16232 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:42.391597 16232 leader_election.cc:290] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:42.392318  7002 tablet_replica.cc:333] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.393121  7002 raft_consensus.cc:2243] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.393743  7002 raft_consensus.cc:2272] T c362335b215641d38dd0c651acfb8fbb P 9480609eccc44250a4d7fcc9686e76cf [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.396345  7002 tablet_replica.cc:333] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.396900  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:42.401598 16255 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:42.402226 16255 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:42.404592 16255 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:42.411808  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53fff91826424990da23103f484232" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 28 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:42.415292  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:42.419605  8074 leader_election.cc:304] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:42.421326 16315 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:42.422839  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb334e41695d4d8c8d5de4eb668cd421" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:42.424242  8223 consensus_peers.cc:597] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:42.431804 16317 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:19:42.432379 16317 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:42.437664 16317 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:42.443475  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:42.444096  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d69cb3874984241afb1521d6e9178f2" candidate_uuid: "9480609eccc44250a4d7fcc9686e76cf" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:42.446354  8074 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:42.447914 16232 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:42.448997  8072 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9480609eccc44250a4d7fcc9686e76cf; no voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:42.451653 16232 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:42.397099  7002 raft_consensus.cc:2243] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 32 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.484673  7002 raft_consensus.cc:2272] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9480609eccc44250a4d7fcc9686e76cf [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.514386  7002 tablet_replica.cc:333] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.540428  7002 raft_consensus.cc:2243] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.541662  7002 raft_consensus.cc:2272] T c0190f54981846a5a2a1df128af42b35 P 9480609eccc44250a4d7fcc9686e76cf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.576197  7002 tablet_replica.cc:333] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.577178  7002 raft_consensus.cc:2243] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.577847  7002 raft_consensus.cc:2272] T eb334e41695d4d8c8d5de4eb668cd421 P 9480609eccc44250a4d7fcc9686e76cf [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:42.598443  8149 consensus_peers.cc:597] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:42.599145  8149 consensus_peers.cc:597] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:42.609257  8223 consensus_peers.cc:597] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:42.610013  8223 consensus_peers.cc:597] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:42.620029  8149 consensus_peers.cc:597] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:42.628404  7002 tablet_replica.cc:333] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.642174  7002 raft_consensus.cc:2243] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.643396  7002 raft_consensus.cc:2272] T 6e8201b083554b0cb094760a4ff0fd39 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:42.634859  8223 consensus_peers.cc:597] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:42.636879  8149 consensus_peers.cc:597] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:42.653124  8223 consensus_peers.cc:597] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:42.657581  7002 tablet_replica.cc:333] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.659559  7002 raft_consensus.cc:2243] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.660473  7002 raft_consensus.cc:2272] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.663889  7002 tablet_replica.cc:333] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.664705  7002 raft_consensus.cc:2243] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.665827  7002 pending_rounds.cc:70] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Trying to abort 1 pending ops.
I20260709 13:19:42.666249  7002 pending_rounds.cc:77] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf: Aborting op as it isn't in flight: id { term: 26 index: 16 } timestamp: 7305638585558736896 op_type: NO_OP noop_request { }
I20260709 13:19:42.666834  7002 raft_consensus.cc:2889] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:42.667412  7002 raft_consensus.cc:2272] T 5d69cb3874984241afb1521d6e9178f2 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.670651  7002 tablet_replica.cc:333] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.675036  7002 raft_consensus.cc:2243] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.675801  7002 raft_consensus.cc:2272] T 7e424b91f5394cedb3ad1923bab01174 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.678880  7002 tablet_replica.cc:333] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.679755  7002 raft_consensus.cc:2243] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.680429  7002 raft_consensus.cc:2272] T 8584c73fd4f14469baaaebe16617e775 P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.683527  7002 tablet_replica.cc:333] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.700851  7002 raft_consensus.cc:2243] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.701893  7002 raft_consensus.cc:2272] T bf53fff91826424990da23103f484232 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.704838  7002 tablet_replica.cc:333] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.705703  7002 raft_consensus.cc:2243] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.706629  7002 raft_consensus.cc:2272] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9480609eccc44250a4d7fcc9686e76cf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.712354  7002 tablet_replica.cc:333] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.713371  7002 raft_consensus.cc:2243] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.714556  7002 raft_consensus.cc:2272] T 6874782ad0e549bd89899c965cd46c33 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.717322  7002 tablet_replica.cc:333] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.723044  7002 raft_consensus.cc:2243] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.724373  7002 raft_consensus.cc:2272] T 7588eb91ce3841808ca10d7985976be2 P 9480609eccc44250a4d7fcc9686e76cf [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:42.731513  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:42.733117  7002 tablet_replica.cc:333] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.734133  7002 raft_consensus.cc:2243] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.734906  7002 raft_consensus.cc:2272] T 3e54e69639dd478bb5f966d86c83c95d P 9480609eccc44250a4d7fcc9686e76cf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.738400  7002 tablet_replica.cc:333] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.739300  7002 raft_consensus.cc:2243] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.740105  7002 pending_rounds.cc:70] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Trying to abort 2 pending ops.
I20260709 13:19:42.740418  7002 pending_rounds.cc:77] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Aborting op as it isn't in flight: id { term: 26 index: 17 } timestamp: 7305638585074958336 op_type: NO_OP noop_request { }
I20260709 13:19:42.740885  7002 raft_consensus.cc:2889] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:42.741276  7002 pending_rounds.cc:77] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf: Aborting op as it isn't in flight: id { term: 24 index: 16 } timestamp: 7305638551536635904 op_type: NO_OP noop_request { }
I20260709 13:19:42.741838  7002 raft_consensus.cc:2889] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:42.742276  7002 raft_consensus.cc:2272] T 3393bfbad81242a2a3374049ddfa0b63 P 9480609eccc44250a4d7fcc9686e76cf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.753314  7002 tablet_replica.cc:333] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
W20260709 13:19:42.754752  8149 consensus_peers.cc:597] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:42.755527  7002 raft_consensus.cc:2243] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.757128  7002 raft_consensus.cc:2272] T fa9dafbde3954b8487327ba47919b4d5 P 9480609eccc44250a4d7fcc9686e76cf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.760524  7002 tablet_replica.cc:333] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf: stopping tablet replica
I20260709 13:19:42.761305  7002 raft_consensus.cc:2243] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.762454  7002 raft_consensus.cc:2272] T dded0a12a5b14bc38c2b5ac21e951545 P 9480609eccc44250a4d7fcc9686e76cf [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:42.771129  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:42.813679  8223 consensus_peers.cc:597] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:42.823764  8149 consensus_peers.cc:597] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:42.825394  8149 consensus_peers.cc:597] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:42.902563  8223 consensus_peers.cc:597] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:42.908581  8223 consensus_peers.cc:597] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:43.023433  8223 consensus_peers.cc:597] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:43.045071  8223 consensus_peers.cc:597] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:43.046293  8149 consensus_peers.cc:597] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:43.137372 16324 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.138031 16324 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:43.142364 16324 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:43.171492  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:43.178182  8223 consensus_peers.cc:597] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:43.191350 16331 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.192004 16331 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.197083 16331 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:43.209414  8755 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:43.210192  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:43.219064 16324 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:43.219515 16316 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.220089 16316 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:43.222553 16316 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:43.226222  8149 consensus_peers.cc:597] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:43.227622  8223 leader_election.cc:336] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:43.228631  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:43.239624  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:43.266016  8221 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:43.267373 16316 raft_consensus.cc:2749] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:43.276365  8149 leader_election.cc:336] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:43.289045  8149 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:43.296084 16331 raft_consensus.cc:2749] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:43.373688 16316 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.374280 16316 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.378049 16316 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:43.380266  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
W20260709 13:19:43.383270  8223 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:43.383822  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:43.385068 16316 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:43.387838 16316 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.388721 16316 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.394042 16309 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.394618 16309 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:43.396733 16309 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:43.396939  8223 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:43.398161 16316 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:43.398524  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:43.399137  8782 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:43.399549  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:43.400213  8147 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:43.401130  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:43.402009 16260 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:43.402400 16260 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.402752 16316 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:43.402891 16331 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.403419 16331 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.402768 16260 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:43.411752 16331 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:43.427095 16316 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.428051 16316 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.429214 16260 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:43.432451  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d092bc636e5347e5a3f10441d996ec96" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:43.433018  8782 raft_consensus.cc:3060] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:43.440526  8782 raft_consensus.cc:2468] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 25.
I20260709 13:19:43.440711 16333 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.441236 16333 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:43.441718  8147 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:43.442581 16331 raft_consensus.cc:2804] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:43.443069 16331 raft_consensus.cc:697] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:43.443315 16333 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:43.444288 16333 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.444999 16260 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:43.444839 16333 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:43.447166 16333 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:43.443938 16331 consensus_queue.cc:237] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:43.454377 16316 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:43.461866  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:43.462584  8251 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:43.467447  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:43.468101  8251 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 26.
I20260709 13:19:43.475658  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:43.476410  8182 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:43.479627  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:43.489413  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:43.495692  8002 catalog_manager.cc:5697] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 24 to 25, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 25 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.512389 16170 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:43.512828 16170 raft_consensus.cc:493] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
W20260709 13:19:43.501681  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:43.513196 16170 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:43.521049 16170 raft_consensus.cc:515] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.526619 16170 leader_election.cc:290] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:43.533806  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:43.555922 16324 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:43.556360 16324 raft_consensus.cc:493] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.556768 16324 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:43.570402  8223 leader_election.cc:336] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:43.582922 16324 raft_consensus.cc:515] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:43.585192 16324 leader_election.cc:290] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:43.589530 16331 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.625782 16331 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.627976 16331 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:43.590920  8149 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:43.602597  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacbbdcc46cd40c0bf26d6ceb75d464d" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:43.628909  8182 raft_consensus.cc:3060] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:19:43.636010  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 45171.3us
I20260709 13:19:43.640386  8182 raft_consensus.cc:2468] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 27.
I20260709 13:19:43.641237 16331 raft_consensus.cc:2764] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
W20260709 13:19:43.622237  8755 leader_election.cc:336] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:43.644450  8755 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:43.645010  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:43.645903 16333 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:43.669648 16316 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.670499 16316 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.673056 16316 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:43.678045  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 65276.9us
I20260709 13:19:43.689157 16316 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.689930 16316 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.692150 16316 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:43.699910  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f0b0ff1e4f482fbd5d5bb078488de9" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:43.743248  8251 raft_consensus.cc:3060] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:43.746258 16333 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.747022 16333 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:43.740226  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:43.748692  8182 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 27.
I20260709 13:19:43.723695  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:43.749724  8254 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 26.
I20260709 13:19:43.753221 16333 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:43.765020  8251 raft_consensus.cc:2468] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 24.
W20260709 13:19:43.771497  8223 leader_election.cc:336] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:43.773887  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 67548.1us
W20260709 13:19:43.805387  8223 consensus_peers.cc:597] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:43.780488 16324 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.784425 16309 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.806362 16309 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.806357 16324 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:43.808686 16309 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:43.809166 16324 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:43.793088 16260 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.810256 16260 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:43.813164 16260 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:43.815635  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:43.816498  8782 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:43.827102 16170 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.827666 16170 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:43.830340 16170 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:43.796334  8149 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:43.842197  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 45892.4us
I20260709 13:19:43.852896 16331 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.853590 16331 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.855827 16331 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:43.843055  8223 leader_election.cc:304] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:43.851423  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:43.856769  8254 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 25.
I20260709 13:19:43.856986 16316 raft_consensus.cc:2804] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:43.851864  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:43.857601 16316 raft_consensus.cc:697] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 27 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:43.858541 16316 consensus_queue.cc:237] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.863536 16334 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.864219 16334 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.867053  8147 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
W20260709 13:19:43.867918  8149 leader_election.cc:336] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:43.868534  8149 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:43.871236  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:43.871727  8755 leader_election.cc:304] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:43.871838  8251 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
I20260709 13:19:43.872068  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:43.872664  8783 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:43.874486  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:43.875702 16344 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.876284 16344 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.876979 16333 raft_consensus.cc:2804] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:43.877544 16333 raft_consensus.cc:697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 24 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:43.878633 16344 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:43.878456 16333 consensus_queue.cc:237] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:43.885866 16170 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:43.886278 16170 raft_consensus.cc:493] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.886613 16170 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:43.888561  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:43.907253 16345 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:43.907773 16345 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.908216 16345 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:43.913004 16334 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:43.917599  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 49891.6us
I20260709 13:19:43.923125 16170 raft_consensus.cc:515] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.925276 16344 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.936425 16344 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:43.938162 16260 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.943197 16344 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:43.946537 16345 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:43.958459 16170 leader_election.cc:290] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:43.938822 16260 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:43.963311  8223 leader_election.cc:336] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:43.972134  8002 catalog_manager.cc:5697] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 26 to 27, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 27 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:43.989902  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 116740us
I20260709 13:19:43.990883  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:43.998064 16349 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:43.998665 16349 raft_consensus.cc:493] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:43.999044 16349 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:19:44.004446  8755 leader_election.cc:336] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.002219 16260 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:44.018844 16170 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:44.019374 16170 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:44.021266 16170 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:44.022017 16349 raft_consensus.cc:515] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:44.022965  8223 leader_election.cc:336] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.031343  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:44.004966 16350 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:44.033766 16350 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:44.033178 16170 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:44.034189  8223 leader_election.cc:336] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:44.035207  8223 leader_election.cc:336] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.035924 16350 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:44.038082 16349 leader_election.cc:290] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:44.039191  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:44.040019  8182 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
W20260709 13:19:44.040380  8223 leader_election.cc:336] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:44.040999  8223 leader_election.cc:336] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.041759  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:44.043566 16345 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:44.044631  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:44.045495  8180 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 26.
I20260709 13:19:44.047248  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98857d2610494fdda88f0508d2370cd7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:44.047981  8180 raft_consensus.cc:3060] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:44.054857  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:44.055601  8183 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:44.043640  8182 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 32.
W20260709 13:19:44.041993  8223 leader_election.cc:336] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:44.027583  8755 leader_election.cc:336] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.067337  8180 raft_consensus.cc:2468] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 28.
W20260709 13:19:44.067816  8755 leader_election.cc:336] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.085613  8755 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:44.086414 16349 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:44.068990  8223 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:44.069079  8002 catalog_manager.cc:5697] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 23 to 24, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 24 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:44.072923  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:44.090276 16358 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:44.090512  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:44.090716 16358 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:44.091836 16344 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:44.092325 16344 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:44.092797 16344 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:44.092955  8147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:45917, user_credentials={real_user=slave}} blocked reactor thread for 85329.2us
I20260709 13:19:44.091150 16358 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:44.097177  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:44.097802  8782 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:44.106674  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:44.098201  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e020840d414fa992e8afcd5cffaad4" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:44.107360  8254 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 23.
I20260709 13:19:44.107489  8783 raft_consensus.cc:3060] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:44.097613 16170 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:44.109620 16170 raft_consensus.cc:493] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:44.110076 16170 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:44.110293  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:44.111830  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
W20260709 13:19:44.114626  8149 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.117491 16316 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:44.117686  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:44.117940 16316 raft_consensus.cc:493] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:44.118340 16316 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:44.118311  8251 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 32.
I20260709 13:19:44.127097  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:44.127861 16170 raft_consensus.cc:515] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:44.138535 16170 leader_election.cc:290] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:44.138552  8254 raft_consensus.cc:2393] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 27: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
W20260709 13:19:44.132395  7002 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8129)
I20260709 13:19:44.135380  8783 raft_consensus.cc:2468] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 22.
I20260709 13:19:44.116837 16344 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:44.139787 16358 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:44.141831  8251 raft_consensus.cc:2393] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 24: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:44.142400 16344 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:44.131567 16316 raft_consensus.cc:515] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:44.143953  8147 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 
I20260709 13:19:44.146013  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:44.146656  8254 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 20.
I20260709 13:19:44.144531 16316 leader_election.cc:290] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:44.144968  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:44.147238 16358 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:44.148835 16348 raft_consensus.cc:2804] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:44.148869  8223 leader_election.cc:304] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:44.149610 16348 raft_consensus.cc:697] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:44.149910 16344 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 13:19:44.150503 16344 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 32 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:44.150933 16344 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 32 FOLLOWER]: Advancing to term 33
W20260709 13:19:44.152797  8149 consensus_peers.cc:597] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:44.151852  8783 raft_consensus.cc:1275] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 13:19:44.159936  8149 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.154501  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7588eb91ce3841808ca10d7985976be2" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:19:44.160642  8149 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.160769  8251 raft_consensus.cc:3060] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:44.151356 16316 raft_consensus.cc:2804] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Leader election won for term 28
W20260709 13:19:44.166926  8149 consensus_peers.cc:597] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:44.150521 16348 consensus_queue.cc:237] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:44.173171  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:44.174263  8180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874782ad0e549bd89899c965cd46c33" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:44.174906  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:44.175525  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e8201b083554b0cb094760a4ff0fd39" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:44.186060 16316 raft_consensus.cc:697] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 28 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:44.164932 16358 consensus_queue.cc:1048] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:19:44.187059  8182 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:44.186625  8784 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:44.186065  8149 leader_election.cc:336] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.186836  8180 raft_consensus.cc:3060] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:19:44.188941  8149 leader_election.cc:336] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.187176  8183 raft_consensus.cc:3060] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:44.195994  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:44.196581  8254 raft_consensus.cc:3060] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:44.200505  8251 raft_consensus.cc:2468] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 26.
W20260709 13:19:44.201146  8223 leader_election.cc:336] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:44.202113  8223 leader_election.cc:336] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.202530  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:44.203341 16358 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:44.203722 16358 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:44.204071 16358 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:44.204460  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:44.206125 16345 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 13:19:44.206496 16345 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 32 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:44.206826 16345 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 32 FOLLOWER]: Advancing to term 33
I20260709 13:19:44.208699  8784 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:44.176016 16344 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:44.211035 16344 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 33 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:44.211500 16358 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:44.202875  8223 leader_election.cc:336] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.213773  8182 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:44.215274 16316 consensus_queue.cc:237] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:44.213544 16358 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:44.216615  8254 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 27.
I20260709 13:19:44.218428  8183 raft_consensus.cc:2468] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:44.218346 16345 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:44.220198  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:44.220937  8180 raft_consensus.cc:2468] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 27.
I20260709 13:19:44.223683  8223 leader_election.cc:304] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:44.224509 16344 raft_consensus.cc:2804] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:44.225162 16344 raft_consensus.cc:697] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:44.224941  8223 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:44.225914 16170 raft_consensus.cc:2804] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:44.226440 16170 raft_consensus.cc:697] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 27 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:44.227164 16170 consensus_queue.cc:237] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:44.229453  8223 leader_election.cc:336] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.229661  8182 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 33: Already voted for candidate 9bd264598fd2483e9e17674bab9ba4e8 in this term.
I20260709 13:19:44.230230 16344 consensus_queue.cc:237] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:44.231065  8149 leader_election.cc:304] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:44.232863 16345 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 33 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:44.233477 16358 raft_consensus.cc:2749] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:44.234543  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:44.239282 16358 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:44.239550  8755 leader_election.cc:304] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:44.239694 16358 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9480609eccc44250a4d7fcc9686e76cf)
I20260709 13:19:44.240139 16358 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:44.243170  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:44.245123 16343 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 13:19:44.245499  8002 catalog_manager.cc:5697] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 21 to 22, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 22 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.249282 16358 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:44.251573 16358 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:44.261991  8149 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:44.264022  8221 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:44.275460 16170 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:44.262828 16333 raft_consensus.cc:2804] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:44.277143 16333 raft_consensus.cc:697] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 26 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:44.278074 16333 consensus_queue.cc:237] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:44.279058 16170 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
W20260709 13:19:44.284936  8149 leader_election.cc:336] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.286396 16352 raft_consensus.cc:2804] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:44.280478 16170 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:44.292177  8149 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
W20260709 13:19:44.293314  8755 leader_election.cc:336] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.292209  8002 catalog_manager.cc:5697] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 27 to 28, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 28 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:44.296597 16348 raft_consensus.cc:2749] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:44.294276 16352 raft_consensus.cc:697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:44.311357 16352 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:44.297485  8149 consensus_peers.cc:597] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:44.316164  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:44.316236  8149 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:44.328533  8149 leader_election.cc:336] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.334185  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:44.334254  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0190f54981846a5a2a1df128af42b35" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:44.334784  8254 raft_consensus.cc:3060] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:44.335041  8253 raft_consensus.cc:3060] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:44.337080  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "9bd264598fd2483e9e17674bab9ba4e8" candidate_term: 33 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:44.337834  8251 raft_consensus.cc:2393] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bd264598fd2483e9e17674bab9ba4e8 in current term 33: Already voted for candidate a0f96c12124b4e1a816d9fa970464091 in this term.
I20260709 13:19:44.344349  8254 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 24.
I20260709 13:19:44.344528  8253 raft_consensus.cc:2468] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd264598fd2483e9e17674bab9ba4e8 in term 21.
I20260709 13:19:44.349442  8149 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:44.350232 16353 raft_consensus.cc:2804] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:44.350328  8149 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:44.350781 16353 raft_consensus.cc:697] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:44.352037 16357 raft_consensus.cc:2804] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:19:44.353971  8223 consensus_peers.cc:597] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:44.353201 16357 raft_consensus.cc:697] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Becoming Leader. State: Replica: 9bd264598fd2483e9e17674bab9ba4e8, State: Running, Role: LEADER
I20260709 13:19:44.378751 16357 consensus_queue.cc:237] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:44.416327  8252 raft_consensus.cc:1275] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260709 13:19:44.351703 16353 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:44.391927  8002 catalog_manager.cc:5697] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 25 to 26, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 26 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:44.416750  8001 catalog_manager.cc:5697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 26 to 27, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 27 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.423309  8180 raft_consensus.cc:1275] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:19:44.426395 16170 consensus_queue.cc:1048] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:44.431531 16355 consensus_queue.cc:1048] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
W20260709 13:19:44.435563  8755 consensus_peers.cc:597] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:44.436163  8149 consensus_peers.cc:597] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:44.436779  8149 consensus_peers.cc:597] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:44.437252  8149 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:44.437920  8149 leader_election.cc:336] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.438350  8149 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:44.440068 16346 raft_consensus.cc:2749] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
W20260709 13:19:44.448307  8149 consensus_peers.cc:597] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:44.452908  8149 leader_election.cc:336] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.455685  7999 catalog_manager.cc:5697] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 22 to 23, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 23 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:44.456826  8223 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111) [suppressed 390 similar messages]
I20260709 13:19:44.457757  7999 catalog_manager.cc:5697] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 26 to 27, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 27 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:44.460924  8149 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.459689  7999 catalog_manager.cc:5697] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 23 to 24, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 24 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.512693  8002 catalog_manager.cc:5697] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 23 to 24, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 24 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.514524  8002 catalog_manager.cc:5697] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: term changed from 20 to 21, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130). New cstate: current_term: 21 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:44.562237  8149 consensus_peers.cc:597] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:44.579164  8149 consensus_peers.cc:597] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:44.596918  8149 consensus_peers.cc:597] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:44.624621  8223 consensus_peers.cc:597] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:44.639907  8149 consensus_peers.cc:597] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:44.649446  8248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:19:44.650321  8248 raft_consensus.cc:606] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Received request to transfer leadership
I20260709 13:19:44.654362  8248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:19:44.654930  8248 raft_consensus.cc:606] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Received request to transfer leadership
I20260709 13:19:44.675072  8248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5"
dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:19:44.675668  8248 raft_consensus.cc:606] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Received request to transfer leadership
W20260709 13:19:44.679273  8755 consensus_peers.cc:597] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:44.686117  8783 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:19:44.688063 16344 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:44.720512 16344 raft_consensus.cc:993] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: : Instructing follower 5033fc7e66374940a203908ea8b0078f to start an election
I20260709 13:19:44.721024 16344 raft_consensus.cc:1081] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Signalling peer 5033fc7e66374940a203908ea8b0078f to start an election
W20260709 13:19:44.729296  8223 consensus_peers.cc:597] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:44.740149  8180 raft_consensus.cc:1275] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:19:44.742810  8783 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5"
dest_uuid: "5033fc7e66374940a203908ea8b0078f"
 from {username='slave'} at 127.0.0.1:48096
I20260709 13:19:44.743526  8783 raft_consensus.cc:493] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:44.743899  8783 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:44.745534 16170 consensus_queue.cc:1048] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:44.748202  8782 raft_consensus.cc:1275] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:19:44.754132 16346 consensus_queue.cc:1048] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:44.765825  8254 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
W20260709 13:19:44.767949  8054 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 13:19:44.774492  8783 raft_consensus.cc:515] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:44.761116  8223 consensus_peers.cc:597] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:44.775938  8054 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for fa9dafbde3954b8487327ba47919b4d5 already in progress
W20260709 13:19:44.776290  8054 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for fa9dafbde3954b8487327ba47919b4d5 already in progress
I20260709 13:19:44.782766  8783 leader_election.cc:290] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:44.789703  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: true dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:44.790432  8182 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:44.784987 16350 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 13:19:44.801569  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9dafbde3954b8487327ba47919b4d5" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: true dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:44.802229  8248 raft_consensus.cc:3055] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:44.802554  8248 raft_consensus.cc:740] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:44.803351  8248 consensus_queue.cc:260] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:44.804658  8248 raft_consensus.cc:3060] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:44.806592  8252 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:44.808964 16357 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:19:44.820897  8755 leader_election.cc:336] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:44.821406  8183 raft_consensus.cc:1275] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 13:19:44.826267 16170 consensus_queue.cc:1048] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:44.834197  8248 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 25.
I20260709 13:19:44.833879  8182 raft_consensus.cc:2468] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 25.
I20260709 13:19:44.838181  8755 leader_election.cc:304] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf
I20260709 13:19:44.850205 16355 raft_consensus.cc:2804] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:44.850905 16355 raft_consensus.cc:697] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 25 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:44.851974 16355 consensus_queue.cc:237] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:44.873560  8257 raft_consensus.cc:1275] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 13:19:44.889173 16333 consensus_queue.cc:1048] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:19:44.898015  8180 raft_consensus.cc:1275] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:19:44.904796 16170 consensus_queue.cc:1048] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:44.953665  8252 raft_consensus.cc:1275] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:19:44.961644  8223 consensus_peers.cc:597] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:44.962409  8223 consensus_peers.cc:597] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:44.963033  8223 consensus_peers.cc:597] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:44.969966 16352 consensus_queue.cc:1048] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:19:44.973418  8149 consensus_peers.cc:597] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:44.974715  8149 consensus_peers.cc:597] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:44.976670  8001 catalog_manager.cc:5697] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 24 to 25, leader changed from a0f96c12124b4e1a816d9fa970464091 (127.6.214.131) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 25 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:45.043256  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:45.057394  8223 consensus_peers.cc:597] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:45.104553  8149 consensus_peers.cc:597] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:45.142123  8149 consensus_peers.cc:597] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:45.146795  8149 consensus_peers.cc:597] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:45.143496  7002 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8129)
W20260709 13:19:45.158179  8149 consensus_peers.cc:597] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:45.158998  8149 consensus_peers.cc:597] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:45.204461  8223 consensus_peers.cc:597] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:45.235378  8223 consensus_peers.cc:597] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:45.271783  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:45.318044  8149 consensus_peers.cc:597] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:45.373086  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:45.399806  8223 consensus_peers.cc:597] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:45.403229  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:45.464493  8252 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:19:45.467988 16355 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:19:45.509296  8223 consensus_peers.cc:597] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:45.659003  8183 raft_consensus.cc:1275] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:19:45.677603 16324 consensus_queue.cc:1048] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.006s
W20260709 13:19:45.691000  8149 consensus_peers.cc:597] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:45.701053  8149 consensus_peers.cc:597] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:45.710925  8149 consensus_peers.cc:597] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:45.723397  8149 consensus_peers.cc:597] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:45.748896  8149 consensus_peers.cc:597] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:45.788937  8223 consensus_peers.cc:597] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:45.857919  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 44904.1us
W20260709 13:19:45.917645  8223 consensus_peers.cc:597] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:45.921111  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:45.928759  8223 consensus_peers.cc:597] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:46.043879  8223 consensus_peers.cc:597] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:46.148181  7002 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8129)
W20260709 13:19:46.228230  8149 consensus_peers.cc:597] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:46.376174  8254 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:19:46.416827  8183 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260709 13:19:46.421756  8221 consensus_peers.cc:597] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0adcb7796ea47a4be5ddd094575ed19. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.423564 16404 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:19:46.432271  8223 consensus_peers.cc:597] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.465541 16404 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.466312 16404 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:46.468797 16404 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:46.472647  8183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 34 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8" is_pre_election: true
I20260709 13:19:46.473706  8183 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 33.
I20260709 13:19:46.476155 16170 raft_consensus.cc:2955] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Committing config change with OpId 26.15: config changed from index -1 to 15, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:19:46.477088  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:46.489602  8149 consensus_peers.cc:597] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:46.515652 16398 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 13:19:46.516150 16398 raft_consensus.cc:493] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.516508 16398 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 33 FOLLOWER]: Advancing to term 34
W20260709 13:19:46.528168  8223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:46389, user_credentials={real_user=slave}} blocked reactor thread for 51176.8us
I20260709 13:19:46.531261  8183 raft_consensus.cc:2955] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Committing config change with OpId 26.15: config changed from index -1 to 15, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
W20260709 13:19:46.534067  8223 leader_election.cc:336] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:46.530478 16398 raft_consensus.cc:515] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:46.543192 16398 leader_election.cc:290] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 34 election: Requested vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:46.543337  7999 catalog_manager.cc:5697] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index -1 to 15, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 26 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:46.553629  8149 consensus_peers.cc:597] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:46.558339  8182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd85d0f27664dc8a33e2cdf0fd4ebdb" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 34 candidate_status { last_received { term: 32 index: 16 } } ignore_live_leader: false dest_uuid: "9bd264598fd2483e9e17674bab9ba4e8"
I20260709 13:19:46.558974  8182 raft_consensus.cc:3060] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 33 FOLLOWER]: Advancing to term 34
I20260709 13:19:46.572281  8182 raft_consensus.cc:2468] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 34.
I20260709 13:19:46.591459  8223 leader_election.cc:304] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:46.597514 16398 raft_consensus.cc:2804] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 34 FOLLOWER]: Leader election won for term 34
I20260709 13:19:46.598176 16398 raft_consensus.cc:697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 34 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:46.598537  8182 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:19:46.599243 16398 consensus_queue.cc:237] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 32.16, Last appended by leader: 16, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:46.603585  8223 leader_election.cc:336] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 34 election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:46.620569  8149 consensus_peers.cc:597] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:46.634919  8147 consensus_peers.cc:597] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c239eb8b961c4362b6e905c0fa6fbd98. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.642210  8257 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:19:46.647513 16388 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:19:46.654518  8149 consensus_peers.cc:597] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.681991 16388 raft_consensus.cc:2955] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 LEADER]: Committing config change with OpId 27.17: config changed from index -1 to 17, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:19:46.693308  8254 raft_consensus.cc:2955] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Committing config change with OpId 27.17: config changed from index -1 to 17, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:19:46.783656  8182 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:19:46.773414  8002 catalog_manager.cc:5697] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 32 to 34, leader changed from 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 34 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:46.790308  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:19:46.812340  7999 catalog_manager.cc:5697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index -1 to 17, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 27 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:46.841041  8149 consensus_peers.cc:597] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:46.848742  8147 consensus_peers.cc:597] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b3279fc005d149f8aad5d0df46e09fda. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.849681  8254 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:19:46.851423 16395 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:46.865731  8149 consensus_peers.cc:597] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.911666  8149 consensus_peers.cc:597] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:46.923668  8149 consensus_peers.cc:597] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:46.945520 16388 raft_consensus.cc:2955] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
W20260709 13:19:46.948733  8223 consensus_peers.cc:597] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:46.954734  8257 raft_consensus.cc:2955] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:19:46.964602  8182 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:19:46.984154  8002 catalog_manager.cc:5697] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index -1 to 12, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 21 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:47.002974  8147 consensus_peers.cc:597] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917): Couldn't send request to peer 5033fc7e66374940a203908ea8b0078f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 264ed863486e43df8dfe1478dfb034ee. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:47.016366  8254 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:19:47.027668 16348 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:19:47.043107  8149 consensus_peers.cc:597] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:47.081475 16422 ts_tablet_manager.cc:933] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:47.106822  8223 consensus_peers.cc:597] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:47.107048  8149 consensus_peers.cc:597] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:47.136754 16422 tablet_copy_client.cc:323] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.131:45561
I20260709 13:19:47.136507 16395 raft_consensus.cc:2955] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Committing config change with OpId 24.15: config changed from index -1 to 15, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:19:47.144268  8266 tablet_copy_service.cc:140] P a0f96c12124b4e1a816d9fa970464091: Received BeginTabletCopySession request for tablet d0adcb7796ea47a4be5ddd094575ed19 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:60806)
I20260709 13:19:47.145112  8266 tablet_copy_service.cc:161] P a0f96c12124b4e1a816d9fa970464091: Beginning new tablet copy session on tablet d0adcb7796ea47a4be5ddd094575ed19 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:60806: session id = 5033fc7e66374940a203908ea8b0078f-d0adcb7796ea47a4be5ddd094575ed19
I20260709 13:19:47.148248  8180 raft_consensus.cc:1275] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 34 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 32 index: 16. Preceding OpId from leader: term: 34 index: 17. (index mismatch)
W20260709 13:19:47.149121  7002 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8129)
I20260709 13:19:47.156006 16398 consensus_queue.cc:1048] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:47.171005  8254 raft_consensus.cc:2955] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index -1 to 15, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
W20260709 13:19:47.182719  8149 consensus_peers.cc:597] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:47.258137  8266 tablet_copy_source_session.cc:215] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:47.256742  7999 catalog_manager.cc:5697] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index -1 to 15, NON_VOTER 5033fc7e66374940a203908ea8b0078f (127.6.214.132) added. New cstate: current_term: 24 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } } }
I20260709 13:19:47.264849 16427 ts_tablet_manager.cc:933] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:47.289928  8223 consensus_peers.cc:597] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:47.326879 16422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0adcb7796ea47a4be5ddd094575ed19. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:47.304780  8223 consensus_peers.cc:597] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:47.337042  8755 consensus_peers.cc:597] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:47.336454  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 68178.5us
I20260709 13:19:47.361965 16427 tablet_copy_client.cc:323] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.130:46389
W20260709 13:19:47.377477  8755 consensus_peers.cc:597] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:47.386080  8193 tablet_copy_service.cc:140] P 9bd264598fd2483e9e17674bab9ba4e8: Received BeginTabletCopySession request for tablet c239eb8b961c4362b6e905c0fa6fbd98 from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:37206)
I20260709 13:19:47.386725  8193 tablet_copy_service.cc:161] P 9bd264598fd2483e9e17674bab9ba4e8: Beginning new tablet copy session on tablet c239eb8b961c4362b6e905c0fa6fbd98 from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:37206: session id = 5033fc7e66374940a203908ea8b0078f-c239eb8b961c4362b6e905c0fa6fbd98
I20260709 13:19:47.397351  8193 tablet_copy_source_session.cc:215] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:47.427493 16427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c239eb8b961c4362b6e905c0fa6fbd98. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:47.429737  8223 consensus_peers.cc:597] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:47.430385  8223 consensus_peers.cc:597] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:47.440347 16422 tablet_copy_client.cc:806] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
W20260709 13:19:47.443271  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:47.457754  8223 consensus_peers.cc:597] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:47.461020  8223 consensus_peers.cc:597] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:47.467633 16422 tablet_copy_client.cc:670] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:47.478438 16422 tablet_copy_client.cc:538] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:47.492460 16435 ts_tablet_manager.cc:933] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:47.507191  8149 consensus_peers.cc:597] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:47.513829  8149 consensus_peers.cc:597] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:47.525048 16422 tablet_bootstrap.cc:492] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:19:47.527496 16436 ts_tablet_manager.cc:933] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f: Initiating tablet copy from peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:47.529143 16427 tablet_copy_client.cc:806] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:47.529927 16427 tablet_copy_client.cc:670] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:47.526269 16435 tablet_copy_client.cc:323] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.130:46389
I20260709 13:19:47.541106  8193 tablet_copy_service.cc:140] P 9bd264598fd2483e9e17674bab9ba4e8: Received BeginTabletCopySession request for tablet b3279fc005d149f8aad5d0df46e09fda from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:37206)
I20260709 13:19:47.541756  8193 tablet_copy_service.cc:161] P 9bd264598fd2483e9e17674bab9ba4e8: Beginning new tablet copy session on tablet b3279fc005d149f8aad5d0df46e09fda from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:37206: session id = 5033fc7e66374940a203908ea8b0078f-b3279fc005d149f8aad5d0df46e09fda
W20260709 13:19:47.552042  8149 consensus_peers.cc:597] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:47.559335 16427 tablet_copy_client.cc:538] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:47.565225  8193 tablet_copy_source_session.cc:215] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:47.572269 16436 tablet_copy_client.cc:323] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f: tablet copy: Beginning tablet copy session from remote peer at address 127.6.214.130:46389
I20260709 13:19:47.574728  8193 tablet_copy_service.cc:140] P 9bd264598fd2483e9e17674bab9ba4e8: Received BeginTabletCopySession request for tablet 264ed863486e43df8dfe1478dfb034ee from peer 5033fc7e66374940a203908ea8b0078f ({username='slave'} at 127.0.0.1:37206)
I20260709 13:19:47.575264  8193 tablet_copy_service.cc:161] P 9bd264598fd2483e9e17674bab9ba4e8: Beginning new tablet copy session on tablet 264ed863486e43df8dfe1478dfb034ee from peer 5033fc7e66374940a203908ea8b0078f at {username='slave'} at 127.0.0.1:37206: session id = 5033fc7e66374940a203908ea8b0078f-264ed863486e43df8dfe1478dfb034ee
I20260709 13:19:47.576386 16435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3279fc005d149f8aad5d0df46e09fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.591986  8193 tablet_copy_source_session.cc:215] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:47.600811 16436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264ed863486e43df8dfe1478dfb034ee. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:47.626196  8149 consensus_peers.cc:597] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:47.657924 16427 tablet_bootstrap.cc:492] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:19:47.670323 16436 tablet_copy_client.cc:806] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
W20260709 13:19:47.674860  8223 consensus_peers.cc:597] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:47.673673 16436 tablet_copy_client.cc:670] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:47.690128 16436 tablet_copy_client.cc:538] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:47.716424 16435 tablet_copy_client.cc:806] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:47.717118 16435 tablet_copy_client.cc:670] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:47.721834 16435 tablet_copy_client.cc:538] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:47.734627 16436 tablet_bootstrap.cc:492] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
I20260709 13:19:47.754009 16435 tablet_bootstrap.cc:492] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f: Bootstrap starting.
W20260709 13:19:47.761066  8223 consensus_peers.cc:597] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:47.809957  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:47.871294  8149 consensus_peers.cc:597] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:47.883773 16422 tablet_bootstrap.cc:492] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=2 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:19:47.889073  8223 consensus_peers.cc:597] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:47.894012 16422 tablet_bootstrap.cc:492] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:19:47.895311 16422 ts_tablet_manager.cc:1403] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.371s	user 0.044s	sys 0.017s
I20260709 13:19:47.911180 16422 raft_consensus.cc:359] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [term 26 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:19:47.912155 16422 raft_consensus.cc:740] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [term 26 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:19:47.912866 16422 consensus_queue.cc:260] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:19:47.925779 16422 ts_tablet_manager.cc:1434] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
W20260709 13:19:47.945098  8149 consensus_peers.cc:597] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:47.948663  8266 tablet_copy_service.cc:342] P a0f96c12124b4e1a816d9fa970464091: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-d0adcb7796ea47a4be5ddd094575ed19 received from {username='slave'} at 127.0.0.1:60806
I20260709 13:19:47.949199  8266 tablet_copy_service.cc:434] P a0f96c12124b4e1a816d9fa970464091: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-d0adcb7796ea47a4be5ddd094575ed19 on tablet d0adcb7796ea47a4be5ddd094575ed19 with peer 5033fc7e66374940a203908ea8b0078f
W20260709 13:19:47.945322  8223 consensus_peers.cc:597] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:47.982156  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:47.982146  8149 consensus_peers.cc:597] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:48.000097 16435 tablet_bootstrap.cc:492] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:48.001147 16435 tablet_bootstrap.cc:492] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:19:48.001899 16435 ts_tablet_manager.cc:1403] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.248s	user 0.048s	sys 0.004s
I20260709 13:19:48.022610 16427 tablet_bootstrap.cc:492] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=1 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:48.033497 16427 tablet_bootstrap.cc:492] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:19:48.034335 16427 ts_tablet_manager.cc:1403] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.377s	user 0.042s	sys 0.022s
I20260709 13:19:48.036648 16435 raft_consensus.cc:359] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:19:48.053263 16435 raft_consensus.cc:740] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
W20260709 13:19:48.046515  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:19:48.048643 16436 tablet_bootstrap.cc:492] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:19:48.054524  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 46498.5us
I20260709 13:19:48.055229 16435 consensus_queue.cc:260] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
W20260709 13:19:48.056116  8149 consensus_peers.cc:597] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:48.055795 16436 tablet_bootstrap.cc:492] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f: Bootstrap complete.
I20260709 13:19:48.057652 16436 ts_tablet_manager.cc:1403] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f: Time spent bootstrapping tablet: real 0.323s	user 0.058s	sys 0.034s
I20260709 13:19:48.044982 16427 raft_consensus.cc:359] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:19:48.070235 16427 raft_consensus.cc:740] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:19:48.071216 16427 consensus_queue.cc:260] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:19:48.082918 16436 raft_consensus.cc:359] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:19:48.083863 16436 raft_consensus.cc:740] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Initialized, Role: LEARNER
I20260709 13:19:48.084299 16427 ts_tablet_manager.cc:1434] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:19:48.088102 16435 ts_tablet_manager.cc:1434] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.002s
I20260709 13:19:48.088897  8193 tablet_copy_service.cc:342] P 9bd264598fd2483e9e17674bab9ba4e8: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-c239eb8b961c4362b6e905c0fa6fbd98 received from {username='slave'} at 127.0.0.1:37206
I20260709 13:19:48.097574  8193 tablet_copy_service.cc:434] P 9bd264598fd2483e9e17674bab9ba4e8: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-c239eb8b961c4362b6e905c0fa6fbd98 on tablet c239eb8b961c4362b6e905c0fa6fbd98 with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:48.099838  8193 tablet_copy_service.cc:342] P 9bd264598fd2483e9e17674bab9ba4e8: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-b3279fc005d149f8aad5d0df46e09fda received from {username='slave'} at 127.0.0.1:37206
I20260709 13:19:48.100208  8193 tablet_copy_service.cc:434] P 9bd264598fd2483e9e17674bab9ba4e8: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-b3279fc005d149f8aad5d0df46e09fda on tablet b3279fc005d149f8aad5d0df46e09fda with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:48.084560 16436 consensus_queue.cc:260] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: NON_VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: true } }
I20260709 13:19:48.110054 16436 ts_tablet_manager.cc:1434] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.002s
I20260709 13:19:48.119096  8193 tablet_copy_service.cc:342] P 9bd264598fd2483e9e17674bab9ba4e8: Request end of tablet copy session 5033fc7e66374940a203908ea8b0078f-264ed863486e43df8dfe1478dfb034ee received from {username='slave'} at 127.0.0.1:37206
I20260709 13:19:48.119585  8193 tablet_copy_service.cc:434] P 9bd264598fd2483e9e17674bab9ba4e8: ending tablet copy session 5033fc7e66374940a203908ea8b0078f-264ed863486e43df8dfe1478dfb034ee on tablet 264ed863486e43df8dfe1478dfb034ee with peer 5033fc7e66374940a203908ea8b0078f
I20260709 13:19:48.148737  8782 raft_consensus.cc:1217] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [term 26 LEARNER]: Deduplicated request from leader. Original: 26.14->[26.15-26.15]   Dedup: 26.15->[]
W20260709 13:19:48.152370  7002 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 8129)
W20260709 13:19:48.182548  8223 consensus_peers.cc:597] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:48.260222  8782 raft_consensus.cc:1217] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 LEARNER]: Deduplicated request from leader. Original: 24.14->[24.15-24.15]   Dedup: 24.15->[]
W20260709 13:19:48.265576  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:48.322958  8223 consensus_peers.cc:597] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:48.336215  8149 consensus_peers.cc:597] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:48.336777  8149 consensus_peers.cc:597] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:48.337144  8149 consensus_peers.cc:597] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:48.356802  8223 consensus_peers.cc:597] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:48.398237  8782 raft_consensus.cc:1217] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 21 LEARNER]: Deduplicated request from leader. Original: 21.11->[21.12-21.12]   Dedup: 21.12->[]
I20260709 13:19:48.605734 16411 raft_consensus.cc:1064] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:19:48.608641  8782 raft_consensus.cc:1217] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 LEARNER]: Deduplicated request from leader. Original: 27.16->[27.17-27.17]   Dedup: 27.17->[]
I20260709 13:19:48.608302 16411 consensus_queue.cc:237] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 13, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:48.674124  8223 consensus_peers.cc:597] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:48.707494  8782 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [term 26 LEARNER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:19:48.709767  8180 raft_consensus.cc:1275] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:19:48.714370 16398 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:19:48.721029  8223 consensus_peers.cc:597] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:48.721922 16445 consensus_queue.cc:1048] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:48.761159 16411 raft_consensus.cc:2955] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Committing config change with OpId 26.16: config changed from index 15 to 16, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:48.775902  8782 raft_consensus.cc:2955] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Committing config change with OpId 26.16: config changed from index 15 to 16, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:48.789000  8180 raft_consensus.cc:2955] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Committing config change with OpId 26.16: config changed from index 15 to 16, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:48.797598  8002 catalog_manager.cc:5697] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index 15 to 16, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 26 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:48.801780 16432 raft_consensus.cc:1064] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:19:48.807864 16432 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 10, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:48.848292  8149 consensus_peers.cc:597] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:19:48.872321 16441 raft_consensus.cc:1064] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:19:48.875095 16441 consensus_queue.cc:237] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 13, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:48.887120  8782 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 21 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:48.888999 16397 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:48.904305  8252 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:48.908205 16395 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:48.918591  8784 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:19:48.919724  8257 raft_consensus.cc:1275] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:19:48.922423 16395 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:19:48.927162  8149 consensus_peers.cc:597] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:48.933467 16395 consensus_queue.cc:1048] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:19:48.944931  8149 consensus_peers.cc:597] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:48.996196 16432 raft_consensus.cc:2955] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index 15 to 16, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:48.999086 16395 raft_consensus.cc:2955] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:49.003748  8784 raft_consensus.cc:2955] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:49.005316  8252 raft_consensus.cc:2955] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:49.047600  8257 raft_consensus.cc:2955] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:49.058033  7999 catalog_manager.cc:5697] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 15 to 16, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:19:49.069798  8149 consensus_peers.cc:597] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:19:49.083384  8784 raft_consensus.cc:2955] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:19:49.091831  8149 consensus_peers.cc:597] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:49.102843 16459 raft_consensus.cc:1064] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: attempting to promote NON_VOTER 5033fc7e66374940a203908ea8b0078f to VOTER
I20260709 13:19:49.105396 16459 consensus_queue.cc:237] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 15, Current term: 27, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:49.113291  8149 consensus_peers.cc:597] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:49.109884  7999 catalog_manager.cc:5697] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 reported cstate change: config changed from index 12 to 13, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } attrs { replace: true } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:19:49.153012  7002 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 8129)
I20260709 13:19:49.221220  8257 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:19:49.223776  8784 raft_consensus.cc:1275] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 LEARNER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
W20260709 13:19:49.226822  8149 consensus_peers.cc:597] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:49.227842 16395 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:19:49.230801 16441 consensus_queue.cc:1048] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:19:49.277489  8149 consensus_peers.cc:597] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:49.298271  8180 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:49.310657  8257 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:49.311761  8782 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Refusing update from remote peer 9bd264598fd2483e9e17674bab9ba4e8: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:49.313501 16395 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:49.321966 16395 raft_consensus.cc:2955] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 13 to 14, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:49.324606  8783 raft_consensus.cc:2955] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:49.327183 16459 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:49.347450 16444 raft_consensus.cc:2955] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 LEADER]: Committing config change with OpId 27.18: config changed from index 17 to 18, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:49.348191  8257 raft_consensus.cc:2955] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:49.351040  8782 raft_consensus.cc:2955] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 FOLLOWER]: Committing config change with OpId 27.18: config changed from index 17 to 18, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
I20260709 13:19:49.386749  7999 catalog_manager.cc:5697] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f reported cstate change: config changed from index 13 to 14, VOTER 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129) evicted. New cstate: current_term: 21 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:19:49.396278  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:19:49.474346  7999 catalog_manager.cc:5697] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 reported cstate change: config changed from index 17 to 18, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New cstate: current_term: 27 leader_uuid: "9bd264598fd2483e9e17674bab9ba4e8" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:49.488130  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 62742.9us
W20260709 13:19:49.491532  7993 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 88830.9us
I20260709 13:19:49.493402  7993 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b3279fc005d149f8aad5d0df46e09fda with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:19:49.498095  7993 catalog_manager.cc:4755] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b3279fc005d149f8aad5d0df46e09fda: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:49.530891  8149 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111) [suppressed 466 similar messages]
W20260709 13:19:49.567087  8223 consensus_peers.cc:597] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:49.590413  8257 raft_consensus.cc:2955] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Committing config change with OpId 27.18: config changed from index 17 to 18, 5033fc7e66374940a203908ea8b0078f (127.6.214.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } } }
W20260709 13:19:49.594530  8223 consensus_peers.cc:597] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:49.618198  8755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:45561, user_credentials={real_user=slave}} blocked reactor thread for 62945.2us
W20260709 13:19:49.647179  8223 consensus_peers.cc:597] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:49.649595  8149 consensus_peers.cc:597] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:49.650281  8149 consensus_peers.cc:597] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:49.720163  8149 consensus_peers.cc:597] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:49.754151  8149 consensus_peers.cc:597] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:49.770239  8223 consensus_peers.cc:597] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:49.770747  8223 consensus_peers.cc:597] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:49.833093  8149 consensus_peers.cc:597] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:49.842242  8755 consensus_peers.cc:597] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:49.848187  8223 consensus_peers.cc:597] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:49.876574  8755 consensus_peers.cc:597] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:49.894164  8149 consensus_peers.cc:597] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:49.915246  8149 consensus_peers.cc:597] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:49.995905  8223 consensus_peers.cc:597] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:50.052065  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:50.116551  8223 consensus_peers.cc:597] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:50.142319  8149 consensus_peers.cc:597] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:50.153614  7002 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 8129)
W20260709 13:19:50.275067  8223 consensus_peers.cc:597] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:50.303498  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:50.347498  8223 consensus_peers.cc:597] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:50.364080  8149 consensus_peers.cc:597] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:50.375288  8149 consensus_peers.cc:597] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:50.389287  8223 consensus_peers.cc:597] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:50.440759  8223 consensus_peers.cc:597] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:50.477649  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:50.558840  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:50.605051  8149 consensus_peers.cc:597] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:50.635639  8149 consensus_peers.cc:597] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:50.679373  8223 consensus_peers.cc:597] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:50.684232  8223 consensus_peers.cc:597] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:50.730173  8149 consensus_peers.cc:597] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:50.732165  8149 consensus_peers.cc:597] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:50.758612  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:50.771694  7993 catalog_manager.cc:4755] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b3279fc005d149f8aad5d0df46e09fda: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:51.059239  8149 consensus_peers.cc:597] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:51.141469  8149 consensus_peers.cc:597] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:51.154134  7002 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 8129)
W20260709 13:19:51.190197  8223 consensus_peers.cc:597] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:51.244241  8223 consensus_peers.cc:597] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:51.437749  8149 consensus_peers.cc:597] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:51.476447  8149 consensus_peers.cc:597] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:51.483709  8149 consensus_peers.cc:597] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:51.503755  8223 consensus_peers.cc:597] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:51.586864  8149 consensus_peers.cc:597] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:51.677716  8149 consensus_peers.cc:597] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:51.754897  8149 consensus_peers.cc:597] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:51.830726  8223 consensus_peers.cc:597] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:51.892274  7993 catalog_manager.cc:4755] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b3279fc005d149f8aad5d0df46e09fda: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:51.950281  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:52.039697  8223 consensus_peers.cc:597] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:52.057248  8149 consensus_peers.cc:597] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:52.105526  8149 consensus_peers.cc:597] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:52.122717  8149 consensus_peers.cc:597] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:52.141225  8223 consensus_peers.cc:597] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:52.155512  7002 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 8129)
W20260709 13:19:52.302598  8223 consensus_peers.cc:597] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:52.330629  8223 consensus_peers.cc:597] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:52.335567  8755 consensus_peers.cc:597] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:52.354677  8755 consensus_peers.cc:597] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:52.372428  8149 consensus_peers.cc:597] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:52.442571  8223 consensus_peers.cc:597] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:52.457767  8223 consensus_peers.cc:597] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:52.472548  8149 consensus_peers.cc:597] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:52.527407  8149 consensus_peers.cc:597] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:52.587033  8149 consensus_peers.cc:597] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:52.601490  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:52.622391  8149 consensus_peers.cc:597] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:52.680980  8223 consensus_peers.cc:597] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:52.697625  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:52.873646  8223 consensus_peers.cc:597] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:52.891932  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:52.915184  8149 consensus_peers.cc:597] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:52.924965  8223 consensus_peers.cc:597] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:52.934155  8149 consensus_peers.cc:597] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:53.044829  8223 consensus_peers.cc:597] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:53.058954  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:53.065289  8223 consensus_peers.cc:597] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:53.077661  8223 consensus_peers.cc:597] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:53.130625  8149 consensus_peers.cc:597] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:53.400203  8149 consensus_peers.cc:597] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:53.402038  8223 consensus_peers.cc:597] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:53.413878  8149 consensus_peers.cc:597] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:53.446835  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:53.456089  8149 consensus_peers.cc:597] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:53.462601  8149 consensus_peers.cc:597] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:53.735849  8149 consensus_peers.cc:597] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:53.846956  8223 consensus_peers.cc:597] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:53.903488  8149 consensus_peers.cc:597] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:53.905014  8223 consensus_peers.cc:597] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:53.976593  8223 consensus_peers.cc:597] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:54.026640  7993 catalog_manager.cc:4755] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b3279fc005d149f8aad5d0df46e09fda: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:54.089640  8149 consensus_peers.cc:597] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:54.181383  8149 consensus_peers.cc:597] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:54.184767  8149 consensus_peers.cc:597] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:54.251857  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:54.354022  8223 consensus_peers.cc:597] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:54.371061  8149 consensus_peers.cc:597] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:54.433178  8149 consensus_peers.cc:597] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:54.496737  8223 consensus_peers.cc:597] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:54.508770  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 75640.3us
W20260709 13:19:54.513453  8223 consensus_peers.cc:597] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:54.550514  8149 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111) [suppressed 476 similar messages]
W20260709 13:19:54.575085  8149 consensus_peers.cc:597] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:54.588403  8149 consensus_peers.cc:597] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:54.589078  8149 consensus_peers.cc:597] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:54.765332  8223 consensus_peers.cc:597] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:54.948761  8223 consensus_peers.cc:597] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:54.986049  8755 consensus_peers.cc:597] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:55.015494  8149 consensus_peers.cc:597] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:55.056280  8755 consensus_peers.cc:597] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:55.059520  7002 tablet_server.cc:196] TabletServer@127.6.214.129:0 shutdown complete.
W20260709 13:19:55.066795  8149 consensus_peers.cc:597] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:55.167747  8149 consensus_peers.cc:597] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:55.225278  8149 consensus_peers.cc:597] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:55.235384  8223 consensus_peers.cc:597] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:55.268039  8223 consensus_peers.cc:597] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:55.278718  7002 tablet_server.cc:179] TabletServer@127.6.214.130:0 shutting down...
W20260709 13:19:55.287393  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:55.301088  8223 consensus_peers.cc:597] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:55.305734  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:55.313714  8755 consensus_peers.cc:597] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.319429  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.339821  8223 consensus_peers.cc:597] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:55.372586  8223 consensus_peers.cc:597] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.379314  8223 consensus_peers.cc:597] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:55.381983  8223 consensus_peers.cc:597] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.388684  8149 consensus_peers.cc:597] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:55.389243  8223 consensus_peers.cc:597] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.402439  8755 consensus_peers.cc:597] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.415549  8223 consensus_peers.cc:597] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.440758  8223 consensus_peers.cc:597] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.484558  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:55.490193  8223 consensus_peers.cc:597] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:55.521344  8223 consensus_peers.cc:597] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.525189  8223 consensus_peers.cc:597] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:55.531731  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.560240  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.577628  8149 consensus_peers.cc:597] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:55.583609  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:55.587941  7002 tablet_replica.cc:333] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:55.596524  7002 raft_consensus.cc:2243] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.597210  7002 raft_consensus.cc:2272] T e05ca9fb2b7a4b46851675643729339f P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.600282  7002 tablet_replica.cc:333] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
W20260709 13:19:55.600478  8223 consensus_peers.cc:597] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:55.601274  7002 raft_consensus.cc:2243] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.620501  7002 raft_consensus.cc:2272] T ba766a24d6d541fcbbc260fd5545d9ca P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.635162  7002 tablet_replica.cc:333] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:55.637182  7002 raft_consensus.cc:2243] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.641847  7002 raft_consensus.cc:2272] T 6e1d160e7dbe4ab091e90aaddec43a43 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.644656  7002 tablet_replica.cc:333] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:55.648365  7002 raft_consensus.cc:2243] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:19:55.651038  8223 consensus_peers.cc:597] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.655375  8223 consensus_peers.cc:597] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.658008  8223 consensus_peers.cc:597] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:55.660131  7002 raft_consensus.cc:2272] T 7f981ef6ec7847cf851489769fac4dff P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:55.669130  8223 consensus_peers.cc:597] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.670439  8755 consensus_peers.cc:597] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:55.676213  7002 tablet_replica.cc:333] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:55.677821  7002 raft_consensus.cc:2243] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:19:55.682878  8223 consensus_peers.cc:597] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:55.687417  8755 consensus_peers.cc:597] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.689901  8149 consensus_peers.cc:597] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:55.690869  8223 consensus_peers.cc:597] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:55.696432  7002 raft_consensus.cc:2272] T ff9e97576a934b9dbf18f6ee6cc670af P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.700911  7002 tablet_replica.cc:333] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:55.705273  7002 raft_consensus.cc:2243] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.707276  7002 raft_consensus.cc:2272] T b3279fc005d149f8aad5d0df46e09fda P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:55.724962  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:55.725608  7002 tablet_replica.cc:333] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:55.726508  7002 raft_consensus.cc:2243] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.779397  7002 raft_consensus.cc:2272] T 5328e1082b164f3dbf9bdbb846c37b26 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.784827  7002 tablet_replica.cc:333] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:55.787695  7002 raft_consensus.cc:2243] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:19:55.792696  8149 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 43975.6us
I20260709 13:19:55.796066  7002 raft_consensus.cc:2272] T d092bc636e5347e5a3f10441d996ec96 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.806989  7002 tablet_replica.cc:333] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:55.812999  7002 raft_consensus.cc:2243] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.825955  7002 raft_consensus.cc:2272] T d3439ee9684744c187e7b7e3627aecda P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:55.854193  8223 consensus_peers.cc:597] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:55.856032  7002 tablet_replica.cc:333] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:55.872234  7002 raft_consensus.cc:2243] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 LEADER]: Raft consensus shutting down.
W20260709 13:19:55.884133  8149 consensus_peers.cc:597] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:55.886603  7002 raft_consensus.cc:2272] T c239eb8b961c4362b6e905c0fa6fbd98 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.892213  7002 tablet_replica.cc:333] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:55.893916  7002 raft_consensus.cc:2243] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:19:55.894887  8149 consensus_peers.cc:597] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:55.902359  7002 raft_consensus.cc:2272] T b491e7c261394e498f940b0169e957b6 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.906877  7002 tablet_replica.cc:333] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:55.908423  7002 raft_consensus.cc:2243] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.913829  7002 raft_consensus.cc:2272] T 9abaa411847e4bf9907f7af5e2689c7b P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:55.919729  8149 consensus_peers.cc:597] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:55.922863  7002 tablet_replica.cc:333] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:55.924459  7002 raft_consensus.cc:2243] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.934886  7002 raft_consensus.cc:2272] T d0adcb7796ea47a4be5ddd094575ed19 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.937669  7002 tablet_replica.cc:333] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:55.939525  7002 raft_consensus.cc:2243] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:19:55.946458  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:55.946494  7002 raft_consensus.cc:2272] T 17d4c6719ffc4a51a444f84eff0c28b7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.953855  7002 tablet_replica.cc:333] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:55.962934  7002 raft_consensus.cc:2243] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.968148  7002 raft_consensus.cc:2272] T a64e531fcf0742cd8db17f008824d588 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.981314  7002 tablet_replica.cc:333] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:55.993476  7002 raft_consensus.cc:2243] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.996093  7002 raft_consensus.cc:2272] T 5590746c03af49c9a057629ee7fe6bfb P 9bd264598fd2483e9e17674bab9ba4e8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.999805  7002 tablet_replica.cc:333] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.001369  7002 raft_consensus.cc:2243] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:56.002629  7002 raft_consensus.cc:2272] T e8a82de7cb524bf996a9df256baca3fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.016042  7002 tablet_replica.cc:333] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.017202  7002 raft_consensus.cc:2243] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:56.018210  7002 raft_consensus.cc:2272] T cd035b4a624c4c7aa2257c2821868021 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.021745  7002 tablet_replica.cc:333] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.029518  7002 raft_consensus.cc:2243] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:56.030948  7002 raft_consensus.cc:2272] T 98857d2610494fdda88f0508d2370cd7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.034824  7002 tablet_replica.cc:333] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.046424  7002 raft_consensus.cc:2243] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:56.047578  7002 raft_consensus.cc:2272] T 09ff07a1f02d49f0923422e378a20d4a P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.051041  7002 tablet_replica.cc:333] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.052109  7002 raft_consensus.cc:2243] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.054181  7002 raft_consensus.cc:2272] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.063293  7002 tablet_replica.cc:333] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.068723  7002 raft_consensus.cc:2243] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:19:56.070153  8149 consensus_peers.cc:597] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:56.070533  7002 raft_consensus.cc:2272] T be8c836876cb41918064b2082dd48efe P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.074481  7002 tablet_replica.cc:333] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.086359  7002 raft_consensus.cc:2243] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:56.087697  7002 raft_consensus.cc:2272] T 45c332ea272c465d9e07083a06e802e7 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.091499  7002 tablet_replica.cc:333] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.094691  7002 raft_consensus.cc:2243] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.099157  7002 raft_consensus.cc:2272] T 264ed863486e43df8dfe1478dfb034ee P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.115501  7002 tablet_replica.cc:333] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.116677  7002 raft_consensus.cc:2243] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.118171  7002 raft_consensus.cc:2272] T 5247aeecdc5c4ebf8516da3b94073f35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.128556  7002 tablet_replica.cc:333] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.129639  7002 raft_consensus.cc:2243] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.131582  7002 raft_consensus.cc:2272] T e1e020840d414fa992e8afcd5cffaad4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.139217  7002 tablet_replica.cc:333] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.140271  7002 raft_consensus.cc:2243] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:56.150990  7002 raft_consensus.cc:2272] T aacbbdcc46cd40c0bf26d6ceb75d464d P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.154363  7002 tablet_replica.cc:333] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.155444  7002 raft_consensus.cc:2243] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.156951  7002 raft_consensus.cc:2272] T 6855110231054b5fa91235e8a822e101 P 9bd264598fd2483e9e17674bab9ba4e8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.162741  7002 tablet_replica.cc:333] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.163738  7002 raft_consensus.cc:2243] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.169394  7002 raft_consensus.cc:2272] T 6353b347875648eda7077a6a3bc633fd P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.184226  7002 tablet_replica.cc:333] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.185273  7002 raft_consensus.cc:2243] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.186952  7002 raft_consensus.cc:2272] T d3456040ac8e456eabcfa4db8a2b5510 P 9bd264598fd2483e9e17674bab9ba4e8 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.190821  7002 tablet_replica.cc:333] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.206303  7002 raft_consensus.cc:2243] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.208060  7002 raft_consensus.cc:2272] T 440543aae4b54ad6aaca74cda8e88fb0 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.211556  7002 tablet_replica.cc:333] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.212595  7002 raft_consensus.cc:2243] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.214275  7002 raft_consensus.cc:2272] T c0190f54981846a5a2a1df128af42b35 P 9bd264598fd2483e9e17674bab9ba4e8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.217913  7002 tablet_replica.cc:333] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.230182  7002 raft_consensus.cc:2243] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.231982  7002 raft_consensus.cc:2272] T 8dca4b8aebe74578b370a72879bb9bba P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.235694  7002 tablet_replica.cc:333] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.236708  7002 raft_consensus.cc:2243] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:56.237954  7002 raft_consensus.cc:2272] T 6874782ad0e549bd89899c965cd46c33 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.241374  7002 tablet_replica.cc:333] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.248113  7002 raft_consensus.cc:2243] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.259132  7002 raft_consensus.cc:2272] T c362335b215641d38dd0c651acfb8fbb P 9bd264598fd2483e9e17674bab9ba4e8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.262699  7002 tablet_replica.cc:333] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.265403  7002 raft_consensus.cc:2243] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.267889  7002 raft_consensus.cc:2272] T 82a8e4371bab42f3a4d150da194ce8bd P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.271544  7002 tablet_replica.cc:333] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.286331  7002 raft_consensus.cc:2243] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 34 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:56.287393  7002 raft_consensus.cc:2272] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P 9bd264598fd2483e9e17674bab9ba4e8 [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.290839  7002 tablet_replica.cc:333] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.291862  7002 raft_consensus.cc:2243] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:56.292724  7002 raft_consensus.cc:2272] T 21cda219d2624c108a6700de24d60d86 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.296142  7002 tablet_replica.cc:333] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.297101  7002 raft_consensus.cc:2243] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.304867  7002 raft_consensus.cc:2272] T 0bf7f11a5f324770a352a6a29f56ebf4 P 9bd264598fd2483e9e17674bab9ba4e8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.308283  7002 tablet_replica.cc:333] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.309253  7002 raft_consensus.cc:2243] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:56.313665  8223 consensus_peers.cc:597] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:56.325894  7002 raft_consensus.cc:2272] T 3e96746d2ece4e52ab82eca0737daf2e P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:56.326593  8223 consensus_peers.cc:597] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:56.330055  7002 tablet_replica.cc:333] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.330999  7002 raft_consensus.cc:2243] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.332597  7002 raft_consensus.cc:2272] T eb334e41695d4d8c8d5de4eb668cd421 P 9bd264598fd2483e9e17674bab9ba4e8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.335417  7002 tablet_replica.cc:333] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.336192  7002 raft_consensus.cc:2243] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:56.337071  7002 raft_consensus.cc:2272] T 6e8201b083554b0cb094760a4ff0fd39 P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.349900  7002 tablet_replica.cc:333] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.352687  7002 raft_consensus.cc:2243] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:56.355942  7002 raft_consensus.cc:2272] T f3f32037b7b54a0c991d35bbea1b786b P 9bd264598fd2483e9e17674bab9ba4e8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.367230  7002 tablet_replica.cc:333] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.368059  7002 raft_consensus.cc:2243] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.370240  7002 raft_consensus.cc:2272] T e0aa1a34518f4bbdb1d1676b4a1541d8 P 9bd264598fd2483e9e17674bab9ba4e8 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.373220  7002 tablet_replica.cc:333] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.378507  7002 raft_consensus.cc:2243] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:56.379830  7002 raft_consensus.cc:2272] T 093d3bfbbaf542b5aa9ecd4e865ff155 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.383087  7002 tablet_replica.cc:333] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.388652  7002 raft_consensus.cc:2243] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.389967  7002 raft_consensus.cc:2272] T bf53fff91826424990da23103f484232 P 9bd264598fd2483e9e17674bab9ba4e8 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.401319  7002 tablet_replica.cc:333] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.402096  7002 raft_consensus.cc:2243] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:56.402971  7002 raft_consensus.cc:2272] T 3393bfbad81242a2a3374049ddfa0b63 P 9bd264598fd2483e9e17674bab9ba4e8 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.406131  7002 tablet_replica.cc:333] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.406828  7002 raft_consensus.cc:2243] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:19:56.409574  7002 raft_consensus.cc:2272] T 73b079a720af4d478dba8d608aeb9059 P 9bd264598fd2483e9e17674bab9ba4e8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:56.413898  7002 tablet_replica.cc:333] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8: stopping tablet replica
I20260709 13:19:56.424104  7002 raft_consensus.cc:2243] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:56.425091  7002 raft_consensus.cc:2272] T fa9dafbde3954b8487327ba47919b4d5 P 9bd264598fd2483e9e17674bab9ba4e8 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:56.586315  7002 connection.cc:466] server connection from 127.0.0.1:46060 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46060 (request call id 3042) could send its response
W20260709 13:19:56.630797  8223 consensus_peers.cc:597] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:56.736819 16498 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:56.737536 16498 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:56.740160 16498 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:56.766017  8223 leader_election.cc:336] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:56.776887  8223 leader_election.cc:336] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:56.778693  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:56.784170 16498 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:56.811269 16494 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:56.812276 16430 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:56.811936 16494 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:56.812958 16430 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:56.815066 16430 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:56.815251 16494 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:56.830950 16498 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:56.831620 16498 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:56.834807 16498 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:56.856858  8223 leader_election.cc:336] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:56.877545  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:56.878470  8257 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 21.
I20260709 13:19:56.880757  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:56.894134 16494 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:56.895082 16494 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:56.897418 16494 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:56.898334  8755 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:56.906883 16494 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:56.907368 16494 raft_consensus.cc:493] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:56.907797 16494 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:56.911594 16430 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:56.912256 16430 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:56.914496 16430 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:56.901108  8223 consensus_peers.cc:597] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:19:56.903333  7995 maintenance_manager.cc:419] P e5e50b3438e24144a9523cb9ae40543f: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033357
I20260709 13:19:56.917111 16494 raft_consensus.cc:515] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:56.935691 16494 leader_election.cc:290] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:56.951776  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:56.952695  8782 raft_consensus.cc:2393] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 22: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:19:56.965896  8755 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:56.966502  8755 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:56.969923 16430 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:56.971308  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:56.977418  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3279fc005d149f8aad5d0df46e09fda" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:56.978026  8257 raft_consensus.cc:3060] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:57.006131  8221 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.009443  8257 raft_consensus.cc:2468] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:57.011027 16498 raft_consensus.cc:2749] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:57.021745  8223 consensus_peers.cc:597] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:57.023617  8755 leader_election.cc:336] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:57.027894  8755 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.028736 16498 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.029608 16498 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.038285 16498 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:57.044320  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:57.045022  8783 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 27.
W20260709 13:19:57.043471  8223 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:57.046662  8223 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:57.047151  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.050073 16497 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.050722 16497 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.053009 16497 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:57.049679 16498 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:57.059270  8755 leader_election.cc:304] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:57.059331  7994 maintenance_manager.cc:643] P e5e50b3438e24144a9523cb9ae40543f: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.140s	user 0.047s	sys 0.003s Metrics: {"bytes_written":8050,"delete_count":0,"lbm_write_time_us":1353,"lbm_writes_lt_1ms":7,"reinsert_count":0,"thread_start_us":17851,"threads_started":1,"update_count":311,"wal-append.queue_time_us":23928}
I20260709 13:19:57.062052  7995 maintenance_manager.cc:419] P e5e50b3438e24144a9523cb9ae40543f: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.379736
I20260709 13:19:57.067449 16430 raft_consensus.cc:2804] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:57.072193 16430 raft_consensus.cc:697] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 22 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:57.073165 16430 consensus_queue.cc:237] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.074307 16497 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.075115 16497 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:57.077256 16497 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:57.083508  8223 leader_election.cc:336] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.096957  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:57.097715  8787 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 21.
W20260709 13:19:57.100720  8223 leader_election.cc:336] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:57.101883  8755 leader_election.cc:336] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.102387  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:57.103202 16504 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:57.103286  8755 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:57.103948  8755 leader_election.cc:336] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:57.104944  8755 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:57.106140  8223 leader_election.cc:336] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.106629  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.107393 16498 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:57.105343  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.120453  8006 catalog_manager.cc:5697] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 21 to 22, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 22 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:57.133690 16430 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.137872 16430 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.140100 16498 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.140738 16498 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:57.140131 16430 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:57.142293  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:57.144079 16430 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:57.148921  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.151628 16497 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:57.152047 16497 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.152402 16497 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:57.142908 16498 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:57.159580 16504 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:57.159081  8223 leader_election.cc:336] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:57.160391 16504 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:57.162966  8223 leader_election.cc:336] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.163286 16504 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:57.163445  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.164405 16492 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:57.172706  8223 consensus_peers.cc:597] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:57.177856 16430 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.179088 16430 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.181082 16430 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:57.180982  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:57.185479 16497 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.201956 16430 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.202586 16492 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.203176 16492 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.206024 16492 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:57.208369  8755 leader_election.cc:336] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:57.202623 16430 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.210917 16492 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.214568 16492 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.216449 16430 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:57.219566 16492 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:57.221984 16497 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:57.224102 16430 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.233776 16430 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.235631 16430 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:57.237332  8755 leader_election.cc:336] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.240654  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.244835 16504 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:57.246341  8755 leader_election.cc:336] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.248406  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:57.251245 16504 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:57.247677  8223 leader_election.cc:336] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:57.253912  8223 leader_election.cc:336] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:57.258037  8223 leader_election.cc:336] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:57.258988  8223 leader_election.cc:336] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.259419  8223 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.258466  7994 maintenance_manager.cc:643] P e5e50b3438e24144a9523cb9ae40543f: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.196s	user 0.100s	sys 0.016s Metrics: {"cfile_cache_miss":10,"cfile_cache_miss_bytes":28948,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":8213,"dirs.run_cpu_time_us":536,"dirs.run_wall_time_us":1484,"lbm_read_time_us":1974,"lbm_reads_lt_1ms":26,"lbm_write_time_us":1672,"lbm_writes_lt_1ms":12,"peak_mem_usage":313991,"reinsert_count":0,"thread_start_us":15807,"threads_started":2,"update_count":317}
W20260709 13:19:57.261322  8755 leader_election.cc:336] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:57.266799 16497 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:57.277144  7995 maintenance_manager.cc:419] P e5e50b3438e24144a9523cb9ae40543f: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:19:57.277812  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:57.278097  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:57.278513  8787 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 17.
I20260709 13:19:57.279464  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5328e1082b164f3dbf9bdbb846c37b26" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:57.280063  8782 raft_consensus.cc:3060] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:57.281826  8755 leader_election.cc:336] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.283367  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.284130 16430 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:57.285725  8223 consensus_peers.cc:597] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:57.286676  8755 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:57.287631  8782 raft_consensus.cc:2468] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:57.288762  7994 maintenance_manager.cc:643] P e5e50b3438e24144a9523cb9ae40543f: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20260709 13:19:57.293962  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.295148 16498 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:57.295540 16498 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.295871 16498 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:57.302783 16430 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.303682 16498 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.304523 16430 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.305626 16504 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.306236 16504 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.307586 16430 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:57.308744 16504 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:57.311738  8755 leader_election.cc:336] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:57.311790  8221 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.313654 16497 raft_consensus.cc:2804] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:57.314450 16497 raft_consensus.cc:697] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:57.315441 16497 consensus_queue.cc:237] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.320745 16498 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:57.322299  8223 leader_election.cc:336] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:57.324849  8755 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.329463  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.330595 16430 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:57.331702  8755 leader_election.cc:336] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.332197  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.332954 16430 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:57.342865  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:57.344038  8006 catalog_manager.cc:5697] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 21 to 22, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 22 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.347426  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:57.350385 16497 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.350965 16497 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:57.353636 16498 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.354192 16498 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.354812 16492 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.355298 16497 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:57.355329 16492 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:57.356269 16498 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:57.356530  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d4c6719ffc4a51a444f84eff0c28b7" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:57.357108  8782 raft_consensus.cc:3060] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:57.357679 16492 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:57.362668  8223 leader_election.cc:336] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:57.364019 16492 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.364522 16492 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:57.365571 16498 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.366138 16498 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.368552 16492 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:57.375453 16498 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:57.368634  8782 raft_consensus.cc:2468] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 18.
W20260709 13:19:57.378597  8223 leader_election.cc:336] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.379089  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.379819 16492 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:19:57.379977  8223 leader_election.cc:336] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:57.380548  8223 leader_election.cc:336] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.383286  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:57.384027  8782 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 22.
I20260709 13:19:57.385325  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:57.385999  8782 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:57.391677  8221 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.392866 16492 raft_consensus.cc:2804] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:57.393406 16492 raft_consensus.cc:697] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 18 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:57.394366 16492 consensus_queue.cc:237] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:57.399580  8223 leader_election.cc:336] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:57.400017  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.400923  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:57.401302  8223 leader_election.cc:336] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.401971 16497 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:57.402696 16497 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:57.403060 16497 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.403416 16497 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:57.404292  8223 leader_election.cc:336] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:57.404706  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:57.406019  8223 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:57.407086  8755 leader_election.cc:336] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.407534  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:57.405361 16498 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:57.410073 16430 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.410607 16430 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.413216 16430 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:57.415493 16497 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.421727 16430 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.422338 16430 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.425490 16497 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:57.425091  8223 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.426962  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:57.427711  8755 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.427878 16430 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:57.428172  8755 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:19:57.427313 16504 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:57.431499 16430 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:57.432204 16492 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:57.434695 16503 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.435207 16503 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.436273  8006 catalog_manager.cc:5697] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 17 to 18, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 18 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.437218 16503 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:57.429975  8755 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:57.448909 16498 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.449533 16498 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.451776 16498 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:57.437680 16497 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:57.453075  8223 leader_election.cc:336] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.452847 16497 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.455149 16497 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
W20260709 13:19:57.464041  8223 leader_election.cc:336] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:57.470153  8223 leader_election.cc:336] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.473690 16514 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.474303 16514 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:57.476909 16514 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:57.480747  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:57.481403  8248 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 25.
W20260709 13:19:57.484788  8223 leader_election.cc:336] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:57.486722  8223 leader_election.cc:336] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.487107  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.487619 16514 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.488153 16514 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:57.490072 16514 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:57.492518 16514 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:57.502101  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "440543aae4b54ad6aaca74cda8e88fb0" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f"
I20260709 13:19:57.502751  8782 raft_consensus.cc:3060] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:57.504596  8223 leader_election.cc:336] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:57.505362  8223 leader_election.cc:336] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.505772  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.506685 16514 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:57.506703 16503 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.507355 16503 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.511293 16503 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:57.515597  8782 raft_consensus.cc:2468] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 23.
I20260709 13:19:57.516927  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:57.517408  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:57.517990 16514 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.518549 16514 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.520978 16514 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:57.524235 16514 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.524736 16514 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:57.526921 16514 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:57.530485  8223 leader_election.cc:336] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.530589  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:57.532507  8248 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:19:57.537189  8221 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.538813  8221 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.539008 16514 raft_consensus.cc:2804] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:57.539525 16514 raft_consensus.cc:697] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Becoming Leader. State: Replica: a0f96c12124b4e1a816d9fa970464091, State: Running, Role: LEADER
I20260709 13:19:57.539554 16497 raft_consensus.cc:2749] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:57.540392  8221 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.540570 16514 consensus_queue.cc:237] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.541215 16492 raft_consensus.cc:2749] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:57.542006  8223 leader_election.cc:336] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:57.542909  8223 leader_election.cc:336] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:57.543262  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.543949 16497 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:57.544843  8755 leader_election.cc:336] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:57.545539  8755 leader_election.cc:336] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:57.546233  8755 leader_election.cc:336] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:57.547364  8755 leader_election.cc:336] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:57.550594  8223 consensus_peers.cc:597] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:57.557753  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.558820 16503 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:57.560297  8755 leader_election.cc:336] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.560783  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.561594 16503 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:57.562651  8755 leader_election.cc:336] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.563189  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.563932 16503 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:57.577626  8006 catalog_manager.cc:5697] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 reported cstate change: term changed from 22 to 23, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to a0f96c12124b4e1a816d9fa970464091 (127.6.214.131). New cstate: current_term: 23 leader_uuid: "a0f96c12124b4e1a816d9fa970464091" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.581768  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:57.582649 16503 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:57.583014 16503 raft_consensus.cc:493] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.583392 16503 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:57.592598 16503 raft_consensus.cc:515] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.594823  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:57.602809 16503 leader_election.cc:290] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:57.605077  7002 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8204)
I20260709 13:19:57.607956  8787 raft_consensus.cc:2393] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0f96c12124b4e1a816d9fa970464091 in current term 17: Already voted for candidate 5033fc7e66374940a203908ea8b0078f in this term.
W20260709 13:19:57.608973  8755 consensus_peers.cc:597] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:57.609596  8755 leader_election.cc:336] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:57.616684  8223 consensus_peers.cc:597] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:57.626464  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b079a720af4d478dba8d608aeb9059" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:57.627178  8248 raft_consensus.cc:3060] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:57.633047  8221 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.635911  8248 raft_consensus.cc:2468] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:19:57.641922 16514 raft_consensus.cc:2749] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:57.643309  8755 leader_election.cc:336] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:57.644179  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:57.645660  8223 consensus_peers.cc:597] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:57.645717  8755 consensus_peers.cc:597] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:19:57.647089  8755 leader_election.cc:304] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.647795 16430 raft_consensus.cc:2804] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:57.648283 16430 raft_consensus.cc:697] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:57.649123 16430 consensus_queue.cc:237] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.690824 16514 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.690838 16504 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.691479 16514 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.692173 16504 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.693332  8248 raft_consensus.cc:1275] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:19:57.694224 16504 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:57.696612  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:57.696833  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:57.697224  8248 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 16.
I20260709 13:19:57.688499  8006 catalog_manager.cc:5697] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 16 to 17, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 17 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:57.699129 16514 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:57.699643 16504 consensus_queue.cc:1048] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:19:57.705322  8223 leader_election.cc:336] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.701114  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:57.706413 16503 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:57.701522 16430 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.706861 16503 raft_consensus.cc:493] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.707288 16503 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:57.707007 16430 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.709239 16430 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:57.705790  8223 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 5033fc7e66374940a203908ea8b0078f, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.711616 16514 raft_consensus.cc:2749] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:57.715443 16503 raft_consensus.cc:515] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.719092 16503 leader_election.cc:290] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:57.738765  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:57.739518  8257 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 22.
I20260709 13:19:57.742825  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dca4b8aebe74578b370a72879bb9bba" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:57.743458  8253 raft_consensus.cc:3060] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:57.743281  8755 leader_election.cc:336] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.745587 16503 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.746263 16503 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.748476 16503 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:57.748980  8223 consensus_peers.cc:597] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:19:57.749280  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:57.752084 16430 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:57.752453 16430 raft_consensus.cc:493] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.752787 16430 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:57.756776  8253 raft_consensus.cc:2468] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 17.
I20260709 13:19:57.760157 16430 raft_consensus.cc:515] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.763291 16430 leader_election.cc:290] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:57.761656  8755 leader_election.cc:304] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:57.774601 16503 raft_consensus.cc:2804] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:19:57.775007  8223 consensus_peers.cc:597] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:57.775120 16503 raft_consensus.cc:697] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
W20260709 13:19:57.775614  8223 consensus_peers.cc:597] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:57.776109 16503 consensus_queue.cc:237] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:57.777282  8223 consensus_peers.cc:597] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:57.778540  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:57.779150  8248 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 24.
I20260709 13:19:57.782670  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82a8e4371bab42f3a4d150da194ce8bd" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
W20260709 13:19:57.782912  8755 leader_election.cc:336] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.783206  8248 raft_consensus.cc:3060] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:57.784387 16503 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.784924 16503 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:57.786111 16514 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.786659 16514 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:57.786968 16503 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:57.788537 16514 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:57.790421  8755 leader_election.cc:336] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:57.797206  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:57.798831  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
I20260709 13:19:57.800660  8787 raft_consensus.cc:1275] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:19:57.801178  8223 leader_election.cc:336] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:57.801584 16430 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:19:57.801884  8223 leader_election.cc:336] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.802208 16430 raft_consensus.cc:493] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.805104  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.805260 16430 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:57.805899 16514 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:57.804647  8248 raft_consensus.cc:2468] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 23.
W20260709 13:19:57.807325  8755 leader_election.cc:336] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:57.808512  8755 consensus_peers.cc:597] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:57.814834  7999 catalog_manager.cc:5697] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 16 to 17, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 17 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:57.823094  8223 consensus_peers.cc:597] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:57.823218 16430 raft_consensus.cc:515] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:57.826642  8223 consensus_peers.cc:597] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:57.812613  8755 leader_election.cc:336] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.833633 16514 consensus_queue.cc:1048] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:57.846133 16430 leader_election.cc:290] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 election: Requested vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:57.857975  8755 leader_election.cc:304] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.861472 16430 raft_consensus.cc:2804] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:57.862141 16430 raft_consensus.cc:697] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:57.863078 16430 consensus_queue.cc:237] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:57.866216  8223 consensus_peers.cc:597] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:57.869961 16514 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:57.870579 16514 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:57.872769 16514 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:57.869781  8223 consensus_peers.cc:597] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:57.883560  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf7f11a5f324770a352a6a29f56ebf4" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091"
I20260709 13:19:57.884244  8253 raft_consensus.cc:3060] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:19:57.889500  8223 leader_election.cc:336] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:57.890359  8223 leader_election.cc:336] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.890829  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.891615 16514 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:57.891985  8253 raft_consensus.cc:2468] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 25.
W20260709 13:19:57.894022  8755 leader_election.cc:336] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:57.907024  8784 raft_consensus.cc:1275] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 13:19:57.911218  8755 leader_election.cc:336] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:57.912357  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:57.916015  7999 catalog_manager.cc:5697] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 22 to 23, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 23 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:57.918788 16503 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:57.932200 16514 consensus_queue.cc:1048] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:57.939791  8755 leader_election.cc:304] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 
W20260709 13:19:57.942476  8223 consensus_peers.cc:597] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:57.956980 16430 raft_consensus.cc:2804] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:57.957536 16430 raft_consensus.cc:697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 25 LEADER]: Becoming Leader. State: Replica: 5033fc7e66374940a203908ea8b0078f, State: Running, Role: LEADER
I20260709 13:19:57.958451 16430 consensus_queue.cc:237] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:57.962178  8223 consensus_peers.cc:597] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:57.983566  8755 leader_election.cc:336] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:58.016852  8784 raft_consensus.cc:1275] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Refusing update from remote peer a0f96c12124b4e1a816d9fa970464091: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 13:19:58.014585  8755 consensus_peers.cc:597] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:58.035596  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:58.037941  8755 consensus_peers.cc:597] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:58.039585 16497 consensus_queue.cc:1048] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:19:58.044221  7999 catalog_manager.cc:5697] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f reported cstate change: term changed from 24 to 25, leader changed from 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130) to 5033fc7e66374940a203908ea8b0078f (127.6.214.132). New cstate: current_term: 25 leader_uuid: "5033fc7e66374940a203908ea8b0078f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:58.069775  8223 consensus_peers.cc:597] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:58.108358  8223 consensus_peers.cc:597] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:58.113674  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:58.144192  8755 consensus_peers.cc:597] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:58.157173  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:58.164496  8755 consensus_peers.cc:597] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:58.166122  8223 consensus_peers.cc:597] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:58.167037  8223 consensus_peers.cc:597] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:58.186021  8755 consensus_peers.cc:597] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:58.190613  8253 raft_consensus.cc:1275] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:19:58.199535  8223 consensus_peers.cc:597] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:58.201557  8223 consensus_peers.cc:597] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:58.202155 16519 consensus_queue.cc:1048] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:58.208590  8253 raft_consensus.cc:1275] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:19:58.215257  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:58.220531  8223 consensus_peers.cc:597] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:58.221357 16519 consensus_queue.cc:1048] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:19:58.241189  8223 consensus_peers.cc:597] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:58.244781  7993 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.6.214.129:45123, user_credentials={real_user=slave}} blocked reactor thread for 64292.1us
W20260709 13:19:58.248072  7993 catalog_manager.cc:4755] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b3279fc005d149f8aad5d0df46e09fda: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:58.291070  8223 consensus_peers.cc:597] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:58.308853  8253 raft_consensus.cc:1275] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 13:19:58.314549  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:58.334431  8223 consensus_peers.cc:597] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:58.337556 16430 consensus_queue.cc:1048] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:19:58.345072  8755 consensus_peers.cc:597] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:58.365350  8223 consensus_peers.cc:597] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:58.377964  8253 raft_consensus.cc:1275] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Refusing update from remote peer 5033fc7e66374940a203908ea8b0078f: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260709 13:19:58.387348  8223 consensus_peers.cc:597] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:19:58.392613 16504 consensus_queue.cc:1048] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:19:58.449492  8755 consensus_peers.cc:597] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:58.510362  8755 consensus_peers.cc:597] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:58.538095  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:58.602742 16514 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:58.603291 16514 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:58.607288  7002 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8204)
I20260709 13:19:58.607465 16514 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:58.643748  8223 leader_election.cc:336] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:58.644680  8223 leader_election.cc:336] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:58.645087  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:58.645823 16514 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:58.699050 16497 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:58.699703 16497 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:58.708400  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:58.709105  8783 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 27.
W20260709 13:19:58.713359  8223 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:58.714236  8223 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:58.714668  8223 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:58.715519 16514 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:58.719053 16497 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:59.035632 16536 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.036334 16536 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:59.048722 16536 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:59.050295 16536 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.050886 16536 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:59.053735 16536 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:59.414678 16537 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.417472 16537 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:59.421849 16537 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:59.431200 16537 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.446656 16538 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.471976 16538 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:59.462198 16497 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.462509 16514 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.462682 16430 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.464510 16536 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.467120 16543 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.474562 16430 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:59.475999 16536 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:59.479254 16430 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:59.475263 16537 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:59.478933 16543 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:19:59.487599  8223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.023s	sys 0.006s
W20260709 13:19:59.489444  8223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.024s	sys 0.007s
I20260709 13:19:59.478070 16503 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.482717 16536 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:59.475471 16497 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:59.476948 16514 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:59.500907 16537 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:59.494760 16503 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:59.504967 16503 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:59.508881 16539 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.509383 16539 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:59.510833 16543 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:59.511538 16539 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:59.512324 16514 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:19:59.514216 16497 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:59.539022 16538 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:59.545751 16537 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.546339 16537 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:59.548369 16537 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:59.551873 16519 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.552404 16519 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:59.559108 16519 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:19:59.562142 16519 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.562728 16519 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:59.564867 16519 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:19:59.578114 16538 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:59.578871  8223 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111) [suppressed 500 similar messages]
I20260709 13:19:59.578682 16538 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:59.581051 16538 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:59.607756  7002 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8204)
W20260709 13:19:59.620975  8223 leader_election.cc:336] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:59.629693  8223 leader_election.cc:336] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:59.630306  8223 leader_election.cc:336] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:59.630786  8223 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:59.631280  8223 leader_election.cc:336] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:59.634961  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:19:59.635704  8783 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
I20260709 13:19:59.642364  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:59.643013  8248 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 24.
W20260709 13:19:59.655357  8223 leader_election.cc:336] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:59.658064  8223 leader_election.cc:336] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:59.662549  8223 consensus_peers.cc:597] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:59.663213  8223 leader_election.cc:336] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:59.664053  8223 leader_election.cc:336] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.664499  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.665253 16514 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:59.666445  8223 leader_election.cc:336] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.666882  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.667809 16514 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:59.671275 16514 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.671768 16514 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:59.674445 16514 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:59.670603  8223 consensus_peers.cc:597] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:59.675683  8223 consensus_peers.cc:597] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:59.676314  8223 leader_election.cc:336] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.676738  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.677470 16514 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:59.678548  8223 leader_election.cc:336] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.678977  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.679689 16514 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:59.680543  8223 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.680968  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.681701 16514 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:59.683828  8223 leader_election.cc:336] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.685613  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:59.692575  8223 leader_election.cc:336] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.693084  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.693881 16538 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:59.695983  8223 leader_election.cc:336] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:59.696472  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.697234 16538 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:59.701542 16497 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:59.702755 16497 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.703229 16497 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:59.705173 16497 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:59.716632  8223 leader_election.cc:336] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.718609 16539 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
W20260709 13:19:59.718809  8223 leader_election.cc:336] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:59.719426  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.719214 16539 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:19:59.720424 16497 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:59.721920 16539 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:19:59.725535  8223 leader_election.cc:336] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:59.726233  8223 leader_election.cc:336] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:59.726661  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.727420 16497 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:59.751629  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:19:59.752338  8248 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 25.
I20260709 13:19:59.753726 16539 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.754312 16539 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:19:59.755133  8755 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:59.756014  8755 leader_election.cc:336] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:59.756449 16539 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:19:59.756507  8755 leader_election.cc:336] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:59.758960  8755 leader_election.cc:336] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:59.759896  8755 leader_election.cc:336] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:59.769881  8755 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:59.777673  8755 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:59.778275  8755 leader_election.cc:336] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:19:59.780201  8755 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.780658  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:59.781685  8755 leader_election.cc:336] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.782135  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:59.783087  8755 leader_election.cc:336] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.783311 16537 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:59.783528  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.784157 16537 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:59.784654 16542 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:59.785740  8755 leader_election.cc:336] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.786198  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:19:59.787177  8755 leader_election.cc:336] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.787822 16539 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:59.794063  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.801975 16539 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:59.802230  8755 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.802896  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.803654 16539 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:59.803928  8755 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.804389  8755 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.805128 16539 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:59.805369  8755 leader_election.cc:336] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:19:59.805887  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.806608 16539 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:59.823339  8755 leader_election.cc:336] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:59.835197  8755 leader_election.cc:336] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:59.835738  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.836562 16539 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:59.841545  8755 leader_election.cc:336] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:19:59.843330  8755 leader_election.cc:336] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:19:59.843781  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:19:59.846335 16539 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:59.915573  8223 consensus_peers.cc:597] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:19:59.953050 16497 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:19:59.953821 16497 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:19:59.956261 16497 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:00.003594  8223 leader_election.cc:336] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:00.020565  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08001738a0 after lost signal to thread 7005
W20260709 13:20:00.021727  8037 debug-util.cc:398] Leaking SignalData structure 0x7b080002f620 after lost signal to thread 8040
W20260709 13:20:00.023025  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08002bd7e0 after lost signal to thread 8281
W20260709 13:20:00.024195  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08000d1560 after lost signal to thread 8823
W20260709 13:20:00.028700  8223 leader_election.cc:336] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:00.037307  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:00.039829 16497 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:00.110642  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:20:00.178539  8223 consensus_peers.cc:597] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:00.249882  8223 consensus_peers.cc:597] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:00.345782  8223 consensus_peers.cc:597] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:00.441846  8223 consensus_peers.cc:597] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:20:00.483814  8223 consensus_peers.cc:597] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:20:00.518044 16514 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:00.518607 16514 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:00.521368 16514 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:20:00.524049  8782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:20:00.524698  8782 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 27.
W20260709 13:20:00.545750  8223 consensus_peers.cc:597] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:00.548280  8223 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:00.550154  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:20:00.549145  8223 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:00.563634  8221 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:00.564481 16514 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:20:00.583771  8223 consensus_peers.cc:597] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:20:00.599258  8223 consensus_peers.cc:597] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:20:00.608278  7002 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8204)
W20260709 13:20:00.714649  8223 consensus_peers.cc:597] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:00.735970  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:00.792171  8755 consensus_peers.cc:597] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:00.804822  8223 consensus_peers.cc:597] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:00.843650  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:00.865684  8223 consensus_peers.cc:597] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:20:00.896099  8223 consensus_peers.cc:597] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:00.897344  8223 consensus_peers.cc:597] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:00.899972  8223 consensus_peers.cc:597] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:00.918517  8223 consensus_peers.cc:597] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:00.921849  8755 consensus_peers.cc:597] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:00.929013  8223 consensus_peers.cc:597] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:20:00.944857  8223 consensus_peers.cc:597] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:00.950739  8223 consensus_peers.cc:597] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:00.971254  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:00.975363  8223 consensus_peers.cc:597] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:00.982007  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:20:00.996120  8223 consensus_peers.cc:597] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:20:00.999166  8755 consensus_peers.cc:597] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:01.031071  8223 consensus_peers.cc:597] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:01.035502  8755 consensus_peers.cc:597] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:01.054400  8223 consensus_peers.cc:597] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:20:01.057835  8755 consensus_peers.cc:597] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:01.074805  8223 consensus_peers.cc:597] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:20:01.109220  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:01.125077  8755 consensus_peers.cc:597] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:01.137627  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:20:01.151841  8755 consensus_peers.cc:597] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:01.159153  8223 consensus_peers.cc:597] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:01.231814 16514 raft_consensus.cc:493] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:01.232366 16514 raft_consensus.cc:515] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:20:01.234283 16514 leader_election.cc:290] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:01.244989  8223 leader_election.cc:336] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:01.245834  8223 leader_election.cc:336] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:01.246325  8223 leader_election.cc:304] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:01.247546 16514 raft_consensus.cc:2749] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:01.297266 16514 raft_consensus.cc:493] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:01.297811 16514 raft_consensus.cc:515] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:20:01.299743 16514 leader_election.cc:290] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:01.308722  8223 leader_election.cc:336] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:01.309549  8223 leader_election.cc:336] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:01.310070  8223 leader_election.cc:304] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:01.310844 16514 raft_consensus.cc:2749] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:01.318478  8223 consensus_peers.cc:597] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:01.398912  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:20:01.422720  8755 consensus_peers.cc:597] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:01.429171  8223 consensus_peers.cc:597] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:01.543385  8223 consensus_peers.cc:597] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:01.562919  8755 consensus_peers.cc:597] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:01.587558  8755 consensus_peers.cc:597] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:01.596668 16514 raft_consensus.cc:493] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:01.597209 16514 raft_consensus.cc:515] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:20:01.599117 16514 leader_election.cc:290] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:01.608744  7002 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 8204)
W20260709 13:20:01.662158  8223 leader_election.cc:336] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:01.663136  8223 leader_election.cc:336] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:01.663609  8223 leader_election.cc:304] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:01.664436 16514 raft_consensus.cc:2749] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:01.707129 16514 raft_consensus.cc:493] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:01.707680 16514 raft_consensus.cc:515] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:20:01.709640 16514 leader_election.cc:290] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:01.711931  8223 consensus_peers.cc:597] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:01.742837  8223 leader_election.cc:336] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:01.745788  8223 leader_election.cc:336] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:01.748761  8223 leader_election.cc:304] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:01.752146 16553 raft_consensus.cc:2749] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:20:01.751310  8755 consensus_peers.cc:597] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:01.775964  8223 consensus_peers.cc:597] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:01.800700  8223 consensus_peers.cc:597] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:20:01.837615 16519 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:01.838308 16519 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:01.840520 16519 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:01.852216  8755 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:01.854532  8755 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:01.855094  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:01.856132 16519 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:01.900970 16556 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:01.901607 16556 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:20:01.903820 16556 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:01.943022  8223 leader_election.cc:336] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:01.953925  8223 leader_election.cc:336] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:01.954483  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:01.955374 16556 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:01.971701  8223 consensus_peers.cc:597] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:20:02.052745 16556 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:02.053396 16556 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:02.056071 16556 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), 5033fc7e66374940a203908ea8b0078f (127.6.214.132:45917)
I20260709 13:20:02.062170  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ed863486e43df8dfe1478dfb034ee" candidate_uuid: "a0f96c12124b4e1a816d9fa970464091" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5033fc7e66374940a203908ea8b0078f" is_pre_election: true
I20260709 13:20:02.062876  8784 raft_consensus.cc:2468] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0f96c12124b4e1a816d9fa970464091 in term 24.
W20260709 13:20:02.066699  8223 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:02.069512  8223 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:02.070080  8223 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:02.071512 16514 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:02.143188 16519 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:02.143818 16519 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:02.146128 16519 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:02.162802  8755 leader_election.cc:336] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:02.164701  8755 leader_election.cc:336] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:02.167860  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:02.169077 16519 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:02.177605 16555 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:02.178193 16555 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:02.180799 16555 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:02.225209  8755 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:02.230304  8755 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:02.230890  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:02.231710 16519 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:02.298154 16519 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:02.298712 16519 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:02.301501 16519 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:20:02.305747  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abaa411847e4bf9907f7af5e2689c7b" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:20:02.306490  8257 raft_consensus.cc:2468] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 25.
W20260709 13:20:02.312623  8755 leader_election.cc:336] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:02.324579  8755 leader_election.cc:336] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:02.325121  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:02.325999 16519 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:02.333271 16556 raft_consensus.cc:493] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:02.333982 16556 raft_consensus.cc:515] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:20:02.336180 16556 leader_election.cc:290] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:02.359994  8223 leader_election.cc:336] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:02.361081  8223 leader_election.cc:336] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:02.361590  8223 leader_election.cc:304] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:02.363387 16556 raft_consensus.cc:2749] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:02.427560 16519 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:02.428227 16519 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:02.430862 16519 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:02.450698  8755 leader_election.cc:336] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:02.452114  8755 leader_election.cc:336] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:02.454218  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:02.457396 16555 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:02.459820 16519 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:02.460475 16519 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:02.463241 16519 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:20:02.501838 16556 raft_consensus.cc:493] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:02.502439 16556 raft_consensus.cc:515] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:20:02.504673 16556 leader_election.cc:290] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:02.518117  8755 leader_election.cc:336] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:02.522140  8755 leader_election.cc:336] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:02.527346  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:02.535733 16519 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:02.539224  8223 leader_election.cc:336] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:02.553385  8223 leader_election.cc:336] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:02.561372  8223 leader_election.cc:304] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:02.576593 16556 raft_consensus.cc:2749] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:20:02.645502  8223 consensus_peers.cc:597] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:20:02.674783  8223 consensus_peers.cc:597] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:20:02.751993 16555 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:02.752586 16555 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:02.754783 16555 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:20:02.759173 16558 raft_consensus.cc:493] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:02.759904 16558 raft_consensus.cc:515] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
W20260709 13:20:02.766460  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:20:02.782269 16558 leader_election.cc:290] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:20:02.792410 16514 raft_consensus.cc:493] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:02.794644 16514 raft_consensus.cc:515] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:20:02.796527 16514 leader_election.cc:290] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:02.818039  8223 consensus_peers.cc:597] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:02.825109  8223 leader_election.cc:336] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:02.837944  8755 leader_election.cc:336] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:02.843214  8755 leader_election.cc:336] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:02.843683  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
W20260709 13:20:02.842509  8223 leader_election.cc:336] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:02.844491  8223 leader_election.cc:304] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:02.845302 16555 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:02.846882 16558 raft_consensus.cc:2749] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:20:02.847847  8223 leader_election.cc:336] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:02.849046  8223 leader_election.cc:336] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:02.850301 16555 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:02.851038 16555 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:02.853144 16555 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:20:02.854532  8223 leader_election.cc:304] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:02.859002 16558 raft_consensus.cc:2749] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:20:02.874003  8755 leader_election.cc:336] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:02.874866  8755 leader_election.cc:336] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:02.875319  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:02.878115 16555 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:02.881266  8223 consensus_peers.cc:597] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:02.890686 16555 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:02.891273 16555 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:02.893829 16558 raft_consensus.cc:493] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:02.894354 16558 raft_consensus.cc:515] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:20:02.896332 16558 leader_election.cc:290] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:20:02.893322 16555 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:02.902258  8223 leader_election.cc:336] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:02.903020  8223 leader_election.cc:336] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:02.904443  8223 leader_election.cc:304] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:02.905197 16558 raft_consensus.cc:2749] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:02.911221  8755 leader_election.cc:336] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:02.912369  8755 leader_election.cc:336] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:02.912818  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:02.913564 16555 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:02.930171  8223 consensus_peers.cc:597] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:20:02.987713  8223 consensus_peers.cc:597] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:20:03.027951 16514 raft_consensus.cc:493] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:03.028446 16514 raft_consensus.cc:515] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:20:03.030342 16514 leader_election.cc:290] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:03.031864  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:20:03.037910  8223 leader_election.cc:336] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:03.041869  8223 leader_election.cc:336] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:03.042757  8223 leader_election.cc:304] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:03.044126 16514 raft_consensus.cc:2749] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:03.094388  8755 consensus_peers.cc:597] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:03.135597  8223 consensus_peers.cc:597] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:20:03.155609  8223 consensus_peers.cc:597] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:03.196242  8223 consensus_peers.cc:597] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:03.218145  8223 consensus_peers.cc:597] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:03.237090  8223 consensus_peers.cc:597] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:03.271703  8223 consensus_peers.cc:597] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:20:03.273604  8223 consensus_peers.cc:597] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:03.281242  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:20:03.302449  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:03.325563  8755 consensus_peers.cc:597] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:20:03.359866  8223 consensus_peers.cc:597] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:03.390573  8223 consensus_peers.cc:597] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:03.444723  8223 consensus_peers.cc:597] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:20:03.445397  8223 consensus_peers.cc:597] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:20:03.494707  8223 consensus_peers.cc:597] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:03.495069  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:20:03.508754  8223 consensus_peers.cc:597] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:03.515193  8755 consensus_peers.cc:597] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:03.527514  8223 consensus_peers.cc:597] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:20:03.539419  8223 consensus_peers.cc:597] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:03.550189  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:20:03.571981  8755 consensus_peers.cc:597] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:03.575889 16558 raft_consensus.cc:493] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:03.576510 16558 raft_consensus.cc:515] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } }
I20260709 13:20:03.578819 16558 leader_election.cc:290] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:03.595054  8223 leader_election.cc:336] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:03.596163  8223 leader_election.cc:336] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:03.596698  8223 leader_election.cc:304] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:03.604637 16558 raft_consensus.cc:2749] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:03.615899  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:03.617936  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:03.632802  8223 consensus_peers.cc:597] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:20:03.656024  8223 consensus_peers.cc:597] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:03.668689  7002 tablet_server.cc:196] TabletServer@127.6.214.130:0 shutdown complete.
W20260709 13:20:03.697561  8223 consensus_peers.cc:597] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:03.704069 16559 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:03.704753 16559 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:03.707098 16555 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:03.707798 16559 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:20:03.707700 16555 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:03.709972 16555 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:20:03.713227  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c239eb8b961c4362b6e905c0fa6fbd98" candidate_uuid: "5033fc7e66374940a203908ea8b0078f" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "a0f96c12124b4e1a816d9fa970464091" is_pre_election: true
I20260709 13:20:03.713937  8253 raft_consensus.cc:2468] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5033fc7e66374940a203908ea8b0078f in term 27.
W20260709 13:20:03.719558  8755 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:03.720077  8755 leader_election.cc:336] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:03.720659  8755 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:03.721020  8755 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f, a0f96c12124b4e1a816d9fa970464091; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:03.727387 16555 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:20:03.729614  8755 leader_election.cc:336] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:03.730055  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:03.730686 16555 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:03.732226  8223 consensus_peers.cc:597] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:20:03.742062  8755 consensus_peers.cc:597] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:20:03.798363  8223 consensus_peers.cc:597] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:20:03.811543  8755 consensus_peers.cc:597] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:03.855266  7002 tablet_server.cc:179] TabletServer@127.6.214.131:0 shutting down...
W20260709 13:20:03.876850  8223 consensus_peers.cc:597] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:20:03.884582  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.905645  8755 consensus_peers.cc:597] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:03.919709  8755 consensus_peers.cc:597] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.946341  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.947778  8755 consensus_peers.cc:597] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.950302  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:03.951414  7002 tablet_replica.cc:333] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:03.952606  7002 raft_consensus.cc:2243] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.954043  7002 raft_consensus.cc:2272] T ba766a24d6d541fcbbc260fd5545d9ca P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.959460  7002 tablet_replica.cc:333] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:03.960438  7002 raft_consensus.cc:2243] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.961217  7002 raft_consensus.cc:2272] T 43e4649131cb4b10a82b13d0d2b8e85a P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.964213  7002 tablet_replica.cc:333] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:03.965085  7002 raft_consensus.cc:2243] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.966176  7002 raft_consensus.cc:2272] T 21cda219d2624c108a6700de24d60d86 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.969307  7002 tablet_replica.cc:333] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:03.970438  7002 raft_consensus.cc:2243] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.971215  7002 raft_consensus.cc:2272] T 7f981ef6ec7847cf851489769fac4dff P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.974185  7002 tablet_replica.cc:333] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:03.975139  7002 raft_consensus.cc:2243] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.976161  7002 raft_consensus.cc:2272] T 6e1d160e7dbe4ab091e90aaddec43a43 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.979570  7002 tablet_replica.cc:333] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:03.980399  7002 raft_consensus.cc:2243] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.981196  7002 raft_consensus.cc:2272] T e05ca9fb2b7a4b46851675643729339f P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.983856  7002 tablet_replica.cc:333] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:03.984688  7002 raft_consensus.cc:2243] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.985275  7002 raft_consensus.cc:2272] T b3279fc005d149f8aad5d0df46e09fda P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.987748  7002 tablet_replica.cc:333] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:03.988579  7002 raft_consensus.cc:2243] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.989989  7002 raft_consensus.cc:2272] T c239eb8b961c4362b6e905c0fa6fbd98 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.992774  7002 tablet_replica.cc:333] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:03.993690  7002 raft_consensus.cc:2243] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.994840  7002 raft_consensus.cc:2272] T 5328e1082b164f3dbf9bdbb846c37b26 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.998008  7002 tablet_replica.cc:333] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:03.998873  7002 raft_consensus.cc:2243] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.999969  7002 raft_consensus.cc:2272] T d3439ee9684744c187e7b7e3627aecda P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.002640  7002 tablet_replica.cc:333] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.003489  7002 raft_consensus.cc:2243] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.005267  7002 raft_consensus.cc:2272] T 6e624c9e6425410d86ead659c0c8db59 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.008322  7002 tablet_replica.cc:333] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.009325  7002 raft_consensus.cc:2243] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.010074  7002 raft_consensus.cc:2272] T b491e7c261394e498f940b0169e957b6 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.013903  7002 tablet_replica.cc:333] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.014658  7002 raft_consensus.cc:2243] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.015384  7002 raft_consensus.cc:2272] T 9abaa411847e4bf9907f7af5e2689c7b P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.018139  7002 tablet_replica.cc:333] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.024406  7002 raft_consensus.cc:2243] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.027236  7002 raft_consensus.cc:2272] T d0adcb7796ea47a4be5ddd094575ed19 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:04.028158  8223 consensus_peers.cc:597] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:20:04.040613  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:20:04.044555  7002 tablet_replica.cc:333] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.045639  7002 raft_consensus.cc:2243] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.047092  7002 raft_consensus.cc:2272] T 17d4c6719ffc4a51a444f84eff0c28b7 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.051136  7002 tablet_replica.cc:333] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.052101  7002 raft_consensus.cc:2243] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.054217  7002 raft_consensus.cc:2272] T 7c962bcd58c74013abdb370fa758d500 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.056854  7002 tablet_replica.cc:333] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.057713  7002 raft_consensus.cc:2243] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.058342  7002 raft_consensus.cc:2272] T e8a82de7cb524bf996a9df256baca3fd P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:04.062390  8755 consensus_peers.cc:597] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.065791  7002 tablet_replica.cc:333] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.066979  7002 raft_consensus.cc:2243] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.070010  7002 raft_consensus.cc:2272] T 6855110231054b5fa91235e8a822e101 P a0f96c12124b4e1a816d9fa970464091 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:04.071692  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.073827 16559 raft_consensus.cc:493] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:04.074374 16559 raft_consensus.cc:515] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:04.076563 16559 leader_election.cc:290] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:04.083981  8755 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:04.084722  8755 leader_election.cc:336] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:04.087934  7002 tablet_replica.cc:333] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.088893  7002 raft_consensus.cc:2243] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.085165  8755 leader_election.cc:304] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:04.089643 16559 raft_consensus.cc:2749] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:04.092617  7002 raft_consensus.cc:2272] T 8ea7d5dc3d1d486a8f4ff9478d8fcefb P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.100294  7002 tablet_replica.cc:333] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.101186  7002 raft_consensus.cc:2243] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:20:04.096030  8755 consensus_peers.cc:597] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:04.101949  8223 consensus_peers.cc:597] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:04.103094  7002 raft_consensus.cc:2272] T 09ff07a1f02d49f0923422e378a20d4a P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.109401  7002 tablet_replica.cc:333] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
W20260709 13:20:04.111101  8755 consensus_peers.cc:597] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.112300  7002 raft_consensus.cc:2243] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.112969  7002 raft_consensus.cc:2272] T be8c836876cb41918064b2082dd48efe P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.117583  7002 tablet_replica.cc:333] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.118417  7002 raft_consensus.cc:2243] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.121838  7002 raft_consensus.cc:2272] T 98857d2610494fdda88f0508d2370cd7 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.126596  7002 tablet_replica.cc:333] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.127426  7002 raft_consensus.cc:2243] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.128772  7002 raft_consensus.cc:2272] T 6e8201b083554b0cb094760a4ff0fd39 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.131567  7002 tablet_replica.cc:333] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.132423  7002 raft_consensus.cc:2243] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.133250  7002 raft_consensus.cc:2272] T e0aa1a34518f4bbdb1d1676b4a1541d8 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:04.140857  8755 consensus_peers.cc:597] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:04.142495  7002 tablet_replica.cc:333] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.143425  7002 raft_consensus.cc:2243] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.144236  7002 raft_consensus.cc:2272] T f3f32037b7b54a0c991d35bbea1b786b P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.147022  7002 tablet_replica.cc:333] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.147768  7002 raft_consensus.cc:2243] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.148600  7002 raft_consensus.cc:2272] T c0190f54981846a5a2a1df128af42b35 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.154320  7002 tablet_replica.cc:333] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.155146  7002 raft_consensus.cc:2243] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.156351  7002 raft_consensus.cc:2272] T aacbbdcc46cd40c0bf26d6ceb75d464d P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:04.160497  8755 consensus_peers.cc:597] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:04.169449  8755 consensus_peers.cc:597] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:04.167702  7002 tablet_replica.cc:333] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.171033  7002 raft_consensus.cc:2243] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.174082  7002 raft_consensus.cc:2272] T 32f0b0ff1e4f482fbd5d5bb078488de9 P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:04.176241  8755 consensus_peers.cc:597] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:04.182597  8755 consensus_peers.cc:597] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.196492  7002 tablet_replica.cc:333] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.201962  7002 raft_consensus.cc:2243] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.204658  7002 raft_consensus.cc:2272] T 264ed863486e43df8dfe1478dfb034ee P a0f96c12124b4e1a816d9fa970464091 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.207882  7002 tablet_replica.cc:333] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.208804  7002 raft_consensus.cc:2243] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.209456  7002 raft_consensus.cc:2272] T d3456040ac8e456eabcfa4db8a2b5510 P a0f96c12124b4e1a816d9fa970464091 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.212138  7002 tablet_replica.cc:333] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.212917  7002 raft_consensus.cc:2243] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.214095  7002 raft_consensus.cc:2272] T 440543aae4b54ad6aaca74cda8e88fb0 P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.216640  7002 tablet_replica.cc:333] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.217481  7002 raft_consensus.cc:2243] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 34 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.218683  7002 raft_consensus.cc:2272] T fbd85d0f27664dc8a33e2cdf0fd4ebdb P a0f96c12124b4e1a816d9fa970464091 [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.221228  7002 tablet_replica.cc:333] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.222015  7002 raft_consensus.cc:2243] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.222775  7002 raft_consensus.cc:2272] T 82a8e4371bab42f3a4d150da194ce8bd P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.225371  7002 tablet_replica.cc:333] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.226122  7002 raft_consensus.cc:2243] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.226722  7002 raft_consensus.cc:2272] T 0bf7f11a5f324770a352a6a29f56ebf4 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.230731  7002 tablet_replica.cc:333] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
W20260709 13:20:04.232360  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.233336  7002 raft_consensus.cc:2243] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.234077  7002 raft_consensus.cc:2272] T 5247aeecdc5c4ebf8516da3b94073f35 P a0f96c12124b4e1a816d9fa970464091 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.236694  7002 tablet_replica.cc:333] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.237192 16555 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:04.237737  7002 raft_consensus.cc:2243] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.237737 16555 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:04.238683  7002 raft_consensus.cc:2272] T 73b079a720af4d478dba8d608aeb9059 P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.240720 16555 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:20:04.249207  7002 tablet_replica.cc:333] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.258343  7002 raft_consensus.cc:2243] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.265486  7002 raft_consensus.cc:2272] T 8dca4b8aebe74578b370a72879bb9bba P a0f96c12124b4e1a816d9fa970464091 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:04.262638  8755 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:04.267313  8755 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:04.267762  8755 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:04.268489 16555 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:20:04.268756  8755 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:04.269761  8755 consensus_peers.cc:597] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.271531  7002 tablet_replica.cc:333] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.272632  7002 raft_consensus.cc:2243] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.273833  7002 raft_consensus.cc:2272] T 7e424b91f5394cedb3ad1923bab01174 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.276788  7002 tablet_replica.cc:333] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.277609  7002 raft_consensus.cc:2243] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.278427  7002 raft_consensus.cc:2272] T 8584c73fd4f14469baaaebe16617e775 P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.281100  7002 tablet_replica.cc:333] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.281915  7002 raft_consensus.cc:2243] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.282557  7002 raft_consensus.cc:2272] T 3e96746d2ece4e52ab82eca0737daf2e P a0f96c12124b4e1a816d9fa970464091 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.285193  7002 tablet_replica.cc:333] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.285974  7002 raft_consensus.cc:2243] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.287163  7002 raft_consensus.cc:2272] T 6874782ad0e549bd89899c965cd46c33 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.289894  7002 tablet_replica.cc:333] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.294935  7002 raft_consensus.cc:2243] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.300426  7002 raft_consensus.cc:2272] T 7588eb91ce3841808ca10d7985976be2 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.305691  7002 tablet_replica.cc:333] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.306593  7002 raft_consensus.cc:2243] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.307963  7002 raft_consensus.cc:2272] T 5d69cb3874984241afb1521d6e9178f2 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.311170  7002 tablet_replica.cc:333] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.312041  7002 raft_consensus.cc:2243] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.313290  7002 raft_consensus.cc:2272] T 3e54e69639dd478bb5f966d86c83c95d P a0f96c12124b4e1a816d9fa970464091 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.316753  7002 tablet_replica.cc:333] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.317646  7002 raft_consensus.cc:2243] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.318884  7002 raft_consensus.cc:2272] T 3393bfbad81242a2a3374049ddfa0b63 P a0f96c12124b4e1a816d9fa970464091 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.322551  7002 tablet_replica.cc:333] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.323493  7002 raft_consensus.cc:2243] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.324704  7002 raft_consensus.cc:2272] T 093d3bfbbaf542b5aa9ecd4e865ff155 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.337177  7002 tablet_replica.cc:333] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.338037  7002 raft_consensus.cc:2243] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.338846  7002 raft_consensus.cc:2272] T bf53fff91826424990da23103f484232 P a0f96c12124b4e1a816d9fa970464091 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.341907  7002 tablet_replica.cc:333] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.342701  7002 raft_consensus.cc:2243] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.344023  7002 raft_consensus.cc:2272] T fa9dafbde3954b8487327ba47919b4d5 P a0f96c12124b4e1a816d9fa970464091 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.347035  7002 tablet_replica.cc:333] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091: stopping tablet replica
I20260709 13:20:04.347779  7002 raft_consensus.cc:2243] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.348510  7002 raft_consensus.cc:2272] T dded0a12a5b14bc38c2b5ac21e951545 P a0f96c12124b4e1a816d9fa970464091 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:04.362543  8755 consensus_peers.cc:597] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:04.365479  8755 consensus_peers.cc:597] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:04.372268  8755 consensus_peers.cc:597] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:04.397861  8755 consensus_peers.cc:597] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:04.537325  8755 connection.cc:769] client connection to 127.6.214.131:45561 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:20:04.569195 16567 raft_consensus.cc:493] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:04.569793 16567 raft_consensus.cc:515] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:04.571827 16567 leader_election.cc:290] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:04.584872  8755 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111) [suppressed 644 similar messages]
W20260709 13:20:04.595932  8755 leader_election.cc:336] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:04.598403  8755 leader_election.cc:336] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:04.598893  8755 leader_election.cc:304] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:04.599733 16568 raft_consensus.cc:2749] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:20:05.119956  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:20:05.156262 16567 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:05.156888 16567 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:05.160157 16567 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:20:05.170611  8755 leader_election.cc:336] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:05.173277  8755 leader_election.cc:336] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:05.173842  8755 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:05.174634 16567 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:05.179301  8755 leader_election.cc:336] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
I20260709 13:20:05.273869 16567 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:05.274478 16567 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:05.276858 16567 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:20:05.281107  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:20:05.285743  8755 leader_election.cc:336] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:05.287747  8755 leader_election.cc:336] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
I20260709 13:20:05.288501  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:05.289321 16567 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:05.420612 16567 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:05.421234 16567 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:05.423805 16567 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:20:05.426925 16567 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:05.429422 16567 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:05.442641 16567 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:20:05.464128 16567 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:05.464741 16567 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:05.466799 16567 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:20:05.471410  8755 leader_election.cc:336] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
W20260709 13:20:05.471953  8755 leader_election.cc:336] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
W20260709 13:20:05.476025  8755 leader_election.cc:336] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:05.476686 16570 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:05.477342 16570 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:05.479409 16570 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:20:05.479943  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
W20260709 13:20:05.481143  8755 leader_election.cc:336] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:05.482100  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:05.481662 16570 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:05.483160 16567 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:05.494730  8755 leader_election.cc:336] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:05.495524  8755 leader_election.cc:336] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
I20260709 13:20:05.495940  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:05.496670 16570 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:05.501700  8755 leader_election.cc:336] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:05.504191  8755 leader_election.cc:336] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
I20260709 13:20:05.504671  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:05.505448 16570 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:05.534919 16570 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:05.535467 16570 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:05.537508 16570 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:20:05.547201  8755 leader_election.cc:336] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:05.547935  8755 leader_election.cc:336] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
I20260709 13:20:05.548374  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:05.549093 16570 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:05.558224  7002 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8278)
W20260709 13:20:05.598153  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:05.600183 16570 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:05.600731 16570 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:05.602901 16570 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:05.612391  8755 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:05.613224  8755 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:05.613688  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:05.614416 16570 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:05.653530 16570 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:05.654072 16570 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:05.656188 16570 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:20:05.668169  8755 leader_election.cc:336] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:05.668877  8755 leader_election.cc:336] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
I20260709 13:20:05.669539  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:05.670323 16570 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:05.694937  8755 consensus_peers.cc:597] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:05.702791 16570 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:05.703403 16570 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:05.705929 16570 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:20:05.730381  8755 leader_election.cc:336] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:05.732961  8755 leader_election.cc:336] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
I20260709 13:20:05.733495  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:05.734234 16570 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:05.754105  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:20:05.783865  8755 consensus_peers.cc:597] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:20:05.828405  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:20:05.963222 16570 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:05.968438 16570 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:05.972764 16570 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:05.980485  8755 leader_election.cc:336] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:05.987780  8755 leader_election.cc:336] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:05.988358  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:05.989708 16567 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:06.016144  8755 consensus_peers.cc:597] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:06.081027  8755 consensus_peers.cc:597] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:20:06.090786  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:06.156728  8755 consensus_peers.cc:597] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:06.164213  8755 consensus_peers.cc:597] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:06.244647 16567 raft_consensus.cc:493] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:06.245546 16567 raft_consensus.cc:515] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:06.248042 16567 leader_election.cc:290] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
I20260709 13:20:06.253400 16567 raft_consensus.cc:493] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:06.254235 16567 raft_consensus.cc:515] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:06.257089 16567 leader_election.cc:290] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:20:06.261180 16567 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:06.261948 16567 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:06.264195 16567 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:06.267737  8755 leader_election.cc:336] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:06.268751  8755 leader_election.cc:336] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:06.269189  8755 leader_election.cc:304] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:06.270047 16567 raft_consensus.cc:2749] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:06.290875  8755 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:06.293715  8755 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:06.294229  8755 leader_election.cc:304] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:06.294981 16567 raft_consensus.cc:2749] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:20:06.299731  8755 leader_election.cc:336] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:06.305970  8755 leader_election.cc:336] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
W20260709 13:20:06.307130  8755 leader_election.cc:336] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:06.307577  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:06.308303 16567 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:06.319496  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:20:06.326418  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:06.333788  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:06.373767 16567 raft_consensus.cc:493] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:06.374646 16567 raft_consensus.cc:515] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:06.377493 16567 leader_election.cc:290] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:20:06.391721  8755 leader_election.cc:336] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
W20260709 13:20:06.392848  8755 consensus_peers.cc:597] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:06.393333  8755 leader_election.cc:336] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:06.393761  8755 leader_election.cc:304] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:06.394488 16567 raft_consensus.cc:2749] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:20:06.395438  8755 leader_election.cc:336] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:06.404132  8755 consensus_peers.cc:597] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:06.441078  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:06.456934  8755 consensus_peers.cc:597] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:06.460260  8755 consensus_peers.cc:597] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:06.481215 16567 raft_consensus.cc:493] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:06.481984 16567 raft_consensus.cc:515] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:06.487217 16567 leader_election.cc:290] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:06.492950  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:20:06.494833  7993 catalog_manager.cc:4755] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b3279fc005d149f8aad5d0df46e09fda: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:06.502269  8755 leader_election.cc:336] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:06.503225  8755 leader_election.cc:336] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:06.503854  8755 leader_election.cc:304] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:06.504784 16567 raft_consensus.cc:2749] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:06.507965  8755 consensus_peers.cc:597] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:06.547909  8755 consensus_peers.cc:597] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:06.558930  7002 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8278)
W20260709 13:20:06.594805  8755 consensus_peers.cc:597] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:06.605654  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:06.739197  8755 consensus_peers.cc:597] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:06.757875  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:06.822486  8755 consensus_peers.cc:597] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:06.838546  8755 consensus_peers.cc:597] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:06.872689  8755 consensus_peers.cc:597] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:06.886430  8755 consensus_peers.cc:597] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:06.972411  8755 consensus_peers.cc:597] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:06.993379  8755 consensus_peers.cc:597] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:06.996464 16567 raft_consensus.cc:493] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:06.997192 16567 raft_consensus.cc:515] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:06.999576 16567 leader_election.cc:290] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:20:07.022157  8755 leader_election.cc:336] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:07.028496  8755 leader_election.cc:336] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
I20260709 13:20:07.029031  8755 leader_election.cc:304] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:07.029954 16576 raft_consensus.cc:2749] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:07.031420  8755 consensus_peers.cc:597] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:07.245826 16578 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:07.246506 16578 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:07.248667 16578 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:20:07.256312  8755 consensus_peers.cc:597] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:07.256805  8755 leader_election.cc:336] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
W20260709 13:20:07.257385  8755 leader_election.cc:336] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:07.257799  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:07.258594 16578 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:07.270251 16578 raft_consensus.cc:493] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:07.270849 16578 raft_consensus.cc:515] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:07.272962 16578 leader_election.cc:290] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:07.277971  8755 leader_election.cc:336] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:07.278903  8755 leader_election.cc:336] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:07.279301  8755 leader_election.cc:304] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:07.280071 16578 raft_consensus.cc:2749] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:07.292284 16578 raft_consensus.cc:493] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:07.293123 16578 raft_consensus.cc:515] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } attrs { replace: true } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:07.294456 16576 raft_consensus.cc:493] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:07.295188 16576 raft_consensus.cc:515] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:07.296186 16578 leader_election.cc:290] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:20:07.297681 16576 leader_election.cc:290] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:20:07.305698  8755 leader_election.cc:336] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:07.307524  8755 leader_election.cc:336] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:07.308007  8755 leader_election.cc:304] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:07.308734 16578 raft_consensus.cc:2749] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:07.309463  8755 leader_election.cc:336] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:07.310169  8755 leader_election.cc:336] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
W20260709 13:20:07.311015  8755 leader_election.cc:336] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
I20260709 13:20:07.311378  8755 leader_election.cc:304] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:07.312117 16578 raft_consensus.cc:2749] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:07.393870 16578 raft_consensus.cc:493] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:07.394770 16578 raft_consensus.cc:515] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } attrs { replace: true } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:07.398000 16578 leader_election.cc:290] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:20:07.405073  8755 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:07.406433  8755 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:07.406877  8755 leader_election.cc:304] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:07.407766 16576 raft_consensus.cc:2749] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:07.408468 16576 raft_consensus.cc:493] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:07.409044 16576 raft_consensus.cc:515] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
W20260709 13:20:07.409937  8755 leader_election.cc:336] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
I20260709 13:20:07.411531 16576 leader_election.cc:290] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:20:07.419442  8755 leader_election.cc:336] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:07.421659  8755 leader_election.cc:336] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
I20260709 13:20:07.422070  8755 leader_election.cc:304] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:07.422799 16576 raft_consensus.cc:2749] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:07.515933 16576 raft_consensus.cc:493] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:07.516697 16576 raft_consensus.cc:515] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:07.519251 16576 leader_election.cc:290] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:07.524284  8755 leader_election.cc:336] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
W20260709 13:20:07.526319  8755 leader_election.cc:336] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:07.526729  8755 leader_election.cc:304] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:07.527448 16576 raft_consensus.cc:2749] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:07.557792  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:20:07.559464  7002 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8278)
I20260709 13:20:07.564252 16576 raft_consensus.cc:493] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:07.564961 16576 raft_consensus.cc:515] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:07.567364 16576 leader_election.cc:290] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:20:07.572151  8755 leader_election.cc:336] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:07.572875  8755 leader_election.cc:336] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
I20260709 13:20:07.573323  8755 leader_election.cc:304] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:07.574087 16576 raft_consensus.cc:2749] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:07.590137 16576 raft_consensus.cc:493] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:07.591001 16576 raft_consensus.cc:515] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:07.593572 16576 leader_election.cc:290] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:20:07.604444  8755 leader_election.cc:336] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
W20260709 13:20:07.605185  8755 leader_election.cc:336] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:07.605650  8755 leader_election.cc:304] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:07.606458 16576 raft_consensus.cc:2749] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:07.630326 16578 raft_consensus.cc:493] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:07.631067 16578 raft_consensus.cc:515] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:07.633234 16578 leader_election.cc:290] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
W20260709 13:20:07.648209  8755 leader_election.cc:336] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:20:07.649914  8755 leader_election.cc:336] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
I20260709 13:20:07.650434  8755 leader_election.cc:304] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9bd264598fd2483e9e17674bab9ba4e8, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:07.651242 16576 raft_consensus.cc:2749] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:07.713235 16576 raft_consensus.cc:493] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:07.713860 16576 raft_consensus.cc:515] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:07.716326 16576 leader_election.cc:290] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:07.722365  8755 leader_election.cc:336] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:07.723433  8755 leader_election.cc:336] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:07.723817  8755 leader_election.cc:304] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:07.724507 16576 raft_consensus.cc:2749] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:07.786552  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:20:08.112516  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:08.146687  8820 debug-util.cc:398] Leaking SignalData structure 0x7b08003d9680 after lost signal to thread 7005
W20260709 13:20:08.147889  8820 debug-util.cc:398] Leaking SignalData structure 0x7b08003819a0 after lost signal to thread 8040
W20260709 13:20:08.149466  8820 debug-util.cc:398] Leaking SignalData structure 0x7b080033a2a0 after lost signal to thread 8823
W20260709 13:20:08.212231  8755 consensus_peers.cc:597] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:08.258100  8755 consensus_peers.cc:597] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:08.271363  8755 consensus_peers.cc:597] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:20:08.420220  8755 consensus_peers.cc:597] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:08.484594  8755 consensus_peers.cc:597] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:20:08.491052  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:20:08.491725  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:08.637760  7002 tablet_server.cc:196] TabletServer@127.6.214.131:0 shutdown complete.
W20260709 13:20:08.644743  8755 consensus_peers.cc:597] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:20:08.688767 16576 raft_consensus.cc:493] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:08.689472 16576 raft_consensus.cc:515] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:08.691905 16576 leader_election.cc:290] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:08.702381  8755 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:08.703532  8755 leader_election.cc:336] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:08.703987  8755 leader_election.cc:304] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:08.704807 16576 raft_consensus.cc:2749] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:20:08.708213  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:08.723907  8755 consensus_peers.cc:597] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:08.741130 16576 raft_consensus.cc:493] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bd264598fd2483e9e17674bab9ba4e8)
I20260709 13:20:08.741762 16576 raft_consensus.cc:515] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "9bd264598fd2483e9e17674bab9ba4e8" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 46389 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:08.744158 16576 leader_election.cc:290] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389)
W20260709 13:20:08.758831  8755 leader_election.cc:336] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:08.761641  8755 leader_election.cc:336] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:08.762207  8755 leader_election.cc:304] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, 9bd264598fd2483e9e17674bab9ba4e8
I20260709 13:20:08.763046 16576 raft_consensus.cc:2749] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:08.764207  8755 consensus_peers.cc:597] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:08.768923  8755 consensus_peers.cc:597] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:08.771795  8755 consensus_peers.cc:597] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:08.796988  8755 consensus_peers.cc:597] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:08.830687  8755 consensus_peers.cc:597] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f -> Peer 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): Couldn't send request to peer 9bd264598fd2483e9e17674bab9ba4e8. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:08.853744  7002 tablet_server.cc:179] TabletServer@127.6.214.132:0 shutting down...
W20260709 13:20:08.857050  8755 consensus_peers.cc:597] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:20:08.882344  8755 consensus_peers.cc:597] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:08.907444  8755 consensus_peers.cc:597] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f -> Peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Couldn't send request to peer 9480609eccc44250a4d7fcc9686e76cf. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:20:08.949577  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:08.951118  7002 tablet_replica.cc:333] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:08.951804 16580 raft_consensus.cc:493] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a0f96c12124b4e1a816d9fa970464091)
I20260709 13:20:08.952482 16580 raft_consensus.cc:515] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9480609eccc44250a4d7fcc9686e76cf" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 45123 } } peers { permanent_uuid: "a0f96c12124b4e1a816d9fa970464091" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 45561 } } peers { permanent_uuid: "5033fc7e66374940a203908ea8b0078f" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 45917 } attrs { promote: false } }
I20260709 13:20:08.952450  7002 raft_consensus.cc:2243] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:20:08.954617 16580 leader_election.cc:290] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123), a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561)
I20260709 13:20:08.955809  7002 raft_consensus.cc:2272] T b3279fc005d149f8aad5d0df46e09fda P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:08.959977  7002 tablet_replica.cc:333] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:08.960995  7002 raft_consensus.cc:2243] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:08.961686  8755 leader_election.cc:336] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
I20260709 13:20:08.962128  7002 raft_consensus.cc:2272] T c239eb8b961c4362b6e905c0fa6fbd98 P 5033fc7e66374940a203908ea8b0078f [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:08.962404  8755 leader_election.cc:336] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111)
I20260709 13:20:08.962836  8755 leader_election.cc:304] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5033fc7e66374940a203908ea8b0078f; no voters: 9480609eccc44250a4d7fcc9686e76cf, a0f96c12124b4e1a816d9fa970464091
I20260709 13:20:08.963582 16580 raft_consensus.cc:2749] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:08.965359  7002 tablet_replica.cc:333] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:08.966288  7002 raft_consensus.cc:2243] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:08.967088  7002 raft_consensus.cc:2272] T d0adcb7796ea47a4be5ddd094575ed19 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:08.969691  7002 tablet_replica.cc:333] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:08.970374  7002 raft_consensus.cc:2243] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:08.971243  7002 raft_consensus.cc:2272] T 9abaa411847e4bf9907f7af5e2689c7b P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:08.973730  7002 tablet_replica.cc:333] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:08.974383  7002 raft_consensus.cc:2243] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:08.974962  7002 raft_consensus.cc:2272] T e1e020840d414fa992e8afcd5cffaad4 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:08.977368  7002 tablet_replica.cc:333] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:08.978341  7002 raft_consensus.cc:2243] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:20:08.979727  7002 raft_consensus.cc:2272] T 3e96746d2ece4e52ab82eca0737daf2e P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:08.982472  7002 tablet_replica.cc:333] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:08.983086  7002 raft_consensus.cc:2243] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:20:08.984206  7002 raft_consensus.cc:2272] T 8584c73fd4f14469baaaebe16617e775 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:08.986490  7002 tablet_replica.cc:333] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:08.987147  7002 raft_consensus.cc:2243] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:08.988204  7002 raft_consensus.cc:2272] T 6353b347875648eda7077a6a3bc633fd P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:08.990576  7002 tablet_replica.cc:333] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:08.991245  7002 raft_consensus.cc:2243] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:20:08.992363  7002 raft_consensus.cc:2272] T 43e4649131cb4b10a82b13d0d2b8e85a P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:08.995230  7002 tablet_replica.cc:333] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:08.996114  7002 raft_consensus.cc:2243] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:08.998308  7002 raft_consensus.cc:2272] T 73b079a720af4d478dba8d608aeb9059 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.001739  7002 tablet_replica.cc:333] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.002642  7002 raft_consensus.cc:2243] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.003662  7002 raft_consensus.cc:2272] T 5d69cb3874984241afb1521d6e9178f2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.006403  7002 tablet_replica.cc:333] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.007285  7002 raft_consensus.cc:2243] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.008023  7002 raft_consensus.cc:2272] T 5328e1082b164f3dbf9bdbb846c37b26 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:09.010257  8755 consensus_peers.cc:597] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:09.011005  7002 tablet_replica.cc:333] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.011695  7002 raft_consensus.cc:2243] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:20:09.013535  7002 raft_consensus.cc:2272] T 7588eb91ce3841808ca10d7985976be2 P 5033fc7e66374940a203908ea8b0078f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.015996  7002 tablet_replica.cc:333] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.016571  7002 raft_consensus.cc:2243] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.017326  7002 raft_consensus.cc:2272] T eb334e41695d4d8c8d5de4eb668cd421 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.019371  7002 tablet_replica.cc:333] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.019999  7002 raft_consensus.cc:2243] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:20:09.021400  7002 raft_consensus.cc:2272] T f3f32037b7b54a0c991d35bbea1b786b P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.024497  7002 tablet_replica.cc:333] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.025343  7002 raft_consensus.cc:2243] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.026217  7002 raft_consensus.cc:2272] T 6e624c9e6425410d86ead659c0c8db59 P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:09.026153  8755 consensus_peers.cc:597] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f -> Peer a0f96c12124b4e1a816d9fa970464091 (127.6.214.131:45561): Couldn't send request to peer a0f96c12124b4e1a816d9fa970464091. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:45561: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:09.029148  7002 tablet_replica.cc:333] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.030085  7002 raft_consensus.cc:2243] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:20:09.031626  7002 raft_consensus.cc:2272] T cd035b4a624c4c7aa2257c2821868021 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.033828  7002 tablet_replica.cc:333] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.034395  7002 raft_consensus.cc:2243] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.035106  7002 raft_consensus.cc:2272] T 5590746c03af49c9a057629ee7fe6bfb P 5033fc7e66374940a203908ea8b0078f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.037127  7002 tablet_replica.cc:333] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.037701  7002 raft_consensus.cc:2243] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.038305  7002 raft_consensus.cc:2272] T 7c962bcd58c74013abdb370fa758d500 P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.040614  7002 tablet_replica.cc:333] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.041203  7002 raft_consensus.cc:2243] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.041872  7002 raft_consensus.cc:2272] T 3e54e69639dd478bb5f966d86c83c95d P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.044241  7002 tablet_replica.cc:333] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.044775  7002 raft_consensus.cc:2243] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.045287  7002 raft_consensus.cc:2272] T 440543aae4b54ad6aaca74cda8e88fb0 P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.047587  7002 tablet_replica.cc:333] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.048242  7002 raft_consensus.cc:2243] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.048936  7002 raft_consensus.cc:2272] T ff9e97576a934b9dbf18f6ee6cc670af P 5033fc7e66374940a203908ea8b0078f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.051433  7002 tablet_replica.cc:333] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.052100  7002 raft_consensus.cc:2243] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:20:09.053409  7002 raft_consensus.cc:2272] T e8a82de7cb524bf996a9df256baca3fd P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.055791  7002 tablet_replica.cc:333] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.056371  7002 raft_consensus.cc:2243] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:20:09.057286  7002 raft_consensus.cc:2272] T e05ca9fb2b7a4b46851675643729339f P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.059258  7002 tablet_replica.cc:333] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.059815  7002 raft_consensus.cc:2243] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.060437  7002 raft_consensus.cc:2272] T c362335b215641d38dd0c651acfb8fbb P 5033fc7e66374940a203908ea8b0078f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.062781  7002 tablet_replica.cc:333] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.063310  7002 raft_consensus.cc:2243] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:20:09.064306  7002 raft_consensus.cc:2272] T dded0a12a5b14bc38c2b5ac21e951545 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.066390  7002 tablet_replica.cc:333] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.066975  7002 raft_consensus.cc:2243] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.067792  7002 raft_consensus.cc:2272] T 264ed863486e43df8dfe1478dfb034ee P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.070168  7002 tablet_replica.cc:333] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.070719  7002 raft_consensus.cc:2243] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:20:09.071678  7002 raft_consensus.cc:2272] T 32f0b0ff1e4f482fbd5d5bb078488de9 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.073968  7002 tablet_replica.cc:333] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.074504  7002 raft_consensus.cc:2243] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.075012  7002 raft_consensus.cc:2272] T 7e424b91f5394cedb3ad1923bab01174 P 5033fc7e66374940a203908ea8b0078f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.077018  7002 tablet_replica.cc:333] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.077582  7002 raft_consensus.cc:2243] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.078317  7002 raft_consensus.cc:2272] T d092bc636e5347e5a3f10441d996ec96 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.080384  7002 tablet_replica.cc:333] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.080914  7002 raft_consensus.cc:2243] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.081411  7002 raft_consensus.cc:2272] T a64e531fcf0742cd8db17f008824d588 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.083272  7002 tablet_replica.cc:333] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.083765  7002 raft_consensus.cc:2243] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:20:09.084753  7002 raft_consensus.cc:2272] T 45c332ea272c465d9e07083a06e802e7 P 5033fc7e66374940a203908ea8b0078f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.086633  7002 tablet_replica.cc:333] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.087335  7002 raft_consensus.cc:2243] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:20:09.089864  7002 raft_consensus.cc:2272] T fa9dafbde3954b8487327ba47919b4d5 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.092881  7002 tablet_replica.cc:333] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.093653  7002 raft_consensus.cc:2243] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:09.094828  7002 raft_consensus.cc:2272] T 8dca4b8aebe74578b370a72879bb9bba P 5033fc7e66374940a203908ea8b0078f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.097117  7002 tablet_replica.cc:333] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.097805  7002 raft_consensus.cc:2243] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:09.098425  7002 raft_consensus.cc:2272] T 17d4c6719ffc4a51a444f84eff0c28b7 P 5033fc7e66374940a203908ea8b0078f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.100415  7002 tablet_replica.cc:333] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.101003  7002 raft_consensus.cc:2243] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:20:09.102342  7002 raft_consensus.cc:2272] T 0bf7f11a5f324770a352a6a29f56ebf4 P 5033fc7e66374940a203908ea8b0078f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.104696  7002 tablet_replica.cc:333] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f: stopping tablet replica
I20260709 13:20:09.105225  7002 raft_consensus.cc:2243] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:20:09.106482  7002 raft_consensus.cc:2272] T 82a8e4371bab42f3a4d150da194ce8bd P 5033fc7e66374940a203908ea8b0078f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:09.622293  7002 tablet_server.cc:196] TabletServer@127.6.214.132:0 shutdown complete.
W20260709 13:20:09.629397  7993 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111) [suppressed 382 similar messages]
W20260709 13:20:09.636780  7993 catalog_manager.cc:4755] TS 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): ChangeConfig:REMOVE_PEER RPC failed for tablet 9abaa411847e4bf9907f7af5e2689c7b: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:20:09.692416  7002 master.cc:562] Master@127.6.214.190:45311 shutting down...
W20260709 13:20:09.734942  8054 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:20:09.735486  8054 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:20:09.735988  8054 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:20:22.934680  7993 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:22.938970  7993 catalog_manager.cc:4755] TS 9480609eccc44250a4d7fcc9686e76cf (127.6.214.129:45123): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b3279fc005d149f8aad5d0df46e09fda: Network error: Client connection negotiation failed: client connection to 127.6.214.129:45123: connect: Connection refused (error 111)
W20260709 13:20:57.613229  8037 debug-util.cc:398] Leaking SignalData structure 0x7b080019c1a0 after lost signal to thread 7005
W20260709 13:20:57.614100  8037 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2260 after lost signal to thread 8040
W20260709 13:21:09.648114  7993 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
W20260709 13:21:09.652339  7993 catalog_manager.cc:4755] TS 9bd264598fd2483e9e17674bab9ba4e8 (127.6.214.130:46389): ChangeConfig:REMOVE_PEER RPC failed for tablet 9abaa411847e4bf9907f7af5e2689c7b: Network error: Client connection negotiation failed: client connection to 127.6.214.130:46389: connect: Connection refused (error 111)
I20260709 13:21:11.210909  7002 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:11.212136  7002 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:11.212507  7002 tablet_replica.cc:333] T 00000000000000000000000000000000 P e5e50b3438e24144a9523cb9ae40543f: stopping tablet replica
I20260709 13:21:11.446084  7002 master.cc:584] Master@127.6.214.190:45311 shutdown complete.
I20260709 13:21:11.496825  7002 test_util.cc:182] -----------------------------------------------
I20260709 13:21:11.497056  7002 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602923898527-7002-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (321589 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:21:11.500566  7002 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.214.190:40917
I20260709 13:21:11.501835  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:11.508312 16594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:11.508306 16595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:11.509366 16597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:11.509858  7002 server_base.cc:1061] running on GCE node
I20260709 13:21:11.512892  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:11.513087  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:11.513211  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603271513199 us; error 0 us; skew 500 ppm
I20260709 13:21:11.513733  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:11.516510  7002 webserver.cc:533] Webserver started at http://127.6.214.190:45471/ using document root <none> and password file <none>
I20260709 13:21:11.516987  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:11.517143  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:11.517366  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:11.518865  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/master-0-root/instance:
uuid: "aa6cb7607ecb4d57908687766c6ec9f8"
format_stamp: "Formatted at 2026-07-09 13:21:11 on dist-test-slave-rnv4"
I20260709 13:21:11.524328  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:21:11.528038 16602 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:11.528898  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:11.529322  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/master-0-root
uuid: "aa6cb7607ecb4d57908687766c6ec9f8"
format_stamp: "Formatted at 2026-07-09 13:21:11 on dist-test-slave-rnv4"
I20260709 13:21:11.529706  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:11.551268  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:11.552666  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:11.594480  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.190:40917
I20260709 13:21:11.594588 16653 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.190:40917 every 8 connection(s)
I20260709 13:21:11.598945 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:11.610855 16654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8: Bootstrap starting.
I20260709 13:21:11.615860 16654 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:11.620344 16654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8: No bootstrap required, opened a new log
I20260709 13:21:11.622668 16654 raft_consensus.cc:359] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6cb7607ecb4d57908687766c6ec9f8" member_type: VOTER }
I20260709 13:21:11.623129 16654 raft_consensus.cc:385] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:11.623370 16654 raft_consensus.cc:740] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6cb7607ecb4d57908687766c6ec9f8, State: Initialized, Role: FOLLOWER
I20260709 13:21:11.624017 16654 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6cb7607ecb4d57908687766c6ec9f8" member_type: VOTER }
I20260709 13:21:11.624511 16654 raft_consensus.cc:399] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:11.624723 16654 raft_consensus.cc:493] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:11.625012 16654 raft_consensus.cc:3060] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:11.629612 16654 raft_consensus.cc:515] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6cb7607ecb4d57908687766c6ec9f8" member_type: VOTER }
I20260709 13:21:11.630144 16654 leader_election.cc:304] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa6cb7607ecb4d57908687766c6ec9f8; no voters: 
I20260709 13:21:11.631320 16654 leader_election.cc:290] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:11.631757 16657 raft_consensus.cc:2804] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:11.633479 16657 raft_consensus.cc:697] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [term 1 LEADER]: Becoming Leader. State: Replica: aa6cb7607ecb4d57908687766c6ec9f8, State: Running, Role: LEADER
I20260709 13:21:11.634147 16657 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6cb7607ecb4d57908687766c6ec9f8" member_type: VOTER }
I20260709 13:21:11.634848 16654 sys_catalog.cc:565] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:11.642084 16658 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa6cb7607ecb4d57908687766c6ec9f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6cb7607ecb4d57908687766c6ec9f8" member_type: VOTER } }
I20260709 13:21:11.641997 16659 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa6cb7607ecb4d57908687766c6ec9f8. Latest consensus state: current_term: 1 leader_uuid: "aa6cb7607ecb4d57908687766c6ec9f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa6cb7607ecb4d57908687766c6ec9f8" member_type: VOTER } }
I20260709 13:21:11.642967 16658 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:11.643136 16659 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:11.645028 16667 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:11.653383 16667 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:11.654559  7002 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:11.663379 16667 catalog_manager.cc:1383] Generated new cluster ID: c41e9b55cdec4363b06d6b27a498ae36
I20260709 13:21:11.663703 16667 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:11.676600 16667 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:11.678030 16667 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:11.698629 16667 catalog_manager.cc:6070] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8: Generated new TSK 0
I20260709 13:21:11.699275 16667 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:11.721608  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:11.729321 16675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:11.730080 16676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:11.731485 16678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:11.733278  7002 server_base.cc:1061] running on GCE node
I20260709 13:21:11.737051  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:11.737277  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:11.737478  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603271737450 us; error 0 us; skew 500 ppm
I20260709 13:21:11.738075  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:11.741806  7002 webserver.cc:533] Webserver started at http://127.6.214.129:44289/ using document root <none> and password file <none>
I20260709 13:21:11.742570  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:11.742846  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:11.743230  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:11.744987  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/instance:
uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
format_stamp: "Formatted at 2026-07-09 13:21:11 on dist-test-slave-rnv4"
I20260709 13:21:11.750249  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.002s
I20260709 13:21:11.754060 16683 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:11.754951  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:21:11.755398  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-0-root
uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
format_stamp: "Formatted at 2026-07-09 13:21:11 on dist-test-slave-rnv4"
I20260709 13:21:11.755716  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:11.774322  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:11.775650  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:11.777377  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:11.779872  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:11.780129  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:11.780371  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:11.780557  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:11.827330  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.129:34869
I20260709 13:21:11.827445 16745 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.129:34869 every 8 connection(s)
I20260709 13:21:11.833979  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:11.843251 16750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:11.844990 16751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:11.847585 16753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:11.848814  7002 server_base.cc:1061] running on GCE node
I20260709 13:21:11.850759 16746 heartbeater.cc:344] Connected to a master server at 127.6.214.190:40917
I20260709 13:21:11.851204 16746 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:11.851778  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:11.852005  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:11.852222  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603271852187 us; error 0 us; skew 500 ppm
I20260709 13:21:11.852151 16746 heartbeater.cc:507] Master 127.6.214.190:40917 requested a full tablet report, sending...
I20260709 13:21:11.853004  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:11.855072 16619 ts_manager.cc:194] Registered new tserver with Master: 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:11.855908  7002 webserver.cc:533] Webserver started at http://127.6.214.130:38429/ using document root <none> and password file <none>
I20260709 13:21:11.856443  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:11.856649  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:11.856932  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:11.857528 16619 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50870
I20260709 13:21:11.858461  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-1-root/instance:
uuid: "5642511b38924ffcbe38110cf27d3535"
format_stamp: "Formatted at 2026-07-09 13:21:11 on dist-test-slave-rnv4"
I20260709 13:21:11.863296  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:21:11.866928 16758 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:11.867769  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:21:11.868050  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-1-root
uuid: "5642511b38924ffcbe38110cf27d3535"
format_stamp: "Formatted at 2026-07-09 13:21:11 on dist-test-slave-rnv4"
I20260709 13:21:11.868345  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:11.885571  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:11.886797  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:11.888284  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:11.890739  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:11.890933  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:11.891273  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:11.891417  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:11.938566  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.130:34809
I20260709 13:21:11.938745 16820 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.130:34809 every 8 connection(s)
I20260709 13:21:11.943624  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:11.951974 16824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:11.952986 16825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:11.956779  7002 server_base.cc:1061] running on GCE node
W20260709 13:21:11.956745 16828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:11.957815 16821 heartbeater.cc:344] Connected to a master server at 127.6.214.190:40917
I20260709 13:21:11.958341 16821 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:11.958425  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:11.958738  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:11.958925  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603271958909 us; error 0 us; skew 500 ppm
I20260709 13:21:11.959317 16821 heartbeater.cc:507] Master 127.6.214.190:40917 requested a full tablet report, sending...
I20260709 13:21:11.959755  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:11.962260 16619 ts_manager.cc:194] Registered new tserver with Master: 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:11.963302  7002 webserver.cc:533] Webserver started at http://127.6.214.131:35497/ using document root <none> and password file <none>
I20260709 13:21:11.964095  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:11.964344  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:11.964365 16619 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50874
I20260709 13:21:11.964828  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:11.966662  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-2-root/instance:
uuid: "71a0b5583e0547a88c88b590549fbcee"
format_stamp: "Formatted at 2026-07-09 13:21:11 on dist-test-slave-rnv4"
I20260709 13:21:11.971603  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:21:11.975283 16832 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:11.976082  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:21:11.976476  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-2-root
uuid: "71a0b5583e0547a88c88b590549fbcee"
format_stamp: "Formatted at 2026-07-09 13:21:11 on dist-test-slave-rnv4"
I20260709 13:21:11.976739  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:11.987722  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:11.989012  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:11.990648  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:11.993072  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:11.993274  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:11.993641  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:11.993788  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:12.039196  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.131:46515
I20260709 13:21:12.039297 16894 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.131:46515 every 8 connection(s)
I20260709 13:21:12.044373  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:12.052003 16898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:12.054232 16899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:12.058612  7002 server_base.cc:1061] running on GCE node
I20260709 13:21:12.060250 16895 heartbeater.cc:344] Connected to a master server at 127.6.214.190:40917
W20260709 13:21:12.060657 16901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:12.060751 16895 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:12.061857  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:21:12.061885 16895 heartbeater.cc:507] Master 127.6.214.190:40917 requested a full tablet report, sending...
W20260709 13:21:12.062289  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:12.062548  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603272062524 us; error 0 us; skew 500 ppm
I20260709 13:21:12.063437  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:12.064337 16619 ts_manager.cc:194] Registered new tserver with Master: 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:12.066612  7002 webserver.cc:533] Webserver started at http://127.6.214.132:39931/ using document root <none> and password file <none>
I20260709 13:21:12.066799 16619 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50882
I20260709 13:21:12.067705  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:12.068048  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:12.068480  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:12.070372  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-3-root/instance:
uuid: "266d75f35db4465788ab06782fae972d"
format_stamp: "Formatted at 2026-07-09 13:21:12 on dist-test-slave-rnv4"
I20260709 13:21:12.075453  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:21:12.079368 16906 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:12.080246  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.001s
I20260709 13:21:12.080616  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-3-root
uuid: "266d75f35db4465788ab06782fae972d"
format_stamp: "Formatted at 2026-07-09 13:21:12 on dist-test-slave-rnv4"
I20260709 13:21:12.081104  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:12.103304  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:12.104787  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:12.106534  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:12.109043  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:12.109325  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:12.109658  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:12.109865  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:12.158327  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.132:32963
I20260709 13:21:12.158408 16968 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.132:32963 every 8 connection(s)
I20260709 13:21:12.173928 16969 heartbeater.cc:344] Connected to a master server at 127.6.214.190:40917
I20260709 13:21:12.174408 16969 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:12.175283 16969 heartbeater.cc:507] Master 127.6.214.190:40917 requested a full tablet report, sending...
I20260709 13:21:12.177227 16619 ts_manager.cc:194] Registered new tserver with Master: 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:12.178293  7002 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01614811s
I20260709 13:21:12.178771 16619 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50898
I20260709 13:21:12.209271 16619 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50904:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:21:12.462105 16711 tablet_service.cc:1511] Processing CreateTablet for tablet dc87d7904d6f4c4489210546472fc39f (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:12.463675 16711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc87d7904d6f4c4489210546472fc39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.466528 16710 tablet_service.cc:1511] Processing CreateTablet for tablet 459fd01e9d83462da735e004032e70b7 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:12.468153 16710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459fd01e9d83462da735e004032e70b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.469931 16934 tablet_service.cc:1511] Processing CreateTablet for tablet dc87d7904d6f4c4489210546472fc39f (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:12.471366 16934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc87d7904d6f4c4489210546472fc39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.474749 16933 tablet_service.cc:1511] Processing CreateTablet for tablet 5a920662fe00409bab733fdb2143da6f (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:12.475145 16709 tablet_service.cc:1511] Processing CreateTablet for tablet 5a920662fe00409bab733fdb2143da6f (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:12.476197 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a920662fe00409bab733fdb2143da6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.476624 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a920662fe00409bab733fdb2143da6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.478682 16932 tablet_service.cc:1511] Processing CreateTablet for tablet ef2738933d0443258a83e98416c422a7 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:12.480192 16860 tablet_service.cc:1511] Processing CreateTablet for tablet 459fd01e9d83462da735e004032e70b7 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:12.481788 16860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459fd01e9d83462da735e004032e70b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.484283 16859 tablet_service.cc:1511] Processing CreateTablet for tablet 5a920662fe00409bab733fdb2143da6f (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:12.486858 16858 tablet_service.cc:1511] Processing CreateTablet for tablet ef2738933d0443258a83e98416c422a7 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:12.480141 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2738933d0443258a83e98416c422a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.492838 16708 tablet_service.cc:1511] Processing CreateTablet for tablet e691d47f85a540f884defe4bf7a293b2 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:12.494083 16858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2738933d0443258a83e98416c422a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.494371 16708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e691d47f85a540f884defe4bf7a293b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.497948 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a920662fe00409bab733fdb2143da6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.516214 16784 tablet_service.cc:1511] Processing CreateTablet for tablet ef2738933d0443258a83e98416c422a7 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:12.516206 16786 tablet_service.cc:1511] Processing CreateTablet for tablet dc87d7904d6f4c4489210546472fc39f (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:12.517554 16785 tablet_service.cc:1511] Processing CreateTablet for tablet 459fd01e9d83462da735e004032e70b7 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:12.519088 16786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc87d7904d6f4c4489210546472fc39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.519729 16785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459fd01e9d83462da735e004032e70b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.522728 16783 tablet_service.cc:1511] Processing CreateTablet for tablet e691d47f85a540f884defe4bf7a293b2 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:12.523346 16784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2738933d0443258a83e98416c422a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.523545 16931 tablet_service.cc:1511] Processing CreateTablet for tablet a37644a5aa384ad88bdebe0b15db71ea (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:12.524241 16783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e691d47f85a540f884defe4bf7a293b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.525010 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a37644a5aa384ad88bdebe0b15db71ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.522780 16857 tablet_service.cc:1511] Processing CreateTablet for tablet e691d47f85a540f884defe4bf7a293b2 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:12.526266 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e691d47f85a540f884defe4bf7a293b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.531616 16707 tablet_service.cc:1511] Processing CreateTablet for tablet a37644a5aa384ad88bdebe0b15db71ea (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:12.533209 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a37644a5aa384ad88bdebe0b15db71ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.553306 16782 tablet_service.cc:1511] Processing CreateTablet for tablet a37644a5aa384ad88bdebe0b15db71ea (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:12.554854 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a37644a5aa384ad88bdebe0b15db71ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.573843 16856 tablet_service.cc:1511] Processing CreateTablet for tablet 625f07ca50734f51bc7c0176ad5326f9 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:12.575798 16856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625f07ca50734f51bc7c0176ad5326f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.576032 16710 tablet_service.cc:1511] Processing CreateTablet for tablet 625f07ca50734f51bc7c0176ad5326f9 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:12.577406 16710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625f07ca50734f51bc7c0176ad5326f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.579465 16933 tablet_service.cc:1511] Processing CreateTablet for tablet 625f07ca50734f51bc7c0176ad5326f9 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:12.580847 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625f07ca50734f51bc7c0176ad5326f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.583813 16781 tablet_service.cc:1511] Processing CreateTablet for tablet 9e47c1b91c71444aa6e2c70fa4eb4403 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:12.585327 16781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e47c1b91c71444aa6e2c70fa4eb4403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.590298 16989 tablet_bootstrap.cc:492] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:12.599084 16990 tablet_bootstrap.cc:492] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:12.603989 16859 tablet_service.cc:1511] Processing CreateTablet for tablet 9e47c1b91c71444aa6e2c70fa4eb4403 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:12.604763 16989 tablet_bootstrap.cc:654] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.605468 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e47c1b91c71444aa6e2c70fa4eb4403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.605984 16991 tablet_bootstrap.cc:492] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:12.614800 16991 tablet_bootstrap.cc:654] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.619961 16932 tablet_service.cc:1511] Processing CreateTablet for tablet 9e47c1b91c71444aa6e2c70fa4eb4403 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:12.621096 16709 tablet_service.cc:1511] Processing CreateTablet for tablet 0239d47f915d4f529cdc01b32055c954 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:12.621392 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e47c1b91c71444aa6e2c70fa4eb4403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.622469 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0239d47f915d4f529cdc01b32055c954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.628490 16784 tablet_service.cc:1511] Processing CreateTablet for tablet 0239d47f915d4f529cdc01b32055c954 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:12.630841 16858 tablet_service.cc:1511] Processing CreateTablet for tablet 0239d47f915d4f529cdc01b32055c954 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:12.631359 16784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0239d47f915d4f529cdc01b32055c954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.632292 16858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0239d47f915d4f529cdc01b32055c954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.638379 16934 tablet_service.cc:1511] Processing CreateTablet for tablet 46a75d301e384d359f3540e990d68e8d (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:12.639379 16990 tablet_bootstrap.cc:654] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.640767 16934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a75d301e384d359f3540e990d68e8d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:12.646960 16666 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:12.657035 16708 tablet_service.cc:1511] Processing CreateTablet for tablet 46a75d301e384d359f3540e990d68e8d (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:12.658516 16708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a75d301e384d359f3540e990d68e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.658363 16785 tablet_service.cc:1511] Processing CreateTablet for tablet 46a75d301e384d359f3540e990d68e8d (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:12.659631 16785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a75d301e384d359f3540e990d68e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.691676 16709 tablet_service.cc:1511] Processing CreateTablet for tablet 8a2c766bb0e34effb7b3f41f13d558a0 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:12.694085 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2c766bb0e34effb7b3f41f13d558a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.692222 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 8a2c766bb0e34effb7b3f41f13d558a0 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:12.702303 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2c766bb0e34effb7b3f41f13d558a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.698148 16932 tablet_service.cc:1511] Processing CreateTablet for tablet 8a2c766bb0e34effb7b3f41f13d558a0 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:12.705329 16992 tablet_bootstrap.cc:492] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:12.710306 16786 tablet_service.cc:1511] Processing CreateTablet for tablet c8cbb6f215ef4d9bb7a65bd627ffcfbe (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:12.708393 16989 tablet_bootstrap.cc:492] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:12.711542 16989 ts_tablet_manager.cc:1403] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.122s	user 0.009s	sys 0.011s
I20260709 13:21:12.711835 16786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8cbb6f215ef4d9bb7a65bd627ffcfbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.708396 16991 tablet_bootstrap.cc:492] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:12.705499 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2c766bb0e34effb7b3f41f13d558a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.718143 16707 tablet_service.cc:1511] Processing CreateTablet for tablet 00095bdfc40040d0a8eefc49c2034fb2 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:12.719512 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00095bdfc40040d0a8eefc49c2034fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.721818 16990 tablet_bootstrap.cc:492] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:12.722362 16990 ts_tablet_manager.cc:1403] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.124s	user 0.020s	sys 0.007s
I20260709 13:21:12.715298 16991 ts_tablet_manager.cc:1403] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.110s	user 0.009s	sys 0.007s
I20260709 13:21:12.715575 16859 tablet_service.cc:1511] Processing CreateTablet for tablet c8cbb6f215ef4d9bb7a65bd627ffcfbe (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:12.715723 16989 raft_consensus.cc:359] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:12.730175 16989 raft_consensus.cc:385] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.730531 16989 raft_consensus.cc:740] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.730764 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8cbb6f215ef4d9bb7a65bd627ffcfbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.731556 16989 consensus_queue.cc:260] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:12.732623 16991 raft_consensus.cc:359] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:12.732800 16990 raft_consensus.cc:359] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:12.733587 16990 raft_consensus.cc:385] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.733939 16990 raft_consensus.cc:740] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.734892 16990 consensus_queue.cc:260] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:12.735670 16992 tablet_bootstrap.cc:654] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.737901 16933 tablet_service.cc:1511] Processing CreateTablet for tablet c8cbb6f215ef4d9bb7a65bd627ffcfbe (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:12.739734 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8cbb6f215ef4d9bb7a65bd627ffcfbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.753981 16991 raft_consensus.cc:385] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.755522 16991 raft_consensus.cc:740] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.756472 16785 tablet_service.cc:1511] Processing CreateTablet for tablet 00095bdfc40040d0a8eefc49c2034fb2 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:12.756618 16991 consensus_queue.cc:260] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:12.759455 16990 ts_tablet_manager.cc:1434] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.037s	user 0.015s	sys 0.009s
I20260709 13:21:12.760277 16895 heartbeater.cc:499] Master 127.6.214.190:40917 was elected leader, sending a full tablet report...
I20260709 13:21:12.762084 16856 tablet_service.cc:1511] Processing CreateTablet for tablet 00095bdfc40040d0a8eefc49c2034fb2 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:12.762389 16934 tablet_service.cc:1511] Processing CreateTablet for tablet 09c70b1ed00f49408fae9002719cc6e5 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:12.763341 16785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00095bdfc40040d0a8eefc49c2034fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.763653 16934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c70b1ed00f49408fae9002719cc6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.764155 16990 tablet_bootstrap.cc:492] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:12.781745 16992 tablet_bootstrap.cc:492] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:12.783493 16856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00095bdfc40040d0a8eefc49c2034fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.786429 16989 ts_tablet_manager.cc:1434] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.013s
I20260709 13:21:12.784207 16707 tablet_service.cc:1511] Processing CreateTablet for tablet 09c70b1ed00f49408fae9002719cc6e5 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
W20260709 13:21:12.793999 16896 tablet.cc:2406] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:21:12.796206 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c70b1ed00f49408fae9002719cc6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.797798 16746 heartbeater.cc:499] Master 127.6.214.190:40917 was elected leader, sending a full tablet report...
I20260709 13:21:12.800313 16999 raft_consensus.cc:493] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.800586 16786 tablet_service.cc:1511] Processing CreateTablet for tablet 09c70b1ed00f49408fae9002719cc6e5 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:12.800891 16999 raft_consensus.cc:515] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:12.802016 16786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09c70b1ed00f49408fae9002719cc6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.803810 16859 tablet_service.cc:1511] Processing CreateTablet for tablet 8089fb9d122745beabb535e51bd29d52 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:12.808732 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8089fb9d122745beabb535e51bd29d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.803785 16999 leader_election.cc:290] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:12.814275 16990 tablet_bootstrap.cc:654] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.805716 16992 ts_tablet_manager.cc:1403] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.101s	user 0.005s	sys 0.008s
I20260709 13:21:12.824559 16989 tablet_bootstrap.cc:492] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:12.844509 16709 tablet_service.cc:1511] Processing CreateTablet for tablet 8089fb9d122745beabb535e51bd29d52 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:12.847635 16969 heartbeater.cc:499] Master 127.6.214.190:40917 was elected leader, sending a full tablet report...
I20260709 13:21:12.848152 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8089fb9d122745beabb535e51bd29d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.842779 16782 tablet_service.cc:1511] Processing CreateTablet for tablet e70bbc621ace4406b50194cd2117bdc6 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:12.850451 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70bbc621ace4406b50194cd2117bdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.825189 16992 raft_consensus.cc:359] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:12.854105 16992 raft_consensus.cc:385] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.854456 16992 raft_consensus.cc:740] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.855239 16992 consensus_queue.cc:260] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:12.861379 16989 tablet_bootstrap.cc:654] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:12.866910 16934 tablet_service.cc:1511] Processing CreateTablet for tablet e70bbc621ace4406b50194cd2117bdc6 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:12.878152 16784 tablet_service.cc:1511] Processing CreateTablet for tablet a4b336bf87ee483f9aef83d5b3358fae (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:12.876091 16710 tablet_service.cc:1511] Processing CreateTablet for tablet a4b336bf87ee483f9aef83d5b3358fae (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:12.879367 16784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b336bf87ee483f9aef83d5b3358fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.880740 16710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b336bf87ee483f9aef83d5b3358fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.886236 16858 tablet_service.cc:1511] Processing CreateTablet for tablet a4b336bf87ee483f9aef83d5b3358fae (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:12.888209 16858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b336bf87ee483f9aef83d5b3358fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.879367 16934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70bbc621ace4406b50194cd2117bdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.867964 16857 tablet_service.cc:1511] Processing CreateTablet for tablet e70bbc621ace4406b50194cd2117bdc6 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:12.906821 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70bbc621ace4406b50194cd2117bdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.914011 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459fd01e9d83462da735e004032e70b7" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:12.916492 16870 raft_consensus.cc:2468] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:12.922345 16685 leader_election.cc:304] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:12.923574 16999 raft_consensus.cc:2804] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:12.923988 16999 raft_consensus.cc:493] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:12.924327 16999 raft_consensus.cc:3060] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:12.924753 16991 ts_tablet_manager.cc:1434] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.195s	user 0.012s	sys 0.012s
I20260709 13:21:12.926342 16991 tablet_bootstrap.cc:492] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:12.937633 16821 heartbeater.cc:499] Master 127.6.214.190:40917 was elected leader, sending a full tablet report...
I20260709 13:21:12.937649 16932 tablet_service.cc:1511] Processing CreateTablet for tablet d72c23005f53496890cfb11e0c19318b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:12.939282 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72c23005f53496890cfb11e0c19318b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.940647 16999 raft_consensus.cc:515] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:12.944603 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459fd01e9d83462da735e004032e70b7" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:12.945250 16870 raft_consensus.cc:3060] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:12.949007 16707 tablet_service.cc:1511] Processing CreateTablet for tablet d72c23005f53496890cfb11e0c19318b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:12.950445 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72c23005f53496890cfb11e0c19318b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.950335 16786 tablet_service.cc:1511] Processing CreateTablet for tablet d72c23005f53496890cfb11e0c19318b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:12.951721 16786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72c23005f53496890cfb11e0c19318b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.957485 16933 tablet_service.cc:1511] Processing CreateTablet for tablet 8089fb9d122745beabb535e51bd29d52 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:12.959095 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8089fb9d122745beabb535e51bd29d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.963029 16999 leader_election.cc:290] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:12.963973 16870 raft_consensus.cc:2468] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:12.974431 16685 leader_election.cc:304] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:12.979815 16859 tablet_service.cc:1511] Processing CreateTablet for tablet 3ffcb1357332401a919db507af113059 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:12.980916 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ffcb1357332401a919db507af113059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:12.983584 16989 tablet_bootstrap.cc:492] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:12.984146 16989 ts_tablet_manager.cc:1403] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.182s	user 0.013s	sys 0.022s
I20260709 13:21:12.985805 16990 tablet_bootstrap.cc:492] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:12.986366 16990 ts_tablet_manager.cc:1403] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.222s	user 0.027s	sys 0.044s
I20260709 13:21:12.987331 16989 raft_consensus.cc:359] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:12.988116 16989 raft_consensus.cc:385] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:12.988401 16989 raft_consensus.cc:740] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:12.989403 16989 consensus_queue.cc:260] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:12.977311 16999 raft_consensus.cc:2804] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:13.002802 16991 tablet_bootstrap.cc:654] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.007208 16992 ts_tablet_manager.cc:1434] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.185s	user 0.011s	sys 0.037s
I20260709 13:21:13.007758 16989 ts_tablet_manager.cc:1434] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 13:21:13.019279 16989 tablet_bootstrap.cc:492] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:13.020260 16931 tablet_service.cc:1511] Processing CreateTablet for tablet 079f892041a84ff8a4b23e4cfffa762d (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:13.007683 17004 raft_consensus.cc:493] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.021862 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079f892041a84ff8a4b23e4cfffa762d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.021749 17004 raft_consensus.cc:515] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:12.991740 16990 raft_consensus.cc:359] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:13.023684 16990 raft_consensus.cc:385] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.024034 16990 raft_consensus.cc:740] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.013247 16932 tablet_service.cc:1511] Processing CreateTablet for tablet 3ffcb1357332401a919db507af113059 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:13.026201 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ffcb1357332401a919db507af113059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.029222 17004 leader_election.cc:290] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:13.034255 16782 tablet_service.cc:1511] Processing CreateTablet for tablet 079f892041a84ff8a4b23e4cfffa762d (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:13.036232 16990 consensus_queue.cc:260] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:13.038923 16990 ts_tablet_manager.cc:1434] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.004s
I20260709 13:21:13.040575 16990 tablet_bootstrap.cc:492] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:13.043150 16997 raft_consensus.cc:493] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.015353 16709 tablet_service.cc:1511] Processing CreateTablet for tablet 3ffcb1357332401a919db507af113059 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:13.043736 16997 raft_consensus.cc:515] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:13.045156 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ffcb1357332401a919db507af113059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.015486 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 079f892041a84ff8a4b23e4cfffa762d (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:13.061715 16992 tablet_bootstrap.cc:492] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:13.067637 16997 leader_election.cc:290] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:13.070701 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079f892041a84ff8a4b23e4cfffa762d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.072106 16991 tablet_bootstrap.cc:492] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:13.072726 16991 ts_tablet_manager.cc:1403] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.147s	user 0.017s	sys 0.003s
I20260709 13:21:13.073331 16707 tablet_service.cc:1511] Processing CreateTablet for tablet 9b15c4a7a5cd4cf090073986cb42b826 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:13.074766 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b15c4a7a5cd4cf090073986cb42b826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.075469 16989 tablet_bootstrap.cc:654] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.076251 16991 raft_consensus.cc:359] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:13.077049 16991 raft_consensus.cc:385] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.077441 16991 raft_consensus.cc:740] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.078439 16991 consensus_queue.cc:260] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:13.096436 16786 tablet_service.cc:1511] Processing CreateTablet for tablet 9b15c4a7a5cd4cf090073986cb42b826 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:13.097698 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079f892041a84ff8a4b23e4cfffa762d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.065948 16999 raft_consensus.cc:697] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:13.106359 16786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b15c4a7a5cd4cf090073986cb42b826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.107395 17000 raft_consensus.cc:493] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.119150 17000 raft_consensus.cc:515] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:13.114871 16990 tablet_bootstrap.cc:654] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.117050 16992 tablet_bootstrap.cc:654] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.126245 16999 consensus_queue.cc:237] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:13.132040 16991 ts_tablet_manager.cc:1434] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:21:13.147433 17000 leader_election.cc:290] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:13.156220 16991 tablet_bootstrap.cc:492] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:13.168522 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e691d47f85a540f884defe4bf7a293b2" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:13.171550 16989 tablet_bootstrap.cc:492] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:13.172333 16989 ts_tablet_manager.cc:1403] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.153s	user 0.011s	sys 0.006s
W20260709 13:21:13.179410 16760 leader_election.cc:343] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.187449 16859 tablet_service.cc:1511] Processing CreateTablet for tablet 9b15c4a7a5cd4cf090073986cb42b826 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:13.187790 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:13.188999 16944 raft_consensus.cc:2468] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:13.191376 16836 leader_election.cc:304] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:13.197750 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b15c4a7a5cd4cf090073986cb42b826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.198580 16997 raft_consensus.cc:2804] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:13.215078 17000 raft_consensus.cc:493] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.215301 17006 raft_consensus.cc:493] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.215744 17000 raft_consensus.cc:515] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:13.215806 17006 raft_consensus.cc:515] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:13.217888 16989 raft_consensus.cc:359] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:13.218629 16989 raft_consensus.cc:385] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.218932 16989 raft_consensus.cc:740] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.219683 16989 consensus_queue.cc:260] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:13.212683 16997 raft_consensus.cc:493] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.223662 16997 raft_consensus.cc:3060] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.224860 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459fd01e9d83462da735e004032e70b7" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:13.225636 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 739b8dae347b48aca06253d0a0a82369 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
W20260709 13:21:13.226759 16686 leader_election.cc:343] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.227124 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739b8dae347b48aca06253d0a0a82369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.230154 17006 leader_election.cc:290] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:13.230019 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459fd01e9d83462da735e004032e70b7" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:13.230026 16990 tablet_bootstrap.cc:492] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:13.221390 17000 leader_election.cc:290] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:13.231848 16990 ts_tablet_manager.cc:1403] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.192s	user 0.011s	sys 0.004s
I20260709 13:21:13.231459 16709 tablet_service.cc:1511] Processing CreateTablet for tablet 4709a71f10ba41f39d6a6db62045e637 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:13.232391 16782 tablet_service.cc:1511] Processing CreateTablet for tablet 4709a71f10ba41f39d6a6db62045e637 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:13.233584 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4709a71f10ba41f39d6a6db62045e637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.233893 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4709a71f10ba41f39d6a6db62045e637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.237191 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:13.243486 16991 tablet_bootstrap.cc:654] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:13.245260 16686 leader_election.cc:343] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:13.246508 16686 leader_election.cc:343] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.247602 16997 raft_consensus.cc:515] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:13.248143 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:13.248859 16721 raft_consensus.cc:2468] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:13.249958 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e691d47f85a540f884defe4bf7a293b2" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:13.250414 16990 raft_consensus.cc:359] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:13.251379 16990 raft_consensus.cc:385] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.251745 16990 raft_consensus.cc:740] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.252637 16992 tablet_bootstrap.cc:492] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:13.253242 16992 ts_tablet_manager.cc:1403] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.192s	user 0.015s	sys 0.006s
W20260709 13:21:13.256767 16762 leader_election.cc:343] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.257464 16762 leader_election.cc:304] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:13.258754 17004 raft_consensus.cc:2749] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:13.259179 16997 leader_election.cc:290] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:13.264055 16992 raft_consensus.cc:359] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:13.264863 16992 raft_consensus.cc:385] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.266655 16931 tablet_service.cc:1511] Processing CreateTablet for tablet 4709a71f10ba41f39d6a6db62045e637 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:13.268002 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4709a71f10ba41f39d6a6db62045e637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.269503 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:13.270223 16720 raft_consensus.cc:3060] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.265058 16617 catalog_manager.cc:5697] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:13.265153 16992 raft_consensus.cc:740] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.252643 16990 consensus_queue.cc:260] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:13.285514 16786 tablet_service.cc:1511] Processing CreateTablet for tablet 41ec078c4d4145dbbcae1cd9fd0c251a (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:13.286933 16858 tablet_service.cc:1511] Processing CreateTablet for tablet 41ec078c4d4145dbbcae1cd9fd0c251a (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:13.273757 16707 tablet_service.cc:1511] Processing CreateTablet for tablet 739b8dae347b48aca06253d0a0a82369 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:13.304746 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739b8dae347b48aca06253d0a0a82369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.305107 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:13.305572 16990 ts_tablet_manager.cc:1434] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.000s
I20260709 13:21:13.305130 16934 tablet_service.cc:1511] Processing CreateTablet for tablet 41ec078c4d4145dbbcae1cd9fd0c251a (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:13.306156 16870 raft_consensus.cc:2393] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 71a0b5583e0547a88c88b590549fbcee in this term.
I20260709 13:21:13.306651 16934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ec078c4d4145dbbcae1cd9fd0c251a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.306746 16990 tablet_bootstrap.cc:492] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:13.292367 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:13.309738 16944 raft_consensus.cc:3060] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.310266 16786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ec078c4d4145dbbcae1cd9fd0c251a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.310534 16992 consensus_queue.cc:260] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:13.298103 16932 tablet_service.cc:1511] Processing CreateTablet for tablet 739b8dae347b48aca06253d0a0a82369 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:13.314293 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739b8dae347b48aca06253d0a0a82369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.315680 16858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ec078c4d4145dbbcae1cd9fd0c251a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.319039 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:13.319912 16943 raft_consensus.cc:2468] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:13.290797 16720 raft_consensus.cc:2468] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:13.323199 16836 leader_election.cc:304] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:13.324061 16997 raft_consensus.cc:2804] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:13.321456 16687 leader_election.cc:304] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:13.328229 16710 tablet_service.cc:1511] Processing CreateTablet for tablet 9bb16a744c5d40a1b64f60422c21e3c5 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:13.329698 16710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb16a744c5d40a1b64f60422c21e3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.332199 16999 raft_consensus.cc:2804] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:13.332660 16999 raft_consensus.cc:493] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.333042 16999 raft_consensus.cc:3060] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.338554 16990 tablet_bootstrap.cc:654] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.341730 16784 tablet_service.cc:1511] Processing CreateTablet for tablet 9bb16a744c5d40a1b64f60422c21e3c5 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:13.343115 16784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb16a744c5d40a1b64f60422c21e3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.343003 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 9bb16a744c5d40a1b64f60422c21e3c5 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:13.345846 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb16a744c5d40a1b64f60422c21e3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.347476 16999 raft_consensus.cc:515] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:13.321938 16989 ts_tablet_manager.cc:1434] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.149s	user 0.007s	sys 0.007s
I20260709 13:21:13.355031 16989 tablet_bootstrap.cc:492] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:13.355360 16933 tablet_service.cc:1511] Processing CreateTablet for tablet eb2b3210f0d344aa8c9f961a1b72c508 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:13.357115 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb2b3210f0d344aa8c9f961a1b72c508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.361603 16992 ts_tablet_manager.cc:1434] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.108s	user 0.010s	sys 0.000s
I20260709 13:21:13.362823 16992 tablet_bootstrap.cc:492] T ef2738933d0443258a83e98416c422a7 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:13.369258 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:13.369747 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:13.371989 16720 raft_consensus.cc:2393] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 71a0b5583e0547a88c88b590549fbcee in this term.
I20260709 13:21:13.372592 16721 raft_consensus.cc:2393] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in this term.
I20260709 13:21:13.367756 16997 raft_consensus.cc:697] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:13.373680 16910 leader_election.cc:304] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:13.373627 16997 consensus_queue.cc:237] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:13.376571 16709 tablet_service.cc:1511] Processing CreateTablet for tablet eb2b3210f0d344aa8c9f961a1b72c508 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:13.369966 16944 raft_consensus.cc:2468] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:13.381934 17000 raft_consensus.cc:2749] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:13.385588 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb2b3210f0d344aa8c9f961a1b72c508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.386855 16989 tablet_bootstrap.cc:654] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.395644 16784 tablet_service.cc:1511] Processing CreateTablet for tablet eb2b3210f0d344aa8c9f961a1b72c508 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:13.396164 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:13.397015 16944 raft_consensus.cc:3060] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.397254 16784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb2b3210f0d344aa8c9f961a1b72c508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.405890 16999 leader_election.cc:290] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:13.407966 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
W20260709 13:21:13.412149 16686 leader_election.cc:343] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.409854 16859 tablet_service.cc:1511] Processing CreateTablet for tablet 3b55efde48bb42119e9a38f9e3f2f6c6 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:13.413811 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b55efde48bb42119e9a38f9e3f2f6c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.421823 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:13.423792 16909 leader_election.cc:343] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.424342 16909 leader_election.cc:304] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:13.433588 16991 tablet_bootstrap.cc:492] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:13.433743 16944 raft_consensus.cc:2468] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:13.433463 16934 tablet_service.cc:1511] Processing CreateTablet for tablet 3b55efde48bb42119e9a38f9e3f2f6c6 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:13.434314 16991 ts_tablet_manager.cc:1403] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.278s	user 0.022s	sys 0.006s
I20260709 13:21:13.435124 16934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b55efde48bb42119e9a38f9e3f2f6c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.435256 16687 leader_election.cc:304] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:13.436164 16708 tablet_service.cc:1511] Processing CreateTablet for tablet 3b55efde48bb42119e9a38f9e3f2f6c6 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:13.437556 17000 raft_consensus.cc:2749] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:13.437691 16991 raft_consensus.cc:359] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:13.438938 16991 raft_consensus.cc:385] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.440887 16991 raft_consensus.cc:740] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.441744 16991 consensus_queue.cc:260] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:13.439663 16999 raft_consensus.cc:2804] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:13.446017 16999 raft_consensus.cc:697] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:13.442893 16708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b55efde48bb42119e9a38f9e3f2f6c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.448269 16619 catalog_manager.cc:5697] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:13.440322 16992 tablet_bootstrap.cc:654] T ef2738933d0443258a83e98416c422a7 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.467542 16786 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca3d970b5014cf8802116fd61f095e7 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:13.469485 16786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca3d970b5014cf8802116fd61f095e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.493896 16858 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca3d970b5014cf8802116fd61f095e7 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:13.494223 16999 consensus_queue.cc:237] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:13.496044 16858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca3d970b5014cf8802116fd61f095e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.507026 17004 raft_consensus.cc:493] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.507644 17004 raft_consensus.cc:515] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:13.510207 17004 leader_election.cc:290] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:13.512355 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47c1b91c71444aa6e2c70fa4eb4403" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:13.514791 16710 tablet_service.cc:1511] Processing CreateTablet for tablet 66f84738cbb7483b9e127384bf8f534a (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:13.516485 16710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66f84738cbb7483b9e127384bf8f534a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:13.519791 16760 leader_election.cc:343] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.534237 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47c1b91c71444aa6e2c70fa4eb4403" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:13.535399 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 66f84738cbb7483b9e127384bf8f534a (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
W20260709 13:21:13.536319 16762 leader_election.cc:343] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.537019 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66f84738cbb7483b9e127384bf8f534a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.536983 16762 leader_election.cc:304] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:13.538192 17004 raft_consensus.cc:2749] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:13.538534 16932 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca3d970b5014cf8802116fd61f095e7 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:13.540184 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca3d970b5014cf8802116fd61f095e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.540998 16784 tablet_service.cc:1511] Processing CreateTablet for tablet 66f84738cbb7483b9e127384bf8f534a (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:13.543522 16784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66f84738cbb7483b9e127384bf8f534a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.545251 16990 tablet_bootstrap.cc:492] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:13.545961 16990 ts_tablet_manager.cc:1403] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.239s	user 0.019s	sys 0.000s
I20260709 13:21:13.550644 16990 raft_consensus.cc:359] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:13.551645 16990 raft_consensus.cc:385] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.552017 16990 raft_consensus.cc:740] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.553539 16933 tablet_service.cc:1511] Processing CreateTablet for tablet 68bdb3e915d14f918607729afc6e38fa (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:13.555238 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68bdb3e915d14f918607729afc6e38fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.564606 16709 tablet_service.cc:1511] Processing CreateTablet for tablet 68bdb3e915d14f918607729afc6e38fa (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:13.566027 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68bdb3e915d14f918607729afc6e38fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.559667 16991 ts_tablet_manager.cc:1434] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.125s	user 0.005s	sys 0.007s
I20260709 13:21:13.572193 16990 consensus_queue.cc:260] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:13.574087 16991 tablet_bootstrap.cc:492] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:13.574322 16989 tablet_bootstrap.cc:492] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:13.574103 16782 tablet_service.cc:1511] Processing CreateTablet for tablet 68bdb3e915d14f918607729afc6e38fa (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:13.574880 16989 ts_tablet_manager.cc:1403] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.220s	user 0.029s	sys 0.056s
I20260709 13:21:13.575598 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68bdb3e915d14f918607729afc6e38fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.578146 16989 raft_consensus.cc:359] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:13.588981 17025 raft_consensus.cc:493] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.589576 17025 raft_consensus.cc:515] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:13.600414 17025 leader_election.cc:290] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:13.587365 16989 raft_consensus.cc:385] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.600804 16934 tablet_service.cc:1511] Processing CreateTablet for tablet 5316894346f24b5984dd23714341777c (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:13.601316 16989 raft_consensus.cc:740] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.602246 16934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5316894346f24b5984dd23714341777c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.602524 16989 consensus_queue.cc:260] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:13.605409 16619 catalog_manager.cc:5697] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:13.609157 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e691d47f85a540f884defe4bf7a293b2" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:13.610895 16721 raft_consensus.cc:2468] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:13.600804 16708 tablet_service.cc:1511] Processing CreateTablet for tablet 5316894346f24b5984dd23714341777c (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:13.612484 16708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5316894346f24b5984dd23714341777c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.612432 16836 leader_election.cc:304] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:13.613205 16989 ts_tablet_manager.cc:1434] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.038s	user 0.011s	sys 0.000s
I20260709 13:21:13.613394 17025 raft_consensus.cc:2804] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:13.595599 16858 tablet_service.cc:1511] Processing CreateTablet for tablet 5316894346f24b5984dd23714341777c (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:13.613817 17025 raft_consensus.cc:493] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.639642 17025 raft_consensus.cc:3060] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.640084 16858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5316894346f24b5984dd23714341777c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.626682 16989 tablet_bootstrap.cc:492] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:13.629563 16992 tablet_bootstrap.cc:492] T ef2738933d0443258a83e98416c422a7 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:13.649880 16992 ts_tablet_manager.cc:1403] T ef2738933d0443258a83e98416c422a7 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.287s	user 0.029s	sys 0.011s
I20260709 13:21:13.652249 16992 raft_consensus.cc:359] T ef2738933d0443258a83e98416c422a7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:13.652750 16992 raft_consensus.cc:385] T ef2738933d0443258a83e98416c422a7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.652928 16992 raft_consensus.cc:740] T ef2738933d0443258a83e98416c422a7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.634639 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e691d47f85a540f884defe4bf7a293b2" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:13.654006 16795 raft_consensus.cc:2468] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:13.653412 16992 consensus_queue.cc:260] T ef2738933d0443258a83e98416c422a7 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:13.655368 16989 tablet_bootstrap.cc:654] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:13.653069 16666 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:13.634909 16990 ts_tablet_manager.cc:1434] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.001s
I20260709 13:21:13.638339 16997 raft_consensus.cc:493] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.656823 16997 raft_consensus.cc:515] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:13.659052 16997 leader_election.cc:290] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:13.659317 16991 tablet_bootstrap.cc:654] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.659447 16992 ts_tablet_manager.cc:1434] T ef2738933d0443258a83e98416c422a7 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:21:13.660697 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2738933d0443258a83e98416c422a7" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:13.660971 17025 raft_consensus.cc:515] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:13.671432 16932 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2aa3a038f049ccadf4405e476cd972 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:13.673352 17025 leader_election.cc:290] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:13.675846 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e691d47f85a540f884defe4bf7a293b2" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:13.676445 16721 raft_consensus.cc:3060] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.661994 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2738933d0443258a83e98416c422a7" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:13.677698 16795 raft_consensus.cc:2468] T ef2738933d0443258a83e98416c422a7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:13.681113 16992 tablet_bootstrap.cc:492] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
W20260709 13:21:13.681883 16836 leader_election.cc:343] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.667280 16990 tablet_bootstrap.cc:492] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:13.682507 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2aa3a038f049ccadf4405e476cd972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.662563 16786 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2aa3a038f049ccadf4405e476cd972 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:13.686607 16786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2aa3a038f049ccadf4405e476cd972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.691002 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e691d47f85a540f884defe4bf7a293b2" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:13.691962 16795 raft_consensus.cc:3060] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.693037 16709 tablet_service.cc:1511] Processing CreateTablet for tablet eed8496b9e0a4440b2069b956dfc7358 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:13.690985 16835 leader_election.cc:304] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:13.694298 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed8496b9e0a4440b2069b956dfc7358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.695911 17025 raft_consensus.cc:2804] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:13.696575 17025 raft_consensus.cc:493] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.697121 17025 raft_consensus.cc:3060] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.700342 16785 tablet_service.cc:1511] Processing CreateTablet for tablet eed8496b9e0a4440b2069b956dfc7358 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:13.697018 16859 tablet_service.cc:1511] Processing CreateTablet for tablet eed8496b9e0a4440b2069b956dfc7358 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:13.701740 16785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed8496b9e0a4440b2069b956dfc7358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.702695 16991 tablet_bootstrap.cc:492] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:13.703209 16991 ts_tablet_manager.cc:1403] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.129s	user 0.011s	sys 0.000s
I20260709 13:21:13.705469 16999 consensus_queue.cc:1048] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:13.707865 16934 tablet_service.cc:1511] Processing CreateTablet for tablet 59ba89448ab04e64b769557c2830641f (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:13.709230 16934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ba89448ab04e64b769557c2830641f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.701741 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed8496b9e0a4440b2069b956dfc7358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.712404 16721 raft_consensus.cc:2468] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:13.713721 16836 leader_election.cc:304] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:13.714604 16997 raft_consensus.cc:2804] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:13.719565 16710 tablet_service.cc:1511] Processing CreateTablet for tablet 59ba89448ab04e64b769557c2830641f (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:13.721153 16710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ba89448ab04e64b769557c2830641f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.724653 16782 tablet_service.cc:1511] Processing CreateTablet for tablet 59ba89448ab04e64b769557c2830641f (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:13.725930 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ba89448ab04e64b769557c2830641f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.730432 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2aa3a038f049ccadf4405e476cd972 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:13.732132 16997 raft_consensus.cc:697] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:13.733105 16997 consensus_queue.cc:237] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:13.735890 16856 tablet_service.cc:1511] Processing CreateTablet for tablet 89b267a6d4ca4f87829b245ef87bd6e3 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:13.750041 17025 raft_consensus.cc:515] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:13.752384 17025 leader_election.cc:290] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:13.760171 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2738933d0443258a83e98416c422a7" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:13.733839 16795 raft_consensus.cc:2468] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:13.760440 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2738933d0443258a83e98416c422a7" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:13.761682 16796 raft_consensus.cc:3060] T ef2738933d0443258a83e98416c422a7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.762638 16992 tablet_bootstrap.cc:654] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.767952 16708 tablet_service.cc:1511] Processing CreateTablet for tablet 89b267a6d4ca4f87829b245ef87bd6e3 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:13.769202 16784 tablet_service.cc:1511] Processing CreateTablet for tablet e27c0b3cbad94ad791a54143f2d5af0b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:13.770072 16708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b267a6d4ca4f87829b245ef87bd6e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.770686 16784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27c0b3cbad94ad791a54143f2d5af0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.768730 16990 tablet_bootstrap.cc:654] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.778762 16856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b267a6d4ca4f87829b245ef87bd6e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.742576 16933 tablet_service.cc:1511] Processing CreateTablet for tablet 89b267a6d4ca4f87829b245ef87bd6e3 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:13.736886 16991 raft_consensus.cc:359] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:13.789915 16991 raft_consensus.cc:385] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.790274 16991 raft_consensus.cc:740] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.790361 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b267a6d4ca4f87829b245ef87bd6e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.791093 16991 consensus_queue.cc:260] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:13.798862 16991 ts_tablet_manager.cc:1434] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
I20260709 13:21:13.798985 16796 raft_consensus.cc:2468] T ef2738933d0443258a83e98416c422a7 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:13.799332 16944 raft_consensus.cc:3060] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.803406 16835 leader_election.cc:304] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:13.804332 17025 raft_consensus.cc:2804] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:13.804912 17025 raft_consensus.cc:697] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:13.805768 17025 consensus_queue.cc:237] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:13.814548 16859 tablet_service.cc:1511] Processing CreateTablet for tablet e27c0b3cbad94ad791a54143f2d5af0b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:13.841039 16934 tablet_service.cc:1511] Processing CreateTablet for tablet e27c0b3cbad94ad791a54143f2d5af0b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:13.842907 16934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27c0b3cbad94ad791a54143f2d5af0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.837021 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2aa3a038f049ccadf4405e476cd972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.851648 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27c0b3cbad94ad791a54143f2d5af0b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:13.856881 16686 consensus_peers.cc:597] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:13.857383 16991 tablet_bootstrap.cc:492] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:13.863708 16710 tablet_service.cc:1511] Processing CreateTablet for tablet b0a5428f572c4214b4ecd02231d81bd7 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:13.865348 16710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0a5428f572c4214b4ecd02231d81bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.873822 16944 raft_consensus.cc:2468] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:13.875645 16786 tablet_service.cc:1511] Processing CreateTablet for tablet b0a5428f572c4214b4ecd02231d81bd7 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:13.877077 16786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0a5428f572c4214b4ecd02231d81bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.878259 16989 tablet_bootstrap.cc:492] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:13.878839 16989 ts_tablet_manager.cc:1403] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.252s	user 0.025s	sys 0.050s
I20260709 13:21:13.882403 16932 tablet_service.cc:1511] Processing CreateTablet for tablet 2ad644a4c46b4ba9b4845f75d943c516 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:13.884343 16709 tablet_service.cc:1511] Processing CreateTablet for tablet 2ad644a4c46b4ba9b4845f75d943c516 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:13.890273 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ad644a4c46b4ba9b4845f75d943c516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.890493 16785 tablet_service.cc:1511] Processing CreateTablet for tablet 2ad644a4c46b4ba9b4845f75d943c516 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:13.891281 16617 catalog_manager.cc:5697] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:13.886588 16859 tablet_service.cc:1511] Processing CreateTablet for tablet b0a5428f572c4214b4ecd02231d81bd7 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:13.888849 17029 raft_consensus.cc:493] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.893909 17029 raft_consensus.cc:515] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:13.895438 16991 tablet_bootstrap.cc:654] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:13.896234 17029 leader_election.cc:290] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:13.898265 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ad644a4c46b4ba9b4845f75d943c516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.899389 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0a5428f572c4214b4ecd02231d81bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.898452 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37644a5aa384ad88bdebe0b15db71ea" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:13.904382 16990 tablet_bootstrap.cc:492] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:13.904953 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37644a5aa384ad88bdebe0b15db71ea" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:13.905380 16989 raft_consensus.cc:359] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:13.906308 16989 raft_consensus.cc:385] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:13.906435 16909 leader_election.cc:343] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:13.906685 16989 raft_consensus.cc:740] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.907384 16785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ad644a4c46b4ba9b4845f75d943c516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.904978 16990 ts_tablet_manager.cc:1403] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.238s	user 0.009s	sys 0.010s
I20260709 13:21:13.912685 16990 raft_consensus.cc:359] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:13.913412 16990 raft_consensus.cc:385] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:13.917613 16997 consensus_queue.cc:1048] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:13.909471 16989 consensus_queue.cc:260] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:13.919260 16721 raft_consensus.cc:2468] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 0.
I20260709 13:21:13.919531 16618 catalog_manager.cc:5697] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:13.917866 16990 raft_consensus.cc:740] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:13.939685 16858 tablet_service.cc:1511] Processing CreateTablet for tablet dbed23d268484353b8fb9eb9d57444f8 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:13.941201 16858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbed23d268484353b8fb9eb9d57444f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.935580 16910 leader_election.cc:304] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:13.946899 16931 tablet_service.cc:1511] Processing CreateTablet for tablet dbed23d268484353b8fb9eb9d57444f8 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:13.947064 16856 tablet_service.cc:1511] Processing CreateTablet for tablet 3b9e621ba6904fdfaec709a9b5e80bf1 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:13.947762 17029 raft_consensus.cc:2804] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:13.948140 17029 raft_consensus.cc:493] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.948269 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbed23d268484353b8fb9eb9d57444f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.948504 17029 raft_consensus.cc:3060] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:13.950573 16782 tablet_service.cc:1511] Processing CreateTablet for tablet 3b9e621ba6904fdfaec709a9b5e80bf1 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:13.951905 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b9e621ba6904fdfaec709a9b5e80bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.955394 16707 tablet_service.cc:1511] Processing CreateTablet for tablet dbed23d268484353b8fb9eb9d57444f8 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:13.957075 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbed23d268484353b8fb9eb9d57444f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.957227 16997 consensus_queue.cc:1048] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:13.959240 16856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b9e621ba6904fdfaec709a9b5e80bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:13.970923 16990 consensus_queue.cc:260] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:13.973879 16990 ts_tablet_manager.cc:1434] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.064s	user 0.004s	sys 0.004s
I20260709 13:21:13.974965 16990 tablet_bootstrap.cc:492] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:13.977075 16989 ts_tablet_manager.cc:1434] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.002s
I20260709 13:21:13.999996 16992 tablet_bootstrap.cc:492] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:14.000639 16992 ts_tablet_manager.cc:1403] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.320s	user 0.041s	sys 0.020s
I20260709 13:21:14.011869 16992 raft_consensus.cc:359] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.014299 16992 raft_consensus.cc:385] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.017611 16992 raft_consensus.cc:740] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.015806 17029 raft_consensus.cc:515] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.005172 16989 tablet_bootstrap.cc:492] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:14.022331 16992 consensus_queue.cc:260] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.024123 16991 tablet_bootstrap.cc:492] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:14.024644 16991 ts_tablet_manager.cc:1403] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.173s	user 0.005s	sys 0.010s
I20260709 13:21:14.025776 16932 tablet_service.cc:1511] Processing CreateTablet for tablet 3b9e621ba6904fdfaec709a9b5e80bf1 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:14.027087 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b9e621ba6904fdfaec709a9b5e80bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.027103 16992 ts_tablet_manager.cc:1434] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:21:14.028417 16992 tablet_bootstrap.cc:492] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:14.028016 16991 raft_consensus.cc:359] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:14.028796 16991 raft_consensus.cc:385] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.029101 16991 raft_consensus.cc:740] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.021759 16990 tablet_bootstrap.cc:654] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.036399 16785 tablet_service.cc:1511] Processing CreateTablet for tablet 71c414f9d9e048e89cedbb0dbe6027a2 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:14.037981 16785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c414f9d9e048e89cedbb0dbe6027a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.038547 17029 leader_election.cc:290] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:14.039799 16991 consensus_queue.cc:260] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:14.042629 16991 ts_tablet_manager.cc:1434] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 13:21:14.043726 16991 tablet_bootstrap.cc:492] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:14.045781 16709 tablet_service.cc:1511] Processing CreateTablet for tablet 71c414f9d9e048e89cedbb0dbe6027a2 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:14.052853 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c414f9d9e048e89cedbb0dbe6027a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.037981 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37644a5aa384ad88bdebe0b15db71ea" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:14.057750 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37644a5aa384ad88bdebe0b15db71ea" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:14.061700 16720 raft_consensus.cc:3060] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:14.067683 16909 leader_election.cc:343] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.084358 16720 raft_consensus.cc:2468] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:14.080329 16989 tablet_bootstrap.cc:654] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:14.085952 16686 consensus_peers.cc:597] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:14.086259 16910 leader_election.cc:304] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:14.087594 17029 raft_consensus.cc:2804] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:14.093106 16992 tablet_bootstrap.cc:654] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.094048 16856 tablet_service.cc:1511] Processing CreateTablet for tablet 71c414f9d9e048e89cedbb0dbe6027a2 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:14.094606 16932 tablet_service.cc:1511] Processing CreateTablet for tablet dbd40203055942f4b32e39396d7d412a (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:14.101837 16991 tablet_bootstrap.cc:654] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.101576 16707 tablet_service.cc:1511] Processing CreateTablet for tablet dbd40203055942f4b32e39396d7d412a (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:14.103689 16990 tablet_bootstrap.cc:492] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:14.108222 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd40203055942f4b32e39396d7d412a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.107573 17006 consensus_queue.cc:1048] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:21:14.115688 16858 tablet_service.cc:1511] Processing CreateTablet for tablet 52265c494440483086dbf5b231415a85 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:14.117192 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd40203055942f4b32e39396d7d412a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.118199 16782 tablet_service.cc:1511] Processing CreateTablet for tablet dbd40203055942f4b32e39396d7d412a (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:14.119473 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd40203055942f4b32e39396d7d412a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.125908 16990 ts_tablet_manager.cc:1403] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.151s	user 0.018s	sys 0.014s
I20260709 13:21:14.133037 16931 tablet_service.cc:1511] Processing CreateTablet for tablet 52265c494440483086dbf5b231415a85 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:14.135267 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52265c494440483086dbf5b231415a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.138576 16990 raft_consensus.cc:359] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:14.147270 16990 raft_consensus.cc:385] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.147794 16990 raft_consensus.cc:740] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.129156 16856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c414f9d9e048e89cedbb0dbe6027a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.153764 17029 raft_consensus.cc:697] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:14.148998 16990 consensus_queue.cc:260] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:14.160858 16858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52265c494440483086dbf5b231415a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.163260 16709 tablet_service.cc:1511] Processing CreateTablet for tablet 52265c494440483086dbf5b231415a85 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:14.164469 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52265c494440483086dbf5b231415a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.165117 16782 tablet_service.cc:1511] Processing CreateTablet for tablet a7baeabe6aad46e283f06762a1594a71 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:14.166220 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7baeabe6aad46e283f06762a1594a71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.168128 16932 tablet_service.cc:1511] Processing CreateTablet for tablet a7baeabe6aad46e283f06762a1594a71 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:14.169240 16859 tablet_service.cc:1511] Processing CreateTablet for tablet a7baeabe6aad46e283f06762a1594a71 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:14.170390 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7baeabe6aad46e283f06762a1594a71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.175565 16989 tablet_bootstrap.cc:492] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:14.176121 16989 ts_tablet_manager.cc:1403] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.171s	user 0.015s	sys 0.013s
I20260709 13:21:14.177227 16997 consensus_queue.cc:1048] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:14.179391 16989 raft_consensus.cc:359] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:14.180142 16989 raft_consensus.cc:385] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.180543 16989 raft_consensus.cc:740] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.181245 16989 consensus_queue.cc:260] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:14.169225 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7baeabe6aad46e283f06762a1594a71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.183676 16989 ts_tablet_manager.cc:1434] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.001s
I20260709 13:21:14.184657 16989 tablet_bootstrap.cc:492] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:14.192108 16990 ts_tablet_manager.cc:1434] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:21:14.192412 16992 tablet_bootstrap.cc:492] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:14.192940 16992 ts_tablet_manager.cc:1403] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.165s	user 0.004s	sys 0.013s
I20260709 13:21:14.193276 16990 tablet_bootstrap.cc:492] T 625f07ca50734f51bc7c0176ad5326f9 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:14.195856 16992 raft_consensus.cc:359] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.196535 16992 raft_consensus.cc:385] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.196817 16992 raft_consensus.cc:740] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.197631 16992 consensus_queue.cc:260] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.199608 17029 consensus_queue.cc:237] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.210757 16989 tablet_bootstrap.cc:654] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.211647 16992 ts_tablet_manager.cc:1434] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:21:14.212342 16997 consensus_queue.cc:1048] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:14.214435 16991 tablet_bootstrap.cc:492] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:14.215523 16707 tablet_service.cc:1511] Processing CreateTablet for tablet ccf4303a8d6a4ec69ef1235487cd52aa (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:14.216678 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf4303a8d6a4ec69ef1235487cd52aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.218295 16857 tablet_service.cc:1511] Processing CreateTablet for tablet ccf4303a8d6a4ec69ef1235487cd52aa (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:14.219452 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf4303a8d6a4ec69ef1235487cd52aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.220510 16992 tablet_bootstrap.cc:492] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:14.220209 16785 tablet_service.cc:1511] Processing CreateTablet for tablet ccf4303a8d6a4ec69ef1235487cd52aa (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:14.227190 16786 tablet_service.cc:1511] Processing CreateTablet for tablet b7da6930c7d44f51ae33d75064b68676 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:14.229751 16785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf4303a8d6a4ec69ef1235487cd52aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.230461 16991 ts_tablet_manager.cc:1403] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.187s	user 0.015s	sys 0.008s
I20260709 13:21:14.232374 16786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7da6930c7d44f51ae33d75064b68676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.230530 16931 tablet_service.cc:1511] Processing CreateTablet for tablet b7da6930c7d44f51ae33d75064b68676 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:14.238482 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7da6930c7d44f51ae33d75064b68676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.248202 16710 tablet_service.cc:1511] Processing CreateTablet for tablet b7da6930c7d44f51ae33d75064b68676 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:14.249091 16859 tablet_service.cc:1511] Processing CreateTablet for tablet 86988133e17b49bfa869fb6da268ba7b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:14.249625 16710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7da6930c7d44f51ae33d75064b68676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.250285 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86988133e17b49bfa869fb6da268ba7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.254923 16796 raft_consensus.cc:3060] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.257248 16989 tablet_bootstrap.cc:492] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:14.257934 16989 ts_tablet_manager.cc:1403] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.004s
I20260709 13:21:14.267705 16989 raft_consensus.cc:359] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.268558 16989 raft_consensus.cc:385] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.236078 16991 raft_consensus.cc:359] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.272779 16991 raft_consensus.cc:385] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.273538 16931 tablet_service.cc:1511] Processing CreateTablet for tablet 86988133e17b49bfa869fb6da268ba7b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:14.275249 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86988133e17b49bfa869fb6da268ba7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.274982 16618 catalog_manager.cc:5697] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 0 to 1, leader changed from <none> to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 1 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.278471 16997 raft_consensus.cc:493] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.278995 16997 raft_consensus.cc:515] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:14.270821 16989 raft_consensus.cc:740] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.281132 16997 leader_election.cc:290] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:14.281281 16989 consensus_queue.cc:260] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.289178 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47c1b91c71444aa6e2c70fa4eb4403" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:14.289901 16795 raft_consensus.cc:2468] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:14.293570 16992 tablet_bootstrap.cc:654] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.273204 16991 raft_consensus.cc:740] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.303988 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47c1b91c71444aa6e2c70fa4eb4403" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:14.310848 16707 tablet_service.cc:1511] Processing CreateTablet for tablet 86988133e17b49bfa869fb6da268ba7b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:14.312193 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86988133e17b49bfa869fb6da268ba7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.313879 16989 ts_tablet_manager.cc:1434] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:21:14.315112 16989 tablet_bootstrap.cc:492] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:14.309104 16835 leader_election.cc:304] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:14.317569 16943 raft_consensus.cc:2468] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:14.318971 17038 raft_consensus.cc:2804] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:14.319101 16997 consensus_queue.cc:1048] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:14.305066 16991 consensus_queue.cc:260] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.319824 17025 consensus_queue.cc:1048] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:14.319411 17038 raft_consensus.cc:493] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:14.320629 17038 raft_consensus.cc:3060] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.324097 16991 ts_tablet_manager.cc:1434] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.001s
I20260709 13:21:14.325286 16990 tablet_bootstrap.cc:654] T 625f07ca50734f51bc7c0176ad5326f9 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.345911 16857 tablet_service.cc:1511] Processing CreateTablet for tablet a465607298c84b8dbd8007c816bc5c9c (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:14.347329 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a465607298c84b8dbd8007c816bc5c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.348238 16989 tablet_bootstrap.cc:654] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.349100 16932 tablet_service.cc:1511] Processing CreateTablet for tablet a465607298c84b8dbd8007c816bc5c9c (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:14.350396 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a465607298c84b8dbd8007c816bc5c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.351257 16858 tablet_service.cc:1511] Processing CreateTablet for tablet fe2434de2d21436fbbf8b25ab1814b54 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:14.352427 16858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2434de2d21436fbbf8b25ab1814b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.356266 16786 tablet_service.cc:1511] Processing CreateTablet for tablet fe2434de2d21436fbbf8b25ab1814b54 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:14.356985 16933 tablet_service.cc:1511] Processing CreateTablet for tablet 8760c2c176b64d10ae61d46fa3c8605b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:14.358168 16991 tablet_bootstrap.cc:492] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:14.358131 16786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2434de2d21436fbbf8b25ab1814b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.359273 16709 tablet_service.cc:1511] Processing CreateTablet for tablet 8760c2c176b64d10ae61d46fa3c8605b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:14.359450 16707 tablet_service.cc:1511] Processing CreateTablet for tablet fe2434de2d21436fbbf8b25ab1814b54 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:14.360483 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe2434de2d21436fbbf8b25ab1814b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.364444 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8760c2c176b64d10ae61d46fa3c8605b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.358346 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8760c2c176b64d10ae61d46fa3c8605b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.389606 17025 raft_consensus.cc:493] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.390167 17025 raft_consensus.cc:515] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:14.390827 16992 tablet_bootstrap.cc:492] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:14.391371 16992 ts_tablet_manager.cc:1403] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.176s	user 0.008s	sys 0.007s
I20260709 13:21:14.392365 17025 leader_election.cc:290] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:14.377837 16785 tablet_service.cc:1511] Processing CreateTablet for tablet a465607298c84b8dbd8007c816bc5c9c (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:14.404731 16782 tablet_service.cc:1511] Processing CreateTablet for tablet 8760c2c176b64d10ae61d46fa3c8605b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:14.406270 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8760c2c176b64d10ae61d46fa3c8605b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.410482 17038 raft_consensus.cc:515] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:14.411063 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0239d47f915d4f529cdc01b32055c954" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:14.411717 16720 raft_consensus.cc:2468] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:14.413777 17038 leader_election.cc:290] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:14.414016 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47c1b91c71444aa6e2c70fa4eb4403" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:14.414291 16784 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec264452e294befb3fab6c21b1307ba (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:14.414757 16943 raft_consensus.cc:3060] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.418013 16836 leader_election.cc:304] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:14.423571 16859 tablet_service.cc:1511] Processing CreateTablet for tablet 13a3b0acceaf4cada63b5f215fab4a29 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:14.424989 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a3b0acceaf4cada63b5f215fab4a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.431991 16943 raft_consensus.cc:2468] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:14.434268 16934 tablet_service.cc:1511] Processing CreateTablet for tablet 13a3b0acceaf4cada63b5f215fab4a29 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:14.435506 16934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a3b0acceaf4cada63b5f215fab4a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.434410 16836 leader_election.cc:304] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:14.439435 16857 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec264452e294befb3fab6c21b1307ba (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:14.441148 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec264452e294befb3fab6c21b1307ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.449323 16709 tablet_service.cc:1511] Processing CreateTablet for tablet 13a3b0acceaf4cada63b5f215fab4a29 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:14.450496 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a3b0acceaf4cada63b5f215fab4a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.451520 17025 raft_consensus.cc:2804] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:14.452010 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47c1b91c71444aa6e2c70fa4eb4403" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:14.452689 16792 raft_consensus.cc:3060] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.452114 17025 raft_consensus.cc:697] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:14.457619 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0239d47f915d4f529cdc01b32055c954" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:14.457597 16932 tablet_service.cc:1511] Processing CreateTablet for tablet 4ec264452e294befb3fab6c21b1307ba (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:14.458600 16783 tablet_service.cc:1511] Processing CreateTablet for tablet ec2fb00d467444edb3d2d8374ad64b7c (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:14.459488 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec264452e294befb3fab6c21b1307ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.443475 16992 raft_consensus.cc:359] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:14.462082 16992 raft_consensus.cc:385] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.462402 16992 raft_consensus.cc:740] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.463168 16992 consensus_queue.cc:260] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:14.464087 16793 raft_consensus.cc:2468] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:14.464810 16792 raft_consensus.cc:2468] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:14.465111 16990 tablet_bootstrap.cc:492] T 625f07ca50734f51bc7c0176ad5326f9 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:14.465976 16990 ts_tablet_manager.cc:1403] T 625f07ca50734f51bc7c0176ad5326f9 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.273s	user 0.020s	sys 0.003s
I20260709 13:21:14.466355 17025 consensus_queue.cc:237] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:14.471050 16710 tablet_service.cc:1511] Processing CreateTablet for tablet ec2fb00d467444edb3d2d8374ad64b7c (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:14.472378 16710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2fb00d467444edb3d2d8374ad64b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.473975 16991 tablet_bootstrap.cc:654] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.475415 16990 raft_consensus.cc:359] T 625f07ca50734f51bc7c0176ad5326f9 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.476261 16990 raft_consensus.cc:385] T 625f07ca50734f51bc7c0176ad5326f9 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.477077 17004 raft_consensus.cc:493] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.477653 17004 raft_consensus.cc:515] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.444639 17038 raft_consensus.cc:2804] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:14.479948 16992 ts_tablet_manager.cc:1434] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.001s
I20260709 13:21:14.482874 17029 raft_consensus.cc:493] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.492992 17029 raft_consensus.cc:515] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.494484 16859 tablet_service.cc:1511] Processing CreateTablet for tablet ec2fb00d467444edb3d2d8374ad64b7c (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:14.495226 17029 leader_election.cc:290] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:14.487979 17004 leader_election.cc:290] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:14.489887 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:14.476691 16990 raft_consensus.cc:740] T 625f07ca50734f51bc7c0176ad5326f9 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.491621 16989 tablet_bootstrap.cc:492] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:14.495672 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2fb00d467444edb3d2d8374ad64b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.490839 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:14.507232 16990 consensus_queue.cc:260] T 625f07ca50734f51bc7c0176ad5326f9 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.497608 16989 ts_tablet_manager.cc:1403] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.183s	user 0.027s	sys 0.032s
I20260709 13:21:14.500372 16999 raft_consensus.cc:493] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.508422 16762 leader_election.cc:304] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:14.508484 16999 raft_consensus.cc:515] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.510463 17004 raft_consensus.cc:2749] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:14.510864 16999 leader_election.cc:290] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:14.500547 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625f07ca50734f51bc7c0176ad5326f9" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:14.511282 16989 raft_consensus.cc:359] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.511682 16870 raft_consensus.cc:2468] T 625f07ca50734f51bc7c0176ad5326f9 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 0.
I20260709 13:21:14.512058 16989 raft_consensus.cc:385] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.512416 16989 raft_consensus.cc:740] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.513108 16989 consensus_queue.cc:260] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.513871 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a75d301e384d359f3540e990d68e8d" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:14.515880 16687 leader_election.cc:343] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.517298 16908 leader_election.cc:304] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:14.518347 17029 raft_consensus.cc:2804] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:14.518666 17029 raft_consensus.cc:493] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:14.518889 17029 raft_consensus.cc:3060] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.520696 16616 catalog_manager.cc:5697] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.523061 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a75d301e384d359f3540e990d68e8d" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:14.523918 16990 ts_tablet_manager.cc:1434] T 625f07ca50734f51bc7c0176ad5326f9 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.058s	user 0.003s	sys 0.003s
W20260709 13:21:14.524731 16686 leader_election.cc:343] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.525033 16990 tablet_bootstrap.cc:492] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:14.525249 16686 leader_election.cc:304] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:14.526605 16999 raft_consensus.cc:2749] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:14.482131 17038 raft_consensus.cc:493] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:14.505713 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625f07ca50734f51bc7c0176ad5326f9" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:14.529671 17038 raft_consensus.cc:3060] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.529893 16721 raft_consensus.cc:2468] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 0.
I20260709 13:21:14.526892 16989 ts_tablet_manager.cc:1434] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:21:14.533125 16989 tablet_bootstrap.cc:492] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:14.537986 17029 raft_consensus.cc:515] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.540340 17029 leader_election.cc:290] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:14.541119 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625f07ca50734f51bc7c0176ad5326f9" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:14.541771 16870 raft_consensus.cc:3060] T 625f07ca50734f51bc7c0176ad5326f9 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.541648 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625f07ca50734f51bc7c0176ad5326f9" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:14.544473 16721 raft_consensus.cc:3060] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.548692 16989 tablet_bootstrap.cc:654] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.550359 16721 raft_consensus.cc:2468] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:14.551664 16910 leader_election.cc:304] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:14.552686 17029 raft_consensus.cc:2804] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:14.553375 17029 raft_consensus.cc:697] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:14.554265 17029 consensus_queue.cc:237] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.556701 16784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec264452e294befb3fab6c21b1307ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.559139 16783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2fb00d467444edb3d2d8374ad64b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.562389 16992 tablet_bootstrap.cc:492] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:14.567885 16786 tablet_service.cc:1511] Processing CreateTablet for tablet 807d54a32dee49c78fe3b3bfa5763b2b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:14.568706 16933 tablet_service.cc:1511] Processing CreateTablet for tablet 5c540f98dc1640918b733b6bef45d026 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:14.569897 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c540f98dc1640918b733b6bef45d026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.570986 16859 tablet_service.cc:1511] Processing CreateTablet for tablet 5c540f98dc1640918b733b6bef45d026 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:14.572804 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c540f98dc1640918b733b6bef45d026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.569105 16786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 807d54a32dee49c78fe3b3bfa5763b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.564199 16709 tablet_service.cc:1511] Processing CreateTablet for tablet 807d54a32dee49c78fe3b3bfa5763b2b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:14.584391 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 807d54a32dee49c78fe3b3bfa5763b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.586993 16992 tablet_bootstrap.cc:654] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.594208 16794 raft_consensus.cc:3060] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.597271 16710 tablet_service.cc:1511] Processing CreateTablet for tablet 5c540f98dc1640918b733b6bef45d026 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:14.598706 16710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c540f98dc1640918b733b6bef45d026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.599221 16782 tablet_service.cc:1511] Processing CreateTablet for tablet 1702099270174fe58528799e1564c74b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:14.600488 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1702099270174fe58528799e1564c74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.629281 16991 tablet_bootstrap.cc:492] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:14.629896 16991 ts_tablet_manager.cc:1403] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.272s	user 0.024s	sys 0.008s
I20260709 13:21:14.630916 16931 tablet_service.cc:1511] Processing CreateTablet for tablet 807d54a32dee49c78fe3b3bfa5763b2b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:14.632843 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 807d54a32dee49c78fe3b3bfa5763b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.637451 16991 raft_consensus.cc:359] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.638231 16991 raft_consensus.cc:385] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.638530 16991 raft_consensus.cc:740] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.641664 16785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a465607298c84b8dbd8007c816bc5c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.650908 16859 tablet_service.cc:1511] Processing CreateTablet for tablet 1702099270174fe58528799e1564c74b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:14.652222 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1702099270174fe58528799e1564c74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.539721 17038 raft_consensus.cc:515] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:14.610334 16870 raft_consensus.cc:2468] T 625f07ca50734f51bc7c0176ad5326f9 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:14.678879 17038 leader_election.cc:290] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:14.683095 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0239d47f915d4f529cdc01b32055c954" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:14.683832 16792 raft_consensus.cc:3060] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.687716 16857 tablet_service.cc:1511] Processing CreateTablet for tablet c133a9bb6d914a1794e8cbb3aa04ed49 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:14.692678 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c133a9bb6d914a1794e8cbb3aa04ed49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.695628 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0239d47f915d4f529cdc01b32055c954" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:14.696334 16720 raft_consensus.cc:3060] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.697265 16782 tablet_service.cc:1511] Processing CreateTablet for tablet c133a9bb6d914a1794e8cbb3aa04ed49 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:14.698738 16782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c133a9bb6d914a1794e8cbb3aa04ed49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.700063 16933 tablet_service.cc:1511] Processing CreateTablet for tablet 1702099270174fe58528799e1564c74b (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:14.700153 16932 tablet_service.cc:1511] Processing CreateTablet for tablet 5c889f0451934db588983524416a5269 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:14.703106 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c889f0451934db588983524416a5269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.701025 17029 consensus_queue.cc:1048] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:14.701107 16710 tablet_service.cc:1511] Processing CreateTablet for tablet 5c889f0451934db588983524416a5269 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:14.705530 16710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c889f0451934db588983524416a5269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.704114 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1702099270174fe58528799e1564c74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.713085 16709 tablet_service.cc:1511] Processing CreateTablet for tablet c133a9bb6d914a1794e8cbb3aa04ed49 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:14.718087 16709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c133a9bb6d914a1794e8cbb3aa04ed49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.722136 16990 tablet_bootstrap.cc:654] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.723529 16989 tablet_bootstrap.cc:492] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:14.724040 16989 ts_tablet_manager.cc:1403] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.191s	user 0.032s	sys 0.043s
I20260709 13:21:14.735795 16785 tablet_service.cc:1511] Processing CreateTablet for tablet 5c889f0451934db588983524416a5269 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:14.737064 16785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c889f0451934db588983524416a5269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.745024 16931 tablet_service.cc:1511] Processing CreateTablet for tablet 5e375bb738794feab91d445c1c81cd73 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 13:21:14.746057 16666 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:14.746654 16931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e375bb738794feab91d445c1c81cd73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.755115 16859 tablet_service.cc:1511] Processing CreateTablet for tablet 5e375bb738794feab91d445c1c81cd73 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:14.756935 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e375bb738794feab91d445c1c81cd73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.670485 16991 consensus_queue.cc:260] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.797130 16707 tablet_service.cc:1511] Processing CreateTablet for tablet 5e375bb738794feab91d445c1c81cd73 (DEFAULT_TABLE table=test-workload [id=5e0b093288ef44b4954652cf25273435]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:14.798209 16989 raft_consensus.cc:359] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:14.798861 16989 raft_consensus.cc:385] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.799111 16989 raft_consensus.cc:740] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.799904 16989 consensus_queue.cc:260] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:14.800397 16990 tablet_bootstrap.cc:492] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:14.800942 16990 ts_tablet_manager.cc:1403] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.276s	user 0.014s	sys 0.036s
I20260709 13:21:14.805332 16989 ts_tablet_manager.cc:1434] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.002s
I20260709 13:21:14.810966 16707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e375bb738794feab91d445c1c81cd73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:14.812340 16992 tablet_bootstrap.cc:492] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:14.812942 16992 ts_tablet_manager.cc:1403] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.251s	user 0.029s	sys 0.031s
I20260709 13:21:14.813875 16991 ts_tablet_manager.cc:1434] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.184s	user 0.009s	sys 0.001s
I20260709 13:21:14.815022 16991 tablet_bootstrap.cc:492] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:14.819332 16618 catalog_manager.cc:5697] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 0 to 1, leader changed from <none> to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 1 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.829571 17029 raft_consensus.cc:493] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.798924 16720 raft_consensus.cc:2468] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:14.830138 17029 raft_consensus.cc:515] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.830991 16836 leader_election.cc:304] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:14.831920 17025 raft_consensus.cc:2804] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:14.832410 17025 raft_consensus.cc:697] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:14.833353 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a75d301e384d359f3540e990d68e8d" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:14.812214 16990 raft_consensus.cc:359] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:14.833232 17025 consensus_queue.cc:237] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:14.834535 16719 raft_consensus.cc:2468] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 0.
I20260709 13:21:14.835932 16910 leader_election.cc:304] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
W20260709 13:21:14.829226 16909 consensus_peers.cc:597] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:14.834540 16792 raft_consensus.cc:2468] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:14.838877 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a75d301e384d359f3540e990d68e8d" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:14.820899 16992 raft_consensus.cc:359] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.840168 16992 raft_consensus.cc:385] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.841063 16992 raft_consensus.cc:740] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
W20260709 13:21:14.840314 16909 leader_election.cc:343] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.845569 16989 tablet_bootstrap.cc:492] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:14.833292 17029 leader_election.cc:290] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:14.836710 16990 raft_consensus.cc:385] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.858250 16990 raft_consensus.cc:740] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.859144 16990 consensus_queue.cc:260] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:14.861515 16990 ts_tablet_manager.cc:1434] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:21:14.847918 16991 tablet_bootstrap.cc:654] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.850055 17079 raft_consensus.cc:2804] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:14.865470 17079 raft_consensus.cc:493] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:14.865921 17079 raft_consensus.cc:3060] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.862397 16992 consensus_queue.cc:260] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.872406 16990 tablet_bootstrap.cc:492] T 8a2c766bb0e34effb7b3f41f13d558a0 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:14.874671 16989 tablet_bootstrap.cc:654] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.875144 16992 ts_tablet_manager.cc:1434] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 13:21:14.879375 16992 tablet_bootstrap.cc:492] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:14.895505 17079 raft_consensus.cc:515] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.905843 16990 tablet_bootstrap.cc:654] T 8a2c766bb0e34effb7b3f41f13d558a0 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.911875 17079 leader_election.cc:290] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:14.913026 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a75d301e384d359f3540e990d68e8d" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:14.913862 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a75d301e384d359f3540e990d68e8d" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:14.914464 16721 raft_consensus.cc:3060] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.914845 17075 raft_consensus.cc:493] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.915230 16991 tablet_bootstrap.cc:492] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:14.915812 16991 ts_tablet_manager.cc:1403] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.001s
I20260709 13:21:14.915334 17075 raft_consensus.cc:515] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
W20260709 13:21:14.916739 16909 leader_election.cc:343] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.919158 17004 raft_consensus.cc:493] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.919814 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00095bdfc40040d0a8eefc49c2034fb2" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:14.900010 16992 tablet_bootstrap.cc:654] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:14.921839 16685 leader_election.cc:343] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.919673 17004 raft_consensus.cc:515] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.924144 17004 leader_election.cc:290] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:14.924799 16991 raft_consensus.cc:359] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.925801 16991 raft_consensus.cc:385] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.925529 16721 raft_consensus.cc:2468] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:14.926240 16991 raft_consensus.cc:740] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.926400 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37644a5aa384ad88bdebe0b15db71ea" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:14.927121 16991 consensus_queue.cc:260] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.927436 16910 leader_election.cc:304] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:14.928452 17079 raft_consensus.cc:2804] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:14.928943 17079 raft_consensus.cc:697] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:14.929798 17079 consensus_queue.cc:237] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.931588 16990 tablet_bootstrap.cc:492] T 8a2c766bb0e34effb7b3f41f13d558a0 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:14.932462 16990 ts_tablet_manager.cc:1403] T 8a2c766bb0e34effb7b3f41f13d558a0 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.000s
I20260709 13:21:14.934430 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00095bdfc40040d0a8eefc49c2034fb2" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:14.936172 16686 leader_election.cc:343] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:14.936580 16991 ts_tablet_manager.cc:1434] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:21:14.936671 16686 leader_election.cc:304] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:14.937954 16991 tablet_bootstrap.cc:492] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:14.937579 16999 raft_consensus.cc:2749] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:14.936875 16990 raft_consensus.cc:359] T 8a2c766bb0e34effb7b3f41f13d558a0 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.937616 17075 leader_election.cc:290] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:14.939352 16990 raft_consensus.cc:385] T 8a2c766bb0e34effb7b3f41f13d558a0 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.939823 16990 raft_consensus.cc:740] T 8a2c766bb0e34effb7b3f41f13d558a0 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.940313 16616 catalog_manager.cc:5697] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:14.941802 16990 consensus_queue.cc:260] T 8a2c766bb0e34effb7b3f41f13d558a0 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.943114 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a37644a5aa384ad88bdebe0b15db71ea" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:14.948171 16762 leader_election.cc:304] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:14.949093 16990 ts_tablet_manager.cc:1434] T 8a2c766bb0e34effb7b3f41f13d558a0 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 13:21:14.950516 16990 tablet_bootstrap.cc:492] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:14.950472 17004 raft_consensus.cc:2749] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:14.953958 16989 tablet_bootstrap.cc:492] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:14.954478 16989 ts_tablet_manager.cc:1403] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.109s	user 0.014s	sys 0.001s
I20260709 13:21:14.959977 16990 tablet_bootstrap.cc:654] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.960474 16619 catalog_manager.cc:5697] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 0 to 1, leader changed from <none> to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 1 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:14.961477 16989 raft_consensus.cc:359] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.962423 16989 raft_consensus.cc:385] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.962739 16989 raft_consensus.cc:740] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.965905 16989 consensus_queue.cc:260] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.968020 16989 ts_tablet_manager.cc:1434] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260709 13:21:14.968986 16989 tablet_bootstrap.cc:492] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:14.969609 17079 raft_consensus.cc:493] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.970131 17079 raft_consensus.cc:515] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.973309 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c766bb0e34effb7b3f41f13d558a0" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:14.974000 16870 raft_consensus.cc:2468] T 8a2c766bb0e34effb7b3f41f13d558a0 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 0.
I20260709 13:21:14.975524 16991 tablet_bootstrap.cc:654] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.975584 16908 leader_election.cc:304] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:14.977672 17052 raft_consensus.cc:2804] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:14.978205 17052 raft_consensus.cc:493] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:14.978631 17052 raft_consensus.cc:3060] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:14.985327 17079 leader_election.cc:290] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:14.986552 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c766bb0e34effb7b3f41f13d558a0" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:14.987259 16721 raft_consensus.cc:2468] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 0.
I20260709 13:21:14.990103 16990 tablet_bootstrap.cc:492] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:14.990645 16990 ts_tablet_manager.cc:1403] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.040s	user 0.027s	sys 0.008s
I20260709 13:21:14.991959 16992 tablet_bootstrap.cc:492] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:14.992537 16992 ts_tablet_manager.cc:1403] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.113s	user 0.008s	sys 0.041s
I20260709 13:21:14.992718 16989 tablet_bootstrap.cc:654] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:14.993757 16990 raft_consensus.cc:359] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:14.994527 16990 raft_consensus.cc:385] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.994796 16990 raft_consensus.cc:740] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.995586 16992 raft_consensus.cc:359] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.996508 16992 raft_consensus.cc:385] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:14.995702 16990 consensus_queue.cc:260] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:14.996855 16992 raft_consensus.cc:740] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:14.998162 17052 raft_consensus.cc:515] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:14.997897 16992 consensus_queue.cc:260] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:14.999086 16990 ts_tablet_manager.cc:1434] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:21:15.000525 16990 tablet_bootstrap.cc:492] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:15.001624 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c766bb0e34effb7b3f41f13d558a0" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:15.002326 16870 raft_consensus.cc:3060] T 8a2c766bb0e34effb7b3f41f13d558a0 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.009369 16997 consensus_queue.cc:1048] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:15.015173 17029 consensus_queue.cc:1048] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:15.015964 16990 tablet_bootstrap.cc:654] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.016644 17029 consensus_queue.cc:1048] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:15.020360 16992 ts_tablet_manager.cc:1434] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:21:15.026232 16992 tablet_bootstrap.cc:492] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:15.030984 16989 tablet_bootstrap.cc:492] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:15.031483 16992 tablet_bootstrap.cc:654] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.032027 17038 raft_consensus.cc:493] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.032570 17038 raft_consensus.cc:515] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:15.034991 17038 leader_election.cc:290] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:15.036450 16989 ts_tablet_manager.cc:1403] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.017s
I20260709 13:21:15.037191 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00095bdfc40040d0a8eefc49c2034fb2" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:15.038228 16719 raft_consensus.cc:2468] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:15.040264 16836 leader_election.cc:304] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:15.040540 16989 raft_consensus.cc:359] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:15.041539 16989 raft_consensus.cc:385] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.041936 16989 raft_consensus.cc:740] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.043244 17038 raft_consensus.cc:2804] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:15.043977 17038 raft_consensus.cc:493] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.044518 17038 raft_consensus.cc:3060] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.048640 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00095bdfc40040d0a8eefc49c2034fb2" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:15.048903 16989 consensus_queue.cc:260] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:15.053845 16989 ts_tablet_manager.cc:1434] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:21:15.055200 16989 tablet_bootstrap.cc:492] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
W20260709 13:21:15.055788 16835 leader_election.cc:343] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.066445 16997 consensus_queue.cc:1048] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:15.082265 16989 tablet_bootstrap.cc:654] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.086859 16870 raft_consensus.cc:2468] T 8a2c766bb0e34effb7b3f41f13d558a0 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:15.094461 16989 tablet_bootstrap.cc:492] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:15.097357 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c766bb0e34effb7b3f41f13d558a0" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:15.225503 16719 raft_consensus.cc:3060] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.225584 16989 ts_tablet_manager.cc:1403] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.171s	user 0.016s	sys 0.000s
I20260709 13:21:15.098047 17052 leader_election.cc:290] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:15.161880 17075 raft_consensus.cc:493] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.233987 17075 raft_consensus.cc:515] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:15.191608 17025 raft_consensus.cc:493] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.236299 17025 raft_consensus.cc:515] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:15.238925 17025 leader_election.cc:290] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:15.241631 17004 raft_consensus.cc:493] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.241734 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c70b1ed00f49408fae9002719cc6e5" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:15.242583 17004 raft_consensus.cc:515] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:15.245527 17004 leader_election.cc:290] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
W20260709 13:21:15.251080 16687 leader_election.cc:343] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.255863 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a75d301e384d359f3540e990d68e8d" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:15.260032 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a75d301e384d359f3540e990d68e8d" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:15.261142 16720 raft_consensus.cc:2393] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 1: Already voted for candidate 266d75f35db4465788ab06782fae972d in this term.
I20260709 13:21:15.262849 16762 leader_election.cc:304] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:15.264151 17004 raft_consensus.cc:3060] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.271173 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c70b1ed00f49408fae9002719cc6e5" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:15.273164 16686 leader_election.cc:343] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.273851 16686 leader_election.cc:304] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:15.274901 17006 raft_consensus.cc:2749] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:15.286451 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8cbb6f215ef4d9bb7a65bd627ffcfbe" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:15.287674 16795 raft_consensus.cc:3060] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:15.294304 16835 leader_election.cc:343] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.241746 17075 leader_election.cc:290] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:15.303640 17004 raft_consensus.cc:2749] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:15.315099 16908 leader_election.cc:304] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:15.349284 17052 raft_consensus.cc:2804] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:15.350324 17052 raft_consensus.cc:697] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:15.351558 17052 consensus_queue.cc:237] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:15.316555 17093 log.cc:927] Time spent T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 13:21:15.317328 17095 log.cc:927] Time spent T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:21:15.320050 16989 raft_consensus.cc:359] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:15.359302 16989 raft_consensus.cc:385] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.359602 16989 raft_consensus.cc:740] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.330981 16991 tablet_bootstrap.cc:492] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:15.360276 16989 consensus_queue.cc:260] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:15.361001 16991 ts_tablet_manager.cc:1403] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.423s	user 0.089s	sys 0.128s
I20260709 13:21:15.362530 16989 ts_tablet_manager.cc:1434] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.136s	user 0.006s	sys 0.000s
I20260709 13:21:15.363509 16989 tablet_bootstrap.cc:492] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:15.363781 16991 raft_consensus.cc:359] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:15.364444 16991 raft_consensus.cc:385] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.364725 16991 raft_consensus.cc:740] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.365396 16991 consensus_queue.cc:260] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:15.368469 16991 ts_tablet_manager.cc:1434] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 13:21:15.369417 16991 tablet_bootstrap.cc:492] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:15.374402 16989 tablet_bootstrap.cc:654] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.389261 16991 tablet_bootstrap.cc:654] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:15.343914 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 152184us
I20260709 13:21:15.399214 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8cbb6f215ef4d9bb7a65bd627ffcfbe" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:15.400182 16943 raft_consensus.cc:2468] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:15.347389 16719 raft_consensus.cc:2468] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:15.454912 17097 consensus_queue.cc:1048] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:15.459113 17038 raft_consensus.cc:515] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
W20260709 13:21:15.464393 16910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 56121.1us
I20260709 13:21:15.476300 17029 consensus_queue.cc:1048] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:15.482573 16836 leader_election.cc:304] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:15.483788 16997 raft_consensus.cc:2804] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:15.484254 16997 raft_consensus.cc:493] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.484634 16997 raft_consensus.cc:3060] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.499244 16997 raft_consensus.cc:515] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:15.511348 17079 consensus_queue.cc:1048] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:15.530787 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00095bdfc40040d0a8eefc49c2034fb2" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:15.561211 16997 leader_election.cc:290] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
W20260709 13:21:15.562139 16835 leader_election.cc:343] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.563159 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8cbb6f215ef4d9bb7a65bd627ffcfbe" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
W20260709 13:21:15.564679 16835 leader_election.cc:343] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.551468 16617 catalog_manager.cc:5697] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 0 to 1, leader changed from <none> to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 1 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:15.565394 16991 tablet_bootstrap.cc:492] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:15.565976 16991 ts_tablet_manager.cc:1403] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.197s	user 0.017s	sys 0.057s
I20260709 13:21:15.569037 16991 raft_consensus.cc:359] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:15.569989 16991 raft_consensus.cc:385] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.570325 16991 raft_consensus.cc:740] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
W20260709 13:21:15.554199 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:32963, user_credentials={real_user=slave}} blocked reactor thread for 71710.6us
W20260709 13:21:15.555881 16992 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.107s	sys 0.352s
W20260709 13:21:15.556479 16990 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.128s	sys 0.311s
W20260709 13:21:15.572034 16992 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.107s	sys 0.352s
W20260709 13:21:15.572172 16990 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.128s	sys 0.311s
I20260709 13:21:15.556905 17038 leader_election.cc:290] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:15.574357 16992 tablet_bootstrap.cc:492] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:15.574723 16990 tablet_bootstrap.cc:492] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:15.574916 16992 ts_tablet_manager.cc:1403] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.549s	user 0.115s	sys 0.352s
I20260709 13:21:15.575290 16990 ts_tablet_manager.cc:1403] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.575s	user 0.139s	sys 0.313s
I20260709 13:21:15.578253 16990 raft_consensus.cc:359] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:15.579018 16990 raft_consensus.cc:385] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.572211 16991 consensus_queue.cc:260] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:15.584756 16992 raft_consensus.cc:359] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:15.585953 16992 raft_consensus.cc:385] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.586253 16992 raft_consensus.cc:740] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.586696 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00095bdfc40040d0a8eefc49c2034fb2" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:15.587373 16721 raft_consensus.cc:3060] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.587013 16992 consensus_queue.cc:260] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:15.585572 16990 raft_consensus.cc:740] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.590911 16990 consensus_queue.cc:260] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:15.591372 16991 ts_tablet_manager.cc:1434] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:21:15.593381 16992 ts_tablet_manager.cc:1434] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:21:15.594595 16991 tablet_bootstrap.cc:492] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:15.594805 16992 tablet_bootstrap.cc:492] T 09c70b1ed00f49408fae9002719cc6e5 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:15.596328 16990 ts_tablet_manager.cc:1434] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:21:15.596918 17004 raft_consensus.cc:493] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.597572 16990 tablet_bootstrap.cc:492] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:15.597388 17004 raft_consensus.cc:515] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:15.599534 17004 leader_election.cc:290] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:15.601148 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8cbb6f215ef4d9bb7a65bd627ffcfbe" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:15.604017 16943 raft_consensus.cc:2468] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 0.
I20260709 13:21:15.603295 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8cbb6f215ef4d9bb7a65bd627ffcfbe" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:15.602579 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8cbb6f215ef4d9bb7a65bd627ffcfbe" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:15.606154 16868 raft_consensus.cc:2393] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 1: Already voted for candidate 71a0b5583e0547a88c88b590549fbcee in this term.
I20260709 13:21:15.606464 17097 consensus_queue.cc:1048] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:15.607667 16762 leader_election.cc:304] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:15.608533 17004 raft_consensus.cc:2804] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:15.608923 17004 raft_consensus.cc:493] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.609633 17004 raft_consensus.cc:3060] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.614981 16990 tablet_bootstrap.cc:654] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.616324 16992 tablet_bootstrap.cc:654] T 09c70b1ed00f49408fae9002719cc6e5 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.615026 16991 tablet_bootstrap.cc:654] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.628989 17004 raft_consensus.cc:515] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:15.634814 16836 leader_election.cc:304] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:15.635201 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8cbb6f215ef4d9bb7a65bd627ffcfbe" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:15.635825 16943 raft_consensus.cc:3060] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.636307 16997 raft_consensus.cc:2749] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:15.641939 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8cbb6f215ef4d9bb7a65bd627ffcfbe" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:15.642877 16868 raft_consensus.cc:2393] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 1: Already voted for candidate 71a0b5583e0547a88c88b590549fbcee in this term.
I20260709 13:21:15.643007 16989 tablet_bootstrap.cc:492] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:15.643667 16989 ts_tablet_manager.cc:1403] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.280s	user 0.017s	sys 0.009s
I20260709 13:21:15.647248 16989 raft_consensus.cc:359] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:15.648171 16989 raft_consensus.cc:385] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.648672 16989 raft_consensus.cc:740] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.643764 17004 leader_election.cc:290] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:15.655929 16989 consensus_queue.cc:260] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:15.649605 16721 raft_consensus.cc:2468] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:15.659202 16989 ts_tablet_manager.cc:1434] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:21:15.658952 16836 leader_election.cc:304] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:15.660408 17097 raft_consensus.cc:2804] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:15.660949 17097 raft_consensus.cc:697] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:15.661931 17097 consensus_queue.cc:237] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:15.666878 16989 tablet_bootstrap.cc:492] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:15.648114 16943 raft_consensus.cc:2468] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:15.675886 16762 leader_election.cc:304] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:15.677361 17004 raft_consensus.cc:2804] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:15.687633 16989 tablet_bootstrap.cc:654] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.706811 16989 tablet_bootstrap.cc:492] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:15.709214 17075 raft_consensus.cc:493] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.711690 16989 ts_tablet_manager.cc:1403] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.002s
I20260709 13:21:15.715420 16989 raft_consensus.cc:359] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:15.720132 16989 raft_consensus.cc:385] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.711476 17075 raft_consensus.cc:515] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:15.721242 16989 raft_consensus.cc:740] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.723825 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8089fb9d122745beabb535e51bd29d52" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:15.724056 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8089fb9d122745beabb535e51bd29d52" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:15.724576 16868 raft_consensus.cc:2468] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
W20260709 13:21:15.725555 16687 leader_election.cc:343] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.726214 17075 leader_election.cc:290] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:15.730021 16685 leader_election.cc:304] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:15.731631 17006 raft_consensus.cc:2804] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:15.732048 17006 raft_consensus.cc:493] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.732409 17006 raft_consensus.cc:3060] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.737309 16989 consensus_queue.cc:260] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:15.741104 16989 ts_tablet_manager.cc:1434] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:21:15.743769 16989 tablet_bootstrap.cc:492] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:15.746244 17006 raft_consensus.cc:515] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:15.750118 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8089fb9d122745beabb535e51bd29d52" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:15.750885 16868 raft_consensus.cc:3060] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.755650 16989 tablet_bootstrap.cc:654] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:15.766798 16666 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:15.779820 17052 consensus_queue.cc:1048] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:15.785555 16990 tablet_bootstrap.cc:492] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:15.786403 16990 ts_tablet_manager.cc:1403] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.189s	user 0.071s	sys 0.057s
I20260709 13:21:15.787333 16991 tablet_bootstrap.cc:492] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:15.787830 16991 ts_tablet_manager.cc:1403] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.194s	user 0.014s	sys 0.008s
I20260709 13:21:15.789352 16990 raft_consensus.cc:359] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:15.790161 16990 raft_consensus.cc:385] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.790464 16990 raft_consensus.cc:740] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.791304 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8089fb9d122745beabb535e51bd29d52" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:15.791193 16990 consensus_queue.cc:260] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:15.792261 17052 raft_consensus.cc:493] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.792752 17052 raft_consensus.cc:515] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:15.793355 16990 ts_tablet_manager.cc:1434] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:21:15.794368 16990 tablet_bootstrap.cc:492] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
W20260709 13:21:15.794409 16687 leader_election.cc:343] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.795290 17029 consensus_queue.cc:1048] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:15.801548 16990 tablet_bootstrap.cc:654] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.805603 17052 leader_election.cc:290] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:15.713933 16615 catalog_manager.cc:5697] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:15.775923 16868 raft_consensus.cc:2468] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:15.825287 16685 leader_election.cc:304] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:15.826320 17075 raft_consensus.cc:2804] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:15.811661 17004 raft_consensus.cc:697] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:15.815156 17006 leader_election.cc:290] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:15.768703 16989 tablet_bootstrap.cc:492] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:15.817992 16991 raft_consensus.cc:359] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:15.820273 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c70b1ed00f49408fae9002719cc6e5" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:15.827924 16989 ts_tablet_manager.cc:1403] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.000s
I20260709 13:21:15.828317 16991 raft_consensus.cc:385] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.828719 16991 raft_consensus.cc:740] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.829685 16991 consensus_queue.cc:260] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
W20260709 13:21:15.832095 16909 leader_election.cc:343] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.832891 16989 raft_consensus.cc:359] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:15.834332 16989 raft_consensus.cc:385] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.825265 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c70b1ed00f49408fae9002719cc6e5" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:15.843039 16990 tablet_bootstrap.cc:492] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:15.843819 16990 ts_tablet_manager.cc:1403] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.012s
I20260709 13:21:15.848121 16990 raft_consensus.cc:359] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:15.849125 16990 raft_consensus.cc:385] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.849781 17004 consensus_queue.cc:237] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:15.850417 16720 raft_consensus.cc:2468] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 0.
I20260709 13:21:15.855818 16910 leader_election.cc:304] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:15.858868 16992 tablet_bootstrap.cc:492] T 09c70b1ed00f49408fae9002719cc6e5 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:15.859406 16992 ts_tablet_manager.cc:1403] T 09c70b1ed00f49408fae9002719cc6e5 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.265s	user 0.019s	sys 0.006s
I20260709 13:21:15.851461 16990 raft_consensus.cc:740] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.861313 17079 raft_consensus.cc:2804] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:15.861799 17079 raft_consensus.cc:493] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.862151 17079 raft_consensus.cc:3060] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.864831 16992 raft_consensus.cc:359] T 09c70b1ed00f49408fae9002719cc6e5 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:15.869824 16992 raft_consensus.cc:385] T 09c70b1ed00f49408fae9002719cc6e5 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.870254 16992 raft_consensus.cc:740] T 09c70b1ed00f49408fae9002719cc6e5 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.834728 16989 raft_consensus.cc:740] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.860452 16991 ts_tablet_manager.cc:1434] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.003s
I20260709 13:21:15.872669 16991 tablet_bootstrap.cc:492] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:15.872558 16990 consensus_queue.cc:260] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:15.874687 16989 consensus_queue.cc:260] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:15.878310 16992 consensus_queue.cc:260] T 09c70b1ed00f49408fae9002719cc6e5 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:15.868908 17079 raft_consensus.cc:515] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:15.884722 16992 ts_tablet_manager.cc:1434] T 09c70b1ed00f49408fae9002719cc6e5 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.001s
I20260709 13:21:15.885726 16989 ts_tablet_manager.cc:1434] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:21:15.884768 16990 ts_tablet_manager.cc:1434] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.000s
I20260709 13:21:15.886205 16992 tablet_bootstrap.cc:492] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:15.887367 16990 tablet_bootstrap.cc:492] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:15.887462 16989 tablet_bootstrap.cc:492] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:15.894322 16990 tablet_bootstrap.cc:654] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.894915 17079 leader_election.cc:290] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:15.898093 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c70b1ed00f49408fae9002719cc6e5" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:15.898579 17097 raft_consensus.cc:493] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.899505 17097 raft_consensus.cc:515] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:15.900154 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09c70b1ed00f49408fae9002719cc6e5" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:15.901302 16793 raft_consensus.cc:3060] T 09c70b1ed00f49408fae9002719cc6e5 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.903366 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b336bf87ee483f9aef83d5b3358fae" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:15.904369 16719 raft_consensus.cc:2468] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:15.898974 16720 raft_consensus.cc:3060] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.906553 16836 leader_election.cc:304] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:15.907837 16997 raft_consensus.cc:2804] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:15.885092 17075 raft_consensus.cc:697] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:15.908259 16997 raft_consensus.cc:493] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.909825 16997 raft_consensus.cc:3060] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.910542 17097 leader_election.cc:290] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:15.911131 16793 raft_consensus.cc:2468] T 09c70b1ed00f49408fae9002719cc6e5 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:15.912946 16909 leader_election.cc:304] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:15.914047 17029 raft_consensus.cc:2804] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:15.915243 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b336bf87ee483f9aef83d5b3358fae" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:15.916922 16835 leader_election.cc:343] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.918061 17029 raft_consensus.cc:697] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:15.919066 17029 consensus_queue.cc:237] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:15.922768 16991 tablet_bootstrap.cc:654] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.928334 16720 raft_consensus.cc:2468] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:15.933588 17075 consensus_queue.cc:237] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:15.936286 16989 tablet_bootstrap.cc:654] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.942796 16997 raft_consensus.cc:515] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:15.957311 16989 tablet_bootstrap.cc:492] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:15.958125 16989 ts_tablet_manager.cc:1403] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.004s
I20260709 13:21:15.962061 16989 raft_consensus.cc:359] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:15.963074 16989 raft_consensus.cc:385] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.963429 16989 raft_consensus.cc:740] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.964360 16989 consensus_queue.cc:260] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:15.956787 16615 catalog_manager.cc:5697] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 0 to 1, leader changed from <none> to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 1 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:15.967751 16989 ts_tablet_manager.cc:1434] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:21:15.969249 16989 tablet_bootstrap.cc:492] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:15.946468 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b336bf87ee483f9aef83d5b3358fae" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:15.971511 16720 raft_consensus.cc:3060] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:15.979557 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b336bf87ee483f9aef83d5b3358fae" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:15.978530 16997 leader_election.cc:290] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
W20260709 13:21:15.981525 16835 leader_election.cc:343] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:15.989741 16991 tablet_bootstrap.cc:492] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:15.990280 16991 ts_tablet_manager.cc:1403] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.118s	user 0.020s	sys 0.023s
I20260709 13:21:15.993134 16991 raft_consensus.cc:359] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:15.993858 16991 raft_consensus.cc:385] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:15.994127 16991 raft_consensus.cc:740] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:15.994482 16992 tablet_bootstrap.cc:654] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.988866 16616 catalog_manager.cc:5697] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:15.999140 16720 raft_consensus.cc:2468] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:16.000737 16836 leader_election.cc:304] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:16.002316 17097 raft_consensus.cc:2804] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:16.003945 17097 raft_consensus.cc:697] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:16.005246 17097 consensus_queue.cc:237] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:16.006214 16989 tablet_bootstrap.cc:654] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:15.994922 16991 consensus_queue.cc:260] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.009946 16991 ts_tablet_manager.cc:1434] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:21:16.011049 16991 tablet_bootstrap.cc:492] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:16.015413 16990 tablet_bootstrap.cc:492] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:16.016062 16990 ts_tablet_manager.cc:1403] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.129s	user 0.040s	sys 0.048s
I20260709 13:21:16.017361 16991 tablet_bootstrap.cc:654] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.020958 16992 tablet_bootstrap.cc:492] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:16.021595 16992 ts_tablet_manager.cc:1403] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.004s
I20260709 13:21:16.021822 17098 raft_consensus.cc:493] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.022346 17098 raft_consensus.cc:515] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.024632 17098 leader_election.cc:290] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:16.026672 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70bbc621ace4406b50194cd2117bdc6" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:16.028746 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70bbc621ace4406b50194cd2117bdc6" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:16.030472 16836 leader_election.cc:343] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.031383 16990 raft_consensus.cc:359] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:16.031930 16835 leader_election.cc:343] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.032122 16990 raft_consensus.cc:385] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.032428 16835 leader_election.cc:304] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:16.024345 16992 raft_consensus.cc:359] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:16.033670 16992 raft_consensus.cc:385] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.033841 17098 raft_consensus.cc:2749] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:16.034004 16992 raft_consensus.cc:740] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.034677 17127 raft_consensus.cc:493] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.035262 17127 raft_consensus.cc:515] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:16.035605 16992 consensus_queue.cc:260] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:16.032433 16990 raft_consensus.cc:740] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.038403 16990 consensus_queue.cc:260] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.038671 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72c23005f53496890cfb11e0c19318b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:16.039382 16943 raft_consensus.cc:2468] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:16.040793 16687 leader_election.cc:304] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:16.041342 16992 ts_tablet_manager.cc:1434] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.002s
I20260709 13:21:16.041687 17006 raft_consensus.cc:2804] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:16.042837 17006 raft_consensus.cc:493] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.043184 17006 raft_consensus.cc:3060] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.043458 16992 tablet_bootstrap.cc:492] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:16.045634 17127 leader_election.cc:290] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:16.046093 16990 ts_tablet_manager.cc:1434] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:21:16.046197 17127 raft_consensus.cc:493] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.046689 17127 raft_consensus.cc:515] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.047111 16990 tablet_bootstrap.cc:492] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:16.048765 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72c23005f53496890cfb11e0c19318b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:16.050726 16686 leader_election.cc:343] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.068352 17127 leader_election.cc:290] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:16.070253 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffcb1357332401a919db507af113059" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:16.074317 16687 leader_election.cc:343] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.076452 16992 tablet_bootstrap.cc:654] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.079921 17006 raft_consensus.cc:515] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:16.079655 16618 catalog_manager.cc:5697] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:16.094933 16989 tablet_bootstrap.cc:492] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:16.095444 16989 ts_tablet_manager.cc:1403] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.127s	user 0.018s	sys 0.010s
I20260709 13:21:16.097620 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffcb1357332401a919db507af113059" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:16.098206 17006 leader_election.cc:290] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:16.098384 16868 raft_consensus.cc:2468] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:16.099537 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72c23005f53496890cfb11e0c19318b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:16.100731 16991 tablet_bootstrap.cc:492] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:16.100979 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72c23005f53496890cfb11e0c19318b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:16.101301 16991 ts_tablet_manager.cc:1403] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.006s
W20260709 13:21:16.101513 16686 leader_election.cc:343] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.101600 16943 raft_consensus.cc:3060] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.110759 16943 raft_consensus.cc:2468] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:16.110836 16685 leader_election.cc:304] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:16.112076 16687 leader_election.cc:304] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:16.113251 17127 raft_consensus.cc:2804] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:16.113831 17139 raft_consensus.cc:2804] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:16.114012 17127 raft_consensus.cc:697] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:16.114326 17139 raft_consensus.cc:493] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.116022 17139 raft_consensus.cc:3060] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.115377 16618 catalog_manager.cc:5697] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:16.115507 17127 consensus_queue.cc:237] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:16.121769 16990 tablet_bootstrap.cc:654] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.125170 16793 raft_consensus.cc:3060] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.126230 16989 raft_consensus.cc:359] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:16.126978 16989 raft_consensus.cc:385] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.127259 16989 raft_consensus.cc:740] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.128075 16989 consensus_queue.cc:260] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:16.130162 16989 ts_tablet_manager.cc:1434] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.003s
I20260709 13:21:16.136276 17098 consensus_queue.cc:1048] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:16.136093 16992 tablet_bootstrap.cc:492] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:16.136550 16991 raft_consensus.cc:359] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.137264 16991 raft_consensus.cc:385] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.137398 16992 ts_tablet_manager.cc:1403] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.008s
I20260709 13:21:16.137575 16991 raft_consensus.cc:740] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.131337 16989 tablet_bootstrap.cc:492] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:16.139669 16991 consensus_queue.cc:260] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.146713 17139 raft_consensus.cc:515] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.150740 16991 ts_tablet_manager.cc:1434] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 13:21:16.151119 16992 raft_consensus.cc:359] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:16.154744 16992 raft_consensus.cc:385] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.155143 16992 raft_consensus.cc:740] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.151460 17139 leader_election.cc:290] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:16.156347 16992 consensus_queue.cc:260] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:16.157543 16991 tablet_bootstrap.cc:492] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:16.158639 16992 ts_tablet_manager.cc:1434] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:21:16.159576 16992 tablet_bootstrap.cc:492] T e70bbc621ace4406b50194cd2117bdc6 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:16.211184 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffcb1357332401a919db507af113059" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:16.212966 16868 raft_consensus.cc:3060] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.222965 16619 catalog_manager.cc:5697] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:16.234309 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffcb1357332401a919db507af113059" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:16.236063 16990 tablet_bootstrap.cc:492] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:16.237367 16990 ts_tablet_manager.cc:1403] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.190s	user 0.017s	sys 0.014s
W20260709 13:21:16.238169 16687 leader_election.cc:343] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.241740 16992 tablet_bootstrap.cc:654] T e70bbc621ace4406b50194cd2117bdc6 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.244066 16990 raft_consensus.cc:359] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.257484 16990 raft_consensus.cc:385] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.257990 16990 raft_consensus.cc:740] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.259218 16990 consensus_queue.cc:260] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.263351 16989 tablet_bootstrap.cc:654] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.264530 16990 ts_tablet_manager.cc:1434] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.002s
I20260709 13:21:16.266757 16990 tablet_bootstrap.cc:492] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:16.273769 17079 raft_consensus.cc:493] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.275923 17079 raft_consensus.cc:515] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.280895 17127 raft_consensus.cc:493] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.265334 17145 consensus_queue.cc:1048] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:21:16.269729 17052 raft_consensus.cc:493] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.296654 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70bbc621ace4406b50194cd2117bdc6" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:16.281875 17127 raft_consensus.cc:515] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:16.308699 17052 raft_consensus.cc:515] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.312116 17052 leader_election.cc:290] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:16.318102 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8089fb9d122745beabb535e51bd29d52" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:16.319898 16870 raft_consensus.cc:2393] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in this term.
I20260709 13:21:16.323668 17127 leader_election.cc:290] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
W20260709 13:21:16.329815 16909 leader_election.cc:343] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.332039 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8089fb9d122745beabb535e51bd29d52" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:16.351997 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b15c4a7a5cd4cf090073986cb42b826" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:16.352835 16908 leader_election.cc:304] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:16.354207 17052 raft_consensus.cc:3060] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.346580 17079 leader_election.cc:290] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:16.352118 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b15c4a7a5cd4cf090073986cb42b826" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:16.360953 16685 leader_election.cc:343] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:16.363544 16686 leader_election.cc:343] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.367449 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70bbc621ace4406b50194cd2117bdc6" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:16.368731 16868 raft_consensus.cc:2468] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:16.368731 16867 raft_consensus.cc:2468] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 0.
W20260709 13:21:16.370391 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 118116us
I20260709 13:21:16.371819 16908 leader_election.cc:304] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:16.373474 17126 raft_consensus.cc:2804] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:16.373953 16991 tablet_bootstrap.cc:654] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.373900 17126 raft_consensus.cc:493] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.376266 17126 raft_consensus.cc:3060] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.376915 17079 consensus_queue.cc:1048] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:16.377878 16992 tablet_bootstrap.cc:492] T e70bbc621ace4406b50194cd2117bdc6 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:16.378892 16992 ts_tablet_manager.cc:1403] T e70bbc621ace4406b50194cd2117bdc6 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.219s	user 0.014s	sys 0.009s
I20260709 13:21:16.389017 16990 tablet_bootstrap.cc:654] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.388690 16686 leader_election.cc:304] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:16.385005 16685 leader_election.cc:304] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:16.394796 17006 raft_consensus.cc:2804] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:16.396281 17075 raft_consensus.cc:2749] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:16.395524 17006 raft_consensus.cc:697] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:16.398638 17006 consensus_queue.cc:237] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.412165 17004 consensus_queue.cc:1048] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:16.417951 17004 raft_consensus.cc:493] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.418957 17004 raft_consensus.cc:515] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:16.419992 17052 raft_consensus.cc:2749] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:16.447764 17139 consensus_queue.cc:1048] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:21:16.449347 17004 leader_election.cc:290] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:16.451243 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b336bf87ee483f9aef83d5b3358fae" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:16.452917 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b336bf87ee483f9aef83d5b3358fae" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:16.451320 16989 tablet_bootstrap.cc:492] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:16.454144 16719 raft_consensus.cc:2393] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 1: Already voted for candidate 71a0b5583e0547a88c88b590549fbcee in this term.
I20260709 13:21:16.454196 16989 ts_tablet_manager.cc:1403] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.323s	user 0.012s	sys 0.012s
I20260709 13:21:16.459172 16762 leader_election.cc:304] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:16.465526 16991 tablet_bootstrap.cc:492] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:16.465199 16619 catalog_manager.cc:5697] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:16.484639 16990 tablet_bootstrap.cc:492] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:16.485210 16990 ts_tablet_manager.cc:1403] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.219s	user 0.008s	sys 0.034s
I20260709 13:21:16.488329 16990 raft_consensus.cc:359] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.489107 16990 raft_consensus.cc:385] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.455366 17126 raft_consensus.cc:515] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.490090 16989 raft_consensus.cc:359] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.490918 16989 raft_consensus.cc:385] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.491197 16989 raft_consensus.cc:740] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.491955 16989 consensus_queue.cc:260] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.494064 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70bbc621ace4406b50194cd2117bdc6" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:16.494832 16867 raft_consensus.cc:3060] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.494191 16992 raft_consensus.cc:359] T e70bbc621ace4406b50194cd2117bdc6 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.493271 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70bbc621ace4406b50194cd2117bdc6" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:16.495671 16992 raft_consensus.cc:385] T e70bbc621ace4406b50194cd2117bdc6 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.495998 16992 raft_consensus.cc:740] T e70bbc621ace4406b50194cd2117bdc6 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.496416 16795 raft_consensus.cc:3060] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.496770 16992 consensus_queue.cc:260] T e70bbc621ace4406b50194cd2117bdc6 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.498199 17126 leader_election.cc:290] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:16.498454 16793 raft_consensus.cc:3060] T e70bbc621ace4406b50194cd2117bdc6 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.500396 16989 ts_tablet_manager.cc:1434] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:21:16.503867 16990 raft_consensus.cc:740] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.504776 16990 consensus_queue.cc:260] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.506681 16991 ts_tablet_manager.cc:1403] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.352s	user 0.018s	sys 0.005s
I20260709 13:21:16.512604 16989 tablet_bootstrap.cc:492] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:16.514071 16991 raft_consensus.cc:359] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.519501 16991 raft_consensus.cc:385] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.519820 16991 raft_consensus.cc:740] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
W20260709 13:21:16.517134 16762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 58235us
I20260709 13:21:16.516350 17126 consensus_queue.cc:1048] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:21:16.532349 16991 consensus_queue.cc:260] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.538856 16992 ts_tablet_manager.cc:1434] T e70bbc621ace4406b50194cd2117bdc6 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.157s	user 0.012s	sys 0.000s
I20260709 13:21:16.542681 16992 tablet_bootstrap.cc:492] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:16.544473 17139 consensus_queue.cc:1048] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:16.539096 16991 ts_tablet_manager.cc:1434] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:21:16.548408 16991 tablet_bootstrap.cc:492] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:16.539498 16990 ts_tablet_manager.cc:1434] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 13:21:16.549933 16992 tablet_bootstrap.cc:654] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.551103 16990 tablet_bootstrap.cc:492] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:16.560949 16989 tablet_bootstrap.cc:654] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.575240 16990 tablet_bootstrap.cc:654] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.579255 17147 consensus_queue.cc:1048] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:16.563056 17139 raft_consensus.cc:493] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.591534 17139 raft_consensus.cc:515] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:16.606313 16992 tablet_bootstrap.cc:492] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:16.606840 16992 ts_tablet_manager.cc:1403] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.012s
I20260709 13:21:16.598243 17162 consensus_queue.cc:1048] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:21:16.604247 17126 raft_consensus.cc:493] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.611434 17126 raft_consensus.cc:515] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.620501 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f892041a84ff8a4b23e4cfffa762d" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:16.625094 16909 leader_election.cc:343] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.618919 17126 leader_election.cc:290] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:16.636303 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f892041a84ff8a4b23e4cfffa762d" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:16.637066 16870 raft_consensus.cc:2468] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 0.
I20260709 13:21:16.638000 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709a71f10ba41f39d6a6db62045e637" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:16.629957 17004 raft_consensus.cc:2749] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:16.640221 16687 leader_election.cc:343] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.633512 17145 raft_consensus.cc:493] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.641294 17145 raft_consensus.cc:515] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.642099 16908 leader_election.cc:304] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:16.643605 17126 raft_consensus.cc:2804] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:16.644058 17126 raft_consensus.cc:493] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.644484 17126 raft_consensus.cc:3060] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.645349 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739b8dae347b48aca06253d0a0a82369" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:16.646932 16836 leader_election.cc:343] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.647900 16991 tablet_bootstrap.cc:654] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.648591 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709a71f10ba41f39d6a6db62045e637" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:16.651597 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739b8dae347b48aca06253d0a0a82369" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:16.652451 16721 raft_consensus.cc:2468] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
W20260709 13:21:16.652720 16686 leader_election.cc:343] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.649514 16867 raft_consensus.cc:2468] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:16.653290 16686 leader_election.cc:304] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:16.654188 17075 raft_consensus.cc:2749] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:16.654428 16908 leader_election.cc:304] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:16.655495 17052 raft_consensus.cc:2804] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:16.656018 17052 raft_consensus.cc:697] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:16.657196 17052 consensus_queue.cc:237] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.662024 16836 leader_election.cc:304] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:16.650681 17145 leader_election.cc:290] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:16.663566 17149 raft_consensus.cc:2804] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:16.629886 17139 leader_election.cc:290] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:16.674423 17149 raft_consensus.cc:493] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.676887 17149 raft_consensus.cc:3060] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.695926 17147 consensus_queue.cc:1048] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:21:16.701689 17165 log.cc:927] Time spent T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:21:16.702816 17075 consensus_queue.cc:1048] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:16.714586 17163 log.cc:927] Time spent T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee: Append to log took a long time: real 0.065s	user 0.004s	sys 0.000s
I20260709 13:21:16.696949 16793 raft_consensus.cc:2468] T e70bbc621ace4406b50194cd2117bdc6 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:16.708811 17149 raft_consensus.cc:515] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.731452 16990 tablet_bootstrap.cc:492] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:16.732211 16990 ts_tablet_manager.cc:1403] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.182s	user 0.012s	sys 0.016s
I20260709 13:21:16.736881 17149 leader_election.cc:290] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:16.736896 16989 tablet_bootstrap.cc:492] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:16.737774 16989 ts_tablet_manager.cc:1403] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.226s	user 0.019s	sys 0.010s
I20260709 13:21:16.738938 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739b8dae347b48aca06253d0a0a82369" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:16.740860 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739b8dae347b48aca06253d0a0a82369" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:16.741623 16721 raft_consensus.cc:3060] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.741714 16989 raft_consensus.cc:359] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.743139 16989 raft_consensus.cc:385] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.743643 16989 raft_consensus.cc:740] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.744655 16989 consensus_queue.cc:260] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:16.746235 16836 leader_election.cc:343] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.708884 16992 raft_consensus.cc:359] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:16.754720 16992 raft_consensus.cc:385] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.755554 16992 raft_consensus.cc:740] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.756474 16992 consensus_queue.cc:260] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:16.757899 16991 tablet_bootstrap.cc:492] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:16.758507 16991 ts_tablet_manager.cc:1403] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.210s	user 0.021s	sys 0.027s
I20260709 13:21:16.758944 16992 ts_tablet_manager.cc:1434] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.152s	user 0.004s	sys 0.004s
I20260709 13:21:16.759861 16793 raft_consensus.cc:3060] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.760428 16992 tablet_bootstrap.cc:492] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:16.754664 16990 raft_consensus.cc:359] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:16.762030 16721 raft_consensus.cc:2468] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:16.765795 16836 leader_election.cc:304] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:16.767120 16991 raft_consensus.cc:359] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.767951 16991 raft_consensus.cc:385] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.768450 16991 raft_consensus.cc:740] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.767685 17147 raft_consensus.cc:2804] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:16.769162 17147 raft_consensus.cc:697] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:16.770043 17147 consensus_queue.cc:237] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.771490 16989 ts_tablet_manager.cc:1434] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:21:16.762037 16990 raft_consensus.cc:385] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.772392 16990 raft_consensus.cc:740] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.773132 16990 consensus_queue.cc:260] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:16.773710 16991 consensus_queue.cc:260] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:16.773306 16989 tablet_bootstrap.cc:492] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:16.775638 16990 ts_tablet_manager.cc:1434] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:21:16.776831 16990 tablet_bootstrap.cc:492] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:16.777499 16991 ts_tablet_manager.cc:1434] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 13:21:16.790494 17006 consensus_queue.cc:1048] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:16.790287 16618 catalog_manager.cc:5697] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:16.794516 16991 tablet_bootstrap.cc:492] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:16.779582 17126 raft_consensus.cc:515] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.814996 16989 tablet_bootstrap.cc:654] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.824437 16990 tablet_bootstrap.cc:654] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.829725 16992 tablet_bootstrap.cc:654] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.831897 16991 tablet_bootstrap.cc:654] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.832743 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f892041a84ff8a4b23e4cfffa762d" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
W20260709 13:21:16.840036 16909 leader_election.cc:343] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.838361 17126 leader_election.cc:290] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:16.841784 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f892041a84ff8a4b23e4cfffa762d" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:16.842509 16868 raft_consensus.cc:3060] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.850471 16618 catalog_manager.cc:5697] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 0 to 1, leader changed from <none> to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 1 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:16.881263 16992 tablet_bootstrap.cc:492] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:16.881886 16992 ts_tablet_manager.cc:1403] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.025s
I20260709 13:21:16.885191 16992 raft_consensus.cc:359] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.886838 16992 raft_consensus.cc:385] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.887126 16992 raft_consensus.cc:740] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.887825 16992 consensus_queue.cc:260] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.890514 16992 ts_tablet_manager.cc:1434] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:16.891902 16992 tablet_bootstrap.cc:492] T 9b15c4a7a5cd4cf090073986cb42b826 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:16.892809 17006 consensus_queue.cc:1048] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:16.895128 17162 raft_consensus.cc:493] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.895692 17162 raft_consensus.cc:515] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.899859 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f892041a84ff8a4b23e4cfffa762d" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:16.868659 16990 tablet_bootstrap.cc:492] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:16.870451 16991 tablet_bootstrap.cc:492] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:16.874027 16989 tablet_bootstrap.cc:492] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:16.900983 16990 ts_tablet_manager.cc:1403] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.125s	user 0.013s	sys 0.005s
I20260709 13:21:16.901463 16989 ts_tablet_manager.cc:1403] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.129s	user 0.015s	sys 0.000s
I20260709 13:21:16.901001 16991 ts_tablet_manager.cc:1403] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.008s
I20260709 13:21:16.904673 16989 raft_consensus.cc:359] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:16.905584 16989 raft_consensus.cc:385] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.905970 16989 raft_consensus.cc:740] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
W20260709 13:21:16.878520 16666 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:16.900075 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f892041a84ff8a4b23e4cfffa762d" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:16.907464 16943 raft_consensus.cc:2393] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 1: Already voted for candidate 266d75f35db4465788ab06782fae972d in this term.
I20260709 13:21:16.906558 16990 raft_consensus.cc:359] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.908740 16990 raft_consensus.cc:385] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.909102 16990 raft_consensus.cc:740] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.909669 16762 leader_election.cc:304] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:16.909940 16990 consensus_queue.cc:260] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.911293 17004 raft_consensus.cc:3060] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.913393 16990 ts_tablet_manager.cc:1434] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:21:16.914937 16990 tablet_bootstrap.cc:492] T 9bb16a744c5d40a1b64f60422c21e3c5 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:16.913533 16992 tablet_bootstrap.cc:654] T 9b15c4a7a5cd4cf090073986cb42b826 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.856827 16868 raft_consensus.cc:2468] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:16.907756 16991 raft_consensus.cc:359] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.907575 17162 leader_election.cc:290] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:16.919158 16908 leader_election.cc:304] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:16.918489 16991 raft_consensus.cc:385] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.920639 17079 raft_consensus.cc:2804] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:16.921335 17079 raft_consensus.cc:697] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:16.922639 17079 consensus_queue.cc:237] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.924479 17004 raft_consensus.cc:2749] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:16.906831 16989 consensus_queue.cc:260] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:16.920668 16991 raft_consensus.cc:740] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.928001 16991 consensus_queue.cc:260] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.930557 16991 ts_tablet_manager.cc:1434] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
I20260709 13:21:16.930652 16990 tablet_bootstrap.cc:654] T 9bb16a744c5d40a1b64f60422c21e3c5 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.937165 16991 tablet_bootstrap.cc:492] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:16.944077 16943 raft_consensus.cc:3060] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.953365 16992 tablet_bootstrap.cc:492] T 9b15c4a7a5cd4cf090073986cb42b826 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:16.954293 16992 ts_tablet_manager.cc:1403] T 9b15c4a7a5cd4cf090073986cb42b826 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.000s
I20260709 13:21:16.957141 16992 raft_consensus.cc:359] T 9b15c4a7a5cd4cf090073986cb42b826 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:16.957839 16992 raft_consensus.cc:385] T 9b15c4a7a5cd4cf090073986cb42b826 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.958109 16992 raft_consensus.cc:740] T 9b15c4a7a5cd4cf090073986cb42b826 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:16.960556 16992 consensus_queue.cc:260] T 9b15c4a7a5cd4cf090073986cb42b826 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:16.962809 16992 ts_tablet_manager.cc:1434] T 9b15c4a7a5cd4cf090073986cb42b826 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:16.963150 17006 consensus_queue.cc:1048] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:16.964026 16992 tablet_bootstrap.cc:492] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:16.944077 16989 ts_tablet_manager.cc:1434] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:21:16.967545 16989 tablet_bootstrap.cc:492] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:16.974140 17052 raft_consensus.cc:493] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.975068 16989 tablet_bootstrap.cc:654] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.974784 17052 raft_consensus.cc:515] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:16.976228 16991 tablet_bootstrap.cc:654] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.978091 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ec078c4d4145dbbcae1cd9fd0c251a" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:16.980329 16909 leader_election.cc:343] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:16.983070 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ec078c4d4145dbbcae1cd9fd0c251a" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:16.983804 16868 raft_consensus.cc:2468] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 0.
I20260709 13:21:16.984506 16992 tablet_bootstrap.cc:654] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:16.985282 16908 leader_election.cc:304] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:16.986292 17052 leader_election.cc:290] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:16.987136 17052 raft_consensus.cc:2804] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:16.987857 17052 raft_consensus.cc:493] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.988245 17052 raft_consensus.cc:3060] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:16.995035 16989 tablet_bootstrap.cc:492] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:16.995728 16989 ts_tablet_manager.cc:1403] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.029s	user 0.027s	sys 0.000s
I20260709 13:21:16.995191 16618 catalog_manager.cc:5697] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 0 to 1, leader changed from <none> to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 1 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:16.998594 16989 raft_consensus.cc:359] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:16.999276 16989 raft_consensus.cc:385] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:16.999595 16989 raft_consensus.cc:740] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.000255 16989 consensus_queue.cc:260] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.002923 16989 ts_tablet_manager.cc:1434] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:17.004092 16989 tablet_bootstrap.cc:492] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:17.004717 16990 tablet_bootstrap.cc:492] T 9bb16a744c5d40a1b64f60422c21e3c5 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:17.006212 17147 raft_consensus.cc:493] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.006808 17147 raft_consensus.cc:515] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.010567 16989 tablet_bootstrap.cc:654] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.010895 16992 tablet_bootstrap.cc:492] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:17.011689 16992 ts_tablet_manager.cc:1403] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.000s
I20260709 13:21:17.011744 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b15c4a7a5cd4cf090073986cb42b826" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:17.012666 16792 raft_consensus.cc:2468] T 9b15c4a7a5cd4cf090073986cb42b826 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:17.005347 16990 ts_tablet_manager.cc:1403] T 9bb16a744c5d40a1b64f60422c21e3c5 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.005s
I20260709 13:21:17.014889 16992 raft_consensus.cc:359] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.015695 16992 raft_consensus.cc:385] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.016033 16992 raft_consensus.cc:740] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.016752 16992 consensus_queue.cc:260] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.019397 16990 raft_consensus.cc:359] T 9bb16a744c5d40a1b64f60422c21e3c5 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.019651 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b15c4a7a5cd4cf090073986cb42b826" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:17.020002 16992 ts_tablet_manager.cc:1434] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:17.020296 16990 raft_consensus.cc:385] T 9bb16a744c5d40a1b64f60422c21e3c5 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.021179 16990 raft_consensus.cc:740] T 9bb16a744c5d40a1b64f60422c21e3c5 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.022236 16990 consensus_queue.cc:260] T 9bb16a744c5d40a1b64f60422c21e3c5 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.023411 16835 leader_election.cc:304] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:17.024878 17149 raft_consensus.cc:2804] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:17.025465 16990 ts_tablet_manager.cc:1434] T 9bb16a744c5d40a1b64f60422c21e3c5 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:21:17.025377 17149 raft_consensus.cc:493] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.026151 17149 raft_consensus.cc:3060] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.027253 16992 tablet_bootstrap.cc:492] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:17.029675 17147 leader_election.cc:290] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:17.030511 16990 tablet_bootstrap.cc:492] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:17.020649 16721 raft_consensus.cc:2468] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:17.044173 16991 tablet_bootstrap.cc:492] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:17.044732 16991 ts_tablet_manager.cc:1403] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.108s	user 0.008s	sys 0.009s
I20260709 13:21:17.047724 16991 raft_consensus.cc:359] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.048740 16991 raft_consensus.cc:385] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.049096 16991 raft_consensus.cc:740] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.055733 16991 consensus_queue.cc:260] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.057669 16992 tablet_bootstrap.cc:654] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.059846 16989 tablet_bootstrap.cc:492] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:17.060382 16989 ts_tablet_manager.cc:1403] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.032s
I20260709 13:21:17.060889 17126 consensus_queue.cc:1048] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:17.062455 16990 tablet_bootstrap.cc:654] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.063676 16989 raft_consensus.cc:359] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.064365 16991 ts_tablet_manager.cc:1434] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:21:17.064455 16989 raft_consensus.cc:385] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.064863 16989 raft_consensus.cc:740] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.065840 16989 consensus_queue.cc:260] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.070904 16992 tablet_bootstrap.cc:492] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:17.071727 16992 ts_tablet_manager.cc:1403] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 13:21:17.065831 16991 tablet_bootstrap.cc:492] T 739b8dae347b48aca06253d0a0a82369 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:17.077035 16989 ts_tablet_manager.cc:1434] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:21:17.078397 16989 tablet_bootstrap.cc:492] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:17.081210 16991 tablet_bootstrap.cc:654] T 739b8dae347b48aca06253d0a0a82369 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.081604 17079 consensus_queue.cc:1048] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:17.074595 16992 raft_consensus.cc:359] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.084722 16990 tablet_bootstrap.cc:492] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:17.084976 16989 tablet_bootstrap.cc:654] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.085289 16992 raft_consensus.cc:385] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.085615 16992 raft_consensus.cc:740] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.086658 16990 ts_tablet_manager.cc:1403] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.001s
I20260709 13:21:17.086284 16992 consensus_queue.cc:260] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.093139 16992 ts_tablet_manager.cc:1434] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:21:17.094305 16992 tablet_bootstrap.cc:492] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:17.095899 16990 raft_consensus.cc:359] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:17.096622 16990 raft_consensus.cc:385] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.096902 16990 raft_consensus.cc:740] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.090996 17052 raft_consensus.cc:515] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:17.102663 17052 leader_election.cc:290] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:17.103829 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ec078c4d4145dbbcae1cd9fd0c251a" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
W20260709 13:21:17.110600 16909 leader_election.cc:343] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.112313 17149 raft_consensus.cc:515] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.117519 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b15c4a7a5cd4cf090073986cb42b826" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:17.121932 16795 raft_consensus.cc:3060] T 9b15c4a7a5cd4cf090073986cb42b826 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.118391 17149 leader_election.cc:290] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:17.127224 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b15c4a7a5cd4cf090073986cb42b826" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:17.127282 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ec078c4d4145dbbcae1cd9fd0c251a" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:17.127930 16721 raft_consensus.cc:3060] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.128230 16867 raft_consensus.cc:3060] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.137552 17004 raft_consensus.cc:493] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.138118 17004 raft_consensus.cc:515] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.140342 17004 leader_election.cc:290] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:17.143309 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb16a744c5d40a1b64f60422c21e3c5" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:17.144106 16868 raft_consensus.cc:2468] T 9bb16a744c5d40a1b64f60422c21e3c5 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 0.
I20260709 13:21:17.146421 16990 consensus_queue.cc:260] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:17.146050 16760 leader_election.cc:304] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:17.148102 17004 raft_consensus.cc:2804] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:17.148480 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb16a744c5d40a1b64f60422c21e3c5" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:17.148656 17004 raft_consensus.cc:493] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.149194 16719 raft_consensus.cc:2468] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 0.
I20260709 13:21:17.149227 17004 raft_consensus.cc:3060] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.151142 16992 tablet_bootstrap.cc:654] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.152037 17079 raft_consensus.cc:493] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.152657 17079 raft_consensus.cc:515] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.157907 16990 ts_tablet_manager.cc:1434] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.071s	user 0.004s	sys 0.004s
I20260709 13:21:17.159158 16991 tablet_bootstrap.cc:492] T 739b8dae347b48aca06253d0a0a82369 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:17.159238 16990 tablet_bootstrap.cc:492] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:17.159767 16991 ts_tablet_manager.cc:1403] T 739b8dae347b48aca06253d0a0a82369 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.002s
I20260709 13:21:17.162935 16991 raft_consensus.cc:359] T 739b8dae347b48aca06253d0a0a82369 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.163727 16991 raft_consensus.cc:385] T 739b8dae347b48aca06253d0a0a82369 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.164078 16991 raft_consensus.cc:740] T 739b8dae347b48aca06253d0a0a82369 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.164863 16991 consensus_queue.cc:260] T 739b8dae347b48aca06253d0a0a82369 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.166085 16795 raft_consensus.cc:2468] T 9b15c4a7a5cd4cf090073986cb42b826 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:17.167524 16991 ts_tablet_manager.cc:1434] T 739b8dae347b48aca06253d0a0a82369 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:21:17.167559 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709a71f10ba41f39d6a6db62045e637" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:17.167812 16835 leader_election.cc:304] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:17.168546 16719 raft_consensus.cc:2468] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 0.
I20260709 13:21:17.169018 17149 raft_consensus.cc:2804] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:17.170418 16867 raft_consensus.cc:2468] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:17.170058 16910 leader_election.cc:304] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:17.175503 16721 raft_consensus.cc:2468] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:17.169665 17004 raft_consensus.cc:515] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.171188 16991 tablet_bootstrap.cc:492] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:17.183943 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb16a744c5d40a1b64f60422c21e3c5" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:17.184659 16721 raft_consensus.cc:3060] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.185223 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709a71f10ba41f39d6a6db62045e637" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:17.188589 16991 tablet_bootstrap.cc:654] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.173282 16989 tablet_bootstrap.cc:492] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:17.176215 17126 raft_consensus.cc:2804] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:17.189795 16989 ts_tablet_manager.cc:1403] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.112s	user 0.028s	sys 0.006s
I20260709 13:21:17.176914 16908 leader_election.cc:304] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:17.190763 17052 raft_consensus.cc:2804] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:17.191359 17052 raft_consensus.cc:697] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:17.192340 17052 consensus_queue.cc:237] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:17.192888 16989 raft_consensus.cc:359] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.193507 16989 raft_consensus.cc:385] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.193743 16989 raft_consensus.cc:740] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.194514 17006 raft_consensus.cc:493] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.195196 17004 leader_election.cc:290] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:17.195349 17006 raft_consensus.cc:515] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.194376 16989 consensus_queue.cc:260] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.177235 17149 raft_consensus.cc:697] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:17.179198 17079 leader_election.cc:290] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:17.180400 17162 raft_consensus.cc:493] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.196719 17162 raft_consensus.cc:515] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.197660 17006 leader_election.cc:290] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:17.198421 16989 ts_tablet_manager.cc:1434] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:17.198868 17162 leader_election.cc:290] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:17.199572 16989 tablet_bootstrap.cc:492] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:17.200974 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709a71f10ba41f39d6a6db62045e637" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:17.201624 16719 raft_consensus.cc:2468] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 0.
I20260709 13:21:17.202812 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b55efde48bb42119e9a38f9e3f2f6c6" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
W20260709 13:21:17.205646 16685 leader_election.cc:343] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.206560 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b55efde48bb42119e9a38f9e3f2f6c6" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:17.206862 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709a71f10ba41f39d6a6db62045e637" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:17.207839 16762 leader_election.cc:304] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
W20260709 13:21:17.208094 16687 leader_election.cc:343] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.208600 16687 leader_election.cc:304] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:17.209822 17139 raft_consensus.cc:2749] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:17.214654 17162 raft_consensus.cc:2804] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:17.215325 17162 raft_consensus.cc:493] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.215687 17162 raft_consensus.cc:3060] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.180225 16990 tablet_bootstrap.cc:654] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.189754 17126 raft_consensus.cc:493] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.217089 17126 raft_consensus.cc:3060] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.176396 16992 tablet_bootstrap.cc:492] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:17.221932 16992 ts_tablet_manager.cc:1403] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.000s
I20260709 13:21:17.228274 17162 raft_consensus.cc:515] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.224969 16992 raft_consensus.cc:359] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:17.229785 16992 raft_consensus.cc:385] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.230206 16992 raft_consensus.cc:740] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.232219 16992 consensus_queue.cc:260] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:17.232769 16989 tablet_bootstrap.cc:654] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.194680 16721 raft_consensus.cc:2468] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:17.238946 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709a71f10ba41f39d6a6db62045e637" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:17.241240 16992 ts_tablet_manager.cc:1434] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:21:17.239497 16795 raft_consensus.cc:2393] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 5642511b38924ffcbe38110cf27d3535 in this term.
I20260709 13:21:17.239751 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb16a744c5d40a1b64f60422c21e3c5" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:17.242517 16992 tablet_bootstrap.cc:492] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:17.241902 16762 leader_election.cc:304] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:17.244982 17004 raft_consensus.cc:2804] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:17.245501 17004 raft_consensus.cc:697] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:17.245748 16867 raft_consensus.cc:3060] T 9bb16a744c5d40a1b64f60422c21e3c5 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.246699 17004 consensus_queue.cc:237] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.249707 17149 consensus_queue.cc:237] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.243328 17126 raft_consensus.cc:515] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.257587 16943 raft_consensus.cc:2393] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 1: Already voted for candidate 266d75f35db4465788ab06782fae972d in this term.
I20260709 13:21:17.258363 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709a71f10ba41f39d6a6db62045e637" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:17.259066 16721 raft_consensus.cc:3060] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.261804 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709a71f10ba41f39d6a6db62045e637" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:17.261782 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4709a71f10ba41f39d6a6db62045e637" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:17.264421 16992 tablet_bootstrap.cc:654] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.268487 16943 raft_consensus.cc:3060] T 739b8dae347b48aca06253d0a0a82369 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.269107 16990 tablet_bootstrap.cc:492] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:17.269677 16990 ts_tablet_manager.cc:1403] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.004s
I20260709 13:21:17.270361 16792 raft_consensus.cc:2393] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 5642511b38924ffcbe38110cf27d3535 in this term.
I20260709 13:21:17.272506 16909 leader_election.cc:304] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:17.262905 17126 leader_election.cc:290] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:17.273877 17052 raft_consensus.cc:2749] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:17.255125 17162 leader_election.cc:290] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:17.272503 16990 raft_consensus.cc:359] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.282967 16990 raft_consensus.cc:385] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.283485 16990 raft_consensus.cc:740] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.284401 16990 consensus_queue.cc:260] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.279305 16867 raft_consensus.cc:2468] T 9bb16a744c5d40a1b64f60422c21e3c5 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:17.289248 16991 tablet_bootstrap.cc:492] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:17.291908 16990 ts_tablet_manager.cc:1434] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:21:17.296680 16991 ts_tablet_manager.cc:1403] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.126s	user 0.025s	sys 0.011s
I20260709 13:21:17.299819 16990 tablet_bootstrap.cc:492] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:17.306313 16991 raft_consensus.cc:359] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.311357 16989 tablet_bootstrap.cc:492] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:17.312153 16989 ts_tablet_manager.cc:1403] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.113s	user 0.017s	sys 0.000s
I20260709 13:21:17.316423 16989 raft_consensus.cc:359] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.317113 16989 raft_consensus.cc:385] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.317466 16989 raft_consensus.cc:740] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.318101 16721 raft_consensus.cc:2468] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:17.321005 17145 consensus_queue.cc:1048] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:17.321203 16762 leader_election.cc:304] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:17.322393 17004 raft_consensus.cc:2804] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:17.322861 16615 catalog_manager.cc:5697] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:17.310074 16991 raft_consensus.cc:385] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.319947 16992 tablet_bootstrap.cc:492] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:17.326954 16992 ts_tablet_manager.cc:1403] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.085s	user 0.031s	sys 0.000s
I20260709 13:21:17.322902 17004 raft_consensus.cc:697] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:17.329555 17004 consensus_queue.cc:237] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.330974 16990 tablet_bootstrap.cc:654] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.332342 17149 consensus_queue.cc:1048] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:17.331773 16992 raft_consensus.cc:359] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.332299 16991 raft_consensus.cc:740] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.334519 16992 raft_consensus.cc:385] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.335192 16992 raft_consensus.cc:740] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.335685 16991 consensus_queue.cc:260] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.340296 16991 ts_tablet_manager.cc:1434] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.003s
I20260709 13:21:17.335983 16992 consensus_queue.cc:260] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.341683 16991 tablet_bootstrap.cc:492] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:17.318147 16989 consensus_queue.cc:260] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.342959 16992 ts_tablet_manager.cc:1434] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:21:17.343956 16989 ts_tablet_manager.cc:1434] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:21:17.344415 16992 tablet_bootstrap.cc:492] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:17.345198 16989 tablet_bootstrap.cc:492] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:17.344106 16618 catalog_manager.cc:5697] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:17.356350 16992 tablet_bootstrap.cc:654] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.357643 16991 tablet_bootstrap.cc:654] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.360702 16989 tablet_bootstrap.cc:654] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.369330 16992 tablet_bootstrap.cc:492] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:17.369935 16992 ts_tablet_manager.cc:1403] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.003s
I20260709 13:21:17.373413 16992 raft_consensus.cc:359] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:17.374370 16992 raft_consensus.cc:385] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.374655 16992 raft_consensus.cc:740] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.375413 16992 consensus_queue.cc:260] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:17.377555 16992 ts_tablet_manager.cc:1434] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:17.378690 16992 tablet_bootstrap.cc:492] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:17.385674 16992 tablet_bootstrap.cc:654] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.395380 16989 tablet_bootstrap.cc:492] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:17.395890 16989 ts_tablet_manager.cc:1403] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.011s
I20260709 13:21:17.396667 17004 raft_consensus.cc:493] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.397202 17004 raft_consensus.cc:515] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:17.398787 16989 raft_consensus.cc:359] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.399437 17004 leader_election.cc:290] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:17.399587 16989 raft_consensus.cc:385] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.400100 16989 raft_consensus.cc:740] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.400851 16989 consensus_queue.cc:260] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.401213 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ec078c4d4145dbbcae1cd9fd0c251a" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:17.402138 16868 raft_consensus.cc:2393] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 1: Already voted for candidate 266d75f35db4465788ab06782fae972d in this term.
I20260709 13:21:17.402773 16992 tablet_bootstrap.cc:492] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:17.403260 16992 ts_tablet_manager.cc:1403] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.007s
I20260709 13:21:17.402159 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ec078c4d4145dbbcae1cd9fd0c251a" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:17.403575 16617 catalog_manager.cc:5697] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 0 to 1, leader changed from <none> to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 1 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:17.406072 16762 leader_election.cc:304] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:17.406783 16989 ts_tablet_manager.cc:1434] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:21:17.406834 16992 raft_consensus.cc:359] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.407703 16992 raft_consensus.cc:385] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.407998 16992 raft_consensus.cc:740] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.408174 16989 tablet_bootstrap.cc:492] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:17.408849 16992 consensus_queue.cc:260] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.409711 17004 raft_consensus.cc:3060] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.411219 16992 ts_tablet_manager.cc:1434] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:17.412541 16992 tablet_bootstrap.cc:492] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:17.415037 16989 tablet_bootstrap.cc:654] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.419636 17004 raft_consensus.cc:2749] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:17.419737 16992 tablet_bootstrap.cc:654] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.422628 16989 tablet_bootstrap.cc:492] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:17.423193 16989 ts_tablet_manager.cc:1403] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:21:17.431613 16992 tablet_bootstrap.cc:492] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:17.432221 16992 ts_tablet_manager.cc:1403] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.002s
I20260709 13:21:17.432442 16989 raft_consensus.cc:359] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.433382 16989 raft_consensus.cc:385] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.433750 16989 raft_consensus.cc:740] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.434748 16989 consensus_queue.cc:260] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.435375 16992 raft_consensus.cc:359] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.436524 16992 raft_consensus.cc:385] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.437085 16992 raft_consensus.cc:740] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.437781 16989 ts_tablet_manager.cc:1434] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:21:17.437963 16992 consensus_queue.cc:260] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.439249 16989 tablet_bootstrap.cc:492] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:17.441162 16992 ts_tablet_manager.cc:1434] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:21:17.442409 16992 tablet_bootstrap.cc:492] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:17.445542 17006 raft_consensus.cc:493] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.446147 17006 raft_consensus.cc:515] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.448383 17006 leader_election.cc:290] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:17.449126 16992 tablet_bootstrap.cc:654] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.450212 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2b3210f0d344aa8c9f961a1b72c508" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:17.450949 16792 raft_consensus.cc:2468] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:17.454298 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2b3210f0d344aa8c9f961a1b72c508" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:17.456207 16686 leader_election.cc:304] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:17.458535 17139 raft_consensus.cc:2804] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:17.459084 17139 raft_consensus.cc:493] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.459568 17139 raft_consensus.cc:3060] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:17.465129 16687 leader_election.cc:343] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.468087 16989 tablet_bootstrap.cc:654] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.495038 17126 consensus_queue.cc:1048] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:17.499924 17162 raft_consensus.cc:493] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.500679 17162 raft_consensus.cc:515] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.504947 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68bdb3e915d14f918607729afc6e38fa" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:17.506872 16762 leader_election.cc:343] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.509915 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68bdb3e915d14f918607729afc6e38fa" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:17.510356 16989 tablet_bootstrap.cc:492] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:17.511102 16989 ts_tablet_manager.cc:1403] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.072s	user 0.009s	sys 0.009s
I20260709 13:21:17.515261 16989 raft_consensus.cc:359] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.516161 16989 raft_consensus.cc:385] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.516973 16989 raft_consensus.cc:740] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.517901 17145 raft_consensus.cc:493] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.517848 16989 consensus_queue.cc:260] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.518755 17145 raft_consensus.cc:515] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.522861 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b55efde48bb42119e9a38f9e3f2f6c6" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:17.523133 17145 leader_election.cc:290] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:17.523645 16942 raft_consensus.cc:2468] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:17.524722 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b55efde48bb42119e9a38f9e3f2f6c6" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:17.525533 16719 raft_consensus.cc:2468] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:17.525904 16836 leader_election.cc:304] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:17.510933 16721 raft_consensus.cc:2468] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 0.
I20260709 13:21:17.526991 17145 raft_consensus.cc:2804] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:17.527554 17149 raft_consensus.cc:493] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.528882 17149 raft_consensus.cc:515] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:17.529619 17006 raft_consensus.cc:493] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.530439 17006 raft_consensus.cc:515] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.533598 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca3d970b5014cf8802116fd61f095e7" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:17.534143 17127 raft_consensus.cc:493] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.535213 17127 raft_consensus.cc:515] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.536444 17149 leader_election.cc:290] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:17.536928 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca3d970b5014cf8802116fd61f095e7" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:17.538551 17006 leader_election.cc:290] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
W20260709 13:21:17.538717 16836 leader_election.cc:343] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.534502 16795 raft_consensus.cc:2468] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:17.539768 16762 leader_election.cc:304] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:17.540215 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f84738cbb7483b9e127384bf8f534a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:17.540905 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f84738cbb7483b9e127384bf8f534a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:17.539271 17126 consensus_queue.cc:1048] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:17.541630 17004 raft_consensus.cc:2804] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:17.542023 17004 raft_consensus.cc:493] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.542414 17004 raft_consensus.cc:3060] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.545398 16793 raft_consensus.cc:2468] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:17.545753 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:17.546531 17127 leader_election.cc:290] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:17.547329 17127 raft_consensus.cc:493] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.547904 16835 leader_election.cc:304] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:17.548058 17127 raft_consensus.cc:515] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:17.545377 16685 leader_election.cc:343] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.551198 17147 raft_consensus.cc:2804] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:21:17.551635 16685 leader_election.cc:343] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.551774 17147 raft_consensus.cc:493] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.552663 17147 raft_consensus.cc:3060] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.561865 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316894346f24b5984dd23714341777c" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:17.561873 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316894346f24b5984dd23714341777c" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:17.564504 16685 leader_election.cc:343] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.564819 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:17.565099 16687 leader_election.cc:343] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.565774 16687 leader_election.cc:304] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:17.566525 16686 leader_election.cc:304] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:17.567734 17006 raft_consensus.cc:2749] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:17.527616 17145 raft_consensus.cc:493] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.571322 17006 raft_consensus.cc:2804] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:17.571861 17006 raft_consensus.cc:493] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.572299 17006 raft_consensus.cc:3060] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.570376 17145 raft_consensus.cc:3060] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.443941 16616 catalog_manager.cc:5697] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:17.582726 16989 ts_tablet_manager.cc:1434] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 13:21:17.569060 17162 leader_election.cc:290] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:17.568976 17127 leader_election.cc:290] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:17.480046 17139 raft_consensus.cc:515] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.605729 16989 tablet_bootstrap.cc:492] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:17.610021 17147 raft_consensus.cc:515] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:17.613029 16989 tablet_bootstrap.cc:654] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.613818 17145 raft_consensus.cc:515] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.616052 17145 leader_election.cc:290] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:17.617722 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b55efde48bb42119e9a38f9e3f2f6c6" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:17.618539 16942 raft_consensus.cc:3060] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.631933 17004 raft_consensus.cc:515] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.634212 17004 leader_election.cc:290] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:17.635952 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68bdb3e915d14f918607729afc6e38fa" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
W20260709 13:21:17.638410 16762 leader_election.cc:343] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.638875 16991 tablet_bootstrap.cc:492] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:17.639441 16991 ts_tablet_manager.cc:1403] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.298s	user 0.050s	sys 0.050s
I20260709 13:21:17.642506 16991 raft_consensus.cc:359] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.643180 16991 raft_consensus.cc:385] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.643442 16991 raft_consensus.cc:740] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.644078 16991 consensus_queue.cc:260] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.644781 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2b3210f0d344aa8c9f961a1b72c508" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:17.648804 16944 raft_consensus.cc:3060] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.651500 16992 tablet_bootstrap.cc:492] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:17.652029 16992 ts_tablet_manager.cc:1403] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.210s	user 0.047s	sys 0.050s
I20260709 13:21:17.652050 17006 raft_consensus.cc:515] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.655007 16992 raft_consensus.cc:359] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.655704 16992 raft_consensus.cc:385] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.655865 17006 leader_election.cc:290] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:17.656019 16992 raft_consensus.cc:740] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.656874 16992 consensus_queue.cc:260] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.657611 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f84738cbb7483b9e127384bf8f534a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:17.649715 17139 leader_election.cc:290] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:17.655797 16990 tablet_bootstrap.cc:492] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:17.660928 16991 ts_tablet_manager.cc:1434] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:21:17.661047 16990 ts_tablet_manager.cc:1403] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.362s	user 0.055s	sys 0.071s
I20260709 13:21:17.647218 17217 raft_consensus.cc:493] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.662614 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b55efde48bb42119e9a38f9e3f2f6c6" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:17.662930 17217 raft_consensus.cc:515] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.664053 16991 tablet_bootstrap.cc:492] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:17.666916 16990 raft_consensus.cc:359] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
W20260709 13:21:17.662614 16685 leader_election.cc:343] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:17.671265 16686 leader_election.cc:343] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.671631 16942 raft_consensus.cc:2468] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:17.663303 16719 raft_consensus.cc:3060] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.667652 16990 raft_consensus.cc:385] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.671826 16686 leader_election.cc:304] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:17.673030 16990 raft_consensus.cc:740] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.672819 16991 tablet_bootstrap.cc:654] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.673974 16990 consensus_queue.cc:260] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.674819 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ba89448ab04e64b769557c2830641f" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:17.673255 16992 ts_tablet_manager.cc:1434] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 13:21:17.665266 17217 leader_election.cc:290] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:17.678699 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca3d970b5014cf8802116fd61f095e7" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
W20260709 13:21:17.679340 16687 leader_election.cc:343] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.679395 16793 raft_consensus.cc:3060] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.683676 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2b3210f0d344aa8c9f961a1b72c508" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:17.684401 16795 raft_consensus.cc:3060] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.684607 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f84738cbb7483b9e127384bf8f534a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:17.685283 16796 raft_consensus.cc:3060] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.686137 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68bdb3e915d14f918607729afc6e38fa" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:17.686797 16720 raft_consensus.cc:3060] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.690280 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ba89448ab04e64b769557c2830641f" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:17.696385 16990 ts_tablet_manager.cc:1434] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:21:17.702404 16990 tablet_bootstrap.cc:492] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:17.704401 16796 raft_consensus.cc:2468] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:17.705050 17006 raft_consensus.cc:493] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.705631 17006 raft_consensus.cc:515] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
W20260709 13:21:17.707366 16686 leader_election.cc:343] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.707856 16686 leader_election.cc:304] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:17.708168 17217 raft_consensus.cc:2749] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:17.708685 17127 raft_consensus.cc:2749] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:17.709331 16719 raft_consensus.cc:2468] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:17.711244 16836 leader_election.cc:304] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:17.719822 16992 tablet_bootstrap.cc:492] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:17.714170 17004 consensus_queue.cc:1048] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:21:17.725117 17006 leader_election.cc:290] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:17.722208 17147 leader_election.cc:290] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:17.731786 16795 raft_consensus.cc:2468] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:17.731988 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a5428f572c4214b4ecd02231d81bd7" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:17.733072 17079 consensus_queue.cc:1048] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:17.733393 16793 raft_consensus.cc:2468] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:17.736965 16835 leader_election.cc:304] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:17.737866 17145 raft_consensus.cc:2804] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:17.738560 17145 raft_consensus.cc:697] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:17.739454 17145 consensus_queue.cc:237] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:17.741521 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a5428f572c4214b4ecd02231d81bd7" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:17.742092 16720 raft_consensus.cc:2468] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
W20260709 13:21:17.743031 16685 leader_election.cc:343] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.737814 16944 raft_consensus.cc:2468] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:17.743857 16762 leader_election.cc:304] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:17.744994 16687 leader_election.cc:304] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:17.745999 17157 raft_consensus.cc:2804] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:17.746537 17157 raft_consensus.cc:697] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:17.720295 17216 raft_consensus.cc:2804] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:17.747553 16991 tablet_bootstrap.cc:492] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:17.747356 17157 consensus_queue.cc:237] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.748059 16991 ts_tablet_manager.cc:1403] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.006s
I20260709 13:21:17.747578 17139 raft_consensus.cc:2804] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:17.749994 17139 raft_consensus.cc:697] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:17.750818 17139 consensus_queue.cc:237] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:17.755511 16686 leader_election.cc:304] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:17.757247 17217 raft_consensus.cc:2804] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:17.758016 17217 raft_consensus.cc:697] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:17.747576 17216 raft_consensus.cc:697] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:17.758958 17217 consensus_queue.cc:237] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
W20260709 13:21:17.759398 16686 leader_election.cc:343] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.759545 17216 consensus_queue.cc:237] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.761276 16686 leader_election.cc:304] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:17.766641 17127 raft_consensus.cc:2749] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:17.769080 17192 consensus_queue.cc:1048] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:17.784655 16989 tablet_bootstrap.cc:492] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:17.785260 16989 ts_tablet_manager.cc:1403] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.188s	user 0.017s	sys 0.037s
I20260709 13:21:17.786532 17004 consensus_queue.cc:1048] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:17.788446 16989 raft_consensus.cc:359] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.789216 16989 raft_consensus.cc:385] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.789636 16989 raft_consensus.cc:740] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.790552 16989 consensus_queue.cc:260] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.795482 16989 ts_tablet_manager.cc:1434] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:21:17.796710 16989 tablet_bootstrap.cc:492] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:17.757266 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca3d970b5014cf8802116fd61f095e7" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:17.800134 17222 consensus_queue.cc:1048] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:17.800427 16836 leader_election.cc:343] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:17.788916 16991 raft_consensus.cc:359] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.806206 16991 raft_consensus.cc:385] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.806567 16991 raft_consensus.cc:740] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.813902 17004 consensus_queue.cc:1048] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:17.819319 16990 tablet_bootstrap.cc:654] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.828845 16991 consensus_queue.cc:260] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:17.832047 16990 tablet_bootstrap.cc:492] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:17.832578 16990 ts_tablet_manager.cc:1403] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.130s	user 0.011s	sys 0.003s
W20260709 13:21:17.842743 17227 log.cc:927] Time spent T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:21:17.847800 16616 catalog_manager.cc:5697] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:17.856254 17145 consensus_queue.cc:1048] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:21:17.863991 16991 ts_tablet_manager.cc:1434] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.116s	user 0.009s	sys 0.000s
I20260709 13:21:17.866689 16617 catalog_manager.cc:5697] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:17.867919 16991 tablet_bootstrap.cc:492] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:17.874477 16992 tablet_bootstrap.cc:654] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.877615 17157 consensus_queue.cc:1048] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:17.881224 16989 tablet_bootstrap.cc:654] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.887785 16990 raft_consensus.cc:359] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.888955 16990 raft_consensus.cc:385] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.896806 16991 tablet_bootstrap.cc:654] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.913544 16990 raft_consensus.cc:740] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.914603 16990 consensus_queue.cc:260] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:17.917091 16990 ts_tablet_manager.cc:1434] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.084s	user 0.003s	sys 0.003s
I20260709 13:21:17.918540 16990 tablet_bootstrap.cc:492] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:17.930625 16990 tablet_bootstrap.cc:654] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.934979 16991 tablet_bootstrap.cc:492] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:17.935583 16991 ts_tablet_manager.cc:1403] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.000s
I20260709 13:21:17.940590 16991 raft_consensus.cc:359] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:17.943141 16991 raft_consensus.cc:385] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.943735 16991 raft_consensus.cc:740] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.956153 16991 consensus_queue.cc:260] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:17.965166 16615 catalog_manager.cc:5697] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:17.980394 16991 ts_tablet_manager.cc:1434] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.044s	user 0.011s	sys 0.000s
I20260709 13:21:17.982060 16991 tablet_bootstrap.cc:492] T 68bdb3e915d14f918607729afc6e38fa P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:17.971745 16615 catalog_manager.cc:5697] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.001235 16992 tablet_bootstrap.cc:492] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:18.001906 16992 ts_tablet_manager.cc:1403] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.284s	user 0.025s	sys 0.017s
W20260709 13:21:17.998718 16760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:46515, user_credentials={real_user=slave}} blocked reactor thread for 56196.3us
I20260709 13:21:18.006943 16990 tablet_bootstrap.cc:492] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:18.007490 16990 ts_tablet_manager.cc:1403] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.089s	user 0.018s	sys 0.010s
I20260709 13:21:18.016690 16990 raft_consensus.cc:359] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:17.990829 16762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 67278.1us
I20260709 13:21:18.017882 16990 raft_consensus.cc:385] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.022670 16990 raft_consensus.cc:740] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.023517 16990 consensus_queue.cc:260] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:18.024322 17222 raft_consensus.cc:493] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.025033 17222 raft_consensus.cc:515] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.026825 16990 ts_tablet_manager.cc:1434] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:21:18.027967 17222 leader_election.cc:290] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:18.028582 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f84738cbb7483b9e127384bf8f534a" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:18.032207 16992 raft_consensus.cc:359] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.033385 16992 raft_consensus.cc:385] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.033787 16992 raft_consensus.cc:740] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.034793 16990 tablet_bootstrap.cc:492] T e27c0b3cbad94ad791a54143f2d5af0b P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:18.041581 16990 tablet_bootstrap.cc:654] T e27c0b3cbad94ad791a54143f2d5af0b P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.046581 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f84738cbb7483b9e127384bf8f534a" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:18.047825 16792 raft_consensus.cc:2393] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a0b5583e0547a88c88b590549fbcee in current term 1: Already voted for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in this term.
I20260709 13:21:18.050179 16835 leader_election.cc:304] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:18.034783 16992 consensus_queue.cc:260] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.059459 17222 raft_consensus.cc:3060] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.067721 16991 tablet_bootstrap.cc:654] T 68bdb3e915d14f918607729afc6e38fa P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.052686 16616 catalog_manager.cc:5697] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.085033 16992 ts_tablet_manager.cc:1434] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.083s	user 0.010s	sys 0.000s
I20260709 13:21:18.086319 16992 tablet_bootstrap.cc:492] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:18.082726 17006 raft_consensus.cc:493] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.087126 17006 raft_consensus.cc:515] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:18.092410 16990 tablet_bootstrap.cc:492] T e27c0b3cbad94ad791a54143f2d5af0b P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:18.092952 16990 ts_tablet_manager.cc:1403] T e27c0b3cbad94ad791a54143f2d5af0b P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.011s
I20260709 13:21:18.093255 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b267a6d4ca4f87829b245ef87bd6e3" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:18.094235 16870 raft_consensus.cc:2468] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:18.095785 16990 raft_consensus.cc:359] T e27c0b3cbad94ad791a54143f2d5af0b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.096709 16990 raft_consensus.cc:385] T e27c0b3cbad94ad791a54143f2d5af0b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.096503 16685 leader_election.cc:304] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:18.098060 17217 raft_consensus.cc:2804] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.098588 17217 raft_consensus.cc:493] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.099013 17217 raft_consensus.cc:3060] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.097333 16990 raft_consensus.cc:740] T e27c0b3cbad94ad791a54143f2d5af0b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.100292 16990 consensus_queue.cc:260] T e27c0b3cbad94ad791a54143f2d5af0b P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.101851 16992 tablet_bootstrap.cc:654] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.106292 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b267a6d4ca4f87829b245ef87bd6e3" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:18.107544 16990 ts_tablet_manager.cc:1434] T e27c0b3cbad94ad791a54143f2d5af0b P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
W20260709 13:21:18.108024 16687 leader_election.cc:343] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.108841 16990 tablet_bootstrap.cc:492] T 5316894346f24b5984dd23714341777c P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:18.108790 17006 leader_election.cc:290] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:18.116889 16990 tablet_bootstrap.cc:654] T 5316894346f24b5984dd23714341777c P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.126631 17147 raft_consensus.cc:493] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.127476 17147 raft_consensus.cc:515] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.137234 17147 leader_election.cc:290] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:18.141978 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:18.149878 16719 raft_consensus.cc:2468] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:18.153746 17247 raft_consensus.cc:493] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.154310 17247 raft_consensus.cc:515] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.156991 17247 leader_election.cc:290] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:18.158279 16836 leader_election.cc:304] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:18.160620 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:18.160967 17216 raft_consensus.cc:2804] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.162184 17216 raft_consensus.cc:493] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.162667 17216 raft_consensus.cc:3060] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.171141 17247 raft_consensus.cc:493] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.171761 17247 raft_consensus.cc:515] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.173688 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:18.174358 17247 leader_election.cc:290] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:18.174583 16792 raft_consensus.cc:2468] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:18.177618 16992 tablet_bootstrap.cc:492] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:18.178169 16992 ts_tablet_manager.cc:1403] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.092s	user 0.017s	sys 0.008s
I20260709 13:21:18.180979 16992 raft_consensus.cc:359] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.181717 16992 raft_consensus.cc:385] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.182008 16992 raft_consensus.cc:740] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.181999 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2aa3a038f049ccadf4405e476cd972" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:18.183053 16992 consensus_queue.cc:260] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.185321 16992 ts_tablet_manager.cc:1434] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:18.185742 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:18.186375 16992 tablet_bootstrap.cc:492] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:18.186478 16719 raft_consensus.cc:2468] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 0.
W20260709 13:21:18.187549 16760 leader_election.cc:343] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.193471 16992 tablet_bootstrap.cc:654] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.199297 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2aa3a038f049ccadf4405e476cd972" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:18.143669 17222 raft_consensus.cc:2749] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.209342 17139 consensus_queue.cc:1048] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.210263 16989 tablet_bootstrap.cc:492] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:18.210812 16989 ts_tablet_manager.cc:1403] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.414s	user 0.045s	sys 0.028s
I20260709 13:21:18.213606 16989 raft_consensus.cc:359] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.214339 16989 raft_consensus.cc:385] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.214624 16989 raft_consensus.cc:740] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.215288 16989 consensus_queue.cc:260] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.217877 16989 ts_tablet_manager.cc:1434] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:21:18.219070 16989 tablet_bootstrap.cc:492] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:18.219408 16991 tablet_bootstrap.cc:492] T 68bdb3e915d14f918607729afc6e38fa P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:18.220031 16991 ts_tablet_manager.cc:1403] T 68bdb3e915d14f918607729afc6e38fa P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.238s	user 0.060s	sys 0.053s
I20260709 13:21:18.204715 17217 raft_consensus.cc:515] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:18.223346 16991 raft_consensus.cc:359] T 68bdb3e915d14f918607729afc6e38fa P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.224187 16991 raft_consensus.cc:385] T 68bdb3e915d14f918607729afc6e38fa P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.224577 16991 raft_consensus.cc:740] T 68bdb3e915d14f918607729afc6e38fa P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.225643 17145 consensus_queue.cc:1048] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:18.229794 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b267a6d4ca4f87829b245ef87bd6e3" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:18.231658 16869 raft_consensus.cc:3060] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:18.232527 16762 leader_election.cc:343] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.233062 16762 leader_election.cc:304] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:18.225724 16991 consensus_queue.cc:260] T 68bdb3e915d14f918607729afc6e38fa P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.226935 16990 tablet_bootstrap.cc:492] T 5316894346f24b5984dd23714341777c P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:18.229326 16992 tablet_bootstrap.cc:492] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:18.233886 17247 raft_consensus.cc:2749] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.234035 16990 ts_tablet_manager.cc:1403] T 5316894346f24b5984dd23714341777c P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.125s	user 0.034s	sys 0.030s
I20260709 13:21:18.234117 16992 ts_tablet_manager.cc:1403] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.002s
I20260709 13:21:18.237201 16762 leader_election.cc:304] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:18.237308 16990 raft_consensus.cc:359] T 5316894346f24b5984dd23714341777c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:18.238086 17247 raft_consensus.cc:2804] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.238543 17247 raft_consensus.cc:493] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.238951 17247 raft_consensus.cc:3060] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.239280 16992 raft_consensus.cc:359] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.239933 16991 ts_tablet_manager.cc:1434] T 68bdb3e915d14f918607729afc6e38fa P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:21:18.240023 16992 raft_consensus.cc:385] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.240471 16992 raft_consensus.cc:740] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.241245 16991 tablet_bootstrap.cc:492] T 59ba89448ab04e64b769557c2830641f P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:18.241202 16992 consensus_queue.cc:260] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.238111 16990 raft_consensus.cc:385] T 5316894346f24b5984dd23714341777c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.242357 16990 raft_consensus.cc:740] T 5316894346f24b5984dd23714341777c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.243394 16992 ts_tablet_manager.cc:1434] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:21:18.243050 16990 consensus_queue.cc:260] T 5316894346f24b5984dd23714341777c P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:18.230417 16666 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:18.245330 16990 ts_tablet_manager.cc:1434] T 5316894346f24b5984dd23714341777c P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:21:18.246379 16990 tablet_bootstrap.cc:492] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:18.249732 16991 tablet_bootstrap.cc:654] T 59ba89448ab04e64b769557c2830641f P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.251134 17217 leader_election.cc:290] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:18.252213 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b267a6d4ca4f87829b245ef87bd6e3" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:18.230628 16989 tablet_bootstrap.cc:654] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:18.254972 16687 leader_election.cc:343] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.253360 16869 raft_consensus.cc:2468] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:18.224526 17216 raft_consensus.cc:515] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.259168 16870 raft_consensus.cc:2393] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 1: Already voted for candidate 71a0b5583e0547a88c88b590549fbcee in this term.
I20260709 13:21:18.262877 16685 leader_election.cc:304] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:18.265287 17006 raft_consensus.cc:2804] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.265889 17006 raft_consensus.cc:697] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:18.266774 17006 consensus_queue.cc:237] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:18.269223 17216 leader_election.cc:290] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:18.273257 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:18.274014 16721 raft_consensus.cc:3060] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.275635 16942 raft_consensus.cc:3060] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.278884 17139 consensus_queue.cc:1048] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:18.282636 16943 raft_consensus.cc:3060] T 68bdb3e915d14f918607729afc6e38fa P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.289280 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:18.284799 16721 raft_consensus.cc:2468] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:18.303563 17079 raft_consensus.cc:493] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.304215 17079 raft_consensus.cc:515] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:18.307850 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316894346f24b5984dd23714341777c" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:18.308122 17079 leader_election.cc:290] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:18.308696 16719 raft_consensus.cc:2468] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 0.
I20260709 13:21:18.309403 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316894346f24b5984dd23714341777c" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:18.309950 16910 leader_election.cc:304] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:18.310146 16870 raft_consensus.cc:2468] T 5316894346f24b5984dd23714341777c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 0.
I20260709 13:21:18.310917 17079 raft_consensus.cc:2804] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.311389 17079 raft_consensus.cc:493] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.311794 17079 raft_consensus.cc:3060] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.315088 16992 tablet_bootstrap.cc:492] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:18.322295 17079 raft_consensus.cc:515] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:18.330593 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316894346f24b5984dd23714341777c" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:18.331418 16719 raft_consensus.cc:3060] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.335000 17246 consensus_queue.cc:1048] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.340298 16989 tablet_bootstrap.cc:492] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:18.340891 16989 ts_tablet_manager.cc:1403] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.122s	user 0.010s	sys 0.000s
I20260709 13:21:18.342288 17217 consensus_queue.cc:1048] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.342778 16719 raft_consensus.cc:2468] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:18.344944 16910 leader_election.cc:304] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:18.346124 17192 raft_consensus.cc:2804] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.346860 17192 raft_consensus.cc:697] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:18.347941 17192 consensus_queue.cc:237] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:18.348434 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316894346f24b5984dd23714341777c" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:18.349350 16870 raft_consensus.cc:3060] T 5316894346f24b5984dd23714341777c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.350251 17246 consensus_queue.cc:1048] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.356236 17139 consensus_queue.cc:1048] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:18.343540 17079 leader_election.cc:290] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:18.349056 16836 leader_election.cc:304] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:18.366470 17145 raft_consensus.cc:2804] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.371518 17145 raft_consensus.cc:697] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:18.372480 17145 consensus_queue.cc:237] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.299547 17247 raft_consensus.cc:515] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.375186 17079 raft_consensus.cc:493] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.375365 16795 raft_consensus.cc:2393] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a0b5583e0547a88c88b590549fbcee in current term 1: Already voted for candidate 5642511b38924ffcbe38110cf27d3535 in this term.
I20260709 13:21:18.375818 17079 raft_consensus.cc:515] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.376051 16615 catalog_manager.cc:5697] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:18.381012 17079 leader_election.cc:290] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:18.382011 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca3d970b5014cf8802116fd61f095e7" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:18.382191 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca3d970b5014cf8802116fd61f095e7" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:18.382835 16792 raft_consensus.cc:2468] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:18.384117 16909 leader_election.cc:304] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:18.385080 17079 raft_consensus.cc:2804] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:18.384842 16989 raft_consensus.cc:359] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:18.385540 17079 raft_consensus.cc:493] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.385766 16989 raft_consensus.cc:385] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.385954 17079 raft_consensus.cc:3060] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:18.386219 16989 raft_consensus.cc:740] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.387197 16989 consensus_queue.cc:260] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:18.391993 17222 consensus_queue.cc:1048] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:18.392920 16991 tablet_bootstrap.cc:492] T 59ba89448ab04e64b769557c2830641f P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:18.346895 16990 tablet_bootstrap.cc:654] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.393886 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:18.394162 17216 consensus_queue.cc:1048] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:18.388811 16616 catalog_manager.cc:5697] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 0 to 1, leader changed from <none> to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 1 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.402667 16991 ts_tablet_manager.cc:1403] T 59ba89448ab04e64b769557c2830641f P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.162s	user 0.026s	sys 0.033s
I20260709 13:21:18.321274 16992 tablet_bootstrap.cc:654] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.413086 16721 raft_consensus.cc:2393] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 1: Already voted for candidate 71a0b5583e0547a88c88b590549fbcee in this term.
I20260709 13:21:18.394707 17079 raft_consensus.cc:515] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.402395 17247 leader_election.cc:290] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:18.431922 16989 ts_tablet_manager.cc:1434] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.091s	user 0.004s	sys 0.005s
I20260709 13:21:18.442966 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca3d970b5014cf8802116fd61f095e7" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:18.447638 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca3d970b5014cf8802116fd61f095e7" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:18.448331 16792 raft_consensus.cc:3060] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:18.451529 17247 raft_consensus.cc:493] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.452308 17247 raft_consensus.cc:515] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.455160 17247 leader_election.cc:290] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:18.459813 16870 raft_consensus.cc:2468] T 5316894346f24b5984dd23714341777c P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:18.460575 16943 raft_consensus.cc:1240] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Rejecting Update request from peer 71a0b5583e0547a88c88b590549fbcee for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:21:18.464138 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:18.466172 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27c0b3cbad94ad791a54143f2d5af0b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:18.467044 16867 raft_consensus.cc:2468] T e27c0b3cbad94ad791a54143f2d5af0b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 0.
I20260709 13:21:18.433710 17079 leader_election.cc:290] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:18.469843 16760 leader_election.cc:304] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:18.470224 17145 consensus_queue.cc:1059] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.471696 17243 raft_consensus.cc:2804] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.472252 17243 raft_consensus.cc:493] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.472677 17243 raft_consensus.cc:3060] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.477463 17222 raft_consensus.cc:3055] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:18.477938 17222 raft_consensus.cc:740] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:18.478708 17222 consensus_queue.cc:260] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.461971 16989 tablet_bootstrap.cc:492] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:18.509898 16618 catalog_manager.cc:5697] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:18.513569 16910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 46106.7us
I20260709 13:21:18.535928 17222 raft_consensus.cc:3060] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:18.539379 17243 raft_consensus.cc:515] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.547408 16992 tablet_bootstrap.cc:492] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:18.548210 16992 ts_tablet_manager.cc:1403] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.233s	user 0.015s	sys 0.006s
I20260709 13:21:18.547375 17243 leader_election.cc:290] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:18.551579 16990 tablet_bootstrap.cc:492] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:18.551975 16992 raft_consensus.cc:359] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.556908 16990 ts_tablet_manager.cc:1403] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.311s	user 0.051s	sys 0.049s
I20260709 13:21:18.556974 16992 raft_consensus.cc:385] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.554641 16991 raft_consensus.cc:359] T 59ba89448ab04e64b769557c2830641f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.554406 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27c0b3cbad94ad791a54143f2d5af0b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:18.558612 16867 raft_consensus.cc:3060] T e27c0b3cbad94ad791a54143f2d5af0b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.557906 16992 raft_consensus.cc:740] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.560442 16992 consensus_queue.cc:260] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.561718 16762 leader_election.cc:304] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:18.558681 16989 tablet_bootstrap.cc:654] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.565071 17245 raft_consensus.cc:2749] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.566888 16992 ts_tablet_manager.cc:1434] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.005s
I20260709 13:21:18.558089 16991 raft_consensus.cc:385] T 59ba89448ab04e64b769557c2830641f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.572098 16992 tablet_bootstrap.cc:492] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:18.579357 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27c0b3cbad94ad791a54143f2d5af0b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:18.583766 17247 raft_consensus.cc:493] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.584343 17247 raft_consensus.cc:515] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.586666 17247 leader_election.cc:290] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:18.571431 16991 raft_consensus.cc:740] T 59ba89448ab04e64b769557c2830641f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.590372 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ba89448ab04e64b769557c2830641f" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:18.578008 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27c0b3cbad94ad791a54143f2d5af0b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:18.592155 16991 consensus_queue.cc:260] T 59ba89448ab04e64b769557c2830641f P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.594056 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ba89448ab04e64b769557c2830641f" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:18.594604 16991 ts_tablet_manager.cc:1434] T 59ba89448ab04e64b769557c2830641f P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.191s	user 0.005s	sys 0.003s
I20260709 13:21:18.594741 16720 raft_consensus.cc:2468] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 0.
I20260709 13:21:18.595850 16991 tablet_bootstrap.cc:492] T 1a2aa3a038f049ccadf4405e476cd972 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:18.598320 16992 tablet_bootstrap.cc:654] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.570128 16867 raft_consensus.cc:2468] T e27c0b3cbad94ad791a54143f2d5af0b P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:18.602641 16760 leader_election.cc:304] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:18.604029 17247 raft_consensus.cc:2804] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.604529 17247 raft_consensus.cc:697] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:18.572299 16990 raft_consensus.cc:359] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.605325 16990 raft_consensus.cc:385] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.605965 16990 raft_consensus.cc:740] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.607515 16990 consensus_queue.cc:260] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.605484 17247 consensus_queue.cc:237] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.613767 16992 tablet_bootstrap.cc:492] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:18.614351 16992 ts_tablet_manager.cc:1403] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.005s
I20260709 13:21:18.577986 16792 raft_consensus.cc:2468] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 2.
I20260709 13:21:18.617033 16796 raft_consensus.cc:1240] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Rejecting Update request from peer 71a0b5583e0547a88c88b590549fbcee for earlier term 1. Current term is 2. Ops: []
W20260709 13:21:18.617625 16762 leader_election.cc:343] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.617111 16992 raft_consensus.cc:359] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.621646 16992 raft_consensus.cc:385] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.617403 16944 raft_consensus.cc:2468] T 59ba89448ab04e64b769557c2830641f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 0.
I20260709 13:21:18.621946 16992 raft_consensus.cc:740] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.622778 16909 leader_election.cc:304] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:18.622747 16992 consensus_queue.cc:260] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
W20260709 13:21:18.623301 16762 leader_election.cc:343] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.624393 17079 raft_consensus.cc:2804] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:18.625196 17079 raft_consensus.cc:697] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:18.625478 16992 ts_tablet_manager.cc:1434] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:21:18.626664 16992 tablet_bootstrap.cc:492] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:18.626188 17079 consensus_queue.cc:237] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.627316 16762 leader_election.cc:304] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:18.635653 17245 raft_consensus.cc:2804] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.636130 17245 raft_consensus.cc:493] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.636466 17245 raft_consensus.cc:3060] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.638859 16990 ts_tablet_manager.cc:1434] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.003s
I20260709 13:21:18.640098 16990 tablet_bootstrap.cc:492] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:18.642457 16992 tablet_bootstrap.cc:654] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.644236 17245 raft_consensus.cc:515] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.646458 17245 leader_election.cc:290] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:18.649760 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ba89448ab04e64b769557c2830641f" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:18.651599 16615 catalog_manager.cc:5697] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.657192 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ba89448ab04e64b769557c2830641f" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:18.657860 16719 raft_consensus.cc:3060] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.658551 17247 raft_consensus.cc:493] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.659111 17247 raft_consensus.cc:515] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.661679 16992 tablet_bootstrap.cc:492] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:18.662379 16992 ts_tablet_manager.cc:1403] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.001s
I20260709 13:21:18.662544 16989 tablet_bootstrap.cc:492] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:18.663019 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a5428f572c4214b4ecd02231d81bd7" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:18.663208 16989 ts_tablet_manager.cc:1403] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.201s	user 0.023s	sys 0.046s
I20260709 13:21:18.663800 16720 raft_consensus.cc:2468] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 0.
I20260709 13:21:18.665361 16992 raft_consensus.cc:359] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.669657 16992 raft_consensus.cc:385] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.668651 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a5428f572c4214b4ecd02231d81bd7" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:18.670132 16992 raft_consensus.cc:740] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.670634 16762 leader_election.cc:304] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:18.668761 17247 leader_election.cc:290] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:18.671082 16992 consensus_queue.cc:260] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
W20260709 13:21:18.671689 16760 leader_election.cc:343] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.668804 16991 tablet_bootstrap.cc:654] T 1a2aa3a038f049ccadf4405e476cd972 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.667285 16989 raft_consensus.cc:359] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.672924 16989 raft_consensus.cc:385] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.673671 16992 ts_tablet_manager.cc:1434] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:21:18.674789 16992 tablet_bootstrap.cc:492] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:18.669672 16618 catalog_manager.cc:5697] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 1 to 2, leader changed from 71a0b5583e0547a88c88b590549fbcee (127.6.214.131) to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 2 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:18.679725 17247 raft_consensus.cc:2804] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.680245 17247 raft_consensus.cc:493] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.680620 17247 raft_consensus.cc:3060] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.684119 16990 tablet_bootstrap.cc:654] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.673184 16989 raft_consensus.cc:740] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.686410 16989 consensus_queue.cc:260] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.691197 16992 tablet_bootstrap.cc:654] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.695577 17006 raft_consensus.cc:493] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.696333 17006 raft_consensus.cc:515] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:18.699775 16992 tablet_bootstrap.cc:492] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:18.700264 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:18.702036 17217 raft_consensus.cc:493] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.702812 17217 raft_consensus.cc:515] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
W20260709 13:21:18.706333 16685 leader_election.cc:343] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.708449 17006 leader_election.cc:290] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:18.709167 17217 leader_election.cc:290] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:18.709604 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:18.708194 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad644a4c46b4ba9b4845f75d943c516" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:18.712406 16687 leader_election.cc:343] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.712917 16687 leader_election.cc:304] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:18.713892 16989 ts_tablet_manager.cc:1434] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.003s
W20260709 13:21:18.714124 16687 leader_election.cc:343] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.715044 16989 tablet_bootstrap.cc:492] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:18.716408 16719 raft_consensus.cc:2468] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:18.717541 17217 raft_consensus.cc:2749] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.712410 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad644a4c46b4ba9b4845f75d943c516" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:18.718577 16762 leader_election.cc:304] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:18.719161 16792 raft_consensus.cc:2468] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:18.719398 17245 raft_consensus.cc:2804] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.719997 17245 raft_consensus.cc:697] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:18.719812 17247 raft_consensus.cc:515] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.721144 17245 consensus_queue.cc:237] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.723243 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a5428f572c4214b4ecd02231d81bd7" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
W20260709 13:21:18.724772 16760 leader_election.cc:343] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.700331 16992 ts_tablet_manager.cc:1403] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:21:18.725762 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a5428f572c4214b4ecd02231d81bd7" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:18.726670 16720 raft_consensus.cc:3060] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.728288 16992 raft_consensus.cc:359] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.728969 16992 raft_consensus.cc:385] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.729254 16992 raft_consensus.cc:740] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.729947 16992 consensus_queue.cc:260] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.731550 16686 leader_election.cc:304] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:18.732529 17217 raft_consensus.cc:2804] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.732903 17217 raft_consensus.cc:493] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.733223 17217 raft_consensus.cc:3060] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.736243 17247 leader_election.cc:290] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:18.737805 16989 tablet_bootstrap.cc:654] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.738543 16720 raft_consensus.cc:2468] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:18.739346 16992 ts_tablet_manager.cc:1434] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:21:18.739744 16762 leader_election.cc:304] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:18.741000 17245 raft_consensus.cc:2804] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.741626 17245 raft_consensus.cc:697] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:18.742542 17245 consensus_queue.cc:237] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.744148 17006 consensus_queue.cc:1048] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.760365 16990 tablet_bootstrap.cc:492] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:18.740538 16992 tablet_bootstrap.cc:492] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:18.761044 16990 ts_tablet_manager.cc:1403] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.121s	user 0.020s	sys 0.027s
I20260709 13:21:18.760013 16615 catalog_manager.cc:5697] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:18.750960 17217 raft_consensus.cc:515] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.763923 16990 raft_consensus.cc:359] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.766824 16990 raft_consensus.cc:385] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.767261 16990 raft_consensus.cc:740] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.767442 16991 tablet_bootstrap.cc:492] T 1a2aa3a038f049ccadf4405e476cd972 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:18.767999 16991 ts_tablet_manager.cc:1403] T 1a2aa3a038f049ccadf4405e476cd972 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.172s	user 0.022s	sys 0.022s
W20260709 13:21:18.776144 16687 consensus_peers.cc:597] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 -> Peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Couldn't send request to peer 266d75f35db4465788ab06782fae972d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:18.776757 16992 tablet_bootstrap.cc:654] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.767931 16990 consensus_queue.cc:260] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.782056 16990 ts_tablet_manager.cc:1434] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 13:21:18.782495 16991 raft_consensus.cc:359] T 1a2aa3a038f049ccadf4405e476cd972 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.783217 16991 raft_consensus.cc:385] T 1a2aa3a038f049ccadf4405e476cd972 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.783464 16990 tablet_bootstrap.cc:492] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:18.784468 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad644a4c46b4ba9b4845f75d943c516" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:18.785104 16792 raft_consensus.cc:3060] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.786399 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad644a4c46b4ba9b4845f75d943c516" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
W20260709 13:21:18.788031 16687 leader_election.cc:343] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.783524 16991 raft_consensus.cc:740] T 1a2aa3a038f049ccadf4405e476cd972 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.792665 16991 consensus_queue.cc:260] T 1a2aa3a038f049ccadf4405e476cd972 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:18.794862 16991 ts_tablet_manager.cc:1434] T 1a2aa3a038f049ccadf4405e476cd972 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:21:18.814040 16991 tablet_bootstrap.cc:492] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:18.779919 17217 leader_election.cc:290] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:18.821214 16990 tablet_bootstrap.cc:654] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.837321 16992 tablet_bootstrap.cc:492] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:18.837931 16992 ts_tablet_manager.cc:1403] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.010s
I20260709 13:21:18.847798 17192 consensus_queue.cc:1048] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:18.851599 16616 catalog_manager.cc:5697] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:18.870503 16989 tablet_bootstrap.cc:492] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:18.871284 16989 ts_tablet_manager.cc:1403] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.156s	user 0.007s	sys 0.028s
I20260709 13:21:18.885787 17222 raft_consensus.cc:493] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.886440 17222 raft_consensus.cc:515] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:18.881297 16989 raft_consensus.cc:359] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.889791 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a5428f572c4214b4ecd02231d81bd7" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:18.890134 16989 raft_consensus.cc:385] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.890477 16989 raft_consensus.cc:740] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.891185 16989 consensus_queue.cc:260] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.897966 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a5428f572c4214b4ecd02231d81bd7" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:18.902426 16719 raft_consensus.cc:2393] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a0b5583e0547a88c88b590549fbcee in current term 1: Already voted for candidate 5642511b38924ffcbe38110cf27d3535 in this term.
I20260709 13:21:18.904657 16989 ts_tablet_manager.cc:1434] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.002s
I20260709 13:21:18.908351 16836 leader_election.cc:304] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:18.894546 17222 leader_election.cc:290] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:18.914742 17145 raft_consensus.cc:3060] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.916371 16792 raft_consensus.cc:2468] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
W20260709 13:21:18.933568 16910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 51763.1us
I20260709 13:21:18.940325 16989 tablet_bootstrap.cc:492] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:18.948520 17145 raft_consensus.cc:2749] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:18.953152 17145 consensus_queue.cc:1048] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:18.955091 16989 tablet_bootstrap.cc:654] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.961135 16686 leader_election.cc:304] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:18.962308 17127 raft_consensus.cc:2804] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.962880 17127 raft_consensus.cc:697] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:18.963809 17127 consensus_queue.cc:237] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:18.979485 16991 tablet_bootstrap.cc:654] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.982378 17126 consensus_queue.cc:1048] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:21:19.001844 16990 tablet_bootstrap.cc:492] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:19.002414 16990 ts_tablet_manager.cc:1403] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.219s	user 0.017s	sys 0.001s
I20260709 13:21:19.006676 16989 tablet_bootstrap.cc:492] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:19.007144 16992 raft_consensus.cc:359] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.007383 16990 raft_consensus.cc:359] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:19.007519 17222 consensus_queue.cc:1048] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.007977 16992 raft_consensus.cc:385] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.008304 16992 raft_consensus.cc:740] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.007207 16989 ts_tablet_manager.cc:1403] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.076s	user 0.023s	sys 0.015s
I20260709 13:21:19.013016 17245 raft_consensus.cc:493] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.013793 17245 raft_consensus.cc:515] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.016546 16989 raft_consensus.cc:359] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.018400 16992 consensus_queue.cc:260] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.019436 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9e621ba6904fdfaec709a9b5e80bf1" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:19.020689 16992 ts_tablet_manager.cc:1434] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.182s	user 0.004s	sys 0.003s
W20260709 13:21:19.020885 16762 leader_election.cc:343] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.020975 16990 raft_consensus.cc:385] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.018724 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9e621ba6904fdfaec709a9b5e80bf1" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:19.021499 16990 raft_consensus.cc:740] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.021875 16992 tablet_bootstrap.cc:492] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:19.022423 16990 consensus_queue.cc:260] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:19.017313 16989 raft_consensus.cc:385] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.023587 16989 raft_consensus.cc:740] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.023684 17283 raft_consensus.cc:493] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.024159 17283 raft_consensus.cc:515] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.024430 16989 consensus_queue.cc:260] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.027158 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c414f9d9e048e89cedbb0dbe6027a2" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:19.027303 17283 leader_election.cc:290] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:19.027832 16795 raft_consensus.cc:2468] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
W20260709 13:21:19.028455 16760 leader_election.cc:343] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.029302 16686 leader_election.cc:304] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:19.030372 17283 raft_consensus.cc:2804] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.030858 17283 raft_consensus.cc:493] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.031275 16989 ts_tablet_manager.cc:1434] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.004s
I20260709 13:21:19.029112 16760 leader_election.cc:304] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:19.033213 17247 raft_consensus.cc:2749] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.034299 16990 ts_tablet_manager.cc:1434] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
W20260709 13:21:19.034845 16762 consensus_peers.cc:597] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 -> Peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Couldn't send request to peer 266d75f35db4465788ab06782fae972d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:19.032403 16989 tablet_bootstrap.cc:492] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:19.031309 17283 raft_consensus.cc:3060] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.035379 16990 tablet_bootstrap.cc:492] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:19.036239 16992 tablet_bootstrap.cc:654] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.037573 17245 leader_election.cc:290] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:19.030279 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c414f9d9e048e89cedbb0dbe6027a2" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
W20260709 13:21:19.041867 16685 leader_election.cc:343] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.044301 16990 tablet_bootstrap.cc:654] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.048391 16992 tablet_bootstrap.cc:492] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:19.048903 16992 ts_tablet_manager.cc:1403] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.007s
I20260709 13:21:19.051806 16989 tablet_bootstrap.cc:654] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.051681 16992 raft_consensus.cc:359] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.052423 16992 raft_consensus.cc:385] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.052742 16992 raft_consensus.cc:740] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.053479 16992 consensus_queue.cc:260] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.062826 16992 ts_tablet_manager.cc:1434] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:21:19.063896 16992 tablet_bootstrap.cc:492] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:19.071612 16992 tablet_bootstrap.cc:654] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.090107 16992 tablet_bootstrap.cc:492] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:19.090730 16992 ts_tablet_manager.cc:1403] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.003s
I20260709 13:21:19.092015 17145 raft_consensus.cc:493] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.092581 17145 raft_consensus.cc:515] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.093688 16992 raft_consensus.cc:359] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.094381 16992 raft_consensus.cc:385] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.093024 16618 catalog_manager.cc:5697] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:19.094637 16992 raft_consensus.cc:740] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.094797 17145 leader_election.cc:290] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:19.095721 16992 consensus_queue.cc:260] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.096146 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2aa3a038f049ccadf4405e476cd972" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:19.096549 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2aa3a038f049ccadf4405e476cd972" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:19.096903 16944 raft_consensus.cc:2468] T 1a2aa3a038f049ccadf4405e476cd972 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:19.097216 16795 raft_consensus.cc:2468] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:19.098374 16836 leader_election.cc:304] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:19.099365 17145 raft_consensus.cc:2804] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.099808 17145 raft_consensus.cc:493] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.100180 17145 raft_consensus.cc:3060] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.102957 16992 ts_tablet_manager.cc:1434] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:21:19.104679 16992 tablet_bootstrap.cc:492] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:19.107278 17283 raft_consensus.cc:515] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.110395 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c414f9d9e048e89cedbb0dbe6027a2" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:19.108515 17145 raft_consensus.cc:515] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.117904 16796 raft_consensus.cc:3060] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.120585 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2aa3a038f049ccadf4405e476cd972" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:19.121285 16944 raft_consensus.cc:3060] T 1a2aa3a038f049ccadf4405e476cd972 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.121682 17283 leader_election.cc:290] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:19.123646 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c414f9d9e048e89cedbb0dbe6027a2" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
W20260709 13:21:19.125226 16685 leader_election.cc:343] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.131738 16944 raft_consensus.cc:2468] T 1a2aa3a038f049ccadf4405e476cd972 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:19.132678 17245 consensus_queue.cc:1048] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.133481 16836 leader_election.cc:304] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:19.133627 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2aa3a038f049ccadf4405e476cd972" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:19.134308 16795 raft_consensus.cc:3060] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.137372 17222 raft_consensus.cc:2804] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.137977 17222 raft_consensus.cc:697] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:19.138828 17222 consensus_queue.cc:237] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.140084 17006 raft_consensus.cc:493] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.140623 17006 raft_consensus.cc:515] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.142776 17006 leader_election.cc:290] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:19.145476 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:19.144496 16795 raft_consensus.cc:2468] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
W20260709 13:21:19.156555 16685 leader_election.cc:343] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.158916 17245 consensus_queue.cc:1048] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.159324 16796 raft_consensus.cc:2468] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:19.161123 16686 leader_election.cc:304] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:19.163486 17006 raft_consensus.cc:2804] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.164143 17006 raft_consensus.cc:697] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:19.168041 16991 tablet_bootstrap.cc:492] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:19.168627 16991 ts_tablet_manager.cc:1403] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.359s	user 0.042s	sys 0.015s
I20260709 13:21:19.171619 16944 raft_consensus.cc:3060] T 59ba89448ab04e64b769557c2830641f P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.171576 16991 raft_consensus.cc:359] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.172389 16991 raft_consensus.cc:385] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.172761 16991 raft_consensus.cc:740] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.172874 16990 tablet_bootstrap.cc:492] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:19.173460 16990 ts_tablet_manager.cc:1403] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.138s	user 0.008s	sys 0.022s
I20260709 13:21:19.175223 16991 consensus_queue.cc:260] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.177354 16989 tablet_bootstrap.cc:492] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:19.180013 16989 ts_tablet_manager.cc:1403] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.148s	user 0.017s	sys 0.012s
I20260709 13:21:19.181242 16990 raft_consensus.cc:359] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.181988 16990 raft_consensus.cc:385] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.182251 16990 raft_consensus.cc:740] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.183056 16990 consensus_queue.cc:260] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.186919 16990 ts_tablet_manager.cc:1434] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:21:19.187311 16991 ts_tablet_manager.cc:1434] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:21:19.188129 17147 raft_consensus.cc:493] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.188655 17147 raft_consensus.cc:515] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.192217 17147 leader_election.cc:290] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:19.192857 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9e621ba6904fdfaec709a9b5e80bf1" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:19.147897 17145 leader_election.cc:290] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:19.193356 16990 tablet_bootstrap.cc:492] T a7baeabe6aad46e283f06762a1594a71 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:19.145790 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:19.194473 16836 leader_election.cc:343] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.194722 16792 raft_consensus.cc:2468] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:19.148180 16992 tablet_bootstrap.cc:654] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.197883 16989 raft_consensus.cc:359] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.198607 16989 raft_consensus.cc:385] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.198942 16989 raft_consensus.cc:740] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.165282 17006 consensus_queue.cc:237] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.199628 16989 consensus_queue.cc:260] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.202071 16989 ts_tablet_manager.cc:1434] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 13:21:19.203248 16989 tablet_bootstrap.cc:492] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:19.203222 17247 consensus_queue.cc:1048] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.193069 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9e621ba6904fdfaec709a9b5e80bf1" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:19.207993 16796 raft_consensus.cc:2468] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:19.208994 17247 consensus_queue.cc:1048] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.210731 16835 leader_election.cc:304] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:19.212059 16989 tablet_bootstrap.cc:654] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.213251 16686 leader_election.cc:304] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:19.213739 17145 raft_consensus.cc:2804] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.214210 17145 raft_consensus.cc:493] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.214612 17145 raft_consensus.cc:3060] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.214706 17283 raft_consensus.cc:2804] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.215344 17283 raft_consensus.cc:493] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.215770 17283 raft_consensus.cc:3060] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.214340 16796 raft_consensus.cc:1275] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:19.225795 17192 consensus_queue.cc:1048] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.236291 16617 catalog_manager.cc:5697] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:19.193107 16991 tablet_bootstrap.cc:492] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:19.235873 16870 raft_consensus.cc:1275] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:21:19.242261 16870 pending_rounds.cc:85] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee: Aborting all ops after (but not including) 0
I20260709 13:21:19.242733 16870 pending_rounds.cc:107] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:21:19.243209 16870 raft_consensus.cc:2889] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:19.250988 17192 consensus_queue.cc:1048] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.286613 16991 tablet_bootstrap.cc:654] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.269232 17145 raft_consensus.cc:515] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.315490 17243 consensus_queue.cc:1048] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.318106 17283 raft_consensus.cc:515] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.320634 17283 leader_election.cc:290] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:19.321254 16992 tablet_bootstrap.cc:492] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:19.321995 16992 ts_tablet_manager.cc:1403] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.218s	user 0.014s	sys 0.004s
I20260709 13:21:19.327399 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:19.327872 16992 raft_consensus.cc:359] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.328475 16990 tablet_bootstrap.cc:654] T a7baeabe6aad46e283f06762a1594a71 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.328550 16992 raft_consensus.cc:385] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:19.329162 16685 leader_election.cc:343] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.331730 16992 raft_consensus.cc:740] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.332329 17283 raft_consensus.cc:493] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.341094 17247 raft_consensus.cc:493] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.341688 17247 raft_consensus.cc:515] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.343792 17247 leader_election.cc:290] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:19.346117 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:19.338709 17283 raft_consensus.cc:515] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.347491 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
W20260709 13:21:19.347822 16762 leader_election.cc:343] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.348121 16795 raft_consensus.cc:3060] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.345993 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:19.348879 16719 raft_consensus.cc:2468] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 0.
I20260709 13:21:19.355829 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:19.356731 16794 raft_consensus.cc:2468] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:19.357223 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:19.359076 16686 leader_election.cc:304] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:19.360183 16762 leader_election.cc:304] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
W20260709 13:21:19.361100 16687 leader_election.cc:343] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.362072 17127 raft_consensus.cc:2804] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.362510 17243 raft_consensus.cc:2804] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.362686 17127 raft_consensus.cc:493] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.363075 17243 raft_consensus.cc:493] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.363313 17127 raft_consensus.cc:3060] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.337010 16992 consensus_queue.cc:260] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.372866 17283 leader_election.cc:290] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:19.363539 17243 raft_consensus.cc:3060] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.377885 16989 tablet_bootstrap.cc:492] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:19.378577 16989 ts_tablet_manager.cc:1403] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.176s	user 0.044s	sys 0.018s
I20260709 13:21:19.379803 16991 tablet_bootstrap.cc:492] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:19.380311 16991 ts_tablet_manager.cc:1403] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.187s	user 0.008s	sys 0.012s
I20260709 13:21:19.377905 17145 leader_election.cc:290] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:19.382983 16991 raft_consensus.cc:359] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.383705 16991 raft_consensus.cc:385] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.383988 16991 raft_consensus.cc:740] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.384661 16991 consensus_queue.cc:260] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.391692 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9e621ba6904fdfaec709a9b5e80bf1" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:19.391868 16618 catalog_manager.cc:5697] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:19.393142 17243 raft_consensus.cc:515] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
W20260709 13:21:19.393807 16836 leader_election.cc:343] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.395018 16989 raft_consensus.cc:359] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:19.402447 16992 ts_tablet_manager.cc:1434] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.080s	user 0.013s	sys 0.000s
I20260709 13:21:19.404270 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9e621ba6904fdfaec709a9b5e80bf1" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:19.407891 16989 raft_consensus.cc:385] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.408269 16989 raft_consensus.cc:740] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.414305 16991 ts_tablet_manager.cc:1434] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.006s
I20260709 13:21:19.422217 16992 tablet_bootstrap.cc:492] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:19.423308 16989 consensus_queue.cc:260] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:19.426610 17243 leader_election.cc:290] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:19.422271 17006 raft_consensus.cc:493] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.415597 16792 raft_consensus.cc:3060] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.428996 17006 raft_consensus.cc:515] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.431318 17006 leader_election.cc:290] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:19.432343 16992 tablet_bootstrap.cc:654] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.435129 16990 tablet_bootstrap.cc:492] T a7baeabe6aad46e283f06762a1594a71 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:19.436014 16990 ts_tablet_manager.cc:1403] T a7baeabe6aad46e283f06762a1594a71 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.248s	user 0.027s	sys 0.012s
W20260709 13:21:19.436839 16666 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:19.433805 16991 tablet_bootstrap.cc:492] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
W20260709 13:21:19.424499 16762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 64444.1us
I20260709 13:21:19.433687 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7da6930c7d44f51ae33d75064b68676" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:19.434295 17312 raft_consensus.cc:493] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.453313 16990 raft_consensus.cc:359] T a7baeabe6aad46e283f06762a1594a71 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.456499 17127 raft_consensus.cc:515] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.459540 16990 raft_consensus.cc:385] T a7baeabe6aad46e283f06762a1594a71 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.462133 17312 raft_consensus.cc:515] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.464527 17312 leader_election.cc:290] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:19.466666 16990 raft_consensus.cc:740] T a7baeabe6aad46e283f06762a1594a71 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
W20260709 13:21:19.472335 16687 leader_election.cc:343] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.478399 17192 raft_consensus.cc:493] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.480218 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7baeabe6aad46e283f06762a1594a71" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:19.479055 17192 raft_consensus.cc:515] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.482426 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:19.482785 17192 leader_election.cc:290] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:19.483594 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad644a4c46b4ba9b4845f75d943c516" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:19.484637 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7da6930c7d44f51ae33d75064b68676" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:19.485325 16794 raft_consensus.cc:2468] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:19.478657 16792 raft_consensus.cc:2468] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:19.479864 16795 raft_consensus.cc:2468] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:19.486986 16835 leader_election.cc:304] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:19.490370 17222 raft_consensus.cc:2804] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.490906 17222 raft_consensus.cc:697] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:19.491765 17222 consensus_queue.cc:237] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.492511 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad644a4c46b4ba9b4845f75d943c516" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:19.493495 16794 raft_consensus.cc:2393] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in this term.
I20260709 13:21:19.494216 16990 consensus_queue.cc:260] T a7baeabe6aad46e283f06762a1594a71 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.495664 16909 leader_election.cc:304] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:19.497632 16686 leader_election.cc:304] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:19.499181 16686 leader_election.cc:304] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:19.499382 17006 raft_consensus.cc:2804] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.504168 17006 raft_consensus.cc:493] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.504552 17006 raft_consensus.cc:3060] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.460575 16989 ts_tablet_manager.cc:1434] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.001s
I20260709 13:21:19.482458 16991 tablet_bootstrap.cc:654] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.514362 16990 ts_tablet_manager.cc:1434] T a7baeabe6aad46e283f06762a1594a71 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 13:21:19.517798 17217 raft_consensus.cc:2804] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:21:19.518308 16762 leader_election.cc:343] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.502522 17284 raft_consensus.cc:3060] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:19.519093 16762 leader_election.cc:343] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.526078 17006 raft_consensus.cc:515] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.527294 17127 leader_election.cc:290] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:19.527685 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:19.528481 17006 leader_election.cc:290] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:19.529701 17217 raft_consensus.cc:697] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
W20260709 13:21:19.530092 16687 leader_election.cc:343] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.530592 17217 consensus_queue.cc:237] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.531196 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7da6930c7d44f51ae33d75064b68676" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
W20260709 13:21:19.532742 16687 leader_election.cc:343] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.534266 16990 tablet_bootstrap.cc:492] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:19.535362 17192 raft_consensus.cc:493] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:19.536098 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 71815.2us
I20260709 13:21:19.539863 17216 raft_consensus.cc:493] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.540367 17216 raft_consensus.cc:515] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:19.541905 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7baeabe6aad46e283f06762a1594a71" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:19.542496 17216 leader_election.cc:290] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:19.542692 16868 raft_consensus.cc:2468] T a7baeabe6aad46e283f06762a1594a71 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 0.
I20260709 13:21:19.536015 17192 raft_consensus.cc:515] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.558785 17192 leader_election.cc:290] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:19.560734 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27c0b3cbad94ad791a54143f2d5af0b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:19.574559 16989 tablet_bootstrap.cc:492] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:19.576779 16992 tablet_bootstrap.cc:492] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:19.578061 16992 ts_tablet_manager.cc:1403] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.156s	user 0.022s	sys 0.024s
I20260709 13:21:19.581812 16992 raft_consensus.cc:359] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.582644 16992 raft_consensus.cc:385] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.582994 16992 raft_consensus.cc:740] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.583765 16992 consensus_queue.cc:260] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.585934 16992 ts_tablet_manager.cc:1434] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 13:21:19.585031 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 45786.7us
I20260709 13:21:19.588518 16760 leader_election.cc:304] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:19.589699 17243 raft_consensus.cc:2804] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.590076 17243 raft_consensus.cc:493] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.590404 17243 raft_consensus.cc:3060] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.592170 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:19.598719 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27c0b3cbad94ad791a54143f2d5af0b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:19.599968 17243 raft_consensus.cc:515] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.600387 16942 raft_consensus.cc:3060] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.600862 16992 tablet_bootstrap.cc:492] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:19.602154 16908 leader_election.cc:304] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:19.603124 17243 leader_election.cc:290] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
W20260709 13:21:19.605187 16836 leader_election.cc:343] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.609921 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7baeabe6aad46e283f06762a1594a71" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:19.611421 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7baeabe6aad46e283f06762a1594a71" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:19.610682 16868 raft_consensus.cc:3060] T a7baeabe6aad46e283f06762a1594a71 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.611953 16992 tablet_bootstrap.cc:654] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:19.613042 16762 leader_election.cc:343] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.619379 16615 catalog_manager.cc:5697] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:19.615190 17284 raft_consensus.cc:2749] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.628715 16989 tablet_bootstrap.cc:654] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.632911 16990 tablet_bootstrap.cc:654] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.634490 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:19.635352 16720 raft_consensus.cc:2393] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 1: Already voted for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in this term.
I20260709 13:21:19.624405 17222 consensus_queue.cc:1048] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:21:19.651891 17317 consensus_queue.cc:1048] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:21:19.660773 16992 tablet_bootstrap.cc:492] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:19.661559 16992 ts_tablet_manager.cc:1403] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.000s
I20260709 13:21:19.665234 16992 raft_consensus.cc:359] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.667011 16992 raft_consensus.cc:385] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:19.665890 16685 consensus_peers.cc:597] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 -> Peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Couldn't send request to peer 71a0b5583e0547a88c88b590549fbcee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:19.667408 16992 raft_consensus.cc:740] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.669525 16992 consensus_queue.cc:260] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.680469 16762 leader_election.cc:304] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:19.682804 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7da6930c7d44f51ae33d75064b68676" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:19.683638 16795 raft_consensus.cc:3060] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.683712 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:19.683035 17312 raft_consensus.cc:2749] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.692940 16792 raft_consensus.cc:2393] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in current term 1: Already voted for candidate 5642511b38924ffcbe38110cf27d3535 in this term.
I20260709 13:21:19.694888 16795 raft_consensus.cc:2468] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:19.695035 16618 catalog_manager.cc:5697] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:19.673072 16868 raft_consensus.cc:2468] T a7baeabe6aad46e283f06762a1594a71 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:19.699517 16760 leader_election.cc:304] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:19.700827 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:19.701681 16719 raft_consensus.cc:2468] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:19.708091 17243 raft_consensus.cc:2804] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.708972 17243 raft_consensus.cc:697] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:19.710242 17243 consensus_queue.cc:237] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.744656 16992 ts_tablet_manager.cc:1434] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.083s	user 0.008s	sys 0.000s
I20260709 13:21:19.746786 16686 leader_election.cc:304] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:19.747109 16836 leader_election.cc:304] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:19.749903 17006 raft_consensus.cc:2749] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.751091 16686 leader_election.cc:304] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:19.755395 16992 tablet_bootstrap.cc:492] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:19.757827 17217 raft_consensus.cc:2804] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.758462 17217 raft_consensus.cc:697] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:19.760319 16990 tablet_bootstrap.cc:492] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:19.760841 16990 ts_tablet_manager.cc:1403] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.227s	user 0.027s	sys 0.009s
I20260709 13:21:19.762553 16989 tablet_bootstrap.cc:492] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:19.763109 16989 ts_tablet_manager.cc:1403] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.246s	user 0.012s	sys 0.000s
I20260709 13:21:19.767258 17320 raft_consensus.cc:2804] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.767740 17320 raft_consensus.cc:493] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.768092 17320 raft_consensus.cc:3060] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.768141 16990 raft_consensus.cc:359] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.768944 16990 raft_consensus.cc:385] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.759785 17217 consensus_queue.cc:237] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.770300 16989 raft_consensus.cc:359] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:19.772118 16989 raft_consensus.cc:385] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.772401 16989 raft_consensus.cc:740] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.745880 17317 raft_consensus.cc:493] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.776695 17317 raft_consensus.cc:515] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:19.769217 16990 raft_consensus.cc:740] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.779064 16990 consensus_queue.cc:260] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.779699 17319 consensus_queue.cc:1048] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.781620 16990 ts_tablet_manager.cc:1434] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.002s
I20260709 13:21:19.783392 16992 tablet_bootstrap.cc:654] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.787326 16989 consensus_queue.cc:260] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:19.801851 16991 tablet_bootstrap.cc:492] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:19.802793 16991 ts_tablet_manager.cc:1403] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.369s	user 0.026s	sys 0.033s
I20260709 13:21:19.814639 16989 ts_tablet_manager.cc:1434] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 13:21:19.820468 17320 raft_consensus.cc:515] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:19.824508 17317 leader_election.cc:290] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:19.833488 16990 tablet_bootstrap.cc:492] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:19.838390 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52265c494440483086dbf5b231415a85" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:19.844018 16989 tablet_bootstrap.cc:492] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
W20260709 13:21:19.851585 16687 leader_election.cc:343] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.851714 17079 raft_consensus.cc:2749] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.851768 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52265c494440483086dbf5b231415a85" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
W20260709 13:21:19.855355 16685 leader_election.cc:343] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.855832 16685 leader_election.cc:304] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:19.858556 17006 raft_consensus.cc:2749] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.858011 16615 catalog_manager.cc:5697] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:19.862129 16991 raft_consensus.cc:359] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:19.862917 16991 raft_consensus.cc:385] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.863183 16991 raft_consensus.cc:740] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.863969 16991 consensus_queue.cc:260] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:19.866801 16991 ts_tablet_manager.cc:1434] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.002s
I20260709 13:21:19.868605 16991 tablet_bootstrap.cc:492] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:19.875893 17283 raft_consensus.cc:493] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.878233 17283 raft_consensus.cc:515] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:19.880316 17283 leader_election.cc:290] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:19.881090 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
W20260709 13:21:19.889621 16836 leader_election.cc:343] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.891106 17320 leader_election.cc:290] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:19.875734 17317 consensus_queue.cc:1048] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:21:19.910521 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:19.906991 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:19.915091 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:19.932322 16685 leader_election.cc:343] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.933864 17317 consensus_queue.cc:1048] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.935142 17312 raft_consensus.cc:493] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.935688 17312 raft_consensus.cc:515] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.929208 16719 raft_consensus.cc:3060] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.922477 17147 consensus_queue.cc:1048] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.927248 16615 catalog_manager.cc:5697] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:19.928596 16990 tablet_bootstrap.cc:654] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.937734 17312 leader_election.cc:290] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:19.939252 16992 tablet_bootstrap.cc:492] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:19.939703 17312 raft_consensus.cc:493] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.939787 16992 ts_tablet_manager.cc:1403] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.185s	user 0.025s	sys 0.011s
I20260709 13:21:19.940237 17312 raft_consensus.cc:515] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:19.942654 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2434de2d21436fbbf8b25ab1814b54" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:19.943598 16992 raft_consensus.cc:359] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.944340 16992 raft_consensus.cc:385] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:19.944237 16760 leader_election.cc:343] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.943949 17312 leader_election.cc:290] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:19.945523 16992 raft_consensus.cc:740] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.946432 16992 consensus_queue.cc:260] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:19.920537 16989 tablet_bootstrap.cc:654] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.956935 16992 ts_tablet_manager.cc:1434] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:21:19.960023 16992 tablet_bootstrap.cc:492] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
W20260709 13:21:19.961858 16687 leader_election.cc:343] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.961958 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8760c2c176b64d10ae61d46fa3c8605b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:19.962455 16687 leader_election.cc:304] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:19.962739 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2434de2d21436fbbf8b25ab1814b54" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:19.963735 17217 raft_consensus.cc:2749] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.970423 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8760c2c176b64d10ae61d46fa3c8605b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:19.975127 16719 raft_consensus.cc:2468] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:19.976372 16992 tablet_bootstrap.cc:654] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.982633 16836 leader_election.cc:304] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
W20260709 13:21:19.985042 16762 leader_election.cc:343] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.985678 17320 raft_consensus.cc:2804] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.991853 17320 raft_consensus.cc:697] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:19.993311 16991 tablet_bootstrap.cc:654] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.994064 16989 tablet_bootstrap.cc:492] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:19.998238 17145 raft_consensus.cc:493] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.999001 17145 raft_consensus.cc:515] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:19.999042 16990 tablet_bootstrap.cc:492] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
W20260709 13:21:20.004139 16836 consensus_peers.cc:597] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee -> Peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Couldn't send request to peer 266d75f35db4465788ab06782fae972d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:20.005617 17145 leader_election.cc:290] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:20.004292 16990 ts_tablet_manager.cc:1403] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.186s	user 0.021s	sys 0.006s
I20260709 13:21:20.013265 16989 ts_tablet_manager.cc:1403] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.163s	user 0.014s	sys 0.012s
I20260709 13:21:20.016146 16989 raft_consensus.cc:359] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:20.017023 16989 raft_consensus.cc:385] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.017380 16989 raft_consensus.cc:740] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.027850 16989 consensus_queue.cc:260] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:20.030855 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c414f9d9e048e89cedbb0dbe6027a2" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:20.035275 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c414f9d9e048e89cedbb0dbe6027a2" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:20.037462 16836 leader_election.cc:304] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:20.038233 17147 raft_consensus.cc:2749] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:20.010842 17320 consensus_queue.cc:237] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.041875 16868 raft_consensus.cc:3060] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.985641 16762 leader_election.cc:304] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:20.039299 16989 ts_tablet_manager.cc:1434] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:21:20.068245 16989 tablet_bootstrap.cc:492] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
W20260709 13:21:20.068468 16762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 83309us
W20260709 13:21:20.070240 16762 leader_election.cc:343] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:20.071794 16762 leader_election.cc:343] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.072312 16762 leader_election.cc:304] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:20.074105 17312 raft_consensus.cc:2749] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:20.074235 17313 raft_consensus.cc:2749] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:20.084173 16990 raft_consensus.cc:359] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.085182 16990 raft_consensus.cc:385] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:20.097112 16685 consensus_peers.cc:597] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 -> Peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Couldn't send request to peer 71a0b5583e0547a88c88b590549fbcee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:20.103530 16989 tablet_bootstrap.cc:654] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.112581 16990 raft_consensus.cc:740] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.115505 16618 catalog_manager.cc:5697] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.119894 16992 tablet_bootstrap.cc:492] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:20.120682 16992 ts_tablet_manager.cc:1403] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.161s	user 0.029s	sys 0.015s
I20260709 13:21:20.122134 16990 consensus_queue.cc:260] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.134019 16991 tablet_bootstrap.cc:492] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:20.134845 16991 ts_tablet_manager.cc:1403] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.266s	user 0.042s	sys 0.054s
I20260709 13:21:20.144613 17283 consensus_queue.cc:1048] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:20.146816 16990 ts_tablet_manager.cc:1434] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.140s	user 0.007s	sys 0.002s
I20260709 13:21:20.148029 16990 tablet_bootstrap.cc:492] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:20.137904 16991 raft_consensus.cc:359] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.152007 16991 raft_consensus.cc:385] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.152352 16991 raft_consensus.cc:740] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.153139 16991 consensus_queue.cc:260] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.155821 16991 ts_tablet_manager.cc:1434] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:21:20.156773 16991 tablet_bootstrap.cc:492] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:20.158195 16992 raft_consensus.cc:359] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:20.159052 16992 raft_consensus.cc:385] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.159358 16992 raft_consensus.cc:740] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.160920 16992 consensus_queue.cc:260] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:20.174508 16991 tablet_bootstrap.cc:654] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:20.203711 16762 consensus_peers.cc:597] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 -> Peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Couldn't send request to peer 266d75f35db4465788ab06782fae972d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:20.205444 16992 ts_tablet_manager.cc:1434] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.084s	user 0.003s	sys 0.005s
I20260709 13:21:20.222692 16990 tablet_bootstrap.cc:654] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:20.226132 16687 consensus_peers.cc:597] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 -> Peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Couldn't send request to peer 266d75f35db4465788ab06782fae972d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:20.226847 16992 tablet_bootstrap.cc:492] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:20.252205 16991 tablet_bootstrap.cc:492] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:20.252528 16990 tablet_bootstrap.cc:492] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:20.252889 16991 ts_tablet_manager.cc:1403] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.096s	user 0.018s	sys 0.024s
I20260709 13:21:20.253078 16990 ts_tablet_manager.cc:1403] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.105s	user 0.014s	sys 0.012s
I20260709 13:21:20.259321 16990 raft_consensus.cc:359] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.260035 16990 raft_consensus.cc:385] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.260603 16991 raft_consensus.cc:359] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:20.261264 16991 raft_consensus.cc:385] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.261518 16991 raft_consensus.cc:740] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.260331 16990 raft_consensus.cc:740] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.264249 16991 consensus_queue.cc:260] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:20.268500 16990 consensus_queue.cc:260] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.269074 16991 ts_tablet_manager.cc:1434] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:21:20.269769 16989 tablet_bootstrap.cc:492] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:20.270373 16989 ts_tablet_manager.cc:1403] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.202s	user 0.019s	sys 0.007s
I20260709 13:21:20.270414 16991 tablet_bootstrap.cc:492] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:20.273494 16989 raft_consensus.cc:359] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:20.274269 16989 raft_consensus.cc:385] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.274564 16989 raft_consensus.cc:740] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.275355 16989 consensus_queue.cc:260] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:20.275957 16992 tablet_bootstrap.cc:654] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.279325 16990 ts_tablet_manager.cc:1434] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:21:20.279866 17243 consensus_queue.cc:1048] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:20.280510 16990 tablet_bootstrap.cc:492] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:20.289937 16991 tablet_bootstrap.cc:654] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.291441 16990 tablet_bootstrap.cc:654] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.304498 16989 ts_tablet_manager.cc:1434] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:21:20.310971 16992 tablet_bootstrap.cc:492] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:20.311849 16992 ts_tablet_manager.cc:1403] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.001s
I20260709 13:21:20.316416 16992 raft_consensus.cc:359] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:20.317523 16992 raft_consensus.cc:385] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.317849 16992 raft_consensus.cc:740] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.321035 16992 consensus_queue.cc:260] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:20.334551 16992 ts_tablet_manager.cc:1434] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:21:20.325296 16990 tablet_bootstrap.cc:492] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:20.332041 16991 tablet_bootstrap.cc:492] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:20.335398 16990 ts_tablet_manager.cc:1403] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.003s
I20260709 13:21:20.335757 16991 ts_tablet_manager.cc:1403] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.025s
I20260709 13:21:20.340005 16991 raft_consensus.cc:359] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:20.340663 16991 raft_consensus.cc:385] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.340991 16991 raft_consensus.cc:740] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.341826 16991 consensus_queue.cc:260] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:20.343343 17006 consensus_queue.cc:1048] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:20.344065 16991 ts_tablet_manager.cc:1434] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:21:20.345398 16991 tablet_bootstrap.cc:492] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:20.349501 17006 raft_consensus.cc:493] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.349956 16992 tablet_bootstrap.cc:492] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:20.350229 17006 raft_consensus.cc:515] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:20.352973 17284 raft_consensus.cc:493] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.337947 16990 raft_consensus.cc:359] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:20.318985 16989 tablet_bootstrap.cc:492] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:20.355325 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8760c2c176b64d10ae61d46fa3c8605b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:20.353705 17284 raft_consensus.cc:515] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.354815 17312 raft_consensus.cc:493] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.357805 17312 raft_consensus.cc:515] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:20.355073 16991 tablet_bootstrap.cc:654] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.360167 17312 leader_election.cc:290] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:20.363947 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465607298c84b8dbd8007c816bc5c9c" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
W20260709 13:21:20.366400 16760 leader_election.cc:343] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:20.369462 16687 leader_election.cc:343] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.355477 16990 raft_consensus.cc:385] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.370347 16990 raft_consensus.cc:740] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.371040 16990 consensus_queue.cc:260] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:20.373150 16990 ts_tablet_manager.cc:1434] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.000s
I20260709 13:21:20.374212 16990 tablet_bootstrap.cc:492] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:20.380589 16992 tablet_bootstrap.cc:654] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.385522 16989 tablet_bootstrap.cc:654] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.392688 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b267a6d4ca4f87829b245ef87bd6e3" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:20.395931 17284 leader_election.cc:290] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:20.399176 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b267a6d4ca4f87829b245ef87bd6e3" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:20.402175 16910 leader_election.cc:304] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:20.405714 16990 tablet_bootstrap.cc:654] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.407509 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465607298c84b8dbd8007c816bc5c9c" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:20.414885 17006 leader_election.cc:290] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:20.414702 17284 raft_consensus.cc:2749] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:20.418403 16762 leader_election.cc:343] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.419028 16762 leader_election.cc:304] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:20.421039 16943 raft_consensus.cc:3060] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.424680 17243 raft_consensus.cc:2749] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:20.433553 16942 raft_consensus.cc:3060] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.435189 17312 raft_consensus.cc:493] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.437045 17312 raft_consensus.cc:515] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:20.435767 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8760c2c176b64d10ae61d46fa3c8605b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:20.439639 16795 raft_consensus.cc:2468] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:20.440011 16989 tablet_bootstrap.cc:492] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:20.440518 16989 ts_tablet_manager.cc:1403] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.122s	user 0.010s	sys 0.002s
I20260709 13:21:20.441818 16686 leader_election.cc:304] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:20.442701 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec264452e294befb3fab6c21b1307ba" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
W20260709 13:21:20.445024 16760 leader_election.cc:343] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.446384 17283 raft_consensus.cc:2804] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:20.447022 17283 raft_consensus.cc:493] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.447467 17283 raft_consensus.cc:3060] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.448601 16991 tablet_bootstrap.cc:492] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:20.449121 16991 ts_tablet_manager.cc:1403] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.104s	user 0.030s	sys 0.029s
I20260709 13:21:20.451174 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec264452e294befb3fab6c21b1307ba" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:20.446583 17312 leader_election.cc:290] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:20.455158 16944 raft_consensus.cc:3060] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.474476 16991 raft_consensus.cc:359] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:20.475509 16991 raft_consensus.cc:385] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.475797 16991 raft_consensus.cc:740] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.482739 17147 raft_consensus.cc:493] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.483728 17147 raft_consensus.cc:515] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.486315 16991 consensus_queue.cc:260] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
W20260709 13:21:20.487988 16762 leader_election.cc:343] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.488462 16762 leader_election.cc:304] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:20.489179 17312 raft_consensus.cc:2749] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:20.489548 16991 ts_tablet_manager.cc:1434] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.004s
I20260709 13:21:20.490698 16991 tablet_bootstrap.cc:492] T 52265c494440483086dbf5b231415a85 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:20.443393 16990 tablet_bootstrap.cc:492] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:20.491351 16990 ts_tablet_manager.cc:1403] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.117s	user 0.007s	sys 0.010s
I20260709 13:21:20.496708 16992 tablet_bootstrap.cc:492] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:20.494182 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:20.497166 16991 tablet_bootstrap.cc:654] T 52265c494440483086dbf5b231415a85 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.497221 16992 ts_tablet_manager.cc:1403] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.147s	user 0.006s	sys 0.008s
I20260709 13:21:20.492116 17147 leader_election.cc:290] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:20.499207 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:20.500046 16719 raft_consensus.cc:2468] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:20.500170 16992 raft_consensus.cc:359] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:20.501076 16992 raft_consensus.cc:385] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.501348 16992 raft_consensus.cc:740] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.502875 16836 leader_election.cc:304] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:20.502929 16992 consensus_queue.cc:260] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:20.503953 17147 raft_consensus.cc:2804] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:20.505225 17147 raft_consensus.cc:493] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.505775 17147 raft_consensus.cc:3060] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:20.511019 16836 leader_election.cc:343] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.513377 16990 raft_consensus.cc:359] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:20.519588 16990 raft_consensus.cc:385] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.520021 16990 raft_consensus.cc:740] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.518173 16992 ts_tablet_manager.cc:1434] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:21:20.522214 16992 tablet_bootstrap.cc:492] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:20.494729 17283 raft_consensus.cc:515] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
W20260709 13:21:20.527563 16666 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:20.523097 16990 consensus_queue.cc:260] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:20.534384 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8760c2c176b64d10ae61d46fa3c8605b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:20.520251 16989 raft_consensus.cc:359] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:20.534909 16867 raft_consensus.cc:3060] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.535094 16795 raft_consensus.cc:3060] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.536021 16990 ts_tablet_manager.cc:1434] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 13:21:20.544385 17284 raft_consensus.cc:493] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.545779 17284 raft_consensus.cc:515] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.549798 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:20.552373 16989 raft_consensus.cc:385] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.552726 16989 raft_consensus.cc:740] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.553642 16992 tablet_bootstrap.cc:654] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.553725 16989 consensus_queue.cc:260] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:20.549297 16990 tablet_bootstrap.cc:492] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:20.559851 16989 ts_tablet_manager.cc:1434] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.119s	user 0.006s	sys 0.004s
I20260709 13:21:20.561154 17126 raft_consensus.cc:493] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.540860 17283 leader_election.cc:290] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:20.561635 17147 raft_consensus.cc:515] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.561875 17126 raft_consensus.cc:515] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:20.563383 16795 raft_consensus.cc:2468] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:20.564015 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:20.566016 16721 raft_consensus.cc:2468] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:20.567018 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7baeabe6aad46e283f06762a1594a71" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:20.568094 16686 leader_election.cc:304] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:20.564456 17284 leader_election.cc:290] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:20.565061 17126 leader_election.cc:290] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:20.565510 16989 tablet_bootstrap.cc:492] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:20.570160 17319 consensus_queue.cc:1048] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:20.571445 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7baeabe6aad46e283f06762a1594a71" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:20.572587 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:20.575089 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8760c2c176b64d10ae61d46fa3c8605b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:20.581126 16910 leader_election.cc:304] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:20.582270 17147 leader_election.cc:290] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:20.584455 17283 raft_consensus.cc:2804] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:20.585192 16990 tablet_bootstrap.cc:654] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.588786 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
W20260709 13:21:20.595335 16836 leader_election.cc:343] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.596794 16721 raft_consensus.cc:3060] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.594352 17243 raft_consensus.cc:493] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:20.598052 16687 leader_election.cc:343] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.603931 16909 leader_election.cc:304] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:20.597791 17243 raft_consensus.cc:515] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:20.607530 16989 tablet_bootstrap.cc:654] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.605351 17284 raft_consensus.cc:2749] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:20.613040 16721 raft_consensus.cc:2468] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:20.614372 16836 leader_election.cc:304] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:20.614863 16991 tablet_bootstrap.cc:492] T 52265c494440483086dbf5b231415a85 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:20.615374 16991 ts_tablet_manager.cc:1403] T 52265c494440483086dbf5b231415a85 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.125s	user 0.022s	sys 0.030s
I20260709 13:21:20.620628 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:20.611048 17243 leader_election.cc:290] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:20.610411 17283 raft_consensus.cc:697] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:20.622918 17283 consensus_queue.cc:237] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:20.612986 17079 raft_consensus.cc:2804] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:20.625329 17079 raft_consensus.cc:493] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71a0b5583e0547a88c88b590549fbcee)
I20260709 13:21:20.620065 17147 raft_consensus.cc:2804] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:20.625787 17079 raft_consensus.cc:3060] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.630005 16991 raft_consensus.cc:359] T 52265c494440483086dbf5b231415a85 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.630963 16991 raft_consensus.cc:385] T 52265c494440483086dbf5b231415a85 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.631479 17147 raft_consensus.cc:697] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:20.632393 17147 consensus_queue.cc:237] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:20.633164 16762 leader_election.cc:343] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.636029 17320 raft_consensus.cc:493] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.612407 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:20.631258 16991 raft_consensus.cc:740] T 52265c494440483086dbf5b231415a85 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.649030 16991 consensus_queue.cc:260] T 52265c494440483086dbf5b231415a85 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:20.650117 16762 leader_election.cc:343] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.650247 17145 raft_consensus.cc:493] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.650604 16762 leader_election.cc:304] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:20.650808 17145 raft_consensus.cc:515] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.653549 17313 raft_consensus.cc:2749] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:20.636574 17320 raft_consensus.cc:515] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:20.655862 16991 ts_tablet_manager.cc:1434] T 52265c494440483086dbf5b231415a85 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:21:20.657047 16991 tablet_bootstrap.cc:492] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:20.658165 16992 tablet_bootstrap.cc:492] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:20.658804 16992 ts_tablet_manager.cc:1403] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.137s	user 0.018s	sys 0.008s
I20260709 13:21:20.662114 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2434de2d21436fbbf8b25ab1814b54" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:20.666930 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2434de2d21436fbbf8b25ab1814b54" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:20.667660 16794 raft_consensus.cc:2468] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:20.668967 16835 leader_election.cc:304] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:20.663116 16719 raft_consensus.cc:2468] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:20.670480 17145 leader_election.cc:290] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:20.658085 17320 leader_election.cc:290] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:20.672996 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52265c494440483086dbf5b231415a85" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:20.676702 16943 raft_consensus.cc:2468] T 52265c494440483086dbf5b231415a85 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:20.676873 16992 raft_consensus.cc:359] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:20.680150 16992 raft_consensus.cc:385] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.678264 16836 leader_election.cc:304] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:20.682153 17365 raft_consensus.cc:2804] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:20.682754 17365 raft_consensus.cc:493] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.683522 17365 raft_consensus.cc:3060] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.684557 17319 consensus_queue.cc:1048] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:20.686378 17367 raft_consensus.cc:2804] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:20.688048 17367 raft_consensus.cc:493] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.680544 16992 raft_consensus.cc:740] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.694519 16992 consensus_queue.cc:260] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:20.707340 16992 ts_tablet_manager.cc:1434] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:21:20.704672 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52265c494440483086dbf5b231415a85" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:20.715904 16719 raft_consensus.cc:2468] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:20.716840 16992 tablet_bootstrap.cc:492] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:20.724145 16991 tablet_bootstrap.cc:654] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.727865 16616 catalog_manager.cc:5697] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.732308 17283 raft_consensus.cc:493] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.733106 17283 raft_consensus.cc:515] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:20.737927 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2fb00d467444edb3d2d8374ad64b7c" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:20.738251 16619 catalog_manager.cc:5697] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.704265 17367 raft_consensus.cc:3060] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.749814 16795 raft_consensus.cc:2468] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:20.770216 16686 leader_election.cc:304] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:20.748675 17283 leader_election.cc:290] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:20.759562 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2fb00d467444edb3d2d8374ad64b7c" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:20.765180 17126 raft_consensus.cc:493] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.778018 17127 raft_consensus.cc:2804] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:20.797685 16990 tablet_bootstrap.cc:492] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:20.798435 16990 ts_tablet_manager.cc:1403] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.249s	user 0.026s	sys 0.007s
I20260709 13:21:20.797081 17127 raft_consensus.cc:493] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.800740 17127 raft_consensus.cc:3060] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.801030 17079 raft_consensus.cc:515] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.803231 16943 raft_consensus.cc:1240] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Rejecting Update request from peer 71a0b5583e0547a88c88b590549fbcee for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:20.815572 16940 raft_consensus.cc:3060] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.790606 17126 raft_consensus.cc:515] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:20.819029 16992 tablet_bootstrap.cc:654] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.822750 16989 tablet_bootstrap.cc:492] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:20.823449 16989 ts_tablet_manager.cc:1403] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.258s	user 0.022s	sys 0.004s
W20260709 13:21:20.809407 16685 leader_election.cc:343] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.828765 17145 consensus_queue.cc:1059] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:20.839216 17126 leader_election.cc:290] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:20.841885 16989 raft_consensus.cc:359] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.842691 16989 raft_consensus.cc:385] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.842947 16989 raft_consensus.cc:740] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.843833 16989 consensus_queue.cc:260] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.846475 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:20.849749 17320 raft_consensus.cc:3055] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:20.850277 17320 raft_consensus.cc:740] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:20.851119 17320 consensus_queue.cc:260] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:20.859066 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:20.859939 16795 raft_consensus.cc:2393] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 5642511b38924ffcbe38110cf27d3535 in this term.
I20260709 13:21:20.863350 17365 raft_consensus.cc:515] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:20.865980 17365 leader_election.cc:290] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:20.867233 17313 raft_consensus.cc:493] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.868103 17313 raft_consensus.cc:515] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:20.869637 16989 ts_tablet_manager.cc:1434] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 13:21:20.870941 16989 tablet_bootstrap.cc:492] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:20.873718 17313 leader_election.cc:290] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:20.874804 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702099270174fe58528799e1564c74b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:20.877267 17127 raft_consensus.cc:515] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:20.880484 17079 leader_election.cc:290] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:20.881870 17367 raft_consensus.cc:515] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:20.885514 16762 leader_election.cc:343] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.926528 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2fb00d467444edb3d2d8374ad64b7c" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:20.927439 16795 raft_consensus.cc:3060] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.921221 17367 leader_election.cc:290] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:20.936821 16990 raft_consensus.cc:359] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:20.937608 16990 raft_consensus.cc:385] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:20.937908 16990 raft_consensus.cc:740] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:20.938529 16990 consensus_queue.cc:260] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:20.939062 16795 raft_consensus.cc:2468] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:20.942929 16686 leader_election.cc:304] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
W20260709 13:21:20.942983 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:32963, user_credentials={real_user=slave}} blocked reactor thread for 114882us
I20260709 13:21:20.950686 16990 ts_tablet_manager.cc:1434] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.152s	user 0.007s	sys 0.000s
I20260709 13:21:20.946573 17283 raft_consensus.cc:2804] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:20.956239 16990 tablet_bootstrap.cc:492] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
W20260709 13:21:20.942479 16835 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:34809, user_credentials={real_user=slave}} blocked reactor thread for 102358us
I20260709 13:21:20.951735 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2434de2d21436fbbf8b25ab1814b54" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:20.949815 17127 leader_election.cc:290] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:20.960482 17283 raft_consensus.cc:697] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:20.961797 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52265c494440483086dbf5b231415a85" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:20.958560 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702099270174fe58528799e1564c74b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:20.963653 16719 raft_consensus.cc:3060] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.966187 16721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:20.967259 16721 raft_consensus.cc:2393] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in this term.
I20260709 13:21:20.964340 16718 raft_consensus.cc:3060] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.955238 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52265c494440483086dbf5b231415a85" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:20.970471 17319 raft_consensus.cc:493] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:20.974277 17319 raft_consensus.cc:515] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
W20260709 13:21:20.973485 16760 leader_election.cc:343] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:20.977792 16991 tablet_bootstrap.cc:492] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:20.978287 16991 ts_tablet_manager.cc:1403] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.321s	user 0.027s	sys 0.004s
I20260709 13:21:20.979400 17283 consensus_queue.cc:237] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:20.980278 16720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:20.980662 17320 raft_consensus.cc:3060] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.980914 16992 tablet_bootstrap.cc:492] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:20.977205 16941 raft_consensus.cc:3060] T 52265c494440483086dbf5b231415a85 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:20.985283 16989 tablet_bootstrap.cc:654] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:20.988219 16992 ts_tablet_manager.cc:1403] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.272s	user 0.023s	sys 0.005s
I20260709 13:21:20.987972 16760 leader_election.cc:304] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:20.995682 17313 raft_consensus.cc:2749] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:20.996882 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2fb00d467444edb3d2d8374ad64b7c" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:21.000012 16992 raft_consensus.cc:359] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:21.002933 16992 raft_consensus.cc:385] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.003068 16719 raft_consensus.cc:2468] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:21.003317 16992 raft_consensus.cc:740] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.006742 16992 consensus_queue.cc:260] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:21.010776 16836 leader_election.cc:304] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
W20260709 13:21:21.022266 16685 leader_election.cc:343] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.025409 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2434de2d21436fbbf8b25ab1814b54" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:21.026242 16794 raft_consensus.cc:3060] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.033123 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:21.028867 16910 leader_election.cc:304] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:21.017740 17375 raft_consensus.cc:2804] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:21.034473 17361 raft_consensus.cc:3060] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.034932 17375 raft_consensus.cc:697] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:21.042348 16991 raft_consensus.cc:359] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.043247 16991 raft_consensus.cc:385] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.043581 16991 raft_consensus.cc:740] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.044488 16991 consensus_queue.cc:260] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.046991 16992 ts_tablet_manager.cc:1434] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.058s	user 0.004s	sys 0.002s
I20260709 13:21:21.036374 17375 consensus_queue.cc:237] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.073153 16992 tablet_bootstrap.cc:492] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535: Bootstrap starting.
I20260709 13:21:21.097688 17319 leader_election.cc:290] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:21.102797 16941 raft_consensus.cc:2468] T 52265c494440483086dbf5b231415a85 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:21.109050 16990 tablet_bootstrap.cc:654] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:21.112185 16836 consensus_peers.cc:597] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee -> Peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Couldn't send request to peer 266d75f35db4465788ab06782fae972d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.112397 16991 ts_tablet_manager.cc:1434] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.134s	user 0.009s	sys 0.000s
I20260709 13:21:21.116169 16991 tablet_bootstrap.cc:492] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:21.111109 16718 raft_consensus.cc:2468] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
W20260709 13:21:21.098552 16910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 69804.5us
I20260709 13:21:21.104720 16794 raft_consensus.cc:2468] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:21.132663 16910 leader_election.cc:304] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:21.134523 17284 raft_consensus.cc:2749] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:21.138268 16835 leader_election.cc:304] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:21.139254 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:21.142230 16687 consensus_peers.cc:597] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 -> Peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Couldn't send request to peer 266d75f35db4465788ab06782fae972d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:21.149065 16835 leader_election.cc:304] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:21.150702 17145 raft_consensus.cc:2804] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:21.151317 17145 raft_consensus.cc:697] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:21.152141 17145 consensus_queue.cc:237] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:21.153158 17376 raft_consensus.cc:2749] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:21.157879 17361 raft_consensus.cc:2749] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.160004 16989 tablet_bootstrap.cc:492] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:21.160523 16989 ts_tablet_manager.cc:1403] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.290s	user 0.014s	sys 0.007s
I20260709 13:21:21.161098 16992 tablet_bootstrap.cc:654] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.171041 16989 raft_consensus.cc:359] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.171859 16989 raft_consensus.cc:385] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.172120 16989 raft_consensus.cc:740] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.173130 16989 consensus_queue.cc:260] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.175207 16989 ts_tablet_manager.cc:1434] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:21:21.176110 16989 tablet_bootstrap.cc:492] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:21.192355 17006 consensus_queue.cc:1048] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:21.193851 16991 tablet_bootstrap.cc:654] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.196878 16990 tablet_bootstrap.cc:492] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:21.197511 16990 ts_tablet_manager.cc:1403] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.242s	user 0.012s	sys 0.006s
I20260709 13:21:21.205621 16990 raft_consensus.cc:359] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.206730 16990 raft_consensus.cc:385] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.207008 16989 tablet_bootstrap.cc:654] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.207113 16990 raft_consensus.cc:740] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.208405 16990 consensus_queue.cc:260] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.209934 17375 consensus_queue.cc:1048] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:21.221272 16992 tablet_bootstrap.cc:492] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535: No bootstrap required, opened a new log
I20260709 13:21:21.221853 16992 ts_tablet_manager.cc:1403] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535: Time spent bootstrapping tablet: real 0.168s	user 0.014s	sys 0.007s
I20260709 13:21:21.230551 16940 raft_consensus.cc:3060] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.234903 16990 ts_tablet_manager.cc:1434] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:21:21.238456 16992 raft_consensus.cc:359] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.240381 16992 raft_consensus.cc:385] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.240581 16992 raft_consensus.cc:740] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.242213 16990 tablet_bootstrap.cc:492] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:21.241117 16992 consensus_queue.cc:260] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.258826 17313 raft_consensus.cc:493] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.259366 17313 raft_consensus.cc:515] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:21.261245 17006 raft_consensus.cc:493] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.261767 17006 raft_consensus.cc:515] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.263760 17006 leader_election.cc:290] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:21.265187 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:21.266621 17313 leader_election.cc:290] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
W20260709 13:21:21.267521 16760 leader_election.cc:343] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.266521 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:21.268484 16943 raft_consensus.cc:2468] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:21.269403 16992 ts_tablet_manager.cc:1434] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:21:21.270036 16687 leader_election.cc:304] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:21.268422 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:21.270995 16795 raft_consensus.cc:2468] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:21.271113 17283 raft_consensus.cc:2804] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:21.271762 17283 raft_consensus.cc:493] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:21.272111 17283 raft_consensus.cc:3060] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:21.274981 16989 tablet_bootstrap.cc:492] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:21.271095 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:21.275527 16989 ts_tablet_manager.cc:1403] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.100s	user 0.008s	sys 0.007s
W20260709 13:21:21.278949 16762 leader_election.cc:343] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.279976 16762 leader_election.cc:304] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:21.281086 17313 raft_consensus.cc:2749] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.281692 16991 tablet_bootstrap.cc:492] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:21.282315 16991 ts_tablet_manager.cc:1403] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.166s	user 0.019s	sys 0.025s
I20260709 13:21:21.284329 16989 raft_consensus.cc:359] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.285147 16989 raft_consensus.cc:385] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.285496 16989 raft_consensus.cc:740] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.286230 16989 consensus_queue.cc:260] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.287309 16991 raft_consensus.cc:359] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:21.288645 16991 raft_consensus.cc:385] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.289634 16991 raft_consensus.cc:740] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.290583 16991 consensus_queue.cc:260] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:21.292989 16991 ts_tablet_manager.cc:1434] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:21:21.294472 16991 tablet_bootstrap.cc:492] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:21.294622 17317 raft_consensus.cc:493] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.295164 17317 raft_consensus.cc:515] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.295926 16990 tablet_bootstrap.cc:654] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.297777 17317 leader_election.cc:290] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:21.299645 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a3b0acceaf4cada63b5f215fab4a29" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:21.300486 16989 ts_tablet_manager.cc:1434] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 13:21:21.300978 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a3b0acceaf4cada63b5f215fab4a29" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:21.301759 16989 tablet_bootstrap.cc:492] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:21.301664 16869 raft_consensus.cc:2468] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:21.304159 16685 leader_election.cc:304] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:21.305507 17317 raft_consensus.cc:2804] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:21.305965 17317 raft_consensus.cc:493] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:21.306322 17317 raft_consensus.cc:3060] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.293182 17283 raft_consensus.cc:515] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.309695 16989 tablet_bootstrap.cc:654] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.312517 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:21.313177 16943 raft_consensus.cc:3060] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:21.314646 16687 leader_election.cc:343] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.337266 16943 raft_consensus.cc:2468] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 2.
I20260709 13:21:21.340482 16687 leader_election.cc:304] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:21.338956 17317 raft_consensus.cc:515] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.343504 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a3b0acceaf4cada63b5f215fab4a29" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:21.344115 16869 raft_consensus.cc:3060] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.345567 17283 leader_election.cc:290] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:21.346207 17283 raft_consensus.cc:2804] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:21.346657 17283 raft_consensus.cc:697] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:21.347442 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:21.348150 16792 raft_consensus.cc:3060] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:21.335999 16615 catalog_manager.cc:5697] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:21.351445 16615 catalog_manager.cc:5697] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:21.355921 16792 raft_consensus.cc:2468] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 2.
I20260709 13:21:21.347491 17283 consensus_queue.cc:237] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.378794 17317 leader_election.cc:290] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:21.380597 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a3b0acceaf4cada63b5f215fab4a29" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:21.382038 16991 tablet_bootstrap.cc:654] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:21.382896 16687 leader_election.cc:343] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.391326 17320 raft_consensus.cc:493] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.391913 17320 raft_consensus.cc:515] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:21.392958 16869 raft_consensus.cc:2468] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:21.394809 16685 leader_election.cc:304] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:21.395881 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465607298c84b8dbd8007c816bc5c9c" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:21.396288 17006 raft_consensus.cc:2804] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:21.396561 16792 raft_consensus.cc:2468] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:21.396853 17006 raft_consensus.cc:697] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:21.397966 16835 leader_election.cc:304] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:21.397811 17006 consensus_queue.cc:237] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.398710 17376 raft_consensus.cc:2804] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:21.399070 17376 raft_consensus.cc:493] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:21.399395 17376 raft_consensus.cc:3060] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.399952 17320 leader_election.cc:290] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:21.409950 16619 catalog_manager.cc:5697] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:21.411331 16990 tablet_bootstrap.cc:492] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:21.411854 16990 ts_tablet_manager.cc:1403] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.170s	user 0.014s	sys 0.012s
I20260709 13:21:21.412437 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465607298c84b8dbd8007c816bc5c9c" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:21.413419 16943 raft_consensus.cc:2468] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:21.432642 16989 tablet_bootstrap.cc:492] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:21.433159 16989 ts_tablet_manager.cc:1403] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.132s	user 0.027s	sys 0.038s
I20260709 13:21:21.414475 16990 raft_consensus.cc:359] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:21.435886 16990 raft_consensus.cc:385] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.436185 16990 raft_consensus.cc:740] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.436800 17376 raft_consensus.cc:515] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:21.437060 16990 consensus_queue.cc:260] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:21.438937 16990 ts_tablet_manager.cc:1434] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:21:21.439946 16990 tablet_bootstrap.cc:492] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:21.439756 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465607298c84b8dbd8007c816bc5c9c" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:21.440490 16795 raft_consensus.cc:3060] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.443480 17376 leader_election.cc:290] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:21.444293 16989 raft_consensus.cc:359] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.445007 16989 raft_consensus.cc:385] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.445268 16989 raft_consensus.cc:740] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.445978 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465607298c84b8dbd8007c816bc5c9c" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:21.445964 16989 consensus_queue.cc:260] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.446648 16943 raft_consensus.cc:3060] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.448117 16989 ts_tablet_manager.cc:1434] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:21:21.449084 16989 tablet_bootstrap.cc:492] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:21.450431 16795 raft_consensus.cc:2468] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:21.451645 16835 leader_election.cc:304] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:21.452545 17320 raft_consensus.cc:2804] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:21.453034 17320 raft_consensus.cc:697] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:21.453912 17320 consensus_queue.cc:237] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:21.455926 16990 tablet_bootstrap.cc:654] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.456559 16943 raft_consensus.cc:2468] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:21.462749 17367 consensus_queue.cc:1048] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:21.463578 16991 tablet_bootstrap.cc:492] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:21.464130 16991 ts_tablet_manager.cc:1403] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.170s	user 0.017s	sys 0.004s
I20260709 13:21:21.464263 17367 consensus_queue.cc:1048] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:21.467000 16991 raft_consensus.cc:359] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.467689 16991 raft_consensus.cc:385] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.467991 16991 raft_consensus.cc:740] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.468636 16991 consensus_queue.cc:260] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.480474 17313 raft_consensus.cc:493] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.483829 17313 raft_consensus.cc:515] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.497988 17006 raft_consensus.cc:493] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.498787 17006 raft_consensus.cc:515] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.502609 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c889f0451934db588983524416a5269" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:21.504542 16687 leader_election.cc:343] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.505860 17006 leader_election.cc:290] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:21.498732 16990 tablet_bootstrap.cc:492] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:21.507144 16990 ts_tablet_manager.cc:1403] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.001s
I20260709 13:21:21.486321 17313 leader_election.cc:290] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:21.508050 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c889f0451934db588983524416a5269" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:21.508687 16991 ts_tablet_manager.cc:1434] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.003s
I20260709 13:21:21.534379 16718 raft_consensus.cc:2468] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 0.
I20260709 13:21:21.513584 17317 raft_consensus.cc:493] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.535017 16991 tablet_bootstrap.cc:492] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:21.535369 17317 raft_consensus.cc:515] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.536723 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c889f0451934db588983524416a5269" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:21.537348 16795 raft_consensus.cc:2468] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:21.538938 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c540f98dc1640918b733b6bef45d026" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
W20260709 13:21:21.540927 16685 leader_election.cc:343] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.541183 16762 leader_election.cc:304] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:21.541908 16991 tablet_bootstrap.cc:654] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.542083 17313 raft_consensus.cc:2804] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:21.542508 17313 raft_consensus.cc:493] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:21.542835 17313 raft_consensus.cc:3060] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.543680 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c540f98dc1640918b733b6bef45d026" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:21.544450 17317 leader_election.cc:290] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:21.519323 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c889f0451934db588983524416a5269" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:21.519604 16615 catalog_manager.cc:5697] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:21.545243 16687 leader_election.cc:343] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.545727 16687 leader_election.cc:304] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:21.527103 17079 raft_consensus.cc:493] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.546731 17079 raft_consensus.cc:515] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.546487 16615 catalog_manager.cc:5697] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 2, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:21.547195 17317 raft_consensus.cc:2749] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.549279 16990 raft_consensus.cc:359] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.549945 16990 raft_consensus.cc:385] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.550215 16990 raft_consensus.cc:740] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.549702 16616 catalog_manager.cc:5697] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:21.550894 16990 consensus_queue.cc:260] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.551442 17079 leader_election.cc:290] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:21.550334 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a3b0acceaf4cada63b5f215fab4a29" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:21.552325 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a3b0acceaf4cada63b5f215fab4a29" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:21.553110 16869 raft_consensus.cc:2393] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in this term.
W20260709 13:21:21.553987 16762 leader_election.cc:343] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.528733 16989 tablet_bootstrap.cc:654] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.554464 16908 leader_election.cc:304] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:21.555107 16990 ts_tablet_manager.cc:1434] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:21:21.556141 16990 tablet_bootstrap.cc:492] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:21.556504 17284 raft_consensus.cc:3060] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.558007 16686 leader_election.cc:304] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:21.558740 17317 raft_consensus.cc:2804] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:21.559104 17317 raft_consensus.cc:493] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:21.559417 17317 raft_consensus.cc:3060] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.564782 17284 raft_consensus.cc:2749] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.566517 17317 raft_consensus.cc:515] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.569832 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c889f0451934db588983524416a5269" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
W20260709 13:21:21.574208 16687 leader_election.cc:343] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.600157 16990 tablet_bootstrap.cc:654] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.608691 16869 raft_consensus.cc:3060] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.572911 17313 raft_consensus.cc:515] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.610811 17313 leader_election.cc:290] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:21.616060 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c889f0451934db588983524416a5269" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
W20260709 13:21:21.624879 16666 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:21:21.626344 16762 leader_election.cc:343] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.650898 16991 tablet_bootstrap.cc:492] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:21.657299 17127 consensus_queue.cc:1048] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:21.649119 17317 leader_election.cc:290] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:21.670409 16991 ts_tablet_manager.cc:1403] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.136s	user 0.011s	sys 0.005s
I20260709 13:21:21.676795 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c889f0451934db588983524416a5269" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:21.677596 16795 raft_consensus.cc:2393] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in current term 1: Already voted for candidate 5642511b38924ffcbe38110cf27d3535 in this term.
I20260709 13:21:21.679859 17320 consensus_queue.cc:1048] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:21.682519 16989 tablet_bootstrap.cc:492] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:21.683055 16989 ts_tablet_manager.cc:1403] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.234s	user 0.009s	sys 0.007s
I20260709 13:21:21.687114 16991 raft_consensus.cc:359] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:21.687880 16991 raft_consensus.cc:385] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.688148 16991 raft_consensus.cc:740] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.688856 16991 consensus_queue.cc:260] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:21.697153 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c889f0451934db588983524416a5269" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:21.698136 16717 raft_consensus.cc:2393] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 1: Already voted for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in this term.
I20260709 13:21:21.699297 17404 consensus_queue.cc:1048] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:21.699692 16686 leader_election.cc:304] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:21.700634 17404 raft_consensus.cc:2749] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.700795 16991 ts_tablet_manager.cc:1434] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:21:21.701645 16762 leader_election.cc:304] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:21.701898 16991 tablet_bootstrap.cc:492] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:21.702715 17313 raft_consensus.cc:2749] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:21.702768 17284 raft_consensus.cc:493] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.708150 17284 raft_consensus.cc:515] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:21.710268 17284 leader_election.cc:290] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:21.712816 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec264452e294befb3fab6c21b1307ba" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:21.713543 16792 raft_consensus.cc:2468] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 0.
I20260709 13:21:21.714860 16909 leader_election.cc:304] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:21.715850 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec264452e294befb3fab6c21b1307ba" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
W20260709 13:21:21.717365 16908 leader_election.cc:343] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.719128 17284 raft_consensus.cc:2804] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:21.719597 17284 raft_consensus.cc:493] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:21.719923 17284 raft_consensus.cc:3060] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.726630 16989 raft_consensus.cc:359] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:21.727479 16989 raft_consensus.cc:385] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.727802 16989 raft_consensus.cc:740] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.734247 17320 raft_consensus.cc:493] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.734359 17284 raft_consensus.cc:515] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:21.734982 17320 raft_consensus.cc:515] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.737138 17320 leader_election.cc:290] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:21.743251 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c540f98dc1640918b733b6bef45d026" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:21.745945 16836 leader_election.cc:343] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.750010 17284 leader_election.cc:290] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:21.750680 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec264452e294befb3fab6c21b1307ba" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:21.751390 16792 raft_consensus.cc:3060] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.751940 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c540f98dc1640918b733b6bef45d026" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:21.752259 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec264452e294befb3fab6c21b1307ba" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:21.753495 17367 consensus_queue.cc:1048] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:21.755455 16991 tablet_bootstrap.cc:654] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.752578 16719 raft_consensus.cc:2468] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:21.759109 16989 consensus_queue.cc:260] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
W20260709 13:21:21.765532 16908 leader_election.cc:343] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.765404 16792 raft_consensus.cc:2468] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:21.767953 16909 leader_election.cc:304] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:21.769167 17284 raft_consensus.cc:2804] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:21.769831 17284 raft_consensus.cc:697] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:21.770716 17284 consensus_queue.cc:237] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:21.771225 16990 tablet_bootstrap.cc:492] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:21.775290 16990 ts_tablet_manager.cc:1403] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.219s	user 0.039s	sys 0.032s
I20260709 13:21:21.778465 16990 raft_consensus.cc:359] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:21.779740 16990 raft_consensus.cc:385] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.780134 16990 raft_consensus.cc:740] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.780917 16990 consensus_queue.cc:260] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:21.797066 16990 ts_tablet_manager.cc:1434] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:21:21.798319 16990 tablet_bootstrap.cc:492] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:21.803344 17127 raft_consensus.cc:493] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.804144 17127 raft_consensus.cc:515] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:21.813956 16990 tablet_bootstrap.cc:654] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.822362 17127 leader_election.cc:290] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:21.824667 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:21.827153 16686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:34809, user_credentials={real_user=slave}} blocked reactor thread for 65164.7us
I20260709 13:21:21.828676 16836 leader_election.cc:304] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:21.830235 17366 raft_consensus.cc:2804] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:21:21.830613 16687 leader_election.cc:343] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:21.830794 17366 raft_consensus.cc:493] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:21.831614 17366 raft_consensus.cc:3060] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.856086 17127 consensus_queue.cc:1048] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:21.900534 17317 consensus_queue.cc:1048] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:21.941349 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:21.942500 16795 raft_consensus.cc:2468] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:21.774168 16989 ts_tablet_manager.cc:1434] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.003s
I20260709 13:21:21.951427 17376 raft_consensus.cc:493] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.952157 17376 raft_consensus.cc:515] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:21.954613 17376 leader_election.cc:290] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:21.959824 16792 raft_consensus.cc:1275] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:21.970747 16989 tablet_bootstrap.cc:492] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:21.984038 17366 raft_consensus.cc:515] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:21.987160 17366 leader_election.cc:290] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:21.992897 16686 leader_election.cc:304] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:22.002853 17317 raft_consensus.cc:2804] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:22.003268 17317 raft_consensus.cc:493] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.003600 17317 raft_consensus.cc:3060] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.011891 17127 consensus_queue.cc:1048] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:22.015865 17367 consensus_queue.cc:1048] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:22.024365 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec264452e294befb3fab6c21b1307ba" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:22.067480 16795 raft_consensus.cc:2393] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a0b5583e0547a88c88b590549fbcee in current term 1: Already voted for candidate 266d75f35db4465788ab06782fae972d in this term.
I20260709 13:21:22.073693 16941 raft_consensus.cc:1275] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:22.075954 17404 raft_consensus.cc:493] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.076794 17404 raft_consensus.cc:515] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:22.077796 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ec264452e294befb3fab6c21b1307ba" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:22.081022 17006 consensus_queue.cc:1048] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:22.081729 17404 leader_election.cc:290] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:22.082543 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
W20260709 13:21:22.086839 16685 leader_election.cc:343] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.093194 17317 raft_consensus.cc:515] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:22.107170 17317 leader_election.cc:290] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:22.109498 16990 tablet_bootstrap.cc:492] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:22.110512 16990 ts_tablet_manager.cc:1403] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.312s	user 0.109s	sys 0.106s
I20260709 13:21:22.114382 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:22.114565 16990 raft_consensus.cc:359] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:22.116530 16990 raft_consensus.cc:385] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.116338 16794 raft_consensus.cc:2468] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 0.
I20260709 13:21:22.116775 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:22.117660 16796 raft_consensus.cc:3060] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.117043 16990 raft_consensus.cc:740] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
W20260709 13:21:22.117055 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 69708.6us
I20260709 13:21:22.118854 16990 consensus_queue.cc:260] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:22.121116 16990 ts_tablet_manager.cc:1434] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:21:22.122138 16990 tablet_bootstrap.cc:492] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:22.126009 16796 raft_consensus.cc:2468] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:22.127863 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c540f98dc1640918b733b6bef45d026" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:22.128571 16717 raft_consensus.cc:3060] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.129793 16990 tablet_bootstrap.cc:654] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.139902 16991 tablet_bootstrap.cc:492] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:22.140445 16991 ts_tablet_manager.cc:1403] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.439s	user 0.050s	sys 0.091s
I20260709 13:21:22.144603 16991 raft_consensus.cc:359] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:22.145395 16991 raft_consensus.cc:385] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.145727 16991 raft_consensus.cc:740] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.146463 16991 consensus_queue.cc:260] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:22.157261 16991 ts_tablet_manager.cc:1434] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.006s
I20260709 13:21:22.156883 16686 leader_election.cc:304] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:22.158733 16991 tablet_bootstrap.cc:492] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:22.165719 17127 raft_consensus.cc:2804] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:22.166551 17127 raft_consensus.cc:493] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.167135 17127 raft_consensus.cc:3060] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.168875 16686 leader_election.cc:304] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:22.183250 17317 raft_consensus.cc:2804] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:22.184289 17317 raft_consensus.cc:697] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:22.185583 17317 consensus_queue.cc:237] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:22.189922 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:22.172366 16836 leader_election.cc:304] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:22.196923 17419 raft_consensus.cc:3060] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.197366 16616 catalog_manager.cc:5697] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 0 to 1, leader changed from <none> to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 1 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:22.165933 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c540f98dc1640918b733b6bef45d026" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:22.176903 16991 tablet_bootstrap.cc:654] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.206168 17006 raft_consensus.cc:493] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71a0b5583e0547a88c88b590549fbcee)
I20260709 13:21:22.206974 17006 raft_consensus.cc:515] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.210100 17006 leader_election.cc:290] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:22.201586 17284 raft_consensus.cc:493] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.212355 17284 raft_consensus.cc:515] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:22.182128 16717 raft_consensus.cc:2468] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:22.210222 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:22.215873 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8760c2c176b64d10ae61d46fa3c8605b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:22.216820 17284 leader_election.cc:290] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:22.216071 16869 raft_consensus.cc:2468] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 2.
I20260709 13:21:22.218528 16685 leader_election.cc:304] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:22.219372 17006 raft_consensus.cc:2804] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:22.219694 17006 raft_consensus.cc:493] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71a0b5583e0547a88c88b590549fbcee)
I20260709 13:21:22.220000 17006 raft_consensus.cc:3060] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:22.224488 16687 leader_election.cc:343] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.226745 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8760c2c176b64d10ae61d46fa3c8605b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:22.231854 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:22.233160 16941 raft_consensus.cc:2393] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in current term 2: Already voted for candidate 266d75f35db4465788ab06782fae972d in this term.
I20260709 13:21:22.239037 16989 tablet_bootstrap.cc:700] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent opening tablet: real 0.123s	user 0.003s	sys 0.000s
I20260709 13:21:22.247077 16989 tablet_bootstrap.cc:654] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.239600 16909 leader_election.cc:304] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:22.245092 16991 tablet_bootstrap.cc:492] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:22.248286 17079 raft_consensus.cc:2749] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.248298 16991 ts_tablet_manager.cc:1403] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.090s	user 0.005s	sys 0.029s
I20260709 13:21:22.251541 16991 raft_consensus.cc:359] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.252242 16991 raft_consensus.cc:385] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.252526 16991 raft_consensus.cc:740] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.253326 16991 consensus_queue.cc:260] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.255359 16991 ts_tablet_manager.cc:1434] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:21:22.256659 16991 tablet_bootstrap.cc:492] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:22.257160 17127 raft_consensus.cc:515] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:22.263947 16991 tablet_bootstrap.cc:654] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.254911 17006 raft_consensus.cc:515] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.267313 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
W20260709 13:21:22.269557 16685 leader_election.cc:343] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.271409 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:22.272027 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:22.272629 16792 raft_consensus.cc:3060] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.275139 16836 leader_election.cc:304] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:22.277010 17367 raft_consensus.cc:2804] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:22.282490 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:22.283396 16941 raft_consensus.cc:2393] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in current term 2: Already voted for candidate 266d75f35db4465788ab06782fae972d in this term.
I20260709 13:21:22.287319 17367 raft_consensus.cc:697] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:22.288393 17367 consensus_queue.cc:237] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.265998 17127 leader_election.cc:290] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:22.297410 16870 raft_consensus.cc:2468] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 2.
I20260709 13:21:22.316000 16685 leader_election.cc:304] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:22.317023 17317 raft_consensus.cc:2804] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:22.317796 17317 raft_consensus.cc:697] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:22.318816 17317 consensus_queue.cc:237] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.311587 17284 raft_consensus.cc:493] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.319947 17284 raft_consensus.cc:515] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.324688 17284 leader_election.cc:290] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:22.309617 17006 leader_election.cc:290] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
W20260709 13:21:22.328282 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 52090.4us
I20260709 13:21:22.338454 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:22.301759 16792 raft_consensus.cc:2468] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:22.351258 17284 consensus_queue.cc:1048] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:22.359743 17376 consensus_queue.cc:1048] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:22.362619 16836 leader_election.cc:343] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.368664 17419 raft_consensus.cc:2749] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.370965 17367 raft_consensus.cc:493] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.375346 17367 raft_consensus.cc:515] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:22.367455 16686 leader_election.cc:304] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:22.376868 17127 raft_consensus.cc:2804] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:22.377975 17367 leader_election.cc:290] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:22.379582 17127 raft_consensus.cc:697] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:22.382407 17127 consensus_queue.cc:237] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:22.388778 16943 raft_consensus.cc:3060] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.391495 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702099270174fe58528799e1564c74b" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:22.397984 16836 leader_election.cc:343] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.399981 16990 tablet_bootstrap.cc:492] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:22.400558 16990 ts_tablet_manager.cc:1403] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.279s	user 0.040s	sys 0.059s
I20260709 13:21:22.404414 16990 raft_consensus.cc:359] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:22.405184 16990 raft_consensus.cc:385] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.405503 16990 raft_consensus.cc:740] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.406275 16990 consensus_queue.cc:260] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:22.411276 16990 ts_tablet_manager.cc:1434] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:21:22.412508 16990 tablet_bootstrap.cc:492] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee: Bootstrap starting.
I20260709 13:21:22.416455 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702099270174fe58528799e1564c74b" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:22.418565 16796 raft_consensus.cc:2468] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:22.425400 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:22.425755 16835 leader_election.cc:304] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:22.433238 16989 tablet_bootstrap.cc:492] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9: No bootstrap required, opened a new log
I20260709 13:21:22.433992 16989 ts_tablet_manager.cc:1403] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.464s	user 0.017s	sys 0.000s
I20260709 13:21:22.438452 16989 raft_consensus.cc:359] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.444976 16989 raft_consensus.cc:385] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.445295 16989 raft_consensus.cc:740] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.446035 16989 consensus_queue.cc:260] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.448985 16989 ts_tablet_manager.cc:1434] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:21:22.453346 17376 raft_consensus.cc:2804] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:22.454038 17376 raft_consensus.cc:493] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.454517 17376 raft_consensus.cc:3060] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.462124 16941 raft_consensus.cc:3060] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.463726 17284 consensus_queue.cc:1048] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:22.464859 17376 raft_consensus.cc:515] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:22.467219 17376 leader_election.cc:290] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:22.472013 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702099270174fe58528799e1564c74b" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
W20260709 13:21:22.475042 16836 leader_election.cc:343] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.487365 17367 raft_consensus.cc:493] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.488091 17367 raft_consensus.cc:515] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:22.491425 17367 leader_election.cc:290] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:22.495023 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:22.504561 16990 tablet_bootstrap.cc:654] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.507867 16908 leader_election.cc:304] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:22.511009 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:22.511222 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702099270174fe58528799e1564c74b" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:22.511714 17361 raft_consensus.cc:2749] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.511932 16796 raft_consensus.cc:3060] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.511947 16792 raft_consensus.cc:2393] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a0b5583e0547a88c88b590549fbcee in current term 1: Already voted for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in this term.
I20260709 13:21:22.526266 16991 tablet_bootstrap.cc:492] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:22.526839 16991 ts_tablet_manager.cc:1403] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.270s	user 0.052s	sys 0.122s
I20260709 13:21:22.527359 16796 raft_consensus.cc:2468] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:22.528188 16990 tablet_bootstrap.cc:492] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee: No bootstrap required, opened a new log
I20260709 13:21:22.529548 16991 raft_consensus.cc:359] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.530211 16990 ts_tablet_manager.cc:1403] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee: Time spent bootstrapping tablet: real 0.118s	user 0.013s	sys 0.005s
I20260709 13:21:22.530275 16991 raft_consensus.cc:385] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.530706 16991 raft_consensus.cc:740] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.531989 16991 consensus_queue.cc:260] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.533737 16990 raft_consensus.cc:359] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.534471 16990 raft_consensus.cc:385] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.534837 16990 raft_consensus.cc:740] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.535734 16990 consensus_queue.cc:260] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.537631 16991 ts_tablet_manager.cc:1434] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:21:22.538079 16990 ts_tablet_manager.cc:1434] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:21:22.538826 16991 tablet_bootstrap.cc:492] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:22.546470 16835 leader_election.cc:304] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:22.547287 17367 raft_consensus.cc:3060] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.547602 16991 tablet_bootstrap.cc:654] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.548126 16615 catalog_manager.cc:5697] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.555719 17367 raft_consensus.cc:2749] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.559584 16991 tablet_bootstrap.cc:492] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:22.560374 16991 ts_tablet_manager.cc:1403] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.000s
I20260709 13:21:22.555891 16615 catalog_manager.cc:5697] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.563063 17376 raft_consensus.cc:493] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.562907 16615 catalog_manager.cc:5697] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 1 to 2, leader changed from 71a0b5583e0547a88c88b590549fbcee (127.6.214.131) to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:22.563671 17376 raft_consensus.cc:515] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.568609 17376 leader_election.cc:290] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:22.570430 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e375bb738794feab91d445c1c81cd73" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:22.570858 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e375bb738794feab91d445c1c81cd73" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:22.571097 16719 raft_consensus.cc:2468] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 0.
I20260709 13:21:22.572556 16836 leader_election.cc:304] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:22.572798 16835 leader_election.cc:304] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 266d75f35db4465788ab06782fae972d
W20260709 13:21:22.573611 16836 leader_election.cc:343] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.574683 17376 raft_consensus.cc:2804] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:22.574937 17367 raft_consensus.cc:2804] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:22.575237 17376 raft_consensus.cc:493] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.575802 17376 raft_consensus.cc:3060] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.577399 17367 raft_consensus.cc:697] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:22.564998 16991 raft_consensus.cc:359] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:22.580363 16991 raft_consensus.cc:385] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.565805 17361 raft_consensus.cc:493] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.580706 16991 raft_consensus.cc:740] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.581113 17361 raft_consensus.cc:515] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.584046 17361 leader_election.cc:290] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:22.586650 16719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c540f98dc1640918b733b6bef45d026" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:22.587513 16719 raft_consensus.cc:2393] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 71a0b5583e0547a88c88b590549fbcee in this term.
I20260709 13:21:22.585705 17376 raft_consensus.cc:515] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.589283 17367 consensus_queue.cc:237] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:22.591013 17376 leader_election.cc:290] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:22.581699 16991 consensus_queue.cc:260] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:22.595368 16991 ts_tablet_manager.cc:1434] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:21:22.596431 16991 tablet_bootstrap.cc:492] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:22.596853 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e375bb738794feab91d445c1c81cd73" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:22.602938 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e375bb738794feab91d445c1c81cd73" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:22.604156 16717 raft_consensus.cc:3060] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.605047 16618 catalog_manager.cc:5697] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.606074 16991 tablet_bootstrap.cc:654] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:22.612195 16836 leader_election.cc:343] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 266d75f35db4465788ab06782fae972d (127.6.214.132:32963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:22.679688 16991 tablet_bootstrap.cc:492] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:22.680403 16991 ts_tablet_manager.cc:1403] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.037s
I20260709 13:21:22.691602 16991 raft_consensus.cc:359] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:22.693733 16991 raft_consensus.cc:385] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.697542 16991 raft_consensus.cc:740] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.698871 16991 consensus_queue.cc:260] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:22.702288 16991 ts_tablet_manager.cc:1434] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
W20260709 13:21:22.707782 16666 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:22.708781 16869 raft_consensus.cc:1275] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:22.710556 16991 tablet_bootstrap.cc:492] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:22.715711 17317 consensus_queue.cc:1048] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:22.721478 16991 tablet_bootstrap.cc:654] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.729696 17361 raft_consensus.cc:493] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.730497 17361 raft_consensus.cc:515] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:22.732327 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c540f98dc1640918b733b6bef45d026" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:22.732762 17361 leader_election.cc:290] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:22.734716 16718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:22.737713 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:22.738451 16792 raft_consensus.cc:2393] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in this term.
I20260709 13:21:22.739473 16909 leader_election.cc:304] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:22.740325 17361 raft_consensus.cc:3060] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.748111 17361 raft_consensus.cc:2749] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.754146 16943 raft_consensus.cc:1275] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:22.760110 17317 consensus_queue.cc:1048] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:22.762861 16908 leader_election.cc:304] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:22.764390 17370 raft_consensus.cc:3060] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.773564 17127 consensus_queue.cc:1048] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:22.777658 17370 raft_consensus.cc:2749] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:22.833361 17006 consensus_queue.cc:1048] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:22.696723 16717 raft_consensus.cc:2468] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:22.839917 17376 consensus_queue.cc:1048] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:22.881722 16615 catalog_manager.cc:5697] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.883667 16991 tablet_bootstrap.cc:492] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:22.884209 16991 ts_tablet_manager.cc:1403] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.174s	user 0.033s	sys 0.057s
I20260709 13:21:22.889715 17283 consensus_queue.cc:1048] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:22.892540 16991 raft_consensus.cc:359] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:22.893298 16991 raft_consensus.cc:385] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:22.893589 16991 raft_consensus.cc:740] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:22.902741 16991 consensus_queue.cc:260] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:22.905453 16991 ts_tablet_manager.cc:1434] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:21:22.910624 16991 tablet_bootstrap.cc:492] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d: Bootstrap starting.
I20260709 13:21:22.916626 16991 tablet_bootstrap.cc:654] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.916630 16836 leader_election.cc:304] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:22.920189 17366 raft_consensus.cc:2804] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:22.920683 17366 raft_consensus.cc:697] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:22.922549 17366 consensus_queue.cc:237] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:22.954172 17361 raft_consensus.cc:493] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.954707 17361 raft_consensus.cc:515] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:22.964283 17361 leader_election.cc:290] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:22.980198 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702099270174fe58528799e1564c74b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:22.985095 17127 consensus_queue.cc:1048] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:22.989985 16991 tablet_bootstrap.cc:492] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d: No bootstrap required, opened a new log
I20260709 13:21:22.990554 16991 ts_tablet_manager.cc:1403] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d: Time spent bootstrapping tablet: real 0.080s	user 0.007s	sys 0.006s
I20260709 13:21:22.994081 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702099270174fe58528799e1564c74b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:22.995304 16792 raft_consensus.cc:2393] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 71a0b5583e0547a88c88b590549fbcee in this term.
I20260709 13:21:22.998906 16909 leader_election.cc:304] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:23.007910 17361 raft_consensus.cc:3060] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:22.998646 16991 raft_consensus.cc:359] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:23.014916 16991 raft_consensus.cc:385] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.015460 16991 raft_consensus.cc:740] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.015966 17361 raft_consensus.cc:2749] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:23.016475 16991 consensus_queue.cc:260] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:23.026839 17367 consensus_queue.cc:1048] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:23.033823 16991 ts_tablet_manager.cc:1434] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.001s
W20260709 13:21:23.061786 16686 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:34809, user_credentials={real_user=slave}} blocked reactor thread for 78541.9us
I20260709 13:21:23.071156 17419 consensus_queue.cc:1048] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:21:23.087448 16615 catalog_manager.cc:5697] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:23.146101 17370 raft_consensus.cc:493] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.146857 17370 raft_consensus.cc:515] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:23.150795 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e375bb738794feab91d445c1c81cd73" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:23.151314 17370 leader_election.cc:290] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:23.152477 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e375bb738794feab91d445c1c81cd73" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:23.153466 16717 raft_consensus.cc:2393] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 71a0b5583e0547a88c88b590549fbcee in this term.
I20260709 13:21:23.155525 16910 leader_election.cc:304] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:23.156488 17361 raft_consensus.cc:3060] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.163883 17361 raft_consensus.cc:2749] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:23.165585 17361 raft_consensus.cc:493] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.166147 17361 raft_consensus.cc:515] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:23.176321 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c889f0451934db588983524416a5269" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:23.177222 16717 raft_consensus.cc:2393] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in this term.
I20260709 13:21:23.179056 17361 leader_election.cc:290] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:23.182338 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c889f0451934db588983524416a5269" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:23.183411 16794 raft_consensus.cc:2393] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 1: Already voted for candidate 5642511b38924ffcbe38110cf27d3535 in this term.
I20260709 13:21:23.184543 16909 leader_election.cc:304] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:23.185916 17370 raft_consensus.cc:3060] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.193521 17370 raft_consensus.cc:2749] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:23.198259 16760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:46515, user_credentials={real_user=slave}} blocked reactor thread for 94299.1us
I20260709 13:21:23.201162 17430 consensus_queue.cc:1048] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:23.305222 17366 consensus_queue.cc:1048] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:23.320263 17366 consensus_queue.cc:1048] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:23.534933 17462 raft_consensus.cc:493] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.535554 17462 raft_consensus.cc:515] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:23.537984 17462 leader_election.cc:290] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:23.538472 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c889f0451934db588983524416a5269" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:23.539140 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c889f0451934db588983524416a5269" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:23.539842 16717 raft_consensus.cc:2468] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:23.539139 16943 raft_consensus.cc:2468] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:23.540828 16762 leader_election.cc:304] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:23.541507 17462 raft_consensus.cc:2804] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:23.541880 17462 raft_consensus.cc:493] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.542220 17462 raft_consensus.cc:3060] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:23.549742 17462 raft_consensus.cc:515] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:23.551496 17462 leader_election.cc:290] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:23.552424 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c889f0451934db588983524416a5269" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:23.553066 16943 raft_consensus.cc:3060] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:23.553037 16717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c889f0451934db588983524416a5269" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:23.553835 16717 raft_consensus.cc:3060] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:23.560313 16943 raft_consensus.cc:2468] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
I20260709 13:21:23.561947 16762 leader_election.cc:304] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:23.563051 17462 raft_consensus.cc:2804] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:23.563577 17462 raft_consensus.cc:697] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:23.564004 16717 raft_consensus.cc:2468] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
I20260709 13:21:23.564977 17462 consensus_queue.cc:237] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:23.578073 16618 catalog_manager.cc:5697] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 0 to 2, leader changed from <none> to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:24.077122 16943 raft_consensus.cc:1275] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Refusing update from remote peer 5642511b38924ffcbe38110cf27d3535: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:24.078512 17462 consensus_queue.cc:1048] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.105732 16717 raft_consensus.cc:1275] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Refusing update from remote peer 5642511b38924ffcbe38110cf27d3535: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:24.107578 17470 consensus_queue.cc:1048] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:24.500244  7002 tablet_server.cc:179] TabletServer@127.6.214.129:0 shutting down...
W20260709 13:21:24.539258 16836 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:24.547130  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:24.548780  7002 tablet_replica.cc:333] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.549798  7002 raft_consensus.cc:2243] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.552994  7002 raft_consensus.cc:2272] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:24.553781 16836 consensus_peers.cc:597] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.555768  7002 tablet_replica.cc:333] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
W20260709 13:21:24.557406 16910 consensus_peers.cc:597] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.557791  7002 raft_consensus.cc:2243] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.558285  7002 raft_consensus.cc:2272] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.560017  7002 tablet_replica.cc:333] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
W20260709 13:21:24.560173 16910 consensus_peers.cc:597] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.560659  7002 raft_consensus.cc:2243] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.561141  7002 raft_consensus.cc:2272] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:24.556608 16762 consensus_peers.cc:597] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.563275  7002 tablet_replica.cc:333] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.563860  7002 raft_consensus.cc:2243] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.564222  7002 raft_consensus.cc:2272] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.565990  7002 tablet_replica.cc:333] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.566525  7002 raft_consensus.cc:2243] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.567210  7002 raft_consensus.cc:2272] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.568956  7002 tablet_replica.cc:333] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.569738  7002 raft_consensus.cc:2243] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.570585  7002 raft_consensus.cc:2272] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.572561  7002 tablet_replica.cc:333] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.573318  7002 raft_consensus.cc:2243] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.574214  7002 raft_consensus.cc:2272] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.576400  7002 tablet_replica.cc:333] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.576995  7002 raft_consensus.cc:2243] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.577782  7002 raft_consensus.cc:2272] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.579543  7002 tablet_replica.cc:333] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.580124  7002 raft_consensus.cc:2243] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.580523  7002 raft_consensus.cc:2272] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.582520  7002 tablet_replica.cc:333] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.583331  7002 raft_consensus.cc:2243] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.584219  7002 raft_consensus.cc:2272] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.586496  7002 tablet_replica.cc:333] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.587157  7002 raft_consensus.cc:2243] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.587626  7002 raft_consensus.cc:2272] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.589533  7002 tablet_replica.cc:333] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.590263  7002 raft_consensus.cc:2243] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.591104  7002 raft_consensus.cc:2272] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.593475  7002 tablet_replica.cc:333] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.594328  7002 raft_consensus.cc:2243] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.595299  7002 raft_consensus.cc:2272] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.597836  7002 tablet_replica.cc:333] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.598670  7002 raft_consensus.cc:2243] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.599726  7002 raft_consensus.cc:2272] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.602358  7002 tablet_replica.cc:333] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.603034  7002 raft_consensus.cc:2243] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.603521  7002 raft_consensus.cc:2272] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.605782  7002 tablet_replica.cc:333] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.606429  7002 raft_consensus.cc:2243] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.607275  7002 raft_consensus.cc:2272] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.609045  7002 tablet_replica.cc:333] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.609726  7002 raft_consensus.cc:2243] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.610090  7002 raft_consensus.cc:2272] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.612440  7002 tablet_replica.cc:333] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.613188  7002 raft_consensus.cc:2243] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.613730  7002 raft_consensus.cc:2272] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.615995  7002 tablet_replica.cc:333] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.616786  7002 raft_consensus.cc:2243] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.617270  7002 raft_consensus.cc:2272] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.619405  7002 tablet_replica.cc:333] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.620152  7002 raft_consensus.cc:2243] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.620620  7002 raft_consensus.cc:2272] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.622612  7002 tablet_replica.cc:333] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.623170  7002 raft_consensus.cc:2243] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.623565  7002 raft_consensus.cc:2272] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.625228  7002 tablet_replica.cc:333] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.625823  7002 raft_consensus.cc:2243] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.626601  7002 raft_consensus.cc:2272] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.628547  7002 tablet_replica.cc:333] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.629289  7002 raft_consensus.cc:2243] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.630151  7002 raft_consensus.cc:2272] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.632546  7002 tablet_replica.cc:333] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.633292  7002 raft_consensus.cc:2243] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.633812  7002 raft_consensus.cc:2272] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:24.635663 16836 consensus_peers.cc:597] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.636521  7002 tablet_replica.cc:333] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.637259  7002 raft_consensus.cc:2243] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.637789  7002 raft_consensus.cc:2272] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.640051  7002 tablet_replica.cc:333] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.640745  7002 raft_consensus.cc:2243] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.641512  7002 raft_consensus.cc:2272] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.644064  7002 tablet_replica.cc:333] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.644870  7002 raft_consensus.cc:2243] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.645853  7002 raft_consensus.cc:2272] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:24.646219 16836 consensus_peers.cc:597] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.647953  7002 tablet_replica.cc:333] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.648828  7002 raft_consensus.cc:2243] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.649820  7002 raft_consensus.cc:2272] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:24.651080 16836 consensus_peers.cc:597] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.653241 16836 consensus_peers.cc:597] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.655212  7002 tablet_replica.cc:333] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.655968  7002 raft_consensus.cc:2243] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.656556  7002 raft_consensus.cc:2272] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.659281  7002 tablet_replica.cc:333] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.659924  7002 raft_consensus.cc:2243] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.660377  7002 raft_consensus.cc:2272] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.662567  7002 tablet_replica.cc:333] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.663345  7002 raft_consensus.cc:2243] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.664136  7002 raft_consensus.cc:2272] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.666486  7002 tablet_replica.cc:333] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
W20260709 13:21:24.666642 16910 consensus_peers.cc:597] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.667155  7002 raft_consensus.cc:2243] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.668107  7002 raft_consensus.cc:2272] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.670288  7002 tablet_replica.cc:333] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.671196  7002 raft_consensus.cc:2243] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.671808  7002 raft_consensus.cc:2272] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:24.674638 16762 consensus_peers.cc:597] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.674862  7002 tablet_replica.cc:333] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.675696  7002 raft_consensus.cc:2243] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.676293  7002 raft_consensus.cc:2272] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.678613  7002 tablet_replica.cc:333] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.679661  7002 raft_consensus.cc:2243] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.680140  7002 raft_consensus.cc:2272] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.682277  7002 tablet_replica.cc:333] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.682827  7002 raft_consensus.cc:2243] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.683316  7002 raft_consensus.cc:2272] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.685189  7002 tablet_replica.cc:333] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.685792  7002 raft_consensus.cc:2243] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.686527  7002 raft_consensus.cc:2272] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.688328  7002 tablet_replica.cc:333] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.688901  7002 raft_consensus.cc:2243] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.689314  7002 raft_consensus.cc:2272] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.691668  7002 tablet_replica.cc:333] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.692304  7002 raft_consensus.cc:2243] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.692754  7002 raft_consensus.cc:2272] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.694908  7002 tablet_replica.cc:333] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.695488  7002 raft_consensus.cc:2243] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.695896  7002 raft_consensus.cc:2272] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.697801  7002 tablet_replica.cc:333] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.698398  7002 raft_consensus.cc:2243] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.698840  7002 raft_consensus.cc:2272] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.700795  7002 tablet_replica.cc:333] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.701372  7002 raft_consensus.cc:2243] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.701836  7002 raft_consensus.cc:2272] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.703786  7002 tablet_replica.cc:333] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.704300  7002 raft_consensus.cc:2243] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.705111  7002 raft_consensus.cc:2272] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.706856  7002 tablet_replica.cc:333] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.707435  7002 raft_consensus.cc:2243] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.707916  7002 raft_consensus.cc:2272] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.710009  7002 tablet_replica.cc:333] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9: stopping tablet replica
I20260709 13:21:24.710475  7002 raft_consensus.cc:2243] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:24.710868  7002 raft_consensus.cc:2272] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:24.736452 16836 consensus_peers.cc:597] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.756134 16762 consensus_peers.cc:597] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.784777  7002 tablet_server.cc:196] TabletServer@127.6.214.129:0 shutdown complete.
W20260709 13:21:24.812459 16762 consensus_peers.cc:597] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.826526 16762 consensus_peers.cc:597] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.858566 16836 consensus_peers.cc:597] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.863299 16910 consensus_peers.cc:597] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.866855 16910 consensus_peers.cc:597] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.881637 16836 consensus_peers.cc:597] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.883297  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:24.891867 16836 consensus_peers.cc:597] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.892443 17481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:24.893177 17482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:24.896816  7002 server_base.cc:1061] running on GCE node
W20260709 13:21:24.897383 17484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:24.901248  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:24.901599  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:24.901819  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603284901796 us; error 0 us; skew 500 ppm
I20260709 13:21:24.902451  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:24.906028  7002 webserver.cc:533] Webserver started at http://127.6.214.129:44289/ using document root <none> and password file <none>
I20260709 13:21:24.906584  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:24.906811  7002 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:21:24.911367  7002 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.001s	sys 0.004s
W20260709 13:21:24.919857 16836 consensus_peers.cc:597] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:24.922628 17489 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:24.923652  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:21:24.924037  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-0-root
uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
format_stamp: "Formatted at 2026-07-09 13:21:11 on dist-test-slave-rnv4"
I20260709 13:21:24.924525  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602923898527-7002-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:24.939275  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:24.940593  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:24.942355  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:24.947999 17496 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:21:24.951515 16836 consensus_peers.cc:597] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.966143 16910 consensus_peers.cc:597] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.974211 16762 consensus_peers.cc:597] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.974458 16836 consensus_peers.cc:597] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:24.975013 16836 consensus_peers.cc:597] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:25.081627 16836 consensus_peers.cc:597] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:25.235838  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:21:25.236460  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.290s	user 0.010s	sys 0.001s
I20260709 13:21:25.236974  7002 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:21:25.252274 17496 tablet_bootstrap.cc:492] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.298976 17496 tablet_bootstrap.cc:492] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.300539 17496 tablet_bootstrap.cc:492] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.301177 17496 ts_tablet_manager.cc:1403] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.012s
I20260709 13:21:25.303920 17496 raft_consensus.cc:359] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.304570 17496 raft_consensus.cc:740] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.305362 17496 consensus_queue.cc:260] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.322086 17496 ts_tablet_manager.cc:1434] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.008s
I20260709 13:21:25.322940 17496 tablet_bootstrap.cc:492] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.336647 17496 tablet_bootstrap.cc:492] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.337563 17496 tablet_bootstrap.cc:492] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.338162 17496 ts_tablet_manager.cc:1403] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:21:25.340444 17496 raft_consensus.cc:359] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.341054 17496 raft_consensus.cc:740] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.342020 17496 consensus_queue.cc:260] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.343983 17496 ts_tablet_manager.cc:1434] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:25.344774 17496 tablet_bootstrap.cc:492] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.362003 17496 tablet_bootstrap.cc:492] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.362964 17496 tablet_bootstrap.cc:492] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.363564 17496 ts_tablet_manager.cc:1403] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:21:25.365703 17496 raft_consensus.cc:359] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.366206 17496 raft_consensus.cc:740] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.366698 17496 consensus_queue.cc:260] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.368592 17496 ts_tablet_manager.cc:1434] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:21:25.369251 17496 tablet_bootstrap.cc:492] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.383334 17496 tablet_bootstrap.cc:492] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.384513 17496 tablet_bootstrap.cc:492] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.385182 17496 ts_tablet_manager.cc:1403] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:21:25.387723 17496 raft_consensus.cc:359] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.388410 17496 raft_consensus.cc:740] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.389101 17496 consensus_queue.cc:260] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.391117 17496 ts_tablet_manager.cc:1434] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:25.391988 17496 tablet_bootstrap.cc:492] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.412945 17496 tablet_bootstrap.cc:492] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.414093 17496 tablet_bootstrap.cc:492] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.414882 17496 ts_tablet_manager.cc:1403] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 13:21:25.418030 17496 raft_consensus.cc:359] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.418859 17496 raft_consensus.cc:740] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.419636 17496 consensus_queue.cc:260] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.422294 17496 ts_tablet_manager.cc:1434] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:25.423075 17496 tablet_bootstrap.cc:492] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.436537 17496 tablet_bootstrap.cc:492] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.437474 17496 tablet_bootstrap.cc:492] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.438133 17496 ts_tablet_manager.cc:1403] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:21:25.440124 17496 raft_consensus.cc:359] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.440652 17496 raft_consensus.cc:740] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.441280 17496 consensus_queue.cc:260] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.443174 17496 ts_tablet_manager.cc:1434] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:25.443985 17496 tablet_bootstrap.cc:492] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.459435 17496 tablet_bootstrap.cc:492] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.460407 17496 tablet_bootstrap.cc:492] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.461073 17496 ts_tablet_manager.cc:1403] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:21:25.463927 17496 raft_consensus.cc:359] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.464696 17496 raft_consensus.cc:740] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.465415 17496 consensus_queue.cc:260] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.467407 17496 ts_tablet_manager.cc:1434] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:21:25.468209 17496 tablet_bootstrap.cc:492] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.481208 17496 tablet_bootstrap.cc:492] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.482015 17496 tablet_bootstrap.cc:492] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.482573 17496 ts_tablet_manager.cc:1403] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:21:25.484714 17496 raft_consensus.cc:359] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.485276 17496 raft_consensus.cc:740] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.485911 17496 consensus_queue.cc:260] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.487479 17496 ts_tablet_manager.cc:1434] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:25.488163 17496 tablet_bootstrap.cc:492] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.501119 17496 tablet_bootstrap.cc:492] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.502063 17496 tablet_bootstrap.cc:492] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.502606 17496 ts_tablet_manager.cc:1403] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:21:25.504434  7002 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:21:25.504783  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.268s	user 0.245s	sys 0.001s
I20260709 13:21:25.504526 17496 raft_consensus.cc:359] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.505273 17496 raft_consensus.cc:740] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.506006 17496 consensus_queue.cc:260] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.507961 17496 ts_tablet_manager.cc:1434] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:25.508803 17496 tablet_bootstrap.cc:492] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.526993 17496 tablet_bootstrap.cc:492] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.527984 17496 tablet_bootstrap.cc:492] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.528589 17496 ts_tablet_manager.cc:1403] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:21:25.531167 17496 raft_consensus.cc:359] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.531934 17496 raft_consensus.cc:740] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.532851 17496 consensus_queue.cc:260] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.535244 17496 ts_tablet_manager.cc:1434] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:21:25.536077 17496 tablet_bootstrap.cc:492] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.535977 17470 raft_consensus.cc:493] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.536744 17470 raft_consensus.cc:515] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.539077 17470 leader_election.cc:290] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.540884 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8760c2c176b64d10ae61d46fa3c8605b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:25.545398 17370 raft_consensus.cc:493] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.546032 17370 raft_consensus.cc:515] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:25.561044 16762 leader_election.cc:336] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.561856 16762 leader_election.cc:304] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:25.562886 17462 raft_consensus.cc:2749] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:25.562808 17370 leader_election.cc:290] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.564059 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b267a6d4ca4f87829b245ef87bd6e3" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
W20260709 13:21:25.580848 16910 leader_election.cc:336] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.581532 16910 leader_election.cc:304] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:25.582728 17497 raft_consensus.cc:493] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.583392 17497 raft_consensus.cc:515] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.584257 17478 raft_consensus.cc:2749] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:25.592700 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459fd01e9d83462da735e004032e70b7" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:25.596722 17497 leader_election.cc:290] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
W20260709 13:21:25.598537 16836 leader_election.cc:336] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.599251 17496 tablet_bootstrap.cc:492] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.599133 16836 leader_election.cc:304] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:25.600265 17496 tablet_bootstrap.cc:492] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.600659 17497 raft_consensus.cc:2749] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:25.601011 17496 ts_tablet_manager.cc:1403] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.000s
I20260709 13:21:25.603560 17497 raft_consensus.cc:493] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.603925 17496 raft_consensus.cc:359] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.604846 17496 raft_consensus.cc:740] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.604521 17497 raft_consensus.cc:515] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.605849 17496 consensus_queue.cc:260] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.608180 17496 ts_tablet_manager.cc:1434] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:21:25.608960 17496 tablet_bootstrap.cc:492] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.609463 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b267a6d4ca4f87829b245ef87bd6e3" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:25.610067 16943 raft_consensus.cc:2468] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:25.612105 17497 leader_election.cc:290] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.614859 16836 leader_election.cc:304] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:25.615988 17367 raft_consensus.cc:2804] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:25.616331 17367 raft_consensus.cc:493] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.616642 17367 raft_consensus.cc:3060] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:25.619815 17370 raft_consensus.cc:493] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.620549 17370 raft_consensus.cc:515] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.624583 17370 leader_election.cc:290] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:25.627216 17470 raft_consensus.cc:493] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.628010 17470 raft_consensus.cc:515] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.629886 17496 tablet_bootstrap.cc:492] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.630827 17496 tablet_bootstrap.cc:492] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.630734 17470 leader_election.cc:290] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.631749 17496 ts_tablet_manager.cc:1403] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:21:25.631784 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7da6930c7d44f51ae33d75064b68676" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:25.634514 17496 raft_consensus.cc:359] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.635162 17496 raft_consensus.cc:740] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.636013 17496 consensus_queue.cc:260] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.638219 17496 ts_tablet_manager.cc:1434] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:21:25.638988 17496 tablet_bootstrap.cc:492] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
W20260709 13:21:25.639623 16910 leader_election.cc:336] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.642925 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72c23005f53496890cfb11e0c19318b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:25.649866 16910 leader_election.cc:304] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:25.645346 17367 raft_consensus.cc:515] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:25.647462 16836 leader_election.cc:336] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.650558 17370 raft_consensus.cc:2749] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:25.649236 16762 leader_election.cc:336] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.652751 17496 tablet_bootstrap.cc:492] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.653311 16762 leader_election.cc:304] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:25.653703 17496 tablet_bootstrap.cc:492] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.653748 17367 leader_election.cc:290] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.654086 17470 raft_consensus.cc:2749] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:25.654501 17496 ts_tablet_manager.cc:1403] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:21:25.657090 17496 raft_consensus.cc:359] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.657758 17496 raft_consensus.cc:740] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.658701 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b267a6d4ca4f87829b245ef87bd6e3" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:25.658562 17496 consensus_queue.cc:260] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.659230 16943 raft_consensus.cc:3060] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:25.659448 17470 raft_consensus.cc:493] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.659976 17470 raft_consensus.cc:515] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
W20260709 13:21:25.660282 16836 leader_election.cc:336] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.660722 17496 ts_tablet_manager.cc:1434] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:21:25.661568 17496 tablet_bootstrap.cc:492] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.661931 17470 leader_election.cc:290] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.662508 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:25.674641 16943 raft_consensus.cc:2468] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 2.
I20260709 13:21:25.675360 17470 raft_consensus.cc:493] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.675915 17470 raft_consensus.cc:515] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.677237 17496 tablet_bootstrap.cc:492] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.677982 17470 leader_election.cc:290] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.678233 17496 tablet_bootstrap.cc:492] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.679010 17496 ts_tablet_manager.cc:1403] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:21:25.682101 17496 raft_consensus.cc:359] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.682729 16836 leader_election.cc:304] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:25.683030 17496 raft_consensus.cc:740] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.683701 17497 raft_consensus.cc:2804] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:25.684278 17497 raft_consensus.cc:697] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:25.684192 17496 consensus_queue.cc:260] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.685760 17497 consensus_queue.cc:237] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.688100 17496 ts_tablet_manager.cc:1434] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:21:25.689280 17496 tablet_bootstrap.cc:492] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.685925 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2b3210f0d344aa8c9f961a1b72c508" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:25.705933 16617 catalog_manager.cc:5697] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 2 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:25.715230 17497 raft_consensus.cc:493] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.715826 17497 raft_consensus.cc:515] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.717968 17497 leader_election.cc:290] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.724120 17470 raft_consensus.cc:493] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.724710 17470 raft_consensus.cc:515] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.726833 17470 leader_election.cc:290] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.726986 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8089fb9d122745beabb535e51bd29d52" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:25.727622 16836 leader_election.cc:336] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.729230 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7da6930c7d44f51ae33d75064b68676" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:25.729889 16941 raft_consensus.cc:2468] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:25.730567 17367 raft_consensus.cc:493] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.731066 17367 raft_consensus.cc:515] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.731070 16762 leader_election.cc:304] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:25.733448 17470 raft_consensus.cc:2804] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:25.733834 17470 raft_consensus.cc:493] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.734324 17496 tablet_bootstrap.cc:492] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.735582 17496 tablet_bootstrap.cc:492] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.736413 17496 ts_tablet_manager.cc:1403] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.004s
I20260709 13:21:25.737521 17470 raft_consensus.cc:3060] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:25.739657 17496 raft_consensus.cc:359] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.740646 17496 raft_consensus.cc:740] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.741724 17496 consensus_queue.cc:260] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.742551 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2fb00d467444edb3d2d8374ad64b7c" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:25.741202 17367 leader_election.cc:290] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:25.745078 17496 ts_tablet_manager.cc:1434] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:21:25.745334 17498 raft_consensus.cc:493] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.746224 17496 tablet_bootstrap.cc:492] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.745940 17498 raft_consensus.cc:515] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.732990 16836 leader_election.cc:304] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:25.750633 17367 raft_consensus.cc:2749] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:25.751425 17498 leader_election.cc:290] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:25.752218 17478 raft_consensus.cc:493] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.752826 17478 raft_consensus.cc:515] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.754961 17478 leader_election.cc:290] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:25.758251 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c414f9d9e048e89cedbb0dbe6027a2" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:25.758769 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:25.763948 16796 raft_consensus.cc:2468] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 2.
W20260709 13:21:25.765404 16910 leader_election.cc:336] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
W20260709 13:21:25.765595 16836 leader_election.cc:336] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.760187 17370 raft_consensus.cc:493] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.766871 16909 leader_election.cc:304] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:25.766839 17370 raft_consensus.cc:515] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.769413 17284 raft_consensus.cc:2804] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:25.769809 17284 raft_consensus.cc:493] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.770153 17284 raft_consensus.cc:3060] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:25.771363 17470 raft_consensus.cc:515] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.773460 17470 leader_election.cc:290] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.775581 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7da6930c7d44f51ae33d75064b68676" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:25.776415 16941 raft_consensus.cc:3060] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:25.777803 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a3b0acceaf4cada63b5f215fab4a29" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:25.778090 17284 raft_consensus.cc:515] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.780076 17284 leader_election.cc:290] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:25.781769 17496 tablet_bootstrap.cc:492] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.782907 17496 tablet_bootstrap.cc:492] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.783246 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:25.783689 17496 ts_tablet_manager.cc:1403] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.038s	user 0.026s	sys 0.004s
I20260709 13:21:25.783830 16796 raft_consensus.cc:3060] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:25.784420 16941 raft_consensus.cc:2468] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
I20260709 13:21:25.785573 16762 leader_election.cc:304] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:25.787120 17496 raft_consensus.cc:359] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.788172 17496 raft_consensus.cc:740] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.789229 17496 consensus_queue.cc:260] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.792043 17496 ts_tablet_manager.cc:1434] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 13:21:25.792845 16910 leader_election.cc:336] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.793016 17496 tablet_bootstrap.cc:492] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:25.793408 16910 leader_election.cc:304] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
W20260709 13:21:25.794147 16910 leader_election.cc:336] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.794872 17284 raft_consensus.cc:2749] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:25.787642 17498 raft_consensus.cc:2804] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:25.795979 17498 raft_consensus.cc:697] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:25.796835 17284 raft_consensus.cc:493] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.797530 17284 raft_consensus.cc:515] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.799896 16796 raft_consensus.cc:2468] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 3.
I20260709 13:21:25.766135 16836 leader_election.cc:304] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:25.801667 16909 leader_election.cc:304] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:25.805169 17478 raft_consensus.cc:2804] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:25.805001 17430 raft_consensus.cc:2749] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:25.801401 17370 leader_election.cc:290] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.814167 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8089fb9d122745beabb535e51bd29d52" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:25.814886 16869 raft_consensus.cc:2468] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:25.815975 16908 leader_election.cc:304] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:25.816171 17284 leader_election.cc:290] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.817369 17284 raft_consensus.cc:2804] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:25.817709 17284 raft_consensus.cc:493] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.818017 17284 raft_consensus.cc:3060] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:25.820367 17430 raft_consensus.cc:493] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.821135 17430 raft_consensus.cc:515] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.828270 17497 raft_consensus.cc:493] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.829041 17497 raft_consensus.cc:515] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.830747 17430 leader_election.cc:290] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:25.831646 17497 leader_election.cc:290] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.832198 17478 raft_consensus.cc:697] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 3 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:25.833884 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:25.833747 17478 consensus_queue.cc:237] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
W20260709 13:21:25.839404 16910 leader_election.cc:336] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.822499 17498 consensus_queue.cc:237] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.845831 17470 raft_consensus.cc:493] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.855692 17470 raft_consensus.cc:515] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.861814 16796 raft_consensus.cc:2468] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:25.863523 16835 leader_election.cc:304] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:25.858264 17470 leader_election.cc:290] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:25.865658 17367 raft_consensus.cc:2804] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:25.866022 17367 raft_consensus.cc:493] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.866384 17367 raft_consensus.cc:3060] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:25.876191 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffcb1357332401a919db507af113059" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:25.881825 17430 raft_consensus.cc:493] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.882426 17430 raft_consensus.cc:515] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.882633 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:25.893015 17470 raft_consensus.cc:493] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.893924 17430 leader_election.cc:290] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.894012 17470 raft_consensus.cc:515] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.897483 17430 raft_consensus.cc:493] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.898051 17470 leader_election.cc:290] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:25.898758 17430 raft_consensus.cc:515] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.896768 17367 raft_consensus.cc:515] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.902773 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f84738cbb7483b9e127384bf8f534a" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:25.903971 16869 raft_consensus.cc:2393] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 2: Already voted for candidate 71a0b5583e0547a88c88b590549fbcee in this term.
I20260709 13:21:25.906335 17563 raft_consensus.cc:493] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.906878 17563 raft_consensus.cc:515] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.908957 17563 leader_election.cc:290] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:25.911120 17370 raft_consensus.cc:493] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.911640 17370 raft_consensus.cc:515] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.912127 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8760c2c176b64d10ae61d46fa3c8605b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:25.912771 16796 raft_consensus.cc:2468] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:25.913668 17370 leader_election.cc:290] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:25.914312 16909 leader_election.cc:304] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:25.915071 17370 raft_consensus.cc:2804] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:25.915432 17370 raft_consensus.cc:493] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.915261 17284 raft_consensus.cc:515] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.918561 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:25.916015 17370 raft_consensus.cc:3060] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:25.920270 17498 raft_consensus.cc:493] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.920794 17498 raft_consensus.cc:515] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.923965 17498 leader_election.cc:290] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.924639 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:25.925706 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:25.929869 16910 leader_election.cc:336] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.935180 17496 tablet_bootstrap.cc:492] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:25.936153 17496 tablet_bootstrap.cc:492] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:25.936857 17496 ts_tablet_manager.cc:1403] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.144s	user 0.012s	sys 0.012s
W20260709 13:21:25.937624 16910 leader_election.cc:336] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.938141 16910 leader_election.cc:304] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:25.930518 17370 raft_consensus.cc:515] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:25.944088 16617 catalog_manager.cc:5697] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:25.944016 17370 leader_election.cc:290] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:25.946610 17569 raft_consensus.cc:2749] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:25.948050 17496 raft_consensus.cc:359] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.949535 17496 raft_consensus.cc:740] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.950385 17496 consensus_queue.cc:260] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.954118 17497 raft_consensus.cc:493] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:25.955045 17497 raft_consensus.cc:515] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:25.957159 16910 leader_election.cc:336] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.958020 17497 leader_election.cc:290] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:25.960116 17367 leader_election.cc:290] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:25.962239 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:25.985963 16792 raft_consensus.cc:3060] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:25.989877 17565 log.cc:927] Time spent T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:21:25.997332 16792 raft_consensus.cc:2468] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 2.
I20260709 13:21:26.002149 16835 leader_election.cc:304] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:26.002925 17570 raft_consensus.cc:2804] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:26.003464 17570 raft_consensus.cc:697] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
W20260709 13:21:26.004777 16910 leader_election.cc:336] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.004652 17570 consensus_queue.cc:237] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:25.963078 17430 leader_election.cc:290] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:25.966315 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2fb00d467444edb3d2d8374ad64b7c" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
W20260709 13:21:25.966599 16836 leader_election.cc:336] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:25.968729 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8089fb9d122745beabb535e51bd29d52" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:26.014043 16869 raft_consensus.cc:2468] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:26.014227 16870 raft_consensus.cc:3060] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.012465 16617 catalog_manager.cc:5697] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 2 to 3, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 3 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:25.970836 17284 leader_election.cc:290] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:26.018107 17284 raft_consensus.cc:493] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.018570 17284 raft_consensus.cc:515] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:25.967278 17370 raft_consensus.cc:493] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.020476 17470 raft_consensus.cc:493] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.020671 17370 raft_consensus.cc:515] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.021025 17470 raft_consensus.cc:515] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:26.022589 17370 leader_election.cc:290] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:25.981750 17496 ts_tablet_manager.cc:1434] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.045s	user 0.010s	sys 0.000s
I20260709 13:21:26.023033 17470 leader_election.cc:290] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:26.023664 17496 tablet_bootstrap.cc:492] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:26.024837 17284 leader_election.cc:290] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
W20260709 13:21:25.985030 16909 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:34809, user_credentials={real_user=slave}} blocked reactor thread for 52476.9us
W20260709 13:21:26.014479 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 47933.4us
I20260709 13:21:26.028111 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad644a4c46b4ba9b4845f75d943c516" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:26.028443 16836 leader_election.cc:336] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.028896 16836 leader_election.cc:304] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:26.030961 17563 raft_consensus.cc:493] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.031550 17563 raft_consensus.cc:515] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.032414 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffcb1357332401a919db507af113059" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:26.032846 17568 raft_consensus.cc:493] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.033674 17568 raft_consensus.cc:515] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:26.035547 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a3b0acceaf4cada63b5f215fab4a29" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:26.036237 16939 raft_consensus.cc:2468] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:26.036352 17568 leader_election.cc:290] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:26.039649 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:26.040284 16868 raft_consensus.cc:2468] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 2.
I20260709 13:21:26.040930 16836 leader_election.cc:304] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:26.033017 16869 raft_consensus.cc:2468] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:26.041973 17367 raft_consensus.cc:2749] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:26.043727 17367 raft_consensus.cc:2804] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:21:26.044010 16910 leader_election.cc:336] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.044071 17367 raft_consensus.cc:493] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.044723 16910 leader_election.cc:304] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:26.045261 17367 raft_consensus.cc:3060] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.045454 16908 leader_election.cc:304] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
W20260709 13:21:26.046029 16910 leader_election.cc:336] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.046743 16908 leader_election.cc:304] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:26.046978 17569 raft_consensus.cc:2749] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:26.047657 17569 raft_consensus.cc:2804] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:26.047840 17478 raft_consensus.cc:2804] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:26.048593 17478 raft_consensus.cc:493] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.049075 17478 raft_consensus.cc:3060] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.049309 17563 leader_election.cc:290] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:26.052387 17367 raft_consensus.cc:515] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:26.052946 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:26.047991 17569 raft_consensus.cc:493] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.053570 16796 raft_consensus.cc:2468] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:26.053789 17569 raft_consensus.cc:3060] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:26.058609 16760 leader_election.cc:304] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
W20260709 13:21:26.058877 16836 leader_election.cc:336] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.059301 16836 leader_election.cc:304] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:26.060115 17498 raft_consensus.cc:2804] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:26.062702 17498 raft_consensus.cc:493] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.063186 17498 raft_consensus.cc:3060] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.066195 17563 raft_consensus.cc:493] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.066799 17563 raft_consensus.cc:515] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.067652 17367 leader_election.cc:290] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:26.068984 17563 leader_election.cc:290] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:26.056717 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8760c2c176b64d10ae61d46fa3c8605b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:26.070092 16792 raft_consensus.cc:3060] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.055948 16909 leader_election.cc:304] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
W20260709 13:21:26.076242 16910 leader_election.cc:336] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.077663 17568 raft_consensus.cc:2804] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:26.078032 17496 tablet_bootstrap.cc:492] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:26.078267 17568 raft_consensus.cc:493] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.078970 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2b3210f0d344aa8c9f961a1b72c508" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:26.060819 16870 raft_consensus.cc:2468] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 2.
I20260709 13:21:26.061272 17497 raft_consensus.cc:2749] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:26.062000 16836 leader_election.cc:336] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.079692 16796 raft_consensus.cc:2468] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:26.080608 16836 leader_election.cc:304] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:26.081842 16908 leader_election.cc:304] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:26.085662 17563 raft_consensus.cc:2804] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:26.086527 17497 raft_consensus.cc:2749] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:26.086861 17563 raft_consensus.cc:697] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:26.087280 17497 raft_consensus.cc:493] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.087836 17497 raft_consensus.cc:515] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:26.088212 17563 consensus_queue.cc:237] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:26.090162 17497 leader_election.cc:290] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:26.085251 16909 leader_election.cc:304] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:26.095397 17284 raft_consensus.cc:2804] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:26.095881 17284 raft_consensus.cc:493] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.096199 17284 raft_consensus.cc:3060] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:26.077258 16910 leader_election.cc:336] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.091275 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c414f9d9e048e89cedbb0dbe6027a2" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:26.097883 16796 raft_consensus.cc:2468] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:26.079030 17568 raft_consensus.cc:3060] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.101197 17370 raft_consensus.cc:493] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.101768 17370 raft_consensus.cc:515] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.104943 17496 tablet_bootstrap.cc:492] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:26.106155 17496 ts_tablet_manager.cc:1403] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.000s
I20260709 13:21:26.107343 16792 raft_consensus.cc:2468] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 2.
I20260709 13:21:26.114574 16909 leader_election.cc:304] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:26.116071 17370 leader_election.cc:290] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:26.116876 17370 raft_consensus.cc:2804] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:26.117235 17370 raft_consensus.cc:697] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:26.117807 17370 consensus_queue.cc:237] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.121363 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f84738cbb7483b9e127384bf8f534a" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:26.064797 17478 raft_consensus.cc:515] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:26.122078 16870 raft_consensus.cc:2468] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:26.122553 17496 raft_consensus.cc:359] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.133216 17496 raft_consensus.cc:740] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.131126 17284 raft_consensus.cc:515] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.113595 17462 raft_consensus.cc:493] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
W20260709 13:21:26.132562 16836 leader_election.cc:336] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.134135 17496 consensus_queue.cc:260] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
W20260709 13:21:26.137015 16836 leader_election.cc:336] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.138553 17496 ts_tablet_manager.cc:1434] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:21:26.145412 17284 leader_election.cc:290] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:26.161087 17496 tablet_bootstrap.cc:492] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:26.165602 16835 leader_election.cc:304] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:26.143937 17462 raft_consensus.cc:515] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.171820 16617 catalog_manager.cc:5697] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 2 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:26.168860 17570 raft_consensus.cc:2804] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:26.181020 17570 raft_consensus.cc:493] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.181546 17570 raft_consensus.cc:3060] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.183661 17580 raft_consensus.cc:493] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.184197 17580 raft_consensus.cc:515] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:26.185339 17462 leader_election.cc:290] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:26.166409 17470 raft_consensus.cc:493] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
W20260709 13:21:26.197746 16909 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:34809, user_credentials={real_user=slave}} blocked reactor thread for 83292.1us
I20260709 13:21:26.199512 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72c23005f53496890cfb11e0c19318b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:26.158041 17569 raft_consensus.cc:515] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:26.173619 17583 raft_consensus.cc:493] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.200212 16796 raft_consensus.cc:2468] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:26.206470 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13a3b0acceaf4cada63b5f215fab4a29" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:26.207252 16943 raft_consensus.cc:3060] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.211412 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2b3210f0d344aa8c9f961a1b72c508" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:26.212159 16796 raft_consensus.cc:3060] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:26.217901 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:32963, user_credentials={real_user=slave}} blocked reactor thread for 64785.6us
I20260709 13:21:26.217087 16909 leader_election.cc:304] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:26.224238 16943 raft_consensus.cc:2468] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 2.
I20260709 13:21:26.228781 17284 raft_consensus.cc:2804] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:26.229312 17284 raft_consensus.cc:493] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.229761 17284 raft_consensus.cc:3060] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:26.233260 16836 leader_election.cc:336] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.198709 17470 raft_consensus.cc:515] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.251017 16796 raft_consensus.cc:2468] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 2.
I20260709 13:21:26.252502 16909 leader_election.cc:304] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:26.267359 17284 raft_consensus.cc:515] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.214061 17583 raft_consensus.cc:515] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.275831 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72c23005f53496890cfb11e0c19318b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:26.279639 16796 raft_consensus.cc:3060] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.276495 17284 leader_election.cc:290] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:26.294569 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffcb1357332401a919db507af113059" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:26.295488 16869 raft_consensus.cc:3060] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:26.243799 16760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:46515, user_credentials={real_user=slave}} blocked reactor thread for 51036.5us
I20260709 13:21:26.266413 17478 leader_election.cc:290] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:26.268678 17569 leader_election.cc:290] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:26.313537 17582 raft_consensus.cc:493] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.328066 17496 tablet_bootstrap.cc:492] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:26.327948 17498 raft_consensus.cc:515] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:26.329367 17496 tablet_bootstrap.cc:492] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:26.329990 16760 leader_election.cc:304] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:26.330807 17583 leader_election.cc:290] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:26.312312 17580 leader_election.cc:290] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:26.331738 17496 ts_tablet_manager.cc:1403] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.171s	user 0.028s	sys 0.003s
I20260709 13:21:26.335541 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:26.336331 16941 raft_consensus.cc:2468] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:26.319941 17582 raft_consensus.cc:515] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:26.339941 16762 leader_election.cc:304] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:26.336648 16869 raft_consensus.cc:2468] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 2.
I20260709 13:21:26.337000 16796 raft_consensus.cc:2468] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 2.
I20260709 13:21:26.320910 17594 raft_consensus.cc:2804] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:26.351742 17496 raft_consensus.cc:359] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:26.352595 17496 raft_consensus.cc:740] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.353403 17496 consensus_queue.cc:260] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:26.354848 16835 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:34809, user_credentials={real_user=slave}} blocked reactor thread for 84311.4us
I20260709 13:21:26.360411 17496 ts_tablet_manager.cc:1434] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 13:21:26.336944 17462 raft_consensus.cc:2804] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:26.361699 16908 leader_election.cc:304] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:26.361645 17496 tablet_bootstrap.cc:492] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:26.364321 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:26.364001 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:26.365167 16796 raft_consensus.cc:2468] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 1.
I20260709 13:21:26.365377 16869 raft_consensus.cc:3060] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:26.366444 16835 leader_election.cc:304] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:26.362977 17462 raft_consensus.cc:493] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.371867 17462 raft_consensus.cc:3060] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.372177 17498 leader_election.cc:290] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:26.373111 17498 raft_consensus.cc:2804] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:26.373677 17498 raft_consensus.cc:493] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.374220 17498 raft_consensus.cc:3060] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.378986 17585 raft_consensus.cc:2804] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:26.390954 16869 raft_consensus.cc:2468] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 3.
I20260709 13:21:26.385994 17430 raft_consensus.cc:2804] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:26.361284 17594 raft_consensus.cc:697] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:26.386550 17585 raft_consensus.cc:697] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:26.395285 16909 leader_election.cc:304] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:26.352134 17570 raft_consensus.cc:515] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:26.396574 16908 leader_election.cc:304] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:26.397341 17370 raft_consensus.cc:2804] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:26.397815 17370 raft_consensus.cc:697] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 3 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:26.398413 17370 consensus_queue.cc:237] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:26.395258 17430 raft_consensus.cc:493] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.398638 17563 raft_consensus.cc:2804] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:26.407963 17570 leader_election.cc:290] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:26.408811 17462 raft_consensus.cc:515] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:26.409132 17594 consensus_queue.cc:237] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.400923 17470 leader_election.cc:290] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:26.414373 17498 raft_consensus.cc:515] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.411736 17585 consensus_queue.cc:237] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:26.416785 17498 leader_election.cc:290] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:26.418385 17462 leader_election.cc:290] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
W20260709 13:21:26.419909 16910 leader_election.cc:336] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.422076 17582 leader_election.cc:290] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:26.406302 17430 raft_consensus.cc:3060] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.413610 17563 raft_consensus.cc:697] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:26.442837 17430 raft_consensus.cc:515] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:26.439658 17563 consensus_queue.cc:237] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.446858 17568 raft_consensus.cc:515] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
W20260709 13:21:26.393646 16760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:46515, user_credentials={real_user=slave}} blocked reactor thread for 62688.2us
I20260709 13:21:26.504479 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459fd01e9d83462da735e004032e70b7" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:26.514991 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2fb00d467444edb3d2d8374ad64b7c" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:26.516175 16869 raft_consensus.cc:2468] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:26.522576 17430 leader_election.cc:290] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:26.530776 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad644a4c46b4ba9b4845f75d943c516" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:26.532321 16941 raft_consensus.cc:2468] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:26.516286 16866 raft_consensus.cc:3060] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.534035 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f84738cbb7483b9e127384bf8f534a" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:26.534243 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:26.535068 16868 raft_consensus.cc:3060] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.535317 16939 raft_consensus.cc:3060] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.504479 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c414f9d9e048e89cedbb0dbe6027a2" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:26.537621 16796 raft_consensus.cc:3060] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.543378 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:26.544569 16792 raft_consensus.cc:3060] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.551985 17496 tablet_bootstrap.cc:492] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:26.553524 17496 tablet_bootstrap.cc:492] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:26.554899 17496 ts_tablet_manager.cc:1403] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.193s	user 0.036s	sys 0.015s
I20260709 13:21:26.560504 16762 leader_election.cc:304] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:26.567169 17568 leader_election.cc:290] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:26.573590 17582 raft_consensus.cc:2804] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:26.574286 17582 raft_consensus.cc:493] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.574836 17582 raft_consensus.cc:3060] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.535410 16943 raft_consensus.cc:1275] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Refusing update from remote peer 5642511b38924ffcbe38110cf27d3535: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:21:26.579916 16910 leader_election.cc:336] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.580096 17496 raft_consensus.cc:359] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.581446 17496 raft_consensus.cc:740] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
W20260709 13:21:26.581802 16910 leader_election.cc:336] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.583159 16868 raft_consensus.cc:2468] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
W20260709 13:21:26.584343 16910 leader_election.cc:336] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.582472 17496 consensus_queue.cc:260] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.589941 17496 ts_tablet_manager.cc:1434] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.035s	user 0.002s	sys 0.012s
I20260709 13:21:26.591785 17496 tablet_bootstrap.cc:492] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:26.578039 16617 catalog_manager.cc:5697] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 2 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:26.602468 16794 raft_consensus.cc:1275] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:26.607197 16939 raft_consensus.cc:2468] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
I20260709 13:21:26.605062 16866 raft_consensus.cc:2468] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
W20260709 13:21:26.610303 16762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:32963, user_credentials={real_user=slave}} blocked reactor thread for 50235.7us
I20260709 13:21:26.611184 16792 raft_consensus.cc:2468] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 2.
I20260709 13:21:26.619825 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:26.620816 16794 raft_consensus.cc:3060] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.637280 16794 raft_consensus.cc:2468] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 2.
I20260709 13:21:26.644379  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.129:34869
I20260709 13:21:26.659291 17500 raft_consensus.cc:493] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.660192 17500 raft_consensus.cc:515] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:26.662680 16944 raft_consensus.cc:1275] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Refusing update from remote peer 71a0b5583e0547a88c88b590549fbcee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:26.669657 16796 raft_consensus.cc:2468] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 2.
I20260709 13:21:26.675225 16869 raft_consensus.cc:1275] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:26.676997 17500 leader_election.cc:290] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:26.682749 17613 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.129:34869 every 8 connection(s)
I20260709 13:21:26.700233 17462 consensus_queue.cc:1048] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:26.705811 16762 leader_election.cc:304] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:26.708323 17581 raft_consensus.cc:2804] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:26.708958 17581 raft_consensus.cc:697] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:26.710415 17581 consensus_queue.cc:237] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.722831 17370 consensus_queue.cc:1048] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:26.697301 17500 raft_consensus.cc:493] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.728739 17500 raft_consensus.cc:515] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:26.731256 17370 consensus_queue.cc:1048] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:26.743475 16836 leader_election.cc:304] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:26.746002 17367 raft_consensus.cc:2804] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:26.746574 17367 raft_consensus.cc:697] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:26.747953 17500 leader_election.cc:290] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:26.747764 17367 consensus_queue.cc:237] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:26.755035 16909 leader_election.cc:304] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:26.755990 17370 raft_consensus.cc:2804] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:26.756495 17370 raft_consensus.cc:697] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:26.757599 17370 consensus_queue.cc:237] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.761092 17496 tablet_bootstrap.cc:492] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:26.716075 17582 raft_consensus.cc:515] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.782503 17496 tablet_bootstrap.cc:492] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:26.783775 17496 ts_tablet_manager.cc:1403] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.193s	user 0.069s	sys 0.017s
I20260709 13:21:26.785650 16835 leader_election.cc:304] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:26.788829 17500 raft_consensus.cc:493] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.789904 17500 raft_consensus.cc:515] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.790741 17610 raft_consensus.cc:2804] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:26.792547 17500 leader_election.cc:290] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:26.794875 17496 raft_consensus.cc:359] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.795965 17496 raft_consensus.cc:740] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.796747 16835 leader_election.cc:304] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:26.799026 17589 raft_consensus.cc:2804] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:26.799582 17589 raft_consensus.cc:697] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:26.796939 17496 consensus_queue.cc:260] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.803973 17610 raft_consensus.cc:697] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:26.815512 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad644a4c46b4ba9b4845f75d943c516" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:26.827914 16944 raft_consensus.cc:3060] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.800889 17589 consensus_queue.cc:237] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:26.847744 16795 raft_consensus.cc:1275] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:26.850426 17478 consensus_queue.cc:1048] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:26.854168 17610 consensus_queue.cc:237] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:26.856264 16793 raft_consensus.cc:1275] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Refusing update from remote peer 71a0b5583e0547a88c88b590549fbcee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:26.838824 17500 raft_consensus.cc:493] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.857857 17500 raft_consensus.cc:515] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:26.842272 17582 leader_election.cc:290] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:26.874619 17599 consensus_queue.cc:1048] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:26.882236 16868 raft_consensus.cc:1275] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:26.860724 17500 leader_election.cc:290] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:26.885929 17500 raft_consensus.cc:493] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.887507 17370 consensus_queue.cc:1048] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:26.886529 17500 raft_consensus.cc:515] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:26.893842 16944 raft_consensus.cc:2468] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
I20260709 13:21:26.895798 16762 leader_election.cc:304] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:26.896760 17581 raft_consensus.cc:2804] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:26.899070 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:26.922457 16795 raft_consensus.cc:1275] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:26.923210 17599 consensus_queue.cc:1048] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:26.898530 17581 raft_consensus.cc:697] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:26.928001 17568 consensus_queue.cc:1048] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:26.920944 16617 catalog_manager.cc:5697] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 2 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:26.957113 16796 raft_consensus.cc:1275] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:21:26.963478 16836 leader_election.cc:336] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:26.968532 17370 consensus_queue.cc:1048] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:21:26.973080 16617 catalog_manager.cc:5697] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 2 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:26.974699 16760 leader_election.cc:304] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:26.975109 16617 catalog_manager.cc:5697] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 2 to 3, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 3 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:26.976135 16760 leader_election.cc:304] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:26.977646 17583 raft_consensus.cc:2804] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:26.978067 17583 raft_consensus.cc:493] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:26.978461 17583 raft_consensus.cc:3060] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:26.979468 17498 raft_consensus.cc:2804] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:26.980211 17498 raft_consensus.cc:697] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:26.980826 17496 ts_tablet_manager.cc:1434] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.197s	user 0.011s	sys 0.001s
I20260709 13:21:26.981248 16617 catalog_manager.cc:5697] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 2 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:26.994253 17498 consensus_queue.cc:237] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:26.999524 17496 tablet_bootstrap.cc:492] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
W20260709 13:21:27.005785 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 46337us
W20260709 13:21:27.008965 16836 leader_election.cc:336] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
W20260709 13:21:27.109751 17630 log.cc:927] Time spent T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:21:27.020406 17500 leader_election.cc:290] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:27.135525 16794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f84738cbb7483b9e127384bf8f534a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:27.136355 16788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8760c2c176b64d10ae61d46fa3c8605b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:27.137243 16789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459fd01e9d83462da735e004032e70b7" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:26.987367 17581 consensus_queue.cc:237] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:27.125021 17500 raft_consensus.cc:493] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.138847 16788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2434de2d21436fbbf8b25ab1814b54" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:27.177588 17626 raft_consensus.cc:493] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.136492 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:27.235760 17628 log.cc:927] Time spent T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
W20260709 13:21:27.237649 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:34809, user_credentials={real_user=slave}} blocked reactor thread for 48507.2us
W20260709 13:21:27.262115 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 253606us
I20260709 13:21:27.224601 17500 raft_consensus.cc:515] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:27.282126 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f84738cbb7483b9e127384bf8f534a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:27.283301 16866 raft_consensus.cc:2393] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in current term 2: Already voted for candidate 5642511b38924ffcbe38110cf27d3535 in this term.
I20260709 13:21:27.284552 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:27.240037 17626 raft_consensus.cc:515] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:27.318398 17634 log.cc:927] Time spent T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:21:27.320398 17650 raft_consensus.cc:493] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.321251 17650 raft_consensus.cc:515] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:27.321838 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe2434de2d21436fbbf8b25ab1814b54" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
W20260709 13:21:27.322445 17632 log.cc:927] Time spent T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:21:27.324478 17650 leader_election.cc:290] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:27.326277 17491 leader_election.cc:304] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:27.325268 17650 raft_consensus.cc:493] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.355443 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2b3210f0d344aa8c9f961a1b72c508" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:27.357841 16617 catalog_manager.cc:5697] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 2 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:27.361514 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459fd01e9d83462da735e004032e70b7" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:27.362550 16867 raft_consensus.cc:2468] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:27.365578 16944 raft_consensus.cc:1275] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Refusing update from remote peer 5642511b38924ffcbe38110cf27d3535: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:27.367024 16615 catalog_manager.cc:5697] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:27.375123 17470 consensus_queue.cc:1048] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:27.383186 17594 raft_consensus.cc:493] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71a0b5583e0547a88c88b590549fbcee)
I20260709 13:21:27.384001 17594 raft_consensus.cc:515] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:27.386843 17650 raft_consensus.cc:515] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:27.415045 17651 raft_consensus.cc:493] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.417991 17637 raft_consensus.cc:493] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.418938 17637 raft_consensus.cc:515] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:27.423455 16788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:27.424226 17636 log.cc:927] Time spent T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535: Append to log took a long time: real 0.185s	user 0.001s	sys 0.004s
I20260709 13:21:27.424485 16788 raft_consensus.cc:2393] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in current term 2: Already voted for candidate 266d75f35db4465788ab06782fae972d in this term.
I20260709 13:21:27.426116 16792 raft_consensus.cc:1275] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Refusing update from remote peer 71a0b5583e0547a88c88b590549fbcee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:27.426258 17650 leader_election.cc:290] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:27.426869 17650 raft_consensus.cc:493] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.427866 17650 raft_consensus.cc:515] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:27.402702 17594 leader_election.cc:290] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:27.344702 17491 leader_election.cc:304] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:27.416101 17651 raft_consensus.cc:515] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:27.468079 17500 leader_election.cc:290] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
W20260709 13:21:27.485109 17583 consensus_meta.cc:287] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535: Time spent flushing consensus metadata: real 0.506s	user 0.013s	sys 0.000s
I20260709 13:21:27.496461 17500 raft_consensus.cc:2749] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:27.498589 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e691d47f85a540f884defe4bf7a293b2" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:27.490180 17491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:46515, user_credentials={real_user=slave}} blocked reactor thread for 162423us
I20260709 13:21:27.475942 16760 leader_election.cc:304] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:27.498607 17583 raft_consensus.cc:515] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:27.512387 17649 raft_consensus.cc:3060] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:27.533263 16909 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:34809, user_credentials={real_user=slave}} blocked reactor thread for 97355.3us
W20260709 13:21:27.532289 16835 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:34809, user_credentials={real_user=slave}} blocked reactor thread for 47183.4us
I20260709 13:21:27.521683 17650 leader_election.cc:290] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
W20260709 13:21:27.545868 16762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 71378.3us
I20260709 13:21:27.535876 17637 leader_election.cc:290] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:27.557847 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702099270174fe58528799e1564c74b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:27.552865 16789 raft_consensus.cc:2393] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in current term 2: Already voted for candidate 5642511b38924ffcbe38110cf27d3535 in this term.
I20260709 13:21:27.559193 17544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
W20260709 13:21:27.547115 16760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:46515, user_credentials={real_user=slave}} blocked reactor thread for 78556us
I20260709 13:21:27.565477 17582 raft_consensus.cc:2804] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:27.556247 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c540f98dc1640918b733b6bef45d026" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:27.575237 17544 raft_consensus.cc:3060] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:27.584971 17496 tablet_bootstrap.cc:492] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:27.588593 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e375bb738794feab91d445c1c81cd73" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:27.589104 17546 raft_consensus.cc:3060] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:27.589967 17582 raft_consensus.cc:697] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:27.591055 17582 consensus_queue.cc:237] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:27.577365 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c766bb0e34effb7b3f41f13d558a0" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:27.597946 17491 leader_election.cc:304] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:27.599007 17637 raft_consensus.cc:493] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.599421 17491 leader_election.cc:304] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:27.599577 17637 raft_consensus.cc:515] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:27.600850 17542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:27.601100 17500 raft_consensus.cc:2749] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:27.601987 17653 raft_consensus.cc:2804] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:27.602066 17539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72c23005f53496890cfb11e0c19318b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:27.604023 17583 leader_election.cc:290] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:27.604545 17536 raft_consensus.cc:3060] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:27.602516 17653 raft_consensus.cc:493] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.605981 17653 raft_consensus.cc:3060] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:27.608568 16867 raft_consensus.cc:1275] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Refusing update from remote peer 5642511b38924ffcbe38110cf27d3535: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:27.610095 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459fd01e9d83462da735e004032e70b7" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:27.610738 16866 raft_consensus.cc:3060] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:27.635871 17661 consensus_queue.cc:1048] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:21:27.642345 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8760c2c176b64d10ae61d46fa3c8605b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:27.645387 17496 tablet_bootstrap.cc:492] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:27.646894 17496 ts_tablet_manager.cc:1403] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.654s	user 0.022s	sys 0.030s
I20260709 13:21:27.647611 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:27.639210 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e691d47f85a540f884defe4bf7a293b2" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:27.667634 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:27.668725 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c540f98dc1640918b733b6bef45d026" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:27.650068 17651 leader_election.cc:290] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:27.669495 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e375bb738794feab91d445c1c81cd73" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:27.670035 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2c766bb0e34effb7b3f41f13d558a0" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:27.670393 17546 raft_consensus.cc:1275] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:27.670639 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316894346f24b5984dd23714341777c" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:27.671749 16869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702099270174fe58528799e1564c74b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:27.671998 17540 raft_consensus.cc:3060] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:27.676218 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2b3210f0d344aa8c9f961a1b72c508" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:27.680505 17637 leader_election.cc:290] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:27.653657 17470 consensus_queue.cc:1048] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:21:27.679519 17650 raft_consensus.cc:493] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.696964 17650 raft_consensus.cc:515] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:27.697391 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316894346f24b5984dd23714341777c" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:27.699484 17650 leader_election.cc:290] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:27.702198 17541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
W20260709 13:21:27.711664 16910 leader_election.cc:343] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.708858 17653 raft_consensus.cc:515] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:27.712530 17546 raft_consensus.cc:3060] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:27.712944 16910 leader_election.cc:343] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.714979 17653 leader_election.cc:290] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:27.675134 17544 raft_consensus.cc:2468] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 2.
I20260709 13:21:27.691270 17493 leader_election.cc:304] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:27.680583 17500 raft_consensus.cc:493] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.695549 16870 raft_consensus.cc:1275] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:27.752643 17500 raft_consensus.cc:515] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:27.774857 17496 raft_consensus.cc:359] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:27.726503 17649 raft_consensus.cc:2749] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:27.776338 17496 raft_consensus.cc:740] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
W20260709 13:21:27.779630 17493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:32963, user_credentials={real_user=slave}} blocked reactor thread for 98858.4us
I20260709 13:21:27.782727 17491 leader_election.cc:304] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:27.785778 16865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459fd01e9d83462da735e004032e70b7" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
W20260709 13:21:27.789315 17669 log.cc:927] Time spent T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:21:27.791539 17626 leader_election.cc:290] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:27.792510 17541 raft_consensus.cc:2468] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 3.
I20260709 13:21:27.797586 16792 raft_consensus.cc:1275] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Refusing update from remote peer 71a0b5583e0547a88c88b590549fbcee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:27.800477 17594 raft_consensus.cc:493] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71a0b5583e0547a88c88b590549fbcee)
I20260709 13:21:27.801270 17594 raft_consensus.cc:515] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:27.802520 17568 raft_consensus.cc:493] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71a0b5583e0547a88c88b590549fbcee)
I20260709 13:21:27.803231 17568 raft_consensus.cc:515] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:27.803906 17594 leader_election.cc:290] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:27.804677 17594 raft_consensus.cc:493] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71a0b5583e0547a88c88b590549fbcee)
I20260709 13:21:27.805686 17610 consensus_queue.cc:1048] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:27.806412 17646 raft_consensus.cc:493] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71a0b5583e0547a88c88b590549fbcee)
I20260709 13:21:27.807005 17646 raft_consensus.cc:515] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:27.812218 17645 consensus_queue.cc:1048] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:27.805888 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:27.822594 16910 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 109688us
I20260709 13:21:27.829249 17496 consensus_queue.cc:260] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:27.771767 17653 raft_consensus.cc:493] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.809258 17646 leader_election.cc:290] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
W20260709 13:21:27.863788 16910 consensus_peers.cc:597] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:27.847991 17634 log.cc:927] Time spent T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:21:27.844038 17649 raft_consensus.cc:493] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:27.865780 16910 consensus_peers.cc:597] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:27.850276 17542 raft_consensus.cc:1275] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:27.805291 17594 raft_consensus.cc:515] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:27.861474 17626 raft_consensus.cc:2749] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:27.857272 16940 raft_consensus.cc:2468] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:27.864996 16867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9e621ba6904fdfaec709a9b5e80bf1" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:27.802613 17493 leader_election.cc:304] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:27.867470 16618 catalog_manager.cc:5697] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 2 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:27.872545 16865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b55efde48bb42119e9a38f9e3f2f6c6" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
W20260709 13:21:27.882462 16910 consensus_peers.cc:597] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:27.867544 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:27.866902 17491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:46515, user_credentials={real_user=slave}} blocked reactor thread for 84343.1us
W20260709 13:21:27.892030 17668 log.cc:927] Time spent T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:21:27.868263 16866 raft_consensus.cc:2468] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
I20260709 13:21:27.896340 17539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2fb00d467444edb3d2d8374ad64b7c" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:27.861698 17568 leader_election.cc:290] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:27.896771 17533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:27.940913 17496 ts_tablet_manager.cc:1434] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.289s	user 0.000s	sys 0.014s
I20260709 13:21:27.941725 17541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7da6930c7d44f51ae33d75064b68676" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:27.942149 17496 tablet_bootstrap.cc:492] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:27.942451 17594 leader_election.cc:290] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:27.940963 17533 raft_consensus.cc:2468] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:27.906199 17537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f84738cbb7483b9e127384bf8f534a" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:27.942492 17541 raft_consensus.cc:3060] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:27.944242 17537 raft_consensus.cc:2468] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
I20260709 13:21:27.945322 16760 leader_election.cc:304] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:27.945498 17537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad644a4c46b4ba9b4845f75d943c516" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:27.906265 16618 catalog_manager.cc:5697] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 2 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:27.946547 17581 raft_consensus.cc:2804] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:27.947098 17581 raft_consensus.cc:697] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:27.896654 17500 leader_election.cc:290] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:27.875694 17653 raft_consensus.cc:515] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:27.948071 17581 consensus_queue.cc:237] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:27.949709 17653 leader_election.cc:290] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:27.949100 16618 catalog_manager.cc:5697] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 2 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:27.884878 17646 consensus_queue.cc:1048] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:21:27.898569 17649 raft_consensus.cc:515] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
W20260709 13:21:27.930766 17493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:32963, user_credentials={real_user=slave}} blocked reactor thread for 128273us
I20260709 13:21:27.931553 17626 raft_consensus.cc:2749] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:27.933574 16938 raft_consensus.cc:2468] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 1.
I20260709 13:21:27.934190 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:27.936038 17540 raft_consensus.cc:1275] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:27.940100 17539 raft_consensus.cc:2468] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 1.
I20260709 13:21:27.940223 16762 leader_election.cc:304] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:27.918443 17536 raft_consensus.cc:1275] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:27.955694 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459fd01e9d83462da735e004032e70b7" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:27.918313 17546 raft_consensus.cc:1275] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:27.944379 17533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad644a4c46b4ba9b4845f75d943c516" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:27.957816 16868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465607298c84b8dbd8007c816bc5c9c" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:27.953734 17544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2fb00d467444edb3d2d8374ad64b7c" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:27.969269 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:27.955793 17542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f84738cbb7483b9e127384bf8f534a" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:27.950747 17537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:27.953369 17541 raft_consensus.cc:2468] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
I20260709 13:21:27.973898 17650 raft_consensus.cc:2749] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:27.980813 17540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:27.981209 17645 consensus_queue.cc:1048] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:27.986230 17539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459fd01e9d83462da735e004032e70b7" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:27.987327 17539 raft_consensus.cc:2393] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 2: Already voted for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in this term.
I20260709 13:21:27.988257 17539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b55efde48bb42119e9a38f9e3f2f6c6" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:27.989491 17539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:27.989950 17533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:27.990078 17539 raft_consensus.cc:2468] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 1.
I20260709 13:21:27.991719 17533 raft_consensus.cc:1275] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Refusing update from remote peer 5642511b38924ffcbe38110cf27d3535: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:27.991909 17539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:27.992902 17533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c414f9d9e048e89cedbb0dbe6027a2" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:27.970501 17500 raft_consensus.cc:493] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.000818 17645 consensus_queue.cc:1048] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:27.973901 17583 raft_consensus.cc:2764] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:21:27.995906 17500 raft_consensus.cc:515] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:27.982170 17544 raft_consensus.cc:3060] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:28.010452 17649 leader_election.cc:290] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:28.030962 17533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:28.031869 17536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459fd01e9d83462da735e004032e70b7" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:27.975085 17493 leader_election.cc:304] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
W20260709 13:21:28.032799 16762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 92642.4us
I20260709 13:21:28.032225 17533 raft_consensus.cc:2393] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 2: Already voted for candidate 266d75f35db4465788ab06782fae972d in this term.
I20260709 13:21:28.047362 16941 raft_consensus.cc:1275] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Refusing update from remote peer 5642511b38924ffcbe38110cf27d3535: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:28.066632 16795 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:28.067317 17533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7da6930c7d44f51ae33d75064b68676" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
W20260709 13:21:28.051993 16909 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:34809, user_credentials={real_user=slave}} blocked reactor thread for 465635us
I20260709 13:21:28.068341 17533 raft_consensus.cc:2376] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2. Re-sending same reply.
I20260709 13:21:28.068888 16909 leader_election.cc:304] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:28.053184 17542 raft_consensus.cc:2468] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
W20260709 13:21:28.033103 17493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:32963, user_credentials={real_user=slave}} blocked reactor thread for 65401.6us
I20260709 13:21:28.062912 17546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2b3210f0d344aa8c9f961a1b72c508" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:28.065443 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68bdb3e915d14f918607729afc6e38fa" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:28.065886 17541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c414f9d9e048e89cedbb0dbe6027a2" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:28.033504 17650 raft_consensus.cc:2749] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.076452 17537 raft_consensus.cc:3060] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:28.079298 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffcb1357332401a919db507af113059" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:28.079979 17568 raft_consensus.cc:2749] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.034512 17536 raft_consensus.cc:2393] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 2: Already voted for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in this term.
I20260709 13:21:28.102005 16789 raft_consensus.cc:1275] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:28.102838 16788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a465607298c84b8dbd8007c816bc5c9c" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:28.103684 17493 leader_election.cc:304] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:28.104560 17649 raft_consensus.cc:2749] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.104981 17493 leader_election.cc:304] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:28.106310 17493 leader_election.cc:304] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:28.098505 17546 raft_consensus.cc:2468] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
I20260709 13:21:28.108968 17649 raft_consensus.cc:2749] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.111021 17539 raft_consensus.cc:1275] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Refusing update from remote peer 5642511b38924ffcbe38110cf27d3535: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:28.111907 16863 raft_consensus.cc:1275] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Refusing update from remote peer 5642511b38924ffcbe38110cf27d3535: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:28.114948 17626 raft_consensus.cc:2749] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.119805 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9e621ba6904fdfaec709a9b5e80bf1" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:28.128834 17493 leader_election.cc:304] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:28.125118 17500 leader_election.cc:290] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:28.135870 17544 raft_consensus.cc:2468] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
I20260709 13:21:28.140823 16938 raft_consensus.cc:1275] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Refusing update from remote peer 71a0b5583e0547a88c88b590549fbcee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:28.143157 17537 raft_consensus.cc:1275] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Refusing update from remote peer 71a0b5583e0547a88c88b590549fbcee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:28.143857 17649 raft_consensus.cc:2749] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.144383 17493 leader_election.cc:304] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:28.145408 17649 raft_consensus.cc:2804] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:28.145830 17649 raft_consensus.cc:493] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71a0b5583e0547a88c88b590549fbcee)
I20260709 13:21:28.146211 17649 raft_consensus.cc:3060] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:28.161602 17583 consensus_queue.cc:1048] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:28.168617 17674 raft_consensus.cc:493] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71a0b5583e0547a88c88b590549fbcee)
I20260709 13:21:28.175335 17496 tablet_bootstrap.cc:492] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:28.181975 17492 leader_election.cc:304] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:28.183065 17500 raft_consensus.cc:2749] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.187445 16796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ba89448ab04e64b769557c2830641f" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:28.145890 17493 leader_election.cc:304] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 71a0b5583e0547a88c88b590549fbcee
W20260709 13:21:28.192688 17493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:32963, user_credentials={real_user=slave}} blocked reactor thread for 46912.1us
I20260709 13:21:28.169250 17674 raft_consensus.cc:515] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:28.195465 17674 leader_election.cc:290] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:28.175124 17582 consensus_queue.cc:1048] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:21:28.202957 17649 raft_consensus.cc:515] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:28.205880 16938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ba89448ab04e64b769557c2830641f" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:28.192941 17500 raft_consensus.cc:2804] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:28.205123 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68bdb3e915d14f918607729afc6e38fa" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:28.206897 17500 raft_consensus.cc:493] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71a0b5583e0547a88c88b590549fbcee)
I20260709 13:21:28.208070 17500 raft_consensus.cc:3060] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:28.208133 17568 raft_consensus.cc:493] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71a0b5583e0547a88c88b590549fbcee)
I20260709 13:21:28.208782 17568 raft_consensus.cc:515] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:28.211154 17568 leader_election.cc:290] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:28.214051 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffcb1357332401a919db507af113059" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:28.217643 16910 leader_election.cc:343] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:28.223162 16762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:32963, user_credentials={real_user=slave}} blocked reactor thread for 58922.8us
I20260709 13:21:28.221742 16910 leader_election.cc:304] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:28.232594 17496 tablet_bootstrap.cc:492] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:28.233377 17496 ts_tablet_manager.cc:1403] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.292s	user 0.026s	sys 0.021s
I20260709 13:21:28.239516 16910 leader_election.cc:304] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:28.242727 17644 raft_consensus.cc:2804] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:28.243135 17644 raft_consensus.cc:493] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71a0b5583e0547a88c88b590549fbcee)
I20260709 13:21:28.243660 17644 raft_consensus.cc:3060] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:28.237331 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd40203055942f4b32e39396d7d412a" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:28.253324 17644 raft_consensus.cc:515] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:28.237329 16836 leader_election.cc:343] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.229310 17478 raft_consensus.cc:493] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71a0b5583e0547a88c88b590549fbcee)
I20260709 13:21:28.276051 17478 raft_consensus.cc:515] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:28.277750 16836 leader_election.cc:343] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.266469 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:28.271341 17492 leader_election.cc:304] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:28.283764 16938 raft_consensus.cc:1240] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Rejecting Update request from peer 71a0b5583e0547a88c88b590549fbcee for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:28.283941 17492 leader_election.cc:304] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:28.273412 16865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2738933d0443258a83e98416c422a7" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:28.274120 17649 leader_election.cc:290] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:28.274789 16866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47c1b91c71444aa6e2c70fa4eb4403" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:28.256929 17646 raft_consensus.cc:2749] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:28.309883 16762 leader_election.cc:343] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.281162 17500 raft_consensus.cc:515] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:28.282212 17493 leader_election.cc:304] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:28.285264 17496 raft_consensus.cc:359] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:28.326649 17496 raft_consensus.cc:740] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
W20260709 13:21:28.292431 16836 consensus_peers.cc:597] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.327638 16836 consensus_peers.cc:597] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.299862 16792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e47c1b91c71444aa6e2c70fa4eb4403" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:28.291375 16910 consensus_peers.cc:597] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:28.329222 16836 consensus_peers.cc:597] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.330791 16836 consensus_peers.cc:597] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.334108 17496 consensus_queue.cc:260] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:28.337809 16909 leader_election.cc:304] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:28.338912 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
W20260709 13:21:28.342871 17493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:32963, user_credentials={real_user=slave}} blocked reactor thread for 60759us
I20260709 13:21:28.343334 16788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2738933d0443258a83e98416c422a7" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:28.343847 17493 leader_election.cc:304] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535
W20260709 13:21:28.344904 16762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 44495.8us
I20260709 13:21:28.346283 17653 raft_consensus.cc:2749] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:28.347497 17665 consensus_queue.cc:1048] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:28.285755 17650 raft_consensus.cc:2749] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.278249 17478 leader_election.cc:290] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:28.288728 17537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7da6930c7d44f51ae33d75064b68676" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:28.353066 17588 consensus_queue.cc:1048] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:21:28.357075 16762 leader_election.cc:343] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:28.361665 16762 leader_election.cc:343] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.362125 16762 leader_election.cc:304] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:28.290787 17594 consensus_queue.cc:1048] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:21:28.363299 17642 raft_consensus.cc:2749] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:28.365339 16762 consensus_peers.cc:597] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.362265 17496 ts_tablet_manager.cc:1434] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.128s	user 0.006s	sys 0.000s
I20260709 13:21:28.350077 17658 consensus_queue.cc:1048] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:28.365370 17615 heartbeater.cc:344] Connected to a master server at 127.6.214.190:40917
I20260709 13:21:28.290407 17674 consensus_queue.cc:1048] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:21:28.347136 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e375bb738794feab91d445c1c81cd73" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:28.290251 17546 raft_consensus.cc:1275] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Refusing update from remote peer 5642511b38924ffcbe38110cf27d3535: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:28.358819 16909 leader_election.cc:304] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:28.285612 17626 raft_consensus.cc:2749] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.383888 17536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2fb00d467444edb3d2d8374ad64b7c" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:28.360409 17478 raft_consensus.cc:2749] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:28.385120 16762 leader_election.cc:343] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.369961 17651 raft_consensus.cc:2749] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:28.375727 17615 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:28.369171 17537 raft_consensus.cc:2376] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2. Re-sending same reply.
I20260709 13:21:28.384268 16865 raft_consensus.cc:1275] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Refusing update from remote peer 5642511b38924ffcbe38110cf27d3535: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:28.393206 16762 leader_election.cc:304] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
W20260709 13:21:28.392058 16836 consensus_peers.cc:597] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:28.398681 17541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:28.399505 17541 raft_consensus.cc:2468] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
I20260709 13:21:28.386159 17659 raft_consensus.cc:2749] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.402014 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:28.411185 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:28.385767 17665 consensus_queue.cc:1059] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:21:28.436559 17665 raft_consensus.cc:3055] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:28.437263 17665 raft_consensus.cc:740] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:28.437813 17615 heartbeater.cc:507] Master 127.6.214.190:40917 requested a full tablet report, sending...
I20260709 13:21:28.438681 17665 consensus_queue.cc:260] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:28.442651 17493 leader_election.cc:304] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:28.444429 17626 raft_consensus.cc:2749] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:21:28.461799 16909 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:34809, user_credentials={real_user=slave}} blocked reactor thread for 80408.6us
I20260709 13:21:28.441077 17665 raft_consensus.cc:3060] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:28.391618 17642 consensus_queue.cc:1048] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:21:28.522231 16909 leader_election.cc:304] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
W20260709 13:21:28.531955 16762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 138829us
I20260709 13:21:28.468094 17582 raft_consensus.cc:2749] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.524395 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:28.559427 17696 raft_consensus.cc:2749] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.565654 17642 consensus_queue.cc:1048] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:28.561561 16939 raft_consensus.cc:2393] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in current term 2: Already voted for candidate 266d75f35db4465788ab06782fae972d in this term.
W20260709 13:21:28.576560 16762 leader_election.cc:343] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.596994 16762 leader_election.cc:304] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:28.601138 17691 raft_consensus.cc:2749] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.603475 17496 tablet_bootstrap.cc:492] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:28.606441 16762 leader_election.cc:304] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:28.607291 17691 raft_consensus.cc:2764] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:21:28.609692 17691 consensus_queue.cc:1048] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:28.611968 16762 consensus_peers.cc:597] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.609880 17500 leader_election.cc:290] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:28.628211 17539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66f84738cbb7483b9e127384bf8f534a" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:28.635361 17539 raft_consensus.cc:2376] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2. Re-sending same reply.
I20260709 13:21:28.639797 17544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:28.641345 16864 raft_consensus.cc:2468] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 2.
I20260709 13:21:28.639936 17546 raft_consensus.cc:1240] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Rejecting Update request from peer 71a0b5583e0547a88c88b590549fbcee for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:28.658840 17539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:28.662029 17535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e375bb738794feab91d445c1c81cd73" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:28.663617 17544 raft_consensus.cc:1275] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Refusing update from remote peer 5642511b38924ffcbe38110cf27d3535: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:21:28.667539 16909 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:34809, user_credentials={real_user=slave}} blocked reactor thread for 145457us
I20260709 13:21:28.669145 16909 leader_election.cc:304] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee
I20260709 13:21:28.673555 16910 leader_election.cc:304] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:28.674985 17370 raft_consensus.cc:2749] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.676347 16910 leader_election.cc:304] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:28.687306 17698 raft_consensus.cc:2749] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.679142 17568 raft_consensus.cc:2749] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:28.734561 17705 log.cc:927] Time spent T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:21:28.738277 17644 leader_election.cc:290] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:28.741886 17496 tablet_bootstrap.cc:492] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:28.767606 17496 tablet_bootstrap.cc:492] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:28.768520 17496 ts_tablet_manager.cc:1403] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.165s	user 0.026s	sys 0.002s
W20260709 13:21:28.779678 16910 consensus_peers.cc:597] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:28.782213 16836 consensus_peers.cc:597] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:28.782693 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 95897.8us
W20260709 13:21:28.783315 16836 consensus_peers.cc:597] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:28.786401 17496 raft_consensus.cc:359] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:28.788533 17496 raft_consensus.cc:740] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.790462 17496 consensus_queue.cc:260] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:28.793450 17496 ts_tablet_manager.cc:1434] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:21:28.794724 17496 tablet_bootstrap.cc:492] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:28.810539 17665 consensus_queue.cc:1059] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:21:28.844287 17496 tablet_bootstrap.cc:492] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:21:28.862154 16762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.132:32963, user_credentials={real_user=slave}} blocked reactor thread for 146257us
I20260709 13:21:28.873330 17496 tablet_bootstrap.cc:492] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:28.874449 17496 ts_tablet_manager.cc:1403] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.080s	user 0.025s	sys 0.003s
I20260709 13:21:28.892617 16762 leader_election.cc:304] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 71a0b5583e0547a88c88b590549fbcee
W20260709 13:21:28.930977 17694 log.cc:927] Time spent T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:21:28.937674 17496 raft_consensus.cc:359] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:28.939548 17496 raft_consensus.cc:740] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.951886 17496 consensus_queue.cc:260] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:28.962772 17430 raft_consensus.cc:3055] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:28.963452 17430 raft_consensus.cc:740] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:28.929005 17691 raft_consensus.cc:2764] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:21:28.965626 16835 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.130:34809, user_credentials={real_user=slave}} blocked reactor thread for 96470.8us
I20260709 13:21:28.976145 17496 ts_tablet_manager.cc:1434] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.101s	user 0.009s	sys 0.000s
I20260709 13:21:28.993712 17496 tablet_bootstrap.cc:492] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
W20260709 13:21:28.996632 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 130435us
W20260709 13:21:29.001567 16762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 70848.2us
I20260709 13:21:29.004644 17691 consensus_queue.cc:1048] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:21:29.003158 17430 consensus_queue.cc:260] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:29.019702 17430 raft_consensus.cc:3060] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.053802 17491 leader_election.cc:304] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:29.054886 17500 raft_consensus.cc:2804] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:29.055399 17500 raft_consensus.cc:697] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:29.056305 17500 consensus_queue.cc:237] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:29.069995 16762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 51697.5us
W20260709 13:21:29.070814 16762 leader_election.cc:343] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.072690 17470 consensus_queue.cc:1048] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:29.073326 16615 catalog_manager.cc:5697] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 2 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.116853 17536 raft_consensus.cc:3060] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:29.127929 16760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:46515, user_credentials={real_user=slave}} blocked reactor thread for 47586.6us
W20260709 13:21:29.136443 16762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 59430.9us
I20260709 13:21:29.261286 17496 tablet_bootstrap.cc:492] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.263612 17496 tablet_bootstrap.cc:492] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.264307 17496 ts_tablet_manager.cc:1403] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.276s	user 0.020s	sys 0.009s
I20260709 13:21:29.268985 17496 raft_consensus.cc:359] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:29.269692 17496 raft_consensus.cc:740] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.270355 17496 consensus_queue.cc:260] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:29.274585 17496 ts_tablet_manager.cc:1434] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:21:29.276387 17496 tablet_bootstrap.cc:492] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
W20260709 13:21:29.327241 16836 consensus_peers.cc:597] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:29.328943 16836 consensus_peers.cc:597] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:29.338017 16836 consensus_peers.cc:597] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:29.344049 16616 ts_manager.cc:194] Re-registered known tserver with Master: 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:29.369836 17541 raft_consensus.cc:3060] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.391785 17496 tablet_bootstrap.cc:492] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.392884 17496 tablet_bootstrap.cc:492] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.393602 17496 ts_tablet_manager.cc:1403] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.118s	user 0.024s	sys 0.001s
I20260709 13:21:29.398862 17496 raft_consensus.cc:359] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:29.399816 17496 raft_consensus.cc:740] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.400516 17496 consensus_queue.cc:260] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:29.412657 17496 ts_tablet_manager.cc:1434] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:21:29.413553 17496 tablet_bootstrap.cc:492] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:29.431958 16617 catalog_manager.cc:5697] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:29.433976 16615 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50898 (request call id 117) took 1299 ms. Trace:
I20260709 13:21:29.433701 16617 catalog_manager.cc:5697] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:29.434995 17496 tablet_bootstrap.cc:492] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.436077 17496 tablet_bootstrap.cc:492] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.437183 17496 ts_tablet_manager.cc:1403] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 13:21:29.434470 16615 rpcz_store.cc:276] 0709 13:21:28.134941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:28.135103 (+   162us) service_pool.cc:224] Handling call
0709 13:21:29.433891 (+1298788us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:29.242098 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:29.246720 (+  4622us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:29.246754 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:21:29.246771 (+    17us) tablet.cc:662] Decoding operations
0709 13:21:29.247106 (+   335us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:29.247189 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:29.247219 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:21:29.247402 (+   183us) tablet.cc:701] Row locks acquired
0709 13:21:29.247419 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:21:29.247564 (+   145us) write_op.cc:270] Start()
0709 13:21:29.247667 (+   103us) write_op.cc:276] Timestamp: P: 1783603289247526 usec, L: 0
0709 13:21:29.247686 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:21:29.248422 (+   736us) log.cc:844] Serialized 540 byte log entry
0709 13:21:29.367909 (+119487us) op_driver.cc:464] REPLICATION: finished
0709 13:21:29.414765 (+ 46856us) write_op.cc:301] APPLY: starting
0709 13:21:29.414857 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:29.414951 (+    94us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:29.415065 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:29.415272 (+   207us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:29.416006 (+   734us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:21:29.416050 (+    44us) write_op.cc:312] APPLY: finished
0709 13:21:29.416224 (+   174us) log.cc:844] Serialized 22 byte log entry
0709 13:21:29.416379 (+   155us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:29.416584 (+   205us) write_op.cc:454] Released schema lock
0709 13:21:29.416633 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:29.416950 (+   317us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:29.416979 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":75966,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":46634,"apply.run_cpu_time_us":1611,"apply.run_wall_time_us":2184,"num_ops":1,"prepare.queue_time_us":155010,"prepare.run_cpu_time_us":9810,"prepare.run_wall_time_us":38723,"raft.queue_time_us":60087,"raft.run_cpu_time_us":34426,"raft.run_wall_time_us":38081,"replication_time_us":119040,"thread_start_us":244833,"threads_started":4,"wal-append.queue_time_us":56406}]]}
I20260709 13:21:29.439288 17496 raft_consensus.cc:359] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:29.439924 17496 raft_consensus.cc:740] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.440920 17496 consensus_queue.cc:260] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:29.443203 17496 ts_tablet_manager.cc:1434] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:21:29.443997 17496 tablet_bootstrap.cc:492] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:29.435313 16617 catalog_manager.cc:5697] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:29.446071 16617 catalog_manager.cc:5697] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 1 to 2, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.473166 17496 tablet_bootstrap.cc:492] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.474129 17496 tablet_bootstrap.cc:492] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.474150 16617 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50874 (request call id 116) took 1090 ms. Trace:
I20260709 13:21:29.474809 17496 ts_tablet_manager.cc:1403] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.008s
I20260709 13:21:29.474860 16617 rpcz_store.cc:276] 0709 13:21:28.383450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:28.388450 (+  5000us) service_pool.cc:224] Handling call
0709 13:21:29.474090 (+1085640us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:29.449933 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:29.450467 (+   534us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:29.450499 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:21:29.450517 (+    18us) tablet.cc:662] Decoding operations
0709 13:21:29.451042 (+   525us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:29.451119 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:29.451166 (+    47us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:21:29.451590 (+   424us) tablet.cc:701] Row locks acquired
0709 13:21:29.451603 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:21:29.451742 (+   139us) write_op.cc:270] Start()
0709 13:21:29.451833 (+    91us) write_op.cc:276] Timestamp: P: 1783603289451699 usec, L: 0
0709 13:21:29.451849 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:21:29.452411 (+   562us) log.cc:844] Serialized 1705 byte log entry
0709 13:21:29.454514 (+  2103us) op_driver.cc:464] REPLICATION: finished
0709 13:21:29.454794 (+   280us) write_op.cc:301] APPLY: starting
0709 13:21:29.454868 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:29.455017 (+   149us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:29.455111 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:29.455613 (+   502us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:29.455778 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:21:29.455821 (+    43us) write_op.cc:312] APPLY: finished
0709 13:21:29.456025 (+   204us) log.cc:844] Serialized 40 byte log entry
0709 13:21:29.456174 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:29.456275 (+   101us) write_op.cc:454] Released schema lock
0709 13:21:29.456317 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:29.456648 (+   331us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:29.456676 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":106,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":90,"apply.run_cpu_time_us":1822,"apply.run_wall_time_us":1822,"num_ops":4,"prepare.queue_time_us":122,"prepare.run_cpu_time_us":2712,"prepare.run_wall_time_us":2712,"replication_time_us":2524}]]}
I20260709 13:21:29.479174 17496 raft_consensus.cc:359] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:29.480036 17496 raft_consensus.cc:740] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.480677 17496 consensus_queue.cc:260] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:29.483805 17496 ts_tablet_manager.cc:1434] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:21:29.483898 16618 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50882 (request call id 134) took 1227 ms. Trace:
I20260709 13:21:29.484617 17496 tablet_bootstrap.cc:492] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:29.484293 16618 rpcz_store.cc:276] 0709 13:21:28.256238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:28.256416 (+   178us) service_pool.cc:224] Handling call
0709 13:21:29.483843 (+1227427us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22191,"reported_tablets":6}
I20260709 13:21:29.508265 17496 tablet_bootstrap.cc:492] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.509405 17496 tablet_bootstrap.cc:492] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.510068 17496 ts_tablet_manager.cc:1403] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.004s
I20260709 13:21:29.512621 17496 raft_consensus.cc:359] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:29.513280 17496 raft_consensus.cc:740] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.513973 17496 consensus_queue.cc:260] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:29.516000 17496 ts_tablet_manager.cc:1434] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:29.516738 17496 tablet_bootstrap.cc:492] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:29.547088 17496 tablet_bootstrap.cc:492] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.548123 17496 tablet_bootstrap.cc:492] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.548833 17496 ts_tablet_manager.cc:1403] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.008s
I20260709 13:21:29.549928 16864 raft_consensus.cc:1275] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:29.551529 17496 raft_consensus.cc:359] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:29.552364 17496 raft_consensus.cc:740] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.551640 17500 consensus_queue.cc:1048] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:29.553200 17496 consensus_queue.cc:260] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:29.555315 17496 ts_tablet_manager.cc:1434] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:29.556180 17496 tablet_bootstrap.cc:492] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:29.563807 17541 raft_consensus.cc:3060] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.594033 16617 catalog_manager.cc:5697] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 1 to 2, leader changed from 71a0b5583e0547a88c88b590549fbcee (127.6.214.131) to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } }
I20260709 13:21:29.601964 16616 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43916
I20260709 13:21:29.611792 16939 raft_consensus.cc:1275] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:29.626689 17626 consensus_queue.cc:1048] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:29.660106 17615 heartbeater.cc:499] Master 127.6.214.190:40917 was elected leader, sending a full tablet report...
I20260709 13:21:29.672145 17496 tablet_bootstrap.cc:492] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.673134 17496 tablet_bootstrap.cc:492] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.673803 17496 ts_tablet_manager.cc:1403] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.118s	user 0.020s	sys 0.039s
I20260709 13:21:29.676781 17496 raft_consensus.cc:359] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:29.677474 17496 raft_consensus.cc:740] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.678422 17496 consensus_queue.cc:260] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:29.680665 17496 ts_tablet_manager.cc:1434] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:21:29.681457 17496 tablet_bootstrap.cc:492] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
W20260709 13:21:29.704237 16762 consensus_peers.cc:597] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:29.730911 17496 tablet_bootstrap.cc:492] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.731959 17496 tablet_bootstrap.cc:492] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.732622 17496 ts_tablet_manager.cc:1403] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.024s
I20260709 13:21:29.735109 17496 raft_consensus.cc:359] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:29.735757 17496 raft_consensus.cc:740] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.736553 17496 consensus_queue.cc:260] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:29.738801 17496 ts_tablet_manager.cc:1434] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:21:29.739552 17496 tablet_bootstrap.cc:492] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:29.756574 17496 tablet_bootstrap.cc:492] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.757392 17496 tablet_bootstrap.cc:492] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.757973 17496 ts_tablet_manager.cc:1403] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:21:29.759804 17496 raft_consensus.cc:359] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:29.760304 17496 raft_consensus.cc:740] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.760921 17496 consensus_queue.cc:260] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:29.762907 17496 ts_tablet_manager.cc:1434] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:29.763662 17496 tablet_bootstrap.cc:492] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:29.776700 17496 tablet_bootstrap.cc:492] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.777680 17496 tablet_bootstrap.cc:492] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.778366 17496 ts_tablet_manager.cc:1403] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:21:29.780599 17496 raft_consensus.cc:359] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:29.781232 17496 raft_consensus.cc:740] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.781914 17496 consensus_queue.cc:260] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:29.783944 17496 ts_tablet_manager.cc:1434] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:29.785579 17496 tablet_bootstrap.cc:492] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:29.800098 17496 tablet_bootstrap.cc:492] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.800786 17496 tablet_bootstrap.cc:492] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.801266 17496 ts_tablet_manager.cc:1403] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:21:29.803350 17496 raft_consensus.cc:359] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:29.803944 17496 raft_consensus.cc:740] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.804659 17496 consensus_queue.cc:260] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:29.806802 17496 ts_tablet_manager.cc:1434] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:21:29.807957 17496 tablet_bootstrap.cc:492] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:29.815052 17536 raft_consensus.cc:3060] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:29.822191 17496 tablet_bootstrap.cc:492] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.823115 17496 tablet_bootstrap.cc:492] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
W20260709 13:21:29.823314 16762 consensus_peers.cc:597] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:29.823710 17496 ts_tablet_manager.cc:1403] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:21:29.826213 17496 raft_consensus.cc:359] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:29.826865 17496 raft_consensus.cc:740] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.827487 17496 consensus_queue.cc:260] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:29.829484 17496 ts_tablet_manager.cc:1434] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:21:29.830463 17496 tablet_bootstrap.cc:492] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:29.858925 17496 tablet_bootstrap.cc:492] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.859903 17496 tablet_bootstrap.cc:492] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.860549 17496 ts_tablet_manager.cc:1403] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.006s
I20260709 13:21:29.863153 17496 raft_consensus.cc:359] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:29.863791 17496 raft_consensus.cc:740] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.864416 17496 consensus_queue.cc:260] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:29.866783 17536 raft_consensus.cc:3060] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.866775 17496 ts_tablet_manager.cc:1434] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.009s	sys 0.000s
I20260709 13:21:29.877808 17496 tablet_bootstrap.cc:492] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:29.894126 17496 tablet_bootstrap.cc:492] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.895123 17496 tablet_bootstrap.cc:492] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.895790 17496 ts_tablet_manager.cc:1403] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:21:29.898506 17496 raft_consensus.cc:359] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:29.899305 17496 raft_consensus.cc:740] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.900096 17496 consensus_queue.cc:260] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:29.901893 17496 ts_tablet_manager.cc:1434] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:21:29.902810 17496 tablet_bootstrap.cc:492] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:29.926837 17496 tablet_bootstrap.cc:492] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.927774 17496 tablet_bootstrap.cc:492] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.928437 17496 ts_tablet_manager.cc:1403] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.004s
I20260709 13:21:29.930711 17496 raft_consensus.cc:359] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:29.931541 17496 raft_consensus.cc:740] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.932227 17496 consensus_queue.cc:260] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:29.934952 17496 ts_tablet_manager.cc:1434] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:21:29.936483 17536 raft_consensus.cc:3060] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:29.936597 17496 tablet_bootstrap.cc:492] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:29.957708 17496 tablet_bootstrap.cc:492] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.958720 17496 tablet_bootstrap.cc:492] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.959452 17496 ts_tablet_manager.cc:1403] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:21:29.963807 17496 raft_consensus.cc:359] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:29.964403 17496 raft_consensus.cc:740] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.964946 17496 consensus_queue.cc:260] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:29.966777 17496 ts_tablet_manager.cc:1434] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:29.967995 17496 tablet_bootstrap.cc:492] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:29.986321 17496 tablet_bootstrap.cc:492] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:29.987283 17496 tablet_bootstrap.cc:492] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:29.987937 17496 ts_tablet_manager.cc:1403] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:21:29.989879 17496 raft_consensus.cc:359] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:29.990566 17496 raft_consensus.cc:740] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.991179 17496 consensus_queue.cc:260] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:29.992889 17496 ts_tablet_manager.cc:1434] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:29.994428 17496 tablet_bootstrap.cc:492] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:30.012826 17496 tablet_bootstrap.cc:492] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:30.013741 17496 tablet_bootstrap.cc:492] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:30.014360 17496 ts_tablet_manager.cc:1403] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:21:30.016891 17496 raft_consensus.cc:359] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:30.017467 17496 raft_consensus.cc:740] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.018165 17496 consensus_queue.cc:260] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:30.020344 17496 ts_tablet_manager.cc:1434] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:30.021862 17496 tablet_bootstrap.cc:492] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:30.037536 17496 tablet_bootstrap.cc:492] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:30.038517 17496 tablet_bootstrap.cc:492] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:30.039094 17496 ts_tablet_manager.cc:1403] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.001s
I20260709 13:21:30.041600 17496 raft_consensus.cc:359] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:30.042259 17496 raft_consensus.cc:740] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.042974 17496 consensus_queue.cc:260] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:30.045245 17496 ts_tablet_manager.cc:1434] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:21:30.046001 17496 tablet_bootstrap.cc:492] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap starting.
I20260709 13:21:30.063263 17496 tablet_bootstrap.cc:492] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:30.064291 17496 tablet_bootstrap.cc:492] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9: Bootstrap complete.
I20260709 13:21:30.064926 17496 ts_tablet_manager.cc:1403] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:21:30.067550 17496 raft_consensus.cc:359] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:30.068181 17496 raft_consensus.cc:740] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.068915 17496 consensus_queue.cc:260] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:30.071722 17496 ts_tablet_manager.cc:1434] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9: Time spent starting tablet: real 0.006s	user 0.010s	sys 0.000s
I20260709 13:21:30.104945 17536 raft_consensus.cc:3060] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.127539 17541 raft_consensus.cc:3060] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.207029 17541 raft_consensus.cc:3060] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:30.262672 17586 raft_consensus.cc:493] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.263257 17586 raft_consensus.cc:515] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:30.265934 17586 leader_election.cc:290] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:30.270819 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:30.272008 17537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:30.272643 17537 raft_consensus.cc:2468] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 2.
I20260709 13:21:30.273902 16836 leader_election.cc:304] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:30.274919 17586 raft_consensus.cc:2804] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:30.275353 17586 raft_consensus.cc:493] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.275740 17586 raft_consensus.cc:3060] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:30.283517 17586 raft_consensus.cc:515] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:30.285185 17586 leader_election.cc:290] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:30.286137 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:30.286331 17541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
I20260709 13:21:30.287184 17541 raft_consensus.cc:3060] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:30.293470 17541 raft_consensus.cc:2468] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 3.
I20260709 13:21:30.294593 16836 leader_election.cc:304] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 266d75f35db4465788ab06782fae972d
I20260709 13:21:30.295287 17586 raft_consensus.cc:2804] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:30.295810 17586 raft_consensus.cc:697] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 3 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:30.296663 17586 consensus_queue.cc:237] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:30.308823 16616 catalog_manager.cc:5697] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.529122 17674 raft_consensus.cc:493] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71a0b5583e0547a88c88b590549fbcee)
I20260709 13:21:30.529800 17674 raft_consensus.cc:515] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:30.532243 17674 leader_election.cc:290] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:30.533053 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:30.533226 17541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" is_pre_election: true
I20260709 13:21:30.534101 17541 raft_consensus.cc:2368] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d for earlier term 2. Current term is 3.
I20260709 13:21:30.535203 16910 leader_election.cc:400] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869) with higher term. Message: Invalid argument: T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d for earlier term 2. Current term is 3.
I20260709 13:21:30.535497 16910 leader_election.cc:403] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:30.536094 17710 raft_consensus.cc:3060] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:21:30.543103 17710 raft_consensus.cc:2749] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869) with higher term. Message: Invalid argument: T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d for earlier term 2. Current term is 3.
I20260709 13:21:30.757580 16943 raft_consensus.cc:1275] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Refusing update from remote peer 71a0b5583e0547a88c88b590549fbcee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:30.759508 17779 consensus_queue.cc:1048] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:30.787153 17542 raft_consensus.cc:1275] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Refusing update from remote peer 71a0b5583e0547a88c88b590549fbcee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:30.789546 17707 consensus_queue.cc:1048] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:37.008585  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:37.081730 16870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00095bdfc40040d0a8eefc49c2034fb2"
dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
mode: GRACEFUL
new_leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:50340
I20260709 13:21:37.082782 16870 raft_consensus.cc:606] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Received request to transfer leadership to TS 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:37.098721 16939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "079f892041a84ff8a4b23e4cfffa762d"
dest_uuid: "266d75f35db4465788ab06782fae972d"
mode: GRACEFUL
new_leader_uuid: "5642511b38924ffcbe38110cf27d3535"
 from {username='slave'} at 127.0.0.1:46608
I20260709 13:21:37.099411 16939 raft_consensus.cc:606] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Received request to transfer leadership to TS 5642511b38924ffcbe38110cf27d3535
I20260709 13:21:37.104204 16939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ffcb1357332401a919db507af113059"
dest_uuid: "266d75f35db4465788ab06782fae972d"
mode: GRACEFUL
new_leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:46608
I20260709 13:21:37.104847 16939 raft_consensus.cc:606] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Received request to transfer leadership to TS 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:37.107640 17799 raft_consensus.cc:993] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d: : Instructing follower 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:37.108897 17795 raft_consensus.cc:1081] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Signalling peer 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:37.111086 16939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b"
dest_uuid: "266d75f35db4465788ab06782fae972d"
mode: GRACEFUL
new_leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:46608
I20260709 13:21:37.111183 17541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ffcb1357332401a919db507af113059"
dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:37834
I20260709 13:21:37.112313 16939 raft_consensus.cc:606] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Received request to transfer leadership to TS 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:37.112530 17541 raft_consensus.cc:493] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:37.113103 17541 raft_consensus.cc:3060] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:37.116389 16939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb2b3210f0d344aa8c9f961a1b72c508"
dest_uuid: "266d75f35db4465788ab06782fae972d"
mode: GRACEFUL
new_leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:46608
I20260709 13:21:37.117055 16939 raft_consensus.cc:606] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Received request to transfer leadership to TS 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:37.118595  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:37.120389  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:37.134904 17798 raft_consensus.cc:993] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee: : Instructing follower 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:37.135692 17779 raft_consensus.cc:1081] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Signalling peer 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:37.137873 17541 raft_consensus.cc:515] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:37.140487 17542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00095bdfc40040d0a8eefc49c2034fb2"
dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:37840
I20260709 13:21:37.141091 17542 raft_consensus.cc:493] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:37.141520 17542 raft_consensus.cc:3060] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:37.141635 17541 leader_election.cc:290] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 3 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:37.142036 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffcb1357332401a919db507af113059" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:37.142944 16870 raft_consensus.cc:3060] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:37.143276 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffcb1357332401a919db507af113059" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:37.143857 16939 raft_consensus.cc:3055] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:37.144060 16939 raft_consensus.cc:740] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:37.145226 16939 consensus_queue.cc:260] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:37.146680 16939 raft_consensus.cc:3060] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:37.150264 17795 raft_consensus.cc:993] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d: : Instructing follower 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:37.151765 17799 raft_consensus.cc:1081] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Signalling peer 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:37.153632 17537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b"
dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:37834
I20260709 13:21:37.154204 17537 raft_consensus.cc:493] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:37.154560 17537 raft_consensus.cc:3060] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:37.157265 16939 raft_consensus.cc:2468] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 3.
I20260709 13:21:37.157280 16870 raft_consensus.cc:2468] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 3.
I20260709 13:21:37.159101 17491 leader_election.cc:304] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:37.152828 17542 raft_consensus.cc:515] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:37.160432 17772 raft_consensus.cc:2804] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:37.161980 17542 leader_election.cc:290] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:37.162883 17537 raft_consensus.cc:515] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:37.163468 16793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00095bdfc40040d0a8eefc49c2034fb2" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:37.164063 16793 raft_consensus.cc:3060] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:37.165645 17537 leader_election.cc:290] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 3 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:37.167018 16791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:37.167717 17772 raft_consensus.cc:697] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:37.167877 16791 raft_consensus.cc:3060] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:37.169193 17772 consensus_queue.cc:237] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:37.171720 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:37.172371 16939 raft_consensus.cc:3055] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:37.172673 16939 raft_consensus.cc:740] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:37.174504 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00095bdfc40040d0a8eefc49c2034fb2" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:37.175119 16870 raft_consensus.cc:3055] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:37.175472 16870 raft_consensus.cc:740] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:37.176630 16870 consensus_queue.cc:260] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:37.176724 16939 consensus_queue.cc:260] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:37.178187 16939 raft_consensus.cc:3060] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:37.178303 16870 raft_consensus.cc:3060] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:37.185545 16793 raft_consensus.cc:2468] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 2.
I20260709 13:21:37.185241 16939 raft_consensus.cc:2468] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 3.
I20260709 13:21:37.187157 17492 leader_election.cc:304] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:37.187584 17493 leader_election.cc:304] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:37.188243 17804 raft_consensus.cc:2804] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:37.196058 17807 raft_consensus.cc:2804] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:37.197964 17804 raft_consensus.cc:697] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:37.199936 17804 consensus_queue.cc:237] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:37.207779 16870 raft_consensus.cc:2468] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 2.
I20260709 13:21:37.208950 17807 raft_consensus.cc:697] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:37.210425 16791 raft_consensus.cc:2468] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 3.
I20260709 13:21:37.213871 17807 consensus_queue.cc:237] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:37.222832 17800 raft_consensus.cc:993] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d: : Instructing follower 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:37.224558 17800 raft_consensus.cc:1081] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Signalling peer 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:37.231076 17542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb2b3210f0d344aa8c9f961a1b72c508"
dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:37834
I20260709 13:21:37.231719 17542 raft_consensus.cc:493] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:37.232122 17542 raft_consensus.cc:3060] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:37.249715 17542 raft_consensus.cc:515] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
W20260709 13:21:37.253016 17493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:32963, user_credentials={real_user=slave}} blocked reactor thread for 65580.5us
I20260709 13:21:37.255980 16791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2b3210f0d344aa8c9f961a1b72c508" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:37.258451 16791 raft_consensus.cc:3060] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:37.259377 16616 catalog_manager.cc:5697] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 2 to 3, leader changed from 266d75f35db4465788ab06782fae972d (127.6.214.132) to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 3 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:37.261632 17542 leader_election.cc:290] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 3 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:37.261901 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2b3210f0d344aa8c9f961a1b72c508" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:37.262820 16943 raft_consensus.cc:3055] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:37.263274 16943 raft_consensus.cc:740] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:37.264045 16943 consensus_queue.cc:260] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:37.265486 16943 raft_consensus.cc:3060] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:37.268930 16791 raft_consensus.cc:2468] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 3.
I20260709 13:21:37.270859 17492 leader_election.cc:304] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:37.272225 17772 raft_consensus.cc:2804] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:37.272884 17772 raft_consensus.cc:697] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:37.273984 17772 consensus_queue.cc:237] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:37.282232 16943 raft_consensus.cc:2468] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 3.
I20260709 13:21:37.306319 16616 catalog_manager.cc:5697] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 1 to 2, leader changed from 71a0b5583e0547a88c88b590549fbcee (127.6.214.131) to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:37.308080 16616 catalog_manager.cc:5697] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 2 to 3, leader changed from 266d75f35db4465788ab06782fae972d (127.6.214.132) to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 3 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:37.309849 16616 catalog_manager.cc:5697] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 2 to 3, leader changed from 266d75f35db4465788ab06782fae972d (127.6.214.132) to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 3 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:37.351125 17795 raft_consensus.cc:993] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d: : Instructing follower 5642511b38924ffcbe38110cf27d3535 to start an election
I20260709 13:21:37.351843 17795 raft_consensus.cc:1081] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Signalling peer 5642511b38924ffcbe38110cf27d3535 to start an election
I20260709 13:21:37.353780 16791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "079f892041a84ff8a4b23e4cfffa762d"
dest_uuid: "5642511b38924ffcbe38110cf27d3535"
 from {username='slave'} at 127.0.0.1:36676
I20260709 13:21:37.354390 16791 raft_consensus.cc:493] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:37.354777 16791 raft_consensus.cc:3060] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:37.375650 16791 raft_consensus.cc:515] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:37.378459 16791 leader_election.cc:290] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:37.380724 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f892041a84ff8a4b23e4cfffa762d" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:37.381464 16863 raft_consensus.cc:3060] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:37.380208 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079f892041a84ff8a4b23e4cfffa762d" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:37.382148 16943 raft_consensus.cc:3055] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:37.382448 16943 raft_consensus.cc:740] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:37.383525 16943 consensus_queue.cc:260] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:37.384689 16943 raft_consensus.cc:3060] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:37.391507 16863 raft_consensus.cc:2468] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
I20260709 13:21:37.391637 16943 raft_consensus.cc:2468] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
I20260709 13:21:37.393129 16760 leader_election.cc:304] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:37.394368 17582 raft_consensus.cc:2804] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:37.394807 17582 raft_consensus.cc:697] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:37.395572 17582 consensus_queue.cc:237] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:37.414906 16616 catalog_manager.cc:5697] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 1 to 2, leader changed from 266d75f35db4465788ab06782fae972d (127.6.214.132) to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:37.569175 16939 raft_consensus.cc:1275] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:37.570518 17772 consensus_queue.cc:1048] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:37.584081 16863 raft_consensus.cc:1275] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:37.590569 17772 consensus_queue.cc:1048] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:37.617931 16791 raft_consensus.cc:1275] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:37.619426 17807 consensus_queue.cc:1048] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:37.633940 16863 raft_consensus.cc:1275] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:37.638976 16937 raft_consensus.cc:1275] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:37.640885 17807 consensus_queue.cc:1048] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:37.641191 17772 consensus_queue.cc:1048] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:37.686872 16791 raft_consensus.cc:1275] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:37.692550 17806 consensus_queue.cc:1048] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:37.774870 16937 raft_consensus.cc:1275] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:37.776162 17806 consensus_queue.cc:1048] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:37.790934 16791 raft_consensus.cc:1275] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:37.793541 17807 consensus_queue.cc:1048] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:37.977568 16870 raft_consensus.cc:1275] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Refusing update from remote peer 5642511b38924ffcbe38110cf27d3535: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:37.978754 17582 consensus_queue.cc:1048] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:37.990134 16939 raft_consensus.cc:1275] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Refusing update from remote peer 5642511b38924ffcbe38110cf27d3535: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:37.991863 17831 consensus_queue.cc:1048] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:38.121622  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:38.169535  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:38.211369 16870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1702099270174fe58528799e1564c74b"
dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
mode: GRACEFUL
new_leader_uuid: "266d75f35db4465788ab06782fae972d"
 from {username='slave'} at 127.0.0.1:50340
I20260709 13:21:38.212000 16870 raft_consensus.cc:606] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Received request to transfer leadership to TS 266d75f35db4465788ab06782fae972d
I20260709 13:21:38.214880 16870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b55efde48bb42119e9a38f9e3f2f6c6"
dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
mode: GRACEFUL
new_leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:50340
I20260709 13:21:38.216740 16870 raft_consensus.cc:606] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Received request to transfer leadership to TS 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:38.219504 16863 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b"
dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
mode: GRACEFUL
new_leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:50340
I20260709 13:21:38.220079 16863 raft_consensus.cc:606] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 3 LEADER]: Received request to transfer leadership to TS 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:38.238188 17779 raft_consensus.cc:993] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee: : Instructing follower 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:38.238718 17798 raft_consensus.cc:1081] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 3 LEADER]: Signalling peer 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:38.240345 17541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b"
dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:37840
I20260709 13:21:38.240901 17541 raft_consensus.cc:493] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:38.241271 17541 raft_consensus.cc:3060] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:38.250775 16790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f"
dest_uuid: "5642511b38924ffcbe38110cf27d3535"
mode: GRACEFUL
new_leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:47028
I20260709 13:21:38.251747 17541 raft_consensus.cc:515] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:38.256098 17541 leader_election.cc:290] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 4 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:38.255966 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:38.257567 16937 raft_consensus.cc:3060] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:38.255901 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:38.259538 16863 raft_consensus.cc:3055] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:21:38.259897 16863 raft_consensus.cc:740] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:38.260699 16863 consensus_queue.cc:260] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:38.262741 16863 raft_consensus.cc:3060] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:38.251814 16790 raft_consensus.cc:606] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Received request to transfer leadership to TS 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:38.268078 16937 raft_consensus.cc:2468] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 4.
I20260709 13:21:38.269115 16864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e691d47f85a540f884defe4bf7a293b2"
dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
mode: GRACEFUL
new_leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:50340
I20260709 13:21:38.269804 16864 raft_consensus.cc:606] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Received request to transfer leadership to TS 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:38.269685 17493 leader_election.cc:304] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:38.271497  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:38.271346 17836 raft_consensus.cc:2804] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:38.272401 17836 raft_consensus.cc:697] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 4 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:38.272826 16863 raft_consensus.cc:2468] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 4.
I20260709 13:21:38.273667  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:38.274314 17836 consensus_queue.cc:237] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:38.291133 16616 catalog_manager.cc:5697] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 3 to 4, leader changed from 71a0b5583e0547a88c88b590549fbcee (127.6.214.131) to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 4 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:38.302625 17779 raft_consensus.cc:993] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee: : Instructing follower 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:38.303298 17829 raft_consensus.cc:1081] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Signalling peer 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:38.304997 17537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e691d47f85a540f884defe4bf7a293b2"
dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:37840
I20260709 13:21:38.305517 17537 raft_consensus.cc:493] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:38.305845 17537 raft_consensus.cc:3060] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:38.311893 17537 raft_consensus.cc:515] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:38.313834 17537 leader_election.cc:290] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:38.314756 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e691d47f85a540f884defe4bf7a293b2" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:38.314957 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e691d47f85a540f884defe4bf7a293b2" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:38.315665 16863 raft_consensus.cc:3055] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:38.315716 16790 raft_consensus.cc:3060] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:38.316135 16863 raft_consensus.cc:740] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:38.317169 16863 consensus_queue.cc:260] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:38.319015 16863 raft_consensus.cc:3060] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:38.323864 16790 raft_consensus.cc:2468] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 2.
I20260709 13:21:38.324522 16863 raft_consensus.cc:2468] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 2.
I20260709 13:21:38.325263 17492 leader_election.cc:304] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:38.326251 17836 raft_consensus.cc:2804] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:38.326802 17836 raft_consensus.cc:697] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:38.327780 17836 consensus_queue.cc:237] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:38.338047 16616 catalog_manager.cc:5697] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 1 to 2, leader changed from 71a0b5583e0547a88c88b590549fbcee (127.6.214.131) to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:38.442200 17798 raft_consensus.cc:993] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee: : Instructing follower 266d75f35db4465788ab06782fae972d to start an election
I20260709 13:21:38.442869 17779 raft_consensus.cc:1081] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Signalling peer 266d75f35db4465788ab06782fae972d to start an election
I20260709 13:21:38.444473 16939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1702099270174fe58528799e1564c74b"
dest_uuid: "266d75f35db4465788ab06782fae972d"
 from {username='slave'} at 127.0.0.1:36182
I20260709 13:21:38.444983 16939 raft_consensus.cc:493] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:38.445281 16939 raft_consensus.cc:3060] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:38.450536 16939 raft_consensus.cc:515] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:38.452442 16939 leader_election.cc:290] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:38.453266 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702099270174fe58528799e1564c74b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:38.453464 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1702099270174fe58528799e1564c74b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:38.454120 16863 raft_consensus.cc:3055] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:38.454131 16790 raft_consensus.cc:3060] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:38.454370 16863 raft_consensus.cc:740] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:38.455173 16863 consensus_queue.cc:260] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:38.456179 16863 raft_consensus.cc:3060] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:38.461824 16863 raft_consensus.cc:2468] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 2.
I20260709 13:21:38.462751 16790 raft_consensus.cc:2468] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 2.
I20260709 13:21:38.463012 16908 leader_election.cc:304] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:38.463989 17795 raft_consensus.cc:2804] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:38.464582 17795 raft_consensus.cc:697] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:38.470463 17795 consensus_queue.cc:237] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } }
I20260709 13:21:38.488363 16616 catalog_manager.cc:5697] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 1 to 2, leader changed from 71a0b5583e0547a88c88b590549fbcee (127.6.214.131) to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 2 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:38.556556 17798 raft_consensus.cc:993] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee: : Instructing follower 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:38.557312 17779 raft_consensus.cc:1081] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Signalling peer 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:38.559334 17537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b55efde48bb42119e9a38f9e3f2f6c6"
dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:37840
I20260709 13:21:38.559901 17537 raft_consensus.cc:493] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:38.560216 17537 raft_consensus.cc:3060] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:38.565416 17537 raft_consensus.cc:515] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:38.567106 17537 leader_election.cc:290] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:38.568084 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b55efde48bb42119e9a38f9e3f2f6c6" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:38.568161 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b55efde48bb42119e9a38f9e3f2f6c6" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:38.568939 16863 raft_consensus.cc:3055] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:38.569123 16939 raft_consensus.cc:3060] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:38.569419 16863 raft_consensus.cc:740] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:38.570561 16863 consensus_queue.cc:260] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:38.571677 16863 raft_consensus.cc:3060] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:38.574992 16939 raft_consensus.cc:2468] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 2.
I20260709 13:21:38.576980 17493 leader_election.cc:304] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:38.577577 16863 raft_consensus.cc:2468] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 2.
I20260709 13:21:38.577930 17836 raft_consensus.cc:2804] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:38.578511 17836 raft_consensus.cc:697] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:38.579414 17836 consensus_queue.cc:237] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:38.589592 16616 catalog_manager.cc:5697] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 1 to 2, leader changed from 71a0b5583e0547a88c88b590549fbcee (127.6.214.131) to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:38.708221 17831 raft_consensus.cc:993] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535: : Instructing follower 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:38.708735 17582 raft_consensus.cc:1081] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Signalling peer 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:38.710234 17537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f"
dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:37488
I20260709 13:21:38.710755 17537 raft_consensus.cc:493] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:38.711073 17537 raft_consensus.cc:3060] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:38.716156 17537 raft_consensus.cc:515] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:38.718215 17537 leader_election.cc:290] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 3 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:38.718822 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:38.719400 16939 raft_consensus.cc:3060] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:38.719599 16791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:38.720213 16791 raft_consensus.cc:3055] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:38.720512 16791 raft_consensus.cc:740] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:38.721261 16791 consensus_queue.cc:260] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:38.722523 16791 raft_consensus.cc:3060] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:38.726557 16939 raft_consensus.cc:2468] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 3.
I20260709 13:21:38.728103 17493 leader_election.cc:304] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:38.728888 16791 raft_consensus.cc:2468] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 3.
I20260709 13:21:38.728964 17836 raft_consensus.cc:2804] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:38.729815 17836 raft_consensus.cc:697] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:38.730722 17836 consensus_queue.cc:237] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:38.741184 16616 catalog_manager.cc:5697] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 2 to 3, leader changed from 5642511b38924ffcbe38110cf27d3535 (127.6.214.130) to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 3 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:38.785530 16863 raft_consensus.cc:1275] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:38.787109 17836 consensus_queue.cc:1048] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:38.799449 16791 raft_consensus.cc:1275] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:38.801395 17835 consensus_queue.cc:1048] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:38.835564 16939 raft_consensus.cc:1275] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:21:38.836901 17847 consensus_queue.cc:1048] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:38.846827 16864 raft_consensus.cc:1275] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:21:38.848456 17847 consensus_queue.cc:1048] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:38.964459 16791 raft_consensus.cc:1275] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:38.965939 17795 consensus_queue.cc:1048] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:38.976557 16864 raft_consensus.cc:1275] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Refusing update from remote peer 266d75f35db4465788ab06782fae972d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:38.979107 17795 consensus_queue.cc:1048] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:39.092422 16864 raft_consensus.cc:1275] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:39.092711 16939 raft_consensus.cc:1275] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:39.094146 17836 consensus_queue.cc:1048] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:39.095139 17847 consensus_queue.cc:1048] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:39.274797  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:39.314078 16790 raft_consensus.cc:1275] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:39.315554 17847 consensus_queue.cc:1048] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:39.316749  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:39.332862 16939 raft_consensus.cc:1275] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:39.335958 17835 consensus_queue.cc:1048] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:39.375329 16864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0239d47f915d4f529cdc01b32055c954"
dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
mode: GRACEFUL
new_leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:50340
I20260709 13:21:39.376230 16864 raft_consensus.cc:606] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Received request to transfer leadership to TS 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:39.379225 16864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49"
dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
mode: GRACEFUL
new_leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:50340
I20260709 13:21:39.379767 16864 raft_consensus.cc:606] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Received request to transfer leadership to TS 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:39.382249 16864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa"
dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
mode: GRACEFUL
new_leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:50340
I20260709 13:21:39.382812 16864 raft_consensus.cc:606] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Received request to transfer leadership to TS 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:39.385265 16939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8"
dest_uuid: "266d75f35db4465788ab06782fae972d"
mode: GRACEFUL
new_leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:46608
I20260709 13:21:39.385907 16939 raft_consensus.cc:606] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 3 LEADER]: Received request to transfer leadership to TS 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:39.388640 16864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358"
dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
mode: GRACEFUL
new_leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:50340
I20260709 13:21:39.389171 16864 raft_consensus.cc:606] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Received request to transfer leadership to TS 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:39.390343  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:39.392019  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:39.409017 17779 raft_consensus.cc:993] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee: : Instructing follower 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:39.409670 17779 raft_consensus.cc:1081] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Signalling peer 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:39.411701 17537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa"
dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:37840
I20260709 13:21:39.412241 17537 raft_consensus.cc:493] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:39.412627 17537 raft_consensus.cc:3060] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:39.418574 17537 raft_consensus.cc:515] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:39.420179 17537 leader_election.cc:290] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 3 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:39.420924 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:39.421299 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:39.421907 16864 raft_consensus.cc:3055] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:39.421810 16790 raft_consensus.cc:3060] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:39.422444 16864 raft_consensus.cc:740] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:39.423343 16864 consensus_queue.cc:260] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:39.424538 16864 raft_consensus.cc:3060] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:39.435722 17856 raft_consensus.cc:993] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d: : Instructing follower 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:39.437283 17855 raft_consensus.cc:1081] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 3 LEADER]: Signalling peer 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:39.439044 17537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8"
dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:37834
I20260709 13:21:39.439704 17537 raft_consensus.cc:493] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:39.440128 17537 raft_consensus.cc:3060] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:39.441015 16790 raft_consensus.cc:2468] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 3.
I20260709 13:21:39.442503 17492 leader_election.cc:304] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:39.443475 17861 raft_consensus.cc:2804] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:39.443948 17861 raft_consensus.cc:697] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:39.444800 17861 consensus_queue.cc:237] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:39.442457 16864 raft_consensus.cc:2468] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 3.
I20260709 13:21:39.454872 17537 raft_consensus.cc:515] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:39.460367 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:39.460983 16863 raft_consensus.cc:3060] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:39.461002 17537 leader_election.cc:290] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 4 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 266d75f35db4465788ab06782fae972d (127.6.214.132:32963)
I20260709 13:21:39.463874 16618 catalog_manager.cc:5697] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 2 to 3, leader changed from 71a0b5583e0547a88c88b590549fbcee (127.6.214.131) to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 3 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.467417 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:39.467903 16863 raft_consensus.cc:2468] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 4.
I20260709 13:21:39.468117 16939 raft_consensus.cc:3055] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:21:39.468478 16939 raft_consensus.cc:740] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:39.469275 17491 leader_election.cc:304] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:39.469230 16939 consensus_queue.cc:260] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:39.470588 16939 raft_consensus.cc:3060] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:39.471079 17836 raft_consensus.cc:2804] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:39.471630 17836 raft_consensus.cc:697] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 4 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:39.472506 17836 consensus_queue.cc:237] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:39.477843 16939 raft_consensus.cc:2468] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 4.
I20260709 13:21:39.491503 17779 raft_consensus.cc:993] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee: : Instructing follower 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:39.491994 17779 raft_consensus.cc:1081] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Signalling peer 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:39.496997 17537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358"
dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:37840
I20260709 13:21:39.497644 17537 raft_consensus.cc:493] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:39.498014 17537 raft_consensus.cc:3060] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:39.506668 17537 raft_consensus.cc:515] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:39.514609 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:39.514729 17537 leader_election.cc:290] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:39.514912 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:39.515417 16790 raft_consensus.cc:3060] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:39.515610 16864 raft_consensus.cc:3055] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:39.516139 16864 raft_consensus.cc:740] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:39.516285 16618 catalog_manager.cc:5697] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 3 to 4, leader changed from 266d75f35db4465788ab06782fae972d (127.6.214.132) to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 4 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:39.516930 16864 consensus_queue.cc:260] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:39.518069 16864 raft_consensus.cc:3060] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:39.523561 16790 raft_consensus.cc:2468] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 2.
I20260709 13:21:39.524808 17492 leader_election.cc:304] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:39.525683 17836 raft_consensus.cc:2804] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:39.526145 17836 raft_consensus.cc:697] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:39.525916 16864 raft_consensus.cc:2468] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 2.
I20260709 13:21:39.527233 17836 consensus_queue.cc:237] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:39.538971 16618 catalog_manager.cc:5697] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 1 to 2, leader changed from 71a0b5583e0547a88c88b590549fbcee (127.6.214.131) to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.750505 17829 raft_consensus.cc:993] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee: : Instructing follower 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:39.751003 17779 raft_consensus.cc:1081] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Signalling peer 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:39.752630 17537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0239d47f915d4f529cdc01b32055c954"
dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:37840
I20260709 13:21:39.753229 17537 raft_consensus.cc:493] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:39.753585 17537 raft_consensus.cc:3060] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:39.761693 17537 raft_consensus.cc:515] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:39.765271 17537 leader_election.cc:290] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:39.766852 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0239d47f915d4f529cdc01b32055c954" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:39.767020 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0239d47f915d4f529cdc01b32055c954" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:39.767443 16790 raft_consensus.cc:3060] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:39.767553 16864 raft_consensus.cc:3055] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:39.767946 16864 raft_consensus.cc:740] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:39.768705 16864 consensus_queue.cc:260] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:39.769934 16864 raft_consensus.cc:3060] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:39.773912 17829 raft_consensus.cc:993] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee: : Instructing follower 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:39.775069 16790 raft_consensus.cc:2468] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 2.
I20260709 13:21:39.775624 17779 raft_consensus.cc:1081] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Signalling peer 9fa67aaf86874b1ca9b7f88c944c80d9 to start an election
I20260709 13:21:39.776533 17492 leader_election.cc:304] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:39.776896 16864 raft_consensus.cc:2468] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 2.
I20260709 13:21:39.777791 17836 raft_consensus.cc:2804] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:39.778293 17836 raft_consensus.cc:697] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:39.779201 17836 consensus_queue.cc:237] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:39.780295 17537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49"
dest_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9"
 from {username='slave'} at 127.0.0.1:37840
I20260709 13:21:39.780951 17537 raft_consensus.cc:493] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:39.781327 17537 raft_consensus.cc:3060] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:39.792719 17537 raft_consensus.cc:515] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:39.791864 16617 catalog_manager.cc:5697] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 1 to 2, leader changed from 71a0b5583e0547a88c88b590549fbcee (127.6.214.131) to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.797297 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:39.798043 16790 raft_consensus.cc:3060] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:39.799481 17537 leader_election.cc:290] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 3 election: Requested vote from peers 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:39.804618 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:39.805204 16864 raft_consensus.cc:3055] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:39.805528 16864 raft_consensus.cc:740] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:39.806277 16864 consensus_queue.cc:260] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:39.808007 16864 raft_consensus.cc:3060] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:39.817929 16864 raft_consensus.cc:2468] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 3.
I20260709 13:21:39.811522 16790 raft_consensus.cc:2468] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fa67aaf86874b1ca9b7f88c944c80d9 in term 3.
I20260709 13:21:39.819520 17491 leader_election.cc:304] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9; no voters: 
I20260709 13:21:39.820685 17836 raft_consensus.cc:2804] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:39.821167 17836 raft_consensus.cc:697] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 LEADER]: Becoming Leader. State: Replica: 9fa67aaf86874b1ca9b7f88c944c80d9, State: Running, Role: LEADER
I20260709 13:21:39.822125 17836 consensus_queue.cc:237] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:39.834429 16617 catalog_manager.cc:5697] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 reported cstate change: term changed from 2 to 3, leader changed from 71a0b5583e0547a88c88b590549fbcee (127.6.214.131) to 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129). New cstate: current_term: 3 leader_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:39.894229 16864 raft_consensus.cc:1275] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:21:39.895610 17836 consensus_queue.cc:1048] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:21:39.906740 16939 raft_consensus.cc:1275] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:21:39.908191 17836 consensus_queue.cc:1048] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:21:39.919900 16864 raft_consensus.cc:1275] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:39.921389 17836 consensus_queue.cc:1048] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:39.936328 16790 raft_consensus.cc:1275] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:39.938917 17861 consensus_queue.cc:1048] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:39.957824 16863 raft_consensus.cc:1275] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:39.959297 17836 consensus_queue.cc:1048] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:39.971633 16791 raft_consensus.cc:1275] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:39.973325 17847 consensus_queue.cc:1048] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:40.272593 16790 raft_consensus.cc:1275] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:40.274070 17847 consensus_queue.cc:1048] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:40.284749 16863 raft_consensus.cc:1275] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:40.287328 17836 consensus_queue.cc:1048] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:40.355480 16863 raft_consensus.cc:1275] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:40.356805 17847 consensus_queue.cc:1048] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:40.368201 16790 raft_consensus.cc:1275] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Refusing update from remote peer 9fa67aaf86874b1ca9b7f88c944c80d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:40.370890 17835 consensus_queue.cc:1048] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:40.392858  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:40.430335  7002 tablet_server.cc:179] TabletServer@127.6.214.129:34869 shutting down...
W20260709 13:21:40.456143 16910 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 138 similar messages]
W20260709 13:21:40.461808 16910 consensus_peers.cc:597] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.478979  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:40.480309  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.481774  7002 raft_consensus.cc:2243] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.482703  7002 raft_consensus.cc:2272] T 625f07ca50734f51bc7c0176ad5326f9 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.486359  7002 tablet_replica.cc:333] stopping tablet replica
W20260709 13:21:40.487033 16910 consensus_peers.cc:597] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.487316  7002 raft_consensus.cc:2243] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.487895  7002 raft_consensus.cc:2272] T b0a5428f572c4214b4ecd02231d81bd7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.490278  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.491093  7002 raft_consensus.cc:2243] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.491544  7002 raft_consensus.cc:2272] T a37644a5aa384ad88bdebe0b15db71ea P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.494146  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.495024  7002 raft_consensus.cc:2243] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.495543  7002 raft_consensus.cc:2272] T a4b336bf87ee483f9aef83d5b3358fae P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.498426  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.499083  7002 raft_consensus.cc:2243] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.499608  7002 raft_consensus.cc:2272] T 9bb16a744c5d40a1b64f60422c21e3c5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:40.499675 16762 consensus_peers.cc:597] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.502523  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.503582  7002 raft_consensus.cc:2243] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.504109  7002 raft_consensus.cc:2272] T 2ad644a4c46b4ba9b4845f75d943c516 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.507246  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.509135  7002 raft_consensus.cc:2243] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:40.510113  7002 raft_consensus.cc:2272] T 00095bdfc40040d0a8eefc49c2034fb2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.513170  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.514067  7002 raft_consensus.cc:2243] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:40.514950  7002 raft_consensus.cc:2272] T dbed23d268484353b8fb9eb9d57444f8 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.518083  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.518903  7002 raft_consensus.cc:2243] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.519302  7002 raft_consensus.cc:2272] T 739b8dae347b48aca06253d0a0a82369 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.523069  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.524012  7002 raft_consensus.cc:2243] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.524682  7002 raft_consensus.cc:2272] T 13a3b0acceaf4cada63b5f215fab4a29 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.528398  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.529261  7002 raft_consensus.cc:2243] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.529834  7002 raft_consensus.cc:2272] T d72c23005f53496890cfb11e0c19318b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:40.530706 16836 consensus_peers.cc:597] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.532943  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.533808  7002 raft_consensus.cc:2243] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.534384  7002 raft_consensus.cc:2272] T 71c414f9d9e048e89cedbb0dbe6027a2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.537405  7002 tablet_replica.cc:333] stopping tablet replica
W20260709 13:21:40.538024 16910 consensus_peers.cc:597] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.538339  7002 raft_consensus.cc:2243] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:40.539237  7002 raft_consensus.cc:2272] T eed8496b9e0a4440b2069b956dfc7358 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.542948  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.543772  7002 raft_consensus.cc:2243] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:40.544659  7002 raft_consensus.cc:2272] T 0239d47f915d4f529cdc01b32055c954 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.547614  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.548547  7002 raft_consensus.cc:2243] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.549024  7002 raft_consensus.cc:2272] T 9b15c4a7a5cd4cf090073986cb42b826 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.551863  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.552627  7002 raft_consensus.cc:2243] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:40.553617  7002 raft_consensus.cc:2272] T dc87d7904d6f4c4489210546472fc39f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.556537  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.557539  7002 raft_consensus.cc:2243] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.558110  7002 raft_consensus.cc:2272] T 4709a71f10ba41f39d6a6db62045e637 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.561080  7002 tablet_replica.cc:333] stopping tablet replica
W20260709 13:21:40.561820 16910 consensus_peers.cc:597] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.561940  7002 raft_consensus.cc:2243] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.562624  7002 raft_consensus.cc:2272] T 46a75d301e384d359f3540e990d68e8d P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:40.564602 16910 consensus_peers.cc:597] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.565852  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.566843  7002 raft_consensus.cc:2243] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.567421  7002 raft_consensus.cc:2272] T ec2fb00d467444edb3d2d8374ad64b7c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:40.567795 16836 consensus_peers.cc:597] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.569818  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.570510  7002 raft_consensus.cc:2243] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.570984  7002 raft_consensus.cc:2272] T b7da6930c7d44f51ae33d75064b68676 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.573410  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.574285  7002 raft_consensus.cc:2243] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:40.575222  7002 raft_consensus.cc:2272] T 807d54a32dee49c78fe3b3bfa5763b2b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.578112  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.578827  7002 raft_consensus.cc:2243] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.579365  7002 raft_consensus.cc:2272] T 8089fb9d122745beabb535e51bd29d52 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.582607  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.583405  7002 raft_consensus.cc:2243] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.583921  7002 raft_consensus.cc:2272] T 459fd01e9d83462da735e004032e70b7 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:40.586369 16836 consensus_peers.cc:597] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.587059  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.587917  7002 raft_consensus.cc:2243] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.588491  7002 raft_consensus.cc:2272] T dbd40203055942f4b32e39396d7d412a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.590981  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.591753  7002 raft_consensus.cc:2243] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.592274  7002 raft_consensus.cc:2272] T 68bdb3e915d14f918607729afc6e38fa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:40.595005 16762 consensus_peers.cc:597] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.595638  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.596423  7002 raft_consensus.cc:2243] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:40.597321  7002 raft_consensus.cc:2272] T eb2b3210f0d344aa8c9f961a1b72c508 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.599413  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.600008  7002 raft_consensus.cc:2243] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:40.600782  7002 raft_consensus.cc:2272] T ccf4303a8d6a4ec69ef1235487cd52aa P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.603070  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.603652  7002 raft_consensus.cc:2243] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.604065  7002 raft_consensus.cc:2272] T fe2434de2d21436fbbf8b25ab1814b54 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.606604  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.607311  7002 raft_consensus.cc:2243] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.607754  7002 raft_consensus.cc:2272] T 8a2c766bb0e34effb7b3f41f13d558a0 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.610046  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.610719  7002 raft_consensus.cc:2243] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:40.611541  7002 raft_consensus.cc:2272] T e691d47f85a540f884defe4bf7a293b2 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.613801  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.614394  7002 raft_consensus.cc:2243] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.614818  7002 raft_consensus.cc:2272] T 5316894346f24b5984dd23714341777c P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.617314  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.617938  7002 raft_consensus.cc:2243] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:40.618734  7002 raft_consensus.cc:2272] T c133a9bb6d914a1794e8cbb3aa04ed49 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.623181  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.624049  7002 raft_consensus.cc:2243] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.624557  7002 raft_consensus.cc:2272] T 09c70b1ed00f49408fae9002719cc6e5 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.627146  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.627707  7002 raft_consensus.cc:2243] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.628224  7002 raft_consensus.cc:2272] T 59ba89448ab04e64b769557c2830641f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.630537  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.631202  7002 raft_consensus.cc:2243] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:40.632102  7002 raft_consensus.cc:2272] T 86988133e17b49bfa869fb6da268ba7b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:40.642987 16762 consensus_peers.cc:597] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.643703 16762 consensus_peers.cc:597] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.651736  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.653052  7002 raft_consensus.cc:2243] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.653793  7002 raft_consensus.cc:2272] T 89b267a6d4ca4f87829b245ef87bd6e3 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.658834  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.659785  7002 raft_consensus.cc:2243] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.660516  7002 raft_consensus.cc:2272] T 8760c2c176b64d10ae61d46fa3c8605b P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:40.660756 16762 consensus_peers.cc:597] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.665611  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.666774  7002 raft_consensus.cc:2243] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:40.668071  7002 raft_consensus.cc:2272] T 3ffcb1357332401a919db507af113059 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.671391  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.672282  7002 raft_consensus.cc:2243] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.672899  7002 raft_consensus.cc:2272] T 52265c494440483086dbf5b231415a85 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.676483  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.677402  7002 raft_consensus.cc:2243] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.677975  7002 raft_consensus.cc:2272] T 5e375bb738794feab91d445c1c81cd73 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.681044  7002 tablet_replica.cc:333] stopping tablet replica
W20260709 13:21:40.682157 16910 consensus_peers.cc:597] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.682368  7002 raft_consensus.cc:2243] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:40.683723  7002 raft_consensus.cc:2272] T 5a920662fe00409bab733fdb2143da6f P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.686681  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.687518  7002 raft_consensus.cc:2243] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.688360  7002 raft_consensus.cc:2272] T 5c889f0451934db588983524416a5269 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.691670  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.692402  7002 raft_consensus.cc:2243] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.692965  7002 raft_consensus.cc:2272] T 66f84738cbb7483b9e127384bf8f534a P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:40.695379 16836 consensus_peers.cc:597] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.696082  7002 tablet_replica.cc:333] stopping tablet replica
W20260709 13:21:40.696311 16836 consensus_peers.cc:597] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.696847  7002 raft_consensus.cc:2243] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:21:40.697742 16836 consensus_peers.cc:597] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.698036  7002 raft_consensus.cc:2272] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:40.701864  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:40.702579  7002 raft_consensus.cc:2243] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:40.703096  7002 raft_consensus.cc:2272] T 5c540f98dc1640918b733b6bef45d026 P 9fa67aaf86874b1ca9b7f88c944c80d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:40.709820 16762 consensus_peers.cc:597] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.765190 16762 consensus_peers.cc:597] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.874230 16762 consensus_peers.cc:597] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.910235 16762 consensus_peers.cc:597] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.988534 16762 consensus_peers.cc:597] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.992118 16762 consensus_peers.cc:597] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.042119 16762 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 50078.4us
W20260709 13:21:41.348610 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.129:34869, user_credentials={real_user=slave}} blocked reactor thread for 625272us
W20260709 13:21:41.510931 16760 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:46515, user_credentials={real_user=slave}} blocked reactor thread for 50322us
I20260709 13:21:41.527460 17891 raft_consensus.cc:493] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.528198 17891 raft_consensus.cc:515] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:41.531451 17891 leader_election.cc:290] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
W20260709 13:21:41.532480 16836 consensus_peers.cc:597] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.533788 16836 consensus_peers.cc:597] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:41.560737 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
W20260709 13:21:41.575281 16910 consensus_peers.cc:597] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.581493 16836 consensus_peers.cc:597] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.584897 16910 consensus_peers.cc:597] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.588644 16910 consensus_peers.cc:597] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.591884 16836 consensus_peers.cc:597] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.594456 16910 consensus_peers.cc:597] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.598986 17490 connection.cc:466] server connection from 127.0.0.1:37834 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37834 (request call id 383) could send its response
W20260709 13:21:41.600320 17490 connection.cc:466] server connection from 127.0.0.1:37834 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37834 (request call id 384) could send its response
W20260709 13:21:41.606961 16836 connection.cc:769] client connection to 127.6.214.129:34869 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:21:41.607805 16836 leader_election.cc:336] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:21:41.608402 16836 leader_election.cc:304] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:41.609545 17898 raft_consensus.cc:2749] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:41.613960  7002 tablet_server.cc:196] TabletServer@127.6.214.129:34869 shutdown complete.
I20260709 13:21:41.641261 17582 raft_consensus.cc:493] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.641990 17582 raft_consensus.cc:515] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:41.645411 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00095bdfc40040d0a8eefc49c2034fb2" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:41.646598 17582 leader_election.cc:290] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:41.664225 17899 raft_consensus.cc:493] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.664939 17899 raft_consensus.cc:515] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:41.667686 17899 leader_election.cc:290] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:41.672477 17898 raft_consensus.cc:493] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.673283 17898 raft_consensus.cc:515] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:41.677876 16791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00095bdfc40040d0a8eefc49c2034fb2" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:41.678862 16791 raft_consensus.cc:2468] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 2.
I20260709 13:21:41.681150 16835 leader_election.cc:304] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:41.682319 17891 raft_consensus.cc:2804] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:41.682816 17891 raft_consensus.cc:493] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.683352 17891 raft_consensus.cc:3060] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:41.689919 17898 leader_election.cc:290] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:41.695824 17891 raft_consensus.cc:515] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
W20260709 13:21:41.698350 16762 leader_election.cc:336] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.698982 16762 leader_election.cc:304] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:41.699630 16791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00095bdfc40040d0a8eefc49c2034fb2" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:41.700269 16791 raft_consensus.cc:3060] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:41.701351 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb2b3210f0d344aa8c9f961a1b72c508" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
W20260709 13:21:41.707588 16762 leader_election.cc:336] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.708137 16762 leader_election.cc:304] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:41.709120 17899 raft_consensus.cc:2749] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:21:41.710955 16836 leader_election.cc:336] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.713140 17899 raft_consensus.cc:493] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.713856 17899 raft_consensus.cc:515] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
W20260709 13:21:41.714686 16836 leader_election.cc:336] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.715605 17891 leader_election.cc:290] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:41.716527 17899 leader_election.cc:290] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:41.717015 17902 raft_consensus.cc:493] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.717128 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:41.718166 17902 raft_consensus.cc:515] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:41.722118 16790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535" is_pre_election: true
I20260709 13:21:41.722874 16937 raft_consensus.cc:2468] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 3.
I20260709 13:21:41.724915 16791 raft_consensus.cc:2468] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 3.
I20260709 13:21:41.726859 17582 raft_consensus.cc:2749] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:41.722899 16790 raft_consensus.cc:2468] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 3.
I20260709 13:21:41.728649 16909 leader_election.cc:304] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 
I20260709 13:21:41.729607 17903 raft_consensus.cc:2804] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:41.730108 17903 raft_consensus.cc:493] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.730623 17903 raft_consensus.cc:3060] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:21:41.726074 16762 leader_election.cc:336] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.726285 17902 leader_election.cc:290] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:41.737533 16762 leader_election.cc:304] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 5642511b38924ffcbe38110cf27d3535; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:41.740608 17582 raft_consensus.cc:2804] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:41.741201 17582 raft_consensus.cc:493] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.742805 17582 raft_consensus.cc:3060] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:41.749558 17902 raft_consensus.cc:493] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.750187 17902 raft_consensus.cc:515] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:41.753269 17903 raft_consensus.cc:515] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:41.757809 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:41.758383 17902 leader_election.cc:290] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:41.759083 16835 leader_election.cc:304] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:41.767824 17903 leader_election.cc:290] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:41.769094 17891 raft_consensus.cc:2804] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:41.770606 17891 raft_consensus.cc:697] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 3 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:41.771505 17891 consensus_queue.cc:237] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:41.769775 16791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5642511b38924ffcbe38110cf27d3535"
I20260709 13:21:41.772114 17582 raft_consensus.cc:515] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:41.777730 16791 raft_consensus.cc:2393] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 266d75f35db4465788ab06782fae972d in current term 4: Already voted for candidate 5642511b38924ffcbe38110cf27d3535 in this term.
I20260709 13:21:41.780246 17898 raft_consensus.cc:493] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.780850 17898 raft_consensus.cc:515] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:41.782552 17582 leader_election.cc:290] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:41.783183 17898 leader_election.cc:290] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:41.786820 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:41.787622 16937 raft_consensus.cc:2468] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 4.
W20260709 13:21:41.796000 16762 leader_election.cc:336] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.797209 17582 raft_consensus.cc:493] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.797853 17582 raft_consensus.cc:515] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:41.801813 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807d54a32dee49c78fe3b3bfa5763b2b" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:41.802681 16937 raft_consensus.cc:2393] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5642511b38924ffcbe38110cf27d3535 in current term 4: Already voted for candidate 266d75f35db4465788ab06782fae972d in this term.
I20260709 13:21:41.803293 17899 raft_consensus.cc:493] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.790474 16836 leader_election.cc:304] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:41.803905 17899 raft_consensus.cc:515] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:41.805979 17899 leader_election.cc:290] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:41.806144 17898 raft_consensus.cc:2804] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:21:41.806532 17898 raft_consensus.cc:493] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.806900 17898 raft_consensus.cc:3060] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:41.807829 16617 catalog_manager.cc:5697] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 2 to 3, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 3 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:41.810425 16836 leader_election.cc:336] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.812487 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e691d47f85a540f884defe4bf7a293b2" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:41.813865 17903 raft_consensus.cc:493] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.814769  7002 tablet_server.cc:179] TabletServer@127.6.214.130:0 shutting down...
I20260709 13:21:41.816164 16762 leader_election.cc:304] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:41.817117 17899 raft_consensus.cc:2749] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:21:41.819796 17903 raft_consensus.cc:515] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:41.820317 16762 leader_election.cc:336] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.823206 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffcb1357332401a919db507af113059" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:41.826143 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0239d47f915d4f529cdc01b32055c954" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:41.827378 17903 leader_election.cc:290] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
W20260709 13:21:41.828150 16762 leader_election.cc:336] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.825055 17891 raft_consensus.cc:493] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.829679 16762 leader_election.cc:304] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
W20260709 13:21:41.829504 16910 leader_election.cc:336] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.830837 17891 raft_consensus.cc:515] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
W20260709 13:21:41.831590 16835 consensus_peers.cc:597] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.832229 16910 leader_election.cc:336] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.834231 17831 raft_consensus.cc:493] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.834339 16910 leader_election.cc:304] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:41.834949 17831 raft_consensus.cc:515] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
W20260709 13:21:41.836217 16910 leader_election.cc:336] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.833532 17891 leader_election.cc:290] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:41.832347 16864 raft_consensus.cc:2468] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
I20260709 13:21:41.835315 17903 raft_consensus.cc:2749] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:21:41.832847 17899 raft_consensus.cc:2749] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:41.841718 16910 leader_election.cc:304] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
W20260709 13:21:41.845124 16762 leader_election.cc:336] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.845743 16760 leader_election.cc:304] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
W20260709 13:21:41.845743 16835 leader_election.cc:336] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:41.846639 17903 raft_consensus.cc:493] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.845736 17582 leader_election.cc:290] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:41.849958 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf4303a8d6a4ec69ef1235487cd52aa" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:41.848373 17899 raft_consensus.cc:2804] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:41.849056 17903 raft_consensus.cc:515] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:41.849484 17902 raft_consensus.cc:2749] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:21:41.847234 17831 leader_election.cc:290] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:41.853557 16760 leader_election.cc:304] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:41.854822 17831 raft_consensus.cc:2749] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:41.852362 17899 raft_consensus.cc:493] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.857548 17899 raft_consensus.cc:3060] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:21:41.858091 16836 leader_election.cc:336] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.858577 16836 leader_election.cc:304] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:41.861498 17891 raft_consensus.cc:2749] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:41.862233 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:41.863554 17831 raft_consensus.cc:493] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.864188 17903 leader_election.cc:290] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:41.864179 17831 raft_consensus.cc:515] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:41.867070 17831 leader_election.cc:290] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:41.867816 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc87d7904d6f4c4489210546472fc39f" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:41.874019 17898 raft_consensus.cc:515] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:41.875556 17831 raft_consensus.cc:493] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.876102 17831 raft_consensus.cc:515] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
W20260709 13:21:41.862283 16910 leader_election.cc:336] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.879733 16910 leader_election.cc:304] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:41.886224 17831 leader_election.cc:290] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:41.890882 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:41.891666 16864 raft_consensus.cc:2468] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 3.
W20260709 13:21:41.892596 16909 consensus_peers.cc:597] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.894321 16762 leader_election.cc:336] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.894802 16762 leader_election.cc:304] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
W20260709 13:21:41.895673 16909 consensus_peers.cc:597] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:41.896394 17892 raft_consensus.cc:2749] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:41.896870 16760 leader_election.cc:304] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:41.897874 17582 raft_consensus.cc:2804] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:21:41.898372 17582 raft_consensus.cc:493] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.900044 17582 raft_consensus.cc:3060] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:21:41.903439 16835 consensus_peers.cc:597] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.905230 16910 leader_election.cc:336] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.905846 16910 leader_election.cc:304] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:41.908793 17902 raft_consensus.cc:2749] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:41.910748 16762 leader_election.cc:336] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.885617 17903 raft_consensus.cc:2749] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:41.927732 17903 raft_consensus.cc:493] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.928565 17903 raft_consensus.cc:515] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:41.931484 17891 raft_consensus.cc:493] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.932098 17891 raft_consensus.cc:515] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:41.938669 17582 raft_consensus.cc:515] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:41.939281 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86988133e17b49bfa869fb6da268ba7b" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:41.939873 16939 raft_consensus.cc:3060] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:41.941767 17582 leader_election.cc:290] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:41.946017 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c133a9bb6d914a1794e8cbb3aa04ed49" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:41.946671 16864 raft_consensus.cc:3060] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:41.948864 17895 raft_consensus.cc:493] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:41.949472 17895 raft_consensus.cc:515] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:41.950762 17899 raft_consensus.cc:515] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:41.951845 17895 leader_election.cc:290] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:41.955338 16863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:41.955999 16870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0239d47f915d4f529cdc01b32055c954" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:41.956562 16870 raft_consensus.cc:3060] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:41.956554 17898 leader_election.cc:290] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 5 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
W20260709 13:21:41.960404 16835 consensus_peers.cc:597] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:41.962414 17891 leader_election.cc:290] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
W20260709 13:21:41.966091 16836 leader_election.cc:336] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.945696 17903 leader_election.cc:290] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
W20260709 13:21:41.968495 16910 leader_election.cc:336] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
W20260709 13:21:41.969870 16762 leader_election.cc:336] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.972276 16870 raft_consensus.cc:2468] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 3.
I20260709 13:21:41.973414 17899 leader_election.cc:290] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
W20260709 13:21:41.974196 16762 leader_election.cc:336] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
W20260709 13:21:41.980435 16909 consensus_peers.cc:597] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:41.975876 16864 raft_consensus.cc:2468] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 4.
W20260709 13:21:41.976817 16836 leader_election.cc:336] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:41.983140 16939 raft_consensus.cc:2468] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 5.
W20260709 13:21:41.984395 16909 consensus_peers.cc:597] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.987510 16909 consensus_peers.cc:597] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:41.988421 16909 leader_election.cc:336] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:41.988631 16760 leader_election.cc:304] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:41.988839 16909 leader_election.cc:304] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:41.989893 17831 raft_consensus.cc:2804] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:41.990509 16760 leader_election.cc:304] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:41.994211 17582 raft_consensus.cc:2804] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:41.994767 17582 raft_consensus.cc:697] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 4 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:41.996115 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:41.996871 16939 raft_consensus.cc:2468] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 2.
I20260709 13:21:41.996562 16836 leader_election.cc:304] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:41.998724 17582 consensus_queue.cc:237] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:41.997076 17912 raft_consensus.cc:493] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:42.002313 16836 leader_election.cc:304] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:42.002743 17869 raft_consensus.cc:2749] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:42.003182 17894 raft_consensus.cc:493] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:42.008296 17894 raft_consensus.cc:515] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:41.998618 17831 raft_consensus.cc:697] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 3 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
I20260709 13:21:42.009704 17912 raft_consensus.cc:515] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:42.018290 17831 consensus_queue.cc:237] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:42.003225 17898 raft_consensus.cc:2804] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:21:42.025130 17894 leader_election.cc:290] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
I20260709 13:21:42.025849 17829 raft_consensus.cc:2804] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:42.026439 17829 raft_consensus.cc:493] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:42.026882 17829 raft_consensus.cc:3060] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:42.028801 17912 leader_election.cc:290] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
I20260709 13:21:42.035681 17890 raft_consensus.cc:493] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:42.036340 17890 raft_consensus.cc:515] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:42.038897 17890 leader_election.cc:290] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
W20260709 13:21:42.040907 16762 leader_election.cc:336] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
W20260709 13:21:42.034200 16909 consensus_peers.cc:597] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:42.044636 16909 consensus_peers.cc:597] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.044287 17912 raft_consensus.cc:493] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:42.050276 17912 raft_consensus.cc:515] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:42.052624 17912 leader_election.cc:290] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
W20260709 13:21:42.052739 16909 consensus_peers.cc:597] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:42.082962 16836 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.132:32963, user_credentials={real_user=slave}} blocked reactor thread for 80727.3us
I20260709 13:21:42.083622 17898 raft_consensus.cc:697] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 5 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:42.085167 17898 consensus_queue.cc:237] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:42.087204 17890 raft_consensus.cc:493] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:42.087772 17890 raft_consensus.cc:515] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:42.088976 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
I20260709 13:21:42.089623 16864 raft_consensus.cc:2468] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 2.
I20260709 13:21:42.089887 17890 leader_election.cc:290] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:42.093474 16616 catalog_manager.cc:5697] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 3 to 4, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 4 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:42.095220 16616 catalog_manager.cc:5697] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 reported cstate change: term changed from 2 to 3, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 5642511b38924ffcbe38110cf27d3535 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "5642511b38924ffcbe38110cf27d3535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:42.084240 16910 leader_election.cc:336] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:42.097970 16910 leader_election.cc:304] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 71a0b5583e0547a88c88b590549fbcee, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:42.098326 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b55efde48bb42119e9a38f9e3f2f6c6" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:42.099400 17900 raft_consensus.cc:2749] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:21:42.100155 16760 leader_election.cc:304] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
W20260709 13:21:42.102406 16836 leader_election.cc:336] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
W20260709 13:21:42.103298 16836 leader_election.cc:336] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
W20260709 13:21:42.104128 16836 leader_election.cc:336] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:42.104894 17901 raft_consensus.cc:493] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:42.105400 17901 raft_consensus.cc:515] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } }
I20260709 13:21:42.107535 16836 leader_election.cc:304] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 266d75f35db4465788ab06782fae972d, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:42.108755 17912 raft_consensus.cc:2749] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:42.104115 17831 raft_consensus.cc:2804] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:42.066988 17829 raft_consensus.cc:515] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:42.113765 17831 raft_consensus.cc:493] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:42.115631 17829 leader_election.cc:290] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:42.115963 17831 raft_consensus.cc:3060] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:21:42.116649 16836 leader_election.cc:336] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:42.119792 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:42.120571 16937 raft_consensus.cc:2468] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 4.
W20260709 13:21:42.125826 16835 consensus_peers.cc:597] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.126654 17901 leader_election.cc:290] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809)
W20260709 13:21:42.129835 16910 leader_election.cc:336] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:42.135377 17902 raft_consensus.cc:493] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:42.135923 17831 raft_consensus.cc:515] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
W20260709 13:21:42.137324 16835 leader_election.cc:336] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:42.136008 17902 raft_consensus.cc:515] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:42.138000 16835 leader_election.cc:304] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:42.140236 17902 leader_election.cc:290] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
W20260709 13:21:42.146056 16835 leader_election.cc:336] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:42.145576 16836 leader_election.cc:304] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:42.146687 16835 leader_election.cc:304] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a0b5583e0547a88c88b590549fbcee; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:42.148366 17915 raft_consensus.cc:2749] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:42.149349  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:42.149189 17917 raft_consensus.cc:2804] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:21:42.150250 16835 consensus_peers.cc:597] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:42.152292 16910 leader_election.cc:336] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:42.157120 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b55efde48bb42119e9a38f9e3f2f6c6" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee" is_pre_election: true
W20260709 13:21:42.157619 16836 leader_election.cc:336] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:42.158130 16864 raft_consensus.cc:2468] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 2.
I20260709 13:21:42.154317  7002 tablet_replica.cc:333] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.160439 16937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a920662fe00409bab733fdb2143da6f" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:42.163292 17919 raft_consensus.cc:493] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:42.164291 16937 raft_consensus.cc:3060] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:42.164649 17919 raft_consensus.cc:515] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:42.160195 17831 leader_election.cc:290] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 election: Requested vote from peers 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869), 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515)
W20260709 13:21:42.155553 16909 consensus_peers.cc:597] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.161542  7002 raft_consensus.cc:2243] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.161839 16908 leader_election.cc:304] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:42.161901 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eed8496b9e0a4440b2069b956dfc7358" candidate_uuid: "5642511b38924ffcbe38110cf27d3535" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:42.152623 17917 raft_consensus.cc:493] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
W20260709 13:21:42.166123 16762 leader_election.cc:336] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:42.167851 16864 raft_consensus.cc:3060] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:21:42.167505 16835 consensus_peers.cc:597] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.169745  7002 raft_consensus.cc:2272] T 4ec264452e294befb3fab6c21b1307ba P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.169463 17901 raft_consensus.cc:2804] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:42.173300 17901 raft_consensus.cc:493] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:42.173729 17901 raft_consensus.cc:3060] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:42.180075 16616 catalog_manager.cc:5697] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 4 to 5, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 5 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:42.181365 16909 consensus_peers.cc:597] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:42.182051 16909 leader_election.cc:336] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:42.182425 16909 leader_election.cc:304] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 266d75f35db4465788ab06782fae972d; no voters: 5642511b38924ffcbe38110cf27d3535, 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:42.183895 17900 raft_consensus.cc:2749] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:42.184878 17901 raft_consensus.cc:515] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:42.185935  7002 tablet_replica.cc:333] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
W20260709 13:21:42.186494 16909 consensus_peers.cc:597] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.187036  7002 raft_consensus.cc:2243] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.187682  7002 raft_consensus.cc:2272] T 8760c2c176b64d10ae61d46fa3c8605b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.187865 17913 raft_consensus.cc:2749] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:42.191581 17919 leader_election.cc:290] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:42.170115 17917 raft_consensus.cc:3060] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:42.194900 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffcb1357332401a919db507af113059" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d" is_pre_election: true
I20260709 13:21:42.195613 16939 raft_consensus.cc:2468] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 3.
W20260709 13:21:42.198426 16836 consensus_peers.cc:597] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.198686 16864 raft_consensus.cc:2468] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5642511b38924ffcbe38110cf27d3535 in term 3.
I20260709 13:21:42.203770 16836 leader_election.cc:304] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:42.204501 17901 leader_election.cc:290] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 election: Requested vote from peers 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:42.205216 17919 raft_consensus.cc:2804] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:21:42.205590 16910 leader_election.cc:336] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:42.205653 17919 raft_consensus.cc:493] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fa67aaf86874b1ca9b7f88c944c80d9)
I20260709 13:21:42.206513 16760 leader_election.cc:304] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5642511b38924ffcbe38110cf27d3535, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:42.206497 17919 raft_consensus.cc:3060] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:42.208231 17582 raft_consensus.cc:2804] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:21:42.208508 16836 leader_election.cc:336] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:42.208799 17582 raft_consensus.cc:697] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 3 LEADER]: Becoming Leader. State: Replica: 5642511b38924ffcbe38110cf27d3535, State: Running, Role: LEADER
W20260709 13:21:42.209379 16835 consensus_peers.cc:597] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.209820 17582 consensus_queue.cc:237] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } } peers { permanent_uuid: "5642511b38924ffcbe38110cf27d3535" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 34809 } } peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } }
I20260709 13:21:42.210170 16864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b55efde48bb42119e9a38f9e3f2f6c6" candidate_uuid: "266d75f35db4465788ab06782fae972d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71a0b5583e0547a88c88b590549fbcee"
I20260709 13:21:42.213016 17917 raft_consensus.cc:515] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:42.215339 17919 raft_consensus.cc:515] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:42.228241 17919 leader_election.cc:290] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 4 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
W20260709 13:21:42.220261 16835 consensus_peers.cc:597] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.233471 16939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbed23d268484353b8fb9eb9d57444f8" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:42.222221  7002 tablet_replica.cc:333] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.234133 16939 raft_consensus.cc:3060] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:21:42.222543 16864 raft_consensus.cc:3060] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:21:42.237675 16836 leader_election.cc:336] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:42.238754 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffcb1357332401a919db507af113059" candidate_uuid: "71a0b5583e0547a88c88b590549fbcee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "266d75f35db4465788ab06782fae972d"
I20260709 13:21:42.239388 16943 raft_consensus.cc:3060] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:42.234740  7002 raft_consensus.cc:2243] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.207437 16937 raft_consensus.cc:2468] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 3.
I20260709 13:21:42.246695 16943 raft_consensus.cc:2468] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 4.
I20260709 13:21:42.247359 16939 raft_consensus.cc:2468] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a0b5583e0547a88c88b590549fbcee in term 5.
I20260709 13:21:42.248586  7002 pending_rounds.cc:70] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535: Trying to abort 1 pending ops.
I20260709 13:21:42.248908  7002 pending_rounds.cc:77] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305639125156691968 op_type: NO_OP noop_request { }
I20260709 13:21:42.249286  7002 raft_consensus.cc:2889] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:42.249667  7002 raft_consensus.cc:2272] T c133a9bb6d914a1794e8cbb3aa04ed49 P 5642511b38924ffcbe38110cf27d3535 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:42.250427 16835 consensus_peers.cc:597] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.250690 16836 leader_election.cc:304] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:42.251977 16836 leader_election.cc:304] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:42.253170 16836 leader_election.cc:304] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 
I20260709 13:21:42.253686 17915 raft_consensus.cc:2804] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:42.253959 17898 raft_consensus.cc:2804] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:42.254515 17915 raft_consensus.cc:697] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 3 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:42.254823 17898 raft_consensus.cc:697] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 4 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:42.255611 17915 consensus_queue.cc:237] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:42.256620 17829 raft_consensus.cc:2804] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:21:42.257138 17829 raft_consensus.cc:697] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 5 LEADER]: Becoming Leader. State: Replica: 71a0b5583e0547a88c88b590549fbcee, State: Running, Role: LEADER
I20260709 13:21:42.258086 17829 consensus_queue.cc:237] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
W20260709 13:21:42.259303 16836 leader_election.cc:336] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111)
I20260709 13:21:42.255690 17898 consensus_queue.cc:237] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:42.266979 16864 raft_consensus.cc:2468] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 266d75f35db4465788ab06782fae972d in term 3.
I20260709 13:21:42.251077 17917 leader_election.cc:290] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [CANDIDATE]: Term 5 election: Requested vote from peers 266d75f35db4465788ab06782fae972d (127.6.214.132:32963), 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869)
I20260709 13:21:42.268416 16908 leader_election.cc:304] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 266d75f35db4465788ab06782fae972d, 71a0b5583e0547a88c88b590549fbcee; no voters: 9fa67aaf86874b1ca9b7f88c944c80d9
I20260709 13:21:42.269578 17901 raft_consensus.cc:2804] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:42.270102 17901 raft_consensus.cc:697] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 3 LEADER]: Becoming Leader. State: Replica: 266d75f35db4465788ab06782fae972d, State: Running, Role: LEADER
I20260709 13:21:42.271077 17901 consensus_queue.cc:237] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } }
I20260709 13:21:42.273166  7002 tablet_replica.cc:333] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.274433  7002 raft_consensus.cc:2243] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.275861  7002 raft_consensus.cc:2272] T a7baeabe6aad46e283f06762a1594a71 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.282893  7002 tablet_replica.cc:333] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.283792  7002 raft_consensus.cc:2243] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.284420  7002 raft_consensus.cc:2272] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.285996 16616 catalog_manager.cc:5697] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d reported cstate change: term changed from 2 to 3, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 266d75f35db4465788ab06782fae972d (127.6.214.132). New cstate: current_term: 3 leader_uuid: "266d75f35db4465788ab06782fae972d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:42.287477  7002 tablet_replica.cc:333] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.288472  7002 raft_consensus.cc:2243] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.289013  7002 raft_consensus.cc:2272] T 1a2aa3a038f049ccadf4405e476cd972 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.291013 16617 catalog_manager.cc:5697] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 2 to 3, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 3 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:42.291996  7002 tablet_replica.cc:333] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.292972  7002 raft_consensus.cc:2243] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.292500 16617 catalog_manager.cc:5697] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 3 to 4, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 4 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:42.294128 16617 catalog_manager.cc:5697] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee reported cstate change: term changed from 4 to 5, leader changed from 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129) to 71a0b5583e0547a88c88b590549fbcee (127.6.214.131). New cstate: current_term: 5 leader_uuid: "71a0b5583e0547a88c88b590549fbcee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71a0b5583e0547a88c88b590549fbcee" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fa67aaf86874b1ca9b7f88c944c80d9" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 34869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:42.295750  7002 raft_consensus.cc:2272] T dbd40203055942f4b32e39396d7d412a P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.298895  7002 tablet_replica.cc:333] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.299520  7002 raft_consensus.cc:2243] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.300243  7002 raft_consensus.cc:2272] T 459fd01e9d83462da735e004032e70b7 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.303160  7002 tablet_replica.cc:333] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.303762  7002 raft_consensus.cc:2243] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.304648  7002 raft_consensus.cc:2272] T 68bdb3e915d14f918607729afc6e38fa P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.307070  7002 tablet_replica.cc:333] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.307723  7002 raft_consensus.cc:2243] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.308561  7002 raft_consensus.cc:2272] T 9bb16a744c5d40a1b64f60422c21e3c5 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.311254  7002 tablet_replica.cc:333] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.312041  7002 raft_consensus.cc:2243] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.312463  7002 raft_consensus.cc:2272] T a4b336bf87ee483f9aef83d5b3358fae P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.314455  7002 tablet_replica.cc:333] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.314989  7002 raft_consensus.cc:2243] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.315379  7002 raft_consensus.cc:2272] T 71c414f9d9e048e89cedbb0dbe6027a2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.317216  7002 tablet_replica.cc:333] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.317849  7002 raft_consensus.cc:2243] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.318240  7002 raft_consensus.cc:2272] T d72c23005f53496890cfb11e0c19318b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.320206  7002 tablet_replica.cc:333] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.320741  7002 raft_consensus.cc:2243] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.321134  7002 raft_consensus.cc:2272] T a37644a5aa384ad88bdebe0b15db71ea P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.323486  7002 tablet_replica.cc:333] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.324069  7002 raft_consensus.cc:2243] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.324932  7002 raft_consensus.cc:2272] T 2ad644a4c46b4ba9b4845f75d943c516 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.327612  7002 tablet_replica.cc:333] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.328369  7002 raft_consensus.cc:2243] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.328893  7002 raft_consensus.cc:2272] T 00095bdfc40040d0a8eefc49c2034fb2 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.331514  7002 tablet_replica.cc:333] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.332430  7002 raft_consensus.cc:2243] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.333403  7002 raft_consensus.cc:2272] T ec2fb00d467444edb3d2d8374ad64b7c P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.336170  7002 tablet_replica.cc:333] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.336907  7002 raft_consensus.cc:2243] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.337868  7002 raft_consensus.cc:2272] T e27c0b3cbad94ad791a54143f2d5af0b P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.340540  7002 tablet_replica.cc:333] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.341128  7002 raft_consensus.cc:2243] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.341981  7002 raft_consensus.cc:2272] T 4709a71f10ba41f39d6a6db62045e637 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.344432  7002 tablet_replica.cc:333] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.344921  7002 raft_consensus.cc:2243] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.345278  7002 raft_consensus.cc:2272] T 41ec078c4d4145dbbcae1cd9fd0c251a P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.347143  7002 tablet_replica.cc:333] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.347704  7002 raft_consensus.cc:2243] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.348114  7002 raft_consensus.cc:2272] T dc87d7904d6f4c4489210546472fc39f P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.349951  7002 tablet_replica.cc:333] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.350488  7002 raft_consensus.cc:2243] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.350908  7002 raft_consensus.cc:2272] T 46a75d301e384d359f3540e990d68e8d P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.352777  7002 tablet_replica.cc:333] T 9b15c4a7a5cd4cf090073986cb42b826 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.353340  7002 raft_consensus.cc:2243] T 9b15c4a7a5cd4cf090073986cb42b826 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.353796  7002 raft_consensus.cc:2272] T 9b15c4a7a5cd4cf090073986cb42b826 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.355839  7002 tablet_replica.cc:333] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.356356  7002 raft_consensus.cc:2243] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.357160  7002 raft_consensus.cc:2272] T 5c889f0451934db588983524416a5269 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.359310  7002 tablet_replica.cc:333] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.359915  7002 raft_consensus.cc:2243] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.360737  7002 raft_consensus.cc:2272] T 66f84738cbb7483b9e127384bf8f534a P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.363425  7002 tablet_replica.cc:333] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.364231  7002 raft_consensus.cc:2243] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.365361  7002 raft_consensus.cc:2272] T b0a5428f572c4214b4ecd02231d81bd7 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:42.365330 16835 consensus_peers.cc:597] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee -> Peer 5642511b38924ffcbe38110cf27d3535 (127.6.214.130:34809): Couldn't send request to peer 5642511b38924ffcbe38110cf27d3535. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.368386  7002 tablet_replica.cc:333] T e70bbc621ace4406b50194cd2117bdc6 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.369174  7002 raft_consensus.cc:2243] T e70bbc621ace4406b50194cd2117bdc6 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.369694  7002 raft_consensus.cc:2272] T e70bbc621ace4406b50194cd2117bdc6 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.372315  7002 tablet_replica.cc:333] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.373091  7002 raft_consensus.cc:2243] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.373840  7002 pending_rounds.cc:70] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535: Trying to abort 1 pending ops.
I20260709 13:21:42.374045  7002 pending_rounds.cc:77] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305639125860724736 op_type: NO_OP noop_request { }
I20260709 13:21:42.374372  7002 raft_consensus.cc:2889] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:42.374692  7002 raft_consensus.cc:2272] T eed8496b9e0a4440b2069b956dfc7358 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.377259  7002 tablet_replica.cc:333] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.377879  7002 raft_consensus.cc:2243] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.378489  7002 pending_rounds.cc:70] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535: Trying to abort 1 pending ops.
I20260709 13:21:42.378715  7002 pending_rounds.cc:77] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305639125077729280 op_type: NO_OP noop_request { }
I20260709 13:21:42.378988  7002 raft_consensus.cc:2889] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:42.379261  7002 raft_consensus.cc:2272] T 0239d47f915d4f529cdc01b32055c954 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.381242  7002 tablet_replica.cc:333] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.381922  7002 raft_consensus.cc:2243] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.382678  7002 raft_consensus.cc:2272] T 079f892041a84ff8a4b23e4cfffa762d P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.384514  7002 tablet_replica.cc:333] T ef2738933d0443258a83e98416c422a7 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.385071  7002 raft_consensus.cc:2243] T ef2738933d0443258a83e98416c422a7 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.385524  7002 raft_consensus.cc:2272] T ef2738933d0443258a83e98416c422a7 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.387508  7002 tablet_replica.cc:333] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.388057  7002 raft_consensus.cc:2243] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.388481  7002 raft_consensus.cc:2272] T 1702099270174fe58528799e1564c74b P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.390437  7002 tablet_replica.cc:333] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.390977  7002 raft_consensus.cc:2243] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.391363  7002 raft_consensus.cc:2272] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.393153  7002 tablet_replica.cc:333] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.393750  7002 raft_consensus.cc:2243] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.394171  7002 raft_consensus.cc:2272] T a465607298c84b8dbd8007c816bc5c9c P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.396121  7002 tablet_replica.cc:333] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.396646  7002 raft_consensus.cc:2243] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.397410  7002 raft_consensus.cc:2272] T 59ba89448ab04e64b769557c2830641f P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.399230  7002 tablet_replica.cc:333] T 09c70b1ed00f49408fae9002719cc6e5 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.399757  7002 raft_consensus.cc:2243] T 09c70b1ed00f49408fae9002719cc6e5 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.400182  7002 raft_consensus.cc:2272] T 09c70b1ed00f49408fae9002719cc6e5 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.402102  7002 tablet_replica.cc:333] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.402630  7002 raft_consensus.cc:2243] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.403050  7002 raft_consensus.cc:2272] T fe2434de2d21436fbbf8b25ab1814b54 P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.405004  7002 tablet_replica.cc:333] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.405637  7002 raft_consensus.cc:2243] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.406050  7002 raft_consensus.cc:2272] T ccf4303a8d6a4ec69ef1235487cd52aa P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.408005  7002 tablet_replica.cc:333] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.408545  7002 raft_consensus.cc:2243] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.408977  7002 raft_consensus.cc:2272] T 8ca3d970b5014cf8802116fd61f095e7 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.410820  7002 tablet_replica.cc:333] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.411329  7002 raft_consensus.cc:2243] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.411775  7002 raft_consensus.cc:2272] T eb2b3210f0d344aa8c9f961a1b72c508 P 5642511b38924ffcbe38110cf27d3535 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.413547  7002 tablet_replica.cc:333] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.414057  7002 raft_consensus.cc:2243] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.414496  7002 raft_consensus.cc:2272] T 807d54a32dee49c78fe3b3bfa5763b2b P 5642511b38924ffcbe38110cf27d3535 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.416385  7002 tablet_replica.cc:333] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.416890  7002 raft_consensus.cc:2243] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.417796  7002 raft_consensus.cc:2272] T b7da6930c7d44f51ae33d75064b68676 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.419777  7002 tablet_replica.cc:333] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.420270  7002 raft_consensus.cc:2243] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.421029  7002 raft_consensus.cc:2272] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 5642511b38924ffcbe38110cf27d3535 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:42.423053 16650 debug-util.cc:398] Leaking SignalData structure 0x7b0800098be0 after lost signal to thread 7005
I20260709 13:21:42.423310  7002 tablet_replica.cc:333] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535: stopping tablet replica
I20260709 13:21:42.424190  7002 raft_consensus.cc:2243] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:42.424278 16650 debug-util.cc:398] Leaking SignalData structure 0x7b080028b0e0 after lost signal to thread 16653
I20260709 13:21:42.424731  7002 raft_consensus.cc:2272] T e691d47f85a540f884defe4bf7a293b2 P 5642511b38924ffcbe38110cf27d3535 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:42.425686 16650 debug-util.cc:398] Leaking SignalData structure 0x7b080020a940 after lost signal to thread 16820
W20260709 13:21:42.426858 16650 debug-util.cc:398] Leaking SignalData structure 0x7b080022ac20 after lost signal to thread 16894
W20260709 13:21:42.428041 16650 debug-util.cc:398] Leaking SignalData structure 0x7b08001001c0 after lost signal to thread 16968
W20260709 13:21:42.528359 16836 consensus_peers.cc:597] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.550207  7002 tablet_server.cc:196] TabletServer@127.6.214.130:0 shutdown complete.
I20260709 13:21:42.634509 16939 raft_consensus.cc:1275] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 5 FOLLOWER]: Refusing update from remote peer 71a0b5583e0547a88c88b590549fbcee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:21:42.637943 17917 consensus_queue.cc:1048] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:21:42.666564 16943 raft_consensus.cc:1275] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Refusing update from remote peer 71a0b5583e0547a88c88b590549fbcee: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:21:42.668562 17917 consensus_queue.cc:1048] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:21:42.711143  7002 tablet_server.cc:179] TabletServer@127.6.214.131:0 shutting down...
W20260709 13:21:42.721213 16836 consensus_peers.cc:597] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:42.730130 16836 consensus_peers.cc:597] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:42.744114 16910 consensus_peers.cc:597] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:42.772298 16908 consensus_peers.cc:597] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d -> Peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Couldn't send request to peer 71a0b5583e0547a88c88b590549fbcee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.784487 16943 raft_consensus.cc:1275] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Refusing update from remote peer 71a0b5583e0547a88c88b590549fbcee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:42.786741 17915 consensus_queue.cc:1048] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:42.792871  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:42.793927  7002 tablet_replica.cc:333] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.795117  7002 raft_consensus.cc:2243] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.795864  7002 raft_consensus.cc:2272] T 4ec264452e294befb3fab6c21b1307ba P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.800328  7002 tablet_replica.cc:333] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.801543  7002 raft_consensus.cc:2243] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.803854  7002 raft_consensus.cc:2272] T 13a3b0acceaf4cada63b5f215fab4a29 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.806905  7002 tablet_replica.cc:333] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.807821  7002 raft_consensus.cc:2243] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.809084  7002 raft_consensus.cc:2272] T a465607298c84b8dbd8007c816bc5c9c P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.812497  7002 tablet_replica.cc:333] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.813400  7002 raft_consensus.cc:2243] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.814476  7002 raft_consensus.cc:2272] T 5e375bb738794feab91d445c1c81cd73 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.817764  7002 tablet_replica.cc:333] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.824700  7002 raft_consensus.cc:2243] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.825791  7002 raft_consensus.cc:2272] T 52265c494440483086dbf5b231415a85 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.828727  7002 tablet_replica.cc:333] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.833791  7002 raft_consensus.cc:2243] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.834880  7002 raft_consensus.cc:2272] T 86988133e17b49bfa869fb6da268ba7b P 71a0b5583e0547a88c88b590549fbcee [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.838397  7002 tablet_replica.cc:333] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.839493  7002 raft_consensus.cc:2243] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.840548  7002 raft_consensus.cc:2272] T 71c414f9d9e048e89cedbb0dbe6027a2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.841085 16939 raft_consensus.cc:1275] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 5 FOLLOWER]: Refusing update from remote peer 71a0b5583e0547a88c88b590549fbcee: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:21:42.842617 17915 consensus_queue.cc:1048] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [LEADER]: Connected to new peer: Peer: permanent_uuid: "266d75f35db4465788ab06782fae972d" member_type: VOTER last_known_addr { host: "127.6.214.132" port: 32963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:21:42.843227  7002 tablet_replica.cc:333] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.844285  7002 raft_consensus.cc:2243] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.845288  7002 raft_consensus.cc:2272] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.848212  7002 tablet_replica.cc:333] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.848997  7002 raft_consensus.cc:2243] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.849490  7002 raft_consensus.cc:2272] T c133a9bb6d914a1794e8cbb3aa04ed49 P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.857097  7002 tablet_replica.cc:333] T a7baeabe6aad46e283f06762a1594a71 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.857946  7002 raft_consensus.cc:2243] T a7baeabe6aad46e283f06762a1594a71 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.858592  7002 raft_consensus.cc:2272] T a7baeabe6aad46e283f06762a1594a71 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:42.858989 16836 consensus_peers.cc:597] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.861498  7002 tablet_replica.cc:333] T 5316894346f24b5984dd23714341777c P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.862447  7002 raft_consensus.cc:2243] T 5316894346f24b5984dd23714341777c P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.863052  7002 raft_consensus.cc:2272] T 5316894346f24b5984dd23714341777c P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.865518  7002 tablet_replica.cc:333] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.866030  7002 raft_consensus.cc:2243] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.866824  7002 raft_consensus.cc:2272] T 89b267a6d4ca4f87829b245ef87bd6e3 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.869040  7002 tablet_replica.cc:333] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.869894  7002 raft_consensus.cc:2243] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.871328  7002 raft_consensus.cc:2272] T a4b336bf87ee483f9aef83d5b3358fae P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:42.873749 16908 consensus_peers.cc:597] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d -> Peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Couldn't send request to peer 71a0b5583e0547a88c88b590549fbcee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.874219  7002 tablet_replica.cc:333] T 9bb16a744c5d40a1b64f60422c21e3c5 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.875123  7002 raft_consensus.cc:2243] T 9bb16a744c5d40a1b64f60422c21e3c5 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.875633  7002 raft_consensus.cc:2272] T 9bb16a744c5d40a1b64f60422c21e3c5 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.877925  7002 tablet_replica.cc:333] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.878511  7002 raft_consensus.cc:2243] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.879289  7002 raft_consensus.cc:2272] T 5c540f98dc1640918b733b6bef45d026 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.881669  7002 tablet_replica.cc:333] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.882179  7002 raft_consensus.cc:2243] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.882521  7002 raft_consensus.cc:2272] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.884617  7002 tablet_replica.cc:333] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.885520  7002 raft_consensus.cc:2243] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.888561  7002 raft_consensus.cc:2272] T 1a2aa3a038f049ccadf4405e476cd972 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.891520  7002 tablet_replica.cc:333] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.892392  7002 raft_consensus.cc:2243] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.893687  7002 raft_consensus.cc:2272] T 739b8dae347b48aca06253d0a0a82369 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.896402  7002 tablet_replica.cc:333] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.897035  7002 raft_consensus.cc:2243] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.897920  7002 raft_consensus.cc:2272] T 3ffcb1357332401a919db507af113059 P 71a0b5583e0547a88c88b590549fbcee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.900302  7002 tablet_replica.cc:333] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.900990  7002 raft_consensus.cc:2243] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.901947  7002 raft_consensus.cc:2272] T 9b15c4a7a5cd4cf090073986cb42b826 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.904106  7002 tablet_replica.cc:333] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.904692  7002 raft_consensus.cc:2243] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.905200  7002 raft_consensus.cc:2272] T 459fd01e9d83462da735e004032e70b7 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.907332  7002 tablet_replica.cc:333] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.907884  7002 raft_consensus.cc:2243] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.908351  7002 raft_consensus.cc:2272] T 8089fb9d122745beabb535e51bd29d52 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.910655  7002 tablet_replica.cc:333] T 625f07ca50734f51bc7c0176ad5326f9 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.911412  7002 raft_consensus.cc:2243] T 625f07ca50734f51bc7c0176ad5326f9 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.911875  7002 raft_consensus.cc:2272] T 625f07ca50734f51bc7c0176ad5326f9 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.914714  7002 tablet_replica.cc:333] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.915364  7002 raft_consensus.cc:2243] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.916217  7002 raft_consensus.cc:2272] T dbed23d268484353b8fb9eb9d57444f8 P 71a0b5583e0547a88c88b590549fbcee [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.918780  7002 tablet_replica.cc:333] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.919441  7002 raft_consensus.cc:2243] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.920425  7002 pending_rounds.cc:70] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee: Trying to abort 1 pending ops.
I20260709 13:21:42.920707  7002 pending_rounds.cc:77] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305639124069740544 op_type: NO_OP noop_request { }
I20260709 13:21:42.921001  7002 raft_consensus.cc:2889] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:42.921306  7002 raft_consensus.cc:2272] T 00095bdfc40040d0a8eefc49c2034fb2 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.923578  7002 tablet_replica.cc:333] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.924175  7002 raft_consensus.cc:2243] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.924646  7002 raft_consensus.cc:2272] T b0a5428f572c4214b4ecd02231d81bd7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.927047  7002 tablet_replica.cc:333] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.927645  7002 raft_consensus.cc:2243] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.928069  7002 raft_consensus.cc:2272] T e70bbc621ace4406b50194cd2117bdc6 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.930054  7002 tablet_replica.cc:333] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.930612  7002 raft_consensus.cc:2243] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.931042  7002 raft_consensus.cc:2272] T eed8496b9e0a4440b2069b956dfc7358 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.933169  7002 tablet_replica.cc:333] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.933749  7002 raft_consensus.cc:2243] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.934190  7002 raft_consensus.cc:2272] T 0239d47f915d4f529cdc01b32055c954 P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.936152  7002 tablet_replica.cc:333] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.936885  7002 raft_consensus.cc:2243] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.937731  7002 raft_consensus.cc:2272] T fe2434de2d21436fbbf8b25ab1814b54 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.940495  7002 tablet_replica.cc:333] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.941231  7002 raft_consensus.cc:2243] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.941761  7002 raft_consensus.cc:2272] T ccf4303a8d6a4ec69ef1235487cd52aa P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.943931  7002 tablet_replica.cc:333] T 8a2c766bb0e34effb7b3f41f13d558a0 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.944589  7002 raft_consensus.cc:2243] T 8a2c766bb0e34effb7b3f41f13d558a0 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.945101  7002 raft_consensus.cc:2272] T 8a2c766bb0e34effb7b3f41f13d558a0 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.947165  7002 tablet_replica.cc:333] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.947726  7002 raft_consensus.cc:2243] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.948177  7002 raft_consensus.cc:2272] T 8ca3d970b5014cf8802116fd61f095e7 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.950559  7002 tablet_replica.cc:333] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.951318  7002 raft_consensus.cc:2243] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.951875  7002 raft_consensus.cc:2272] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.954556  7002 tablet_replica.cc:333] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.955184  7002 raft_consensus.cc:2243] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.955641  7002 raft_consensus.cc:2272] T e691d47f85a540f884defe4bf7a293b2 P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.957741  7002 tablet_replica.cc:333] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.958273  7002 raft_consensus.cc:2243] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.958734  7002 raft_consensus.cc:2272] T 66f84738cbb7483b9e127384bf8f534a P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.961167  7002 tablet_replica.cc:333] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.961902  7002 raft_consensus.cc:2243] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.962458  7002 raft_consensus.cc:2272] T ec2fb00d467444edb3d2d8374ad64b7c P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.965194  7002 tablet_replica.cc:333] T e27c0b3cbad94ad791a54143f2d5af0b P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.965942  7002 raft_consensus.cc:2243] T e27c0b3cbad94ad791a54143f2d5af0b P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.966480  7002 raft_consensus.cc:2272] T e27c0b3cbad94ad791a54143f2d5af0b P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.969341  7002 tablet_replica.cc:333] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.970130  7002 raft_consensus.cc:2243] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.970683  7002 raft_consensus.cc:2272] T 41ec078c4d4145dbbcae1cd9fd0c251a P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:42.971011 16908 consensus_peers.cc:597] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d -> Peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Couldn't send request to peer 71a0b5583e0547a88c88b590549fbcee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.973536  7002 tablet_replica.cc:333] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.974277  7002 raft_consensus.cc:2243] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.975158  7002 raft_consensus.cc:2272] T ef2738933d0443258a83e98416c422a7 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.978400  7002 tablet_replica.cc:333] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.978955  7002 raft_consensus.cc:2243] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.979723  7002 raft_consensus.cc:2272] T 5a920662fe00409bab733fdb2143da6f P 71a0b5583e0547a88c88b590549fbcee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.982112  7002 tablet_replica.cc:333] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.982630  7002 raft_consensus.cc:2243] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.983122  7002 raft_consensus.cc:2272] T 1702099270174fe58528799e1564c74b P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:42.985483  7002 tablet_replica.cc:333] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.986069  7002 raft_consensus.cc:2243] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:42.986944  7002 raft_consensus.cc:2272] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 71a0b5583e0547a88c88b590549fbcee [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:42.988672 16908 consensus_peers.cc:597] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d -> Peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Couldn't send request to peer 71a0b5583e0547a88c88b590549fbcee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:42.989553  7002 tablet_replica.cc:333] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee: stopping tablet replica
I20260709 13:21:42.990087  7002 raft_consensus.cc:2243] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:42.990523  7002 raft_consensus.cc:2272] T 079f892041a84ff8a4b23e4cfffa762d P 71a0b5583e0547a88c88b590549fbcee [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:43.016225 16908 consensus_peers.cc:597] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d -> Peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Couldn't send request to peer 71a0b5583e0547a88c88b590549fbcee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.041271 16908 consensus_peers.cc:597] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d -> Peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Couldn't send request to peer 71a0b5583e0547a88c88b590549fbcee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.058120 16908 consensus_peers.cc:597] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d -> Peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Couldn't send request to peer 71a0b5583e0547a88c88b590549fbcee. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.076211  7002 tablet_server.cc:196] TabletServer@127.6.214.131:0 shutdown complete.
W20260709 13:21:43.107597 16908 consensus_peers.cc:597] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d -> Peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Couldn't send request to peer 71a0b5583e0547a88c88b590549fbcee. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:46515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.165879 16908 consensus_peers.cc:597] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d -> Peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Couldn't send request to peer 71a0b5583e0547a88c88b590549fbcee. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:46515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.184451  7002 tablet_server.cc:179] TabletServer@127.6.214.132:0 shutting down...
W20260709 13:21:43.219396 16908 consensus_peers.cc:597] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d -> Peer 71a0b5583e0547a88c88b590549fbcee (127.6.214.131:46515): Couldn't send request to peer 71a0b5583e0547a88c88b590549fbcee. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.131:46515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.235649  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:43.236732  7002 tablet_replica.cc:333] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.237506  7002 raft_consensus.cc:2243] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.238103  7002 raft_consensus.cc:2272] T 5c889f0451934db588983524416a5269 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.240451  7002 tablet_replica.cc:333] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.241111  7002 raft_consensus.cc:2243] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.241667  7002 raft_consensus.cc:2272] T 86988133e17b49bfa869fb6da268ba7b P 266d75f35db4465788ab06782fae972d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.244685  7002 tablet_replica.cc:333] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.245543  7002 raft_consensus.cc:2243] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.246364  7002 raft_consensus.cc:2272] T 4ec264452e294befb3fab6c21b1307ba P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.248564  7002 tablet_replica.cc:333] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.249265  7002 raft_consensus.cc:2243] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.250003  7002 raft_consensus.cc:2272] T 13a3b0acceaf4cada63b5f215fab4a29 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.252306  7002 tablet_replica.cc:333] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.252976  7002 raft_consensus.cc:2243] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.253481  7002 raft_consensus.cc:2272] T 5e375bb738794feab91d445c1c81cd73 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.255662  7002 tablet_replica.cc:333] T 52265c494440483086dbf5b231415a85 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.256279  7002 raft_consensus.cc:2243] T 52265c494440483086dbf5b231415a85 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.256794  7002 raft_consensus.cc:2272] T 52265c494440483086dbf5b231415a85 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.259052  7002 tablet_replica.cc:333] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.259754  7002 raft_consensus.cc:2243] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.260239  7002 raft_consensus.cc:2272] T 3b9e621ba6904fdfaec709a9b5e80bf1 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.262640  7002 tablet_replica.cc:333] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.263237  7002 raft_consensus.cc:2243] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.264187  7002 raft_consensus.cc:2272] T 8760c2c176b64d10ae61d46fa3c8605b P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.266330  7002 tablet_replica.cc:333] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.267063  7002 raft_consensus.cc:2243] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.267568  7002 raft_consensus.cc:2272] T 89b267a6d4ca4f87829b245ef87bd6e3 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.269804  7002 tablet_replica.cc:333] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.270426  7002 raft_consensus.cc:2243] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.270875  7002 raft_consensus.cc:2272] T dbed23d268484353b8fb9eb9d57444f8 P 266d75f35db4465788ab06782fae972d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.273494  7002 tablet_replica.cc:333] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.274160  7002 raft_consensus.cc:2243] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.274657  7002 raft_consensus.cc:2272] T 2ad644a4c46b4ba9b4845f75d943c516 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.276832  7002 tablet_replica.cc:333] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.277482  7002 raft_consensus.cc:2243] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.278415  7002 raft_consensus.cc:2272] T dbd40203055942f4b32e39396d7d412a P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.281307  7002 tablet_replica.cc:333] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.282209  7002 raft_consensus.cc:2243] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.283303  7002 raft_consensus.cc:2272] T 8089fb9d122745beabb535e51bd29d52 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.286115  7002 tablet_replica.cc:333] T 68bdb3e915d14f918607729afc6e38fa P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.286979  7002 raft_consensus.cc:2243] T 68bdb3e915d14f918607729afc6e38fa P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.287577  7002 raft_consensus.cc:2272] T 68bdb3e915d14f918607729afc6e38fa P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:43.288229 16910 consensus_peers.cc:597] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d -> Peer 9fa67aaf86874b1ca9b7f88c944c80d9 (127.6.214.129:34869): Couldn't send request to peer 9fa67aaf86874b1ca9b7f88c944c80d9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:34869: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:43.290143  7002 tablet_replica.cc:333] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.290799  7002 raft_consensus.cc:2243] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.291260  7002 raft_consensus.cc:2272] T 5c540f98dc1640918b733b6bef45d026 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.293777  7002 tablet_replica.cc:333] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.294356  7002 raft_consensus.cc:2243] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.295122  7002 pending_rounds.cc:70] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d: Trying to abort 1 pending ops.
I20260709 13:21:43.295324  7002 pending_rounds.cc:77] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305639126117081088 op_type: NO_OP noop_request { }
I20260709 13:21:43.295603  7002 raft_consensus.cc:2889] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:43.295893  7002 raft_consensus.cc:2272] T 3b55efde48bb42119e9a38f9e3f2f6c6 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.297890  7002 tablet_replica.cc:333] T 1a2aa3a038f049ccadf4405e476cd972 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.298475  7002 raft_consensus.cc:2243] T 1a2aa3a038f049ccadf4405e476cd972 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.298933  7002 raft_consensus.cc:2272] T 1a2aa3a038f049ccadf4405e476cd972 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.301033  7002 tablet_replica.cc:333] T 739b8dae347b48aca06253d0a0a82369 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.301712  7002 raft_consensus.cc:2243] T 739b8dae347b48aca06253d0a0a82369 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.302170  7002 raft_consensus.cc:2272] T 739b8dae347b48aca06253d0a0a82369 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.304477  7002 tablet_replica.cc:333] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.305058  7002 raft_consensus.cc:2243] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.305524  7002 raft_consensus.cc:2272] T 3ffcb1357332401a919db507af113059 P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.308048  7002 tablet_replica.cc:333] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.308665  7002 raft_consensus.cc:2243] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.309513  7002 raft_consensus.cc:2272] T a37644a5aa384ad88bdebe0b15db71ea P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.311659  7002 tablet_replica.cc:333] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.312233  7002 raft_consensus.cc:2243] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.313009  7002 raft_consensus.cc:2272] T 625f07ca50734f51bc7c0176ad5326f9 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.315095  7002 tablet_replica.cc:333] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.315660  7002 raft_consensus.cc:2243] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.316439  7002 raft_consensus.cc:2272] T d72c23005f53496890cfb11e0c19318b P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.318822  7002 tablet_replica.cc:333] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.319505  7002 raft_consensus.cc:2243] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.320401  7002 raft_consensus.cc:2272] T e70bbc621ace4406b50194cd2117bdc6 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.322865  7002 tablet_replica.cc:333] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.323526  7002 raft_consensus.cc:2243] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.324455  7002 raft_consensus.cc:2272] T 8ca3d970b5014cf8802116fd61f095e7 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.326771  7002 tablet_replica.cc:333] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.327379  7002 raft_consensus.cc:2243] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.328250  7002 raft_consensus.cc:2272] T 8a2c766bb0e34effb7b3f41f13d558a0 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.330526  7002 tablet_replica.cc:333] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.331161  7002 raft_consensus.cc:2243] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.331669  7002 raft_consensus.cc:2272] T e27c0b3cbad94ad791a54143f2d5af0b P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.333950  7002 tablet_replica.cc:333] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.334560  7002 raft_consensus.cc:2243] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.335047  7002 raft_consensus.cc:2272] T dc87d7904d6f4c4489210546472fc39f P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.337389  7002 tablet_replica.cc:333] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.338075  7002 raft_consensus.cc:2243] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.338598  7002 raft_consensus.cc:2272] T 4709a71f10ba41f39d6a6db62045e637 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.340792  7002 tablet_replica.cc:333] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.341456  7002 raft_consensus.cc:2243] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.342340  7002 raft_consensus.cc:2272] T 46a75d301e384d359f3540e990d68e8d P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.344586  7002 tablet_replica.cc:333] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.345202  7002 raft_consensus.cc:2243] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.346230  7002 raft_consensus.cc:2272] T 41ec078c4d4145dbbcae1cd9fd0c251a P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.348551  7002 tablet_replica.cc:333] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.349170  7002 raft_consensus.cc:2243] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.349687  7002 raft_consensus.cc:2272] T ef2738933d0443258a83e98416c422a7 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.351743  7002 tablet_replica.cc:333] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.352305  7002 raft_consensus.cc:2243] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.352722  7002 raft_consensus.cc:2272] T 5a920662fe00409bab733fdb2143da6f P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.355177  7002 tablet_replica.cc:333] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.355882  7002 raft_consensus.cc:2243] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.356832  7002 raft_consensus.cc:2272] T 1702099270174fe58528799e1564c74b P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.358860  7002 tablet_replica.cc:333] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.359390  7002 raft_consensus.cc:2243] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.359870  7002 raft_consensus.cc:2272] T 9e47c1b91c71444aa6e2c70fa4eb4403 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.361907  7002 tablet_replica.cc:333] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.362454  7002 raft_consensus.cc:2243] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.362902  7002 raft_consensus.cc:2272] T 079f892041a84ff8a4b23e4cfffa762d P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.364996  7002 tablet_replica.cc:333] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.365646  7002 raft_consensus.cc:2243] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.366101  7002 raft_consensus.cc:2272] T a7baeabe6aad46e283f06762a1594a71 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.367997  7002 tablet_replica.cc:333] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.368518  7002 raft_consensus.cc:2243] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.369293  7002 raft_consensus.cc:2272] T 5316894346f24b5984dd23714341777c P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.371418  7002 tablet_replica.cc:333] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.372234  7002 raft_consensus.cc:2243] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.372678  7002 raft_consensus.cc:2272] T a465607298c84b8dbd8007c816bc5c9c P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.374594  7002 tablet_replica.cc:333] T 59ba89448ab04e64b769557c2830641f P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.375119  7002 raft_consensus.cc:2243] T 59ba89448ab04e64b769557c2830641f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.375468  7002 raft_consensus.cc:2272] T 59ba89448ab04e64b769557c2830641f P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.377337  7002 tablet_replica.cc:333] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.377872  7002 raft_consensus.cc:2243] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.378582  7002 raft_consensus.cc:2272] T 09c70b1ed00f49408fae9002719cc6e5 P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.380493  7002 tablet_replica.cc:333] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.380988  7002 raft_consensus.cc:2243] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.381392  7002 raft_consensus.cc:2272] T eb2b3210f0d344aa8c9f961a1b72c508 P 266d75f35db4465788ab06782fae972d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.383255  7002 tablet_replica.cc:333] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.383724  7002 raft_consensus.cc:2243] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.384174  7002 raft_consensus.cc:2272] T 807d54a32dee49c78fe3b3bfa5763b2b P 266d75f35db4465788ab06782fae972d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.385982  7002 tablet_replica.cc:333] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.386451  7002 raft_consensus.cc:2243] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.386896  7002 raft_consensus.cc:2272] T b7da6930c7d44f51ae33d75064b68676 P 266d75f35db4465788ab06782fae972d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.388811  7002 tablet_replica.cc:333] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d: stopping tablet replica
I20260709 13:21:43.389246  7002 raft_consensus.cc:2243] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:43.389667  7002 raft_consensus.cc:2272] T c8cbb6f215ef4d9bb7a65bd627ffcfbe P 266d75f35db4465788ab06782fae972d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.462320  7002 tablet_server.cc:196] TabletServer@127.6.214.132:0 shutdown complete.
I20260709 13:21:43.541034  7002 master.cc:562] Master@127.6.214.190:40917 shutting down...
I20260709 13:21:43.578732  7002 raft_consensus.cc:2243] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:43.579357  7002 raft_consensus.cc:2272] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:43.579766  7002 tablet_replica.cc:333] T 00000000000000000000000000000000 P aa6cb7607ecb4d57908687766c6ec9f8: stopping tablet replica
W20260709 13:21:44.599241  7002 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16650)
W20260709 13:21:45.599756  7002 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 16650)
I20260709 13:21:46.333029  7002 master.cc:584] Master@127.6.214.190:40917 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (34924 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:21:46.425225  7002 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.214.190:45705
I20260709 13:21:46.426659  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:46.432814 17938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:46.433212 17939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:46.434101 17941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:46.434973  7002 server_base.cc:1061] running on GCE node
I20260709 13:21:46.436312  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:46.436515  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:46.436741  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603306436724 us; error 0 us; skew 500 ppm
I20260709 13:21:46.437392  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:46.440157  7002 webserver.cc:533] Webserver started at http://127.6.214.190:37095/ using document root <none> and password file <none>
I20260709 13:21:46.440724  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:46.440896  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:46.441278  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:46.442744  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/master-0-root/instance:
uuid: "f8d04f54f531478bbad2588929075186"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-rnv4"
I20260709 13:21:46.448089  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 13:21:46.452384 17946 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.453474  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:21:46.453742  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/master-0-root
uuid: "f8d04f54f531478bbad2588929075186"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-rnv4"
I20260709 13:21:46.453986  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:46.467403  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:46.469412  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:46.512476  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.190:45705
I20260709 13:21:46.512706 17997 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.190:45705 every 8 connection(s)
I20260709 13:21:46.516678 17998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:46.528596 17998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186: Bootstrap starting.
I20260709 13:21:46.533658 17998 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:46.538324 17998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186: No bootstrap required, opened a new log
I20260709 13:21:46.540550 17998 raft_consensus.cc:359] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d04f54f531478bbad2588929075186" member_type: VOTER }
I20260709 13:21:46.540946 17998 raft_consensus.cc:385] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:46.541131 17998 raft_consensus.cc:740] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d04f54f531478bbad2588929075186, State: Initialized, Role: FOLLOWER
I20260709 13:21:46.541788 17998 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d04f54f531478bbad2588929075186" member_type: VOTER }
I20260709 13:21:46.542256 17998 raft_consensus.cc:399] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:46.542456 17998 raft_consensus.cc:493] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:46.542673 17998 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:46.547374 17998 raft_consensus.cc:515] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d04f54f531478bbad2588929075186" member_type: VOTER }
I20260709 13:21:46.547887 17998 leader_election.cc:304] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8d04f54f531478bbad2588929075186; no voters: 
I20260709 13:21:46.549053 17998 leader_election.cc:290] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:46.549621 18001 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:46.551151 18001 raft_consensus.cc:697] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [term 1 LEADER]: Becoming Leader. State: Replica: f8d04f54f531478bbad2588929075186, State: Running, Role: LEADER
I20260709 13:21:46.551926 18001 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d04f54f531478bbad2588929075186" member_type: VOTER }
I20260709 13:21:46.552279 17998 sys_catalog.cc:565] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:46.556531 18002 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8d04f54f531478bbad2588929075186" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d04f54f531478bbad2588929075186" member_type: VOTER } }
I20260709 13:21:46.556668 18003 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8d04f54f531478bbad2588929075186. Latest consensus state: current_term: 1 leader_uuid: "f8d04f54f531478bbad2588929075186" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d04f54f531478bbad2588929075186" member_type: VOTER } }
I20260709 13:21:46.557533 18002 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:46.557546 18003 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:46.560267 18007 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:46.568629 18007 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:46.569792  7002 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:46.578166 18007 catalog_manager.cc:1383] Generated new cluster ID: 0759e5c6d4f84b74ac8174be17740c1f
I20260709 13:21:46.578523 18007 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:46.589905 18007 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:46.591265 18007 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:46.603953 18007 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186: Generated new TSK 0
I20260709 13:21:46.604583 18007 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:46.637253  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:46.643414 18019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:46.644800 18020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:46.646570 18022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:46.646759  7002 server_base.cc:1061] running on GCE node
I20260709 13:21:46.648162  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:46.648372  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:46.648509  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603306648497 us; error 0 us; skew 500 ppm
I20260709 13:21:46.649040  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:46.651676  7002 webserver.cc:533] Webserver started at http://127.6.214.129:39113/ using document root <none> and password file <none>
I20260709 13:21:46.652117  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:46.652267  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:46.652482  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:46.653661  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-0-root/instance:
uuid: "59282fcc26e74b65bb74d4e2b39f848c"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-rnv4"
I20260709 13:21:46.658614  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:46.662254 18027 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.663305  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:21:46.663776  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-0-root
uuid: "59282fcc26e74b65bb74d4e2b39f848c"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-rnv4"
I20260709 13:21:46.664113  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:46.723886  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:46.726017  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:46.727694  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:46.730613  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:46.730854  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.731155  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:46.731340  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.778595  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.129:35019
I20260709 13:21:46.778729 18090 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.129:35019 every 8 connection(s)
I20260709 13:21:46.786419  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:46.796125 18096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:46.797176 18095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:46.799736  7002 server_base.cc:1061] running on GCE node
W20260709 13:21:46.799902 18098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:46.801165  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:46.801424  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:46.801666  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603306801646 us; error 0 us; skew 500 ppm
I20260709 13:21:46.802282  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:46.805898  7002 webserver.cc:533] Webserver started at http://127.6.214.130:46841/ using document root <none> and password file <none>
I20260709 13:21:46.806090 18091 heartbeater.cc:344] Connected to a master server at 127.6.214.190:45705
I20260709 13:21:46.806632  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:46.806663 18091 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:46.806993  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:46.807487  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:46.808207 18091 heartbeater.cc:507] Master 127.6.214.190:45705 requested a full tablet report, sending...
I20260709 13:21:46.809329  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-1-root/instance:
uuid: "6d8b172f07c347c097df022dcda9aab9"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-rnv4"
I20260709 13:21:46.811242 17963 ts_manager.cc:194] Registered new tserver with Master: 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019)
I20260709 13:21:46.813722 17963 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57398
I20260709 13:21:46.815614  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:21:46.819871 18103 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.820919  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:21:46.821252  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-1-root
uuid: "6d8b172f07c347c097df022dcda9aab9"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-rnv4"
I20260709 13:21:46.821650  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:46.845885  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:46.847165  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:46.849097  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:46.851692  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:46.851984  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.852299  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:46.852460  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.898773 18165 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.130:33935 every 8 connection(s)
I20260709 13:21:46.898794  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.130:33935
I20260709 13:21:46.904834  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:46.914562 18169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:46.916481 18170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:46.918612  7002 server_base.cc:1061] running on GCE node
W20260709 13:21:46.919507 18172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:46.920756  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:46.921068  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:46.921267  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603306921249 us; error 0 us; skew 500 ppm
I20260709 13:21:46.921765 18166 heartbeater.cc:344] Connected to a master server at 127.6.214.190:45705
I20260709 13:21:46.921967  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:46.922289 18166 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:46.923400 18166 heartbeater.cc:507] Master 127.6.214.190:45705 requested a full tablet report, sending...
I20260709 13:21:46.924963  7002 webserver.cc:533] Webserver started at http://127.6.214.131:44137/ using document root <none> and password file <none>
I20260709 13:21:46.925683  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:46.925879  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:46.925933 17963 ts_manager.cc:194] Registered new tserver with Master: 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:46.926172  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:46.927506  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-2-root/instance:
uuid: "c89811f1c6a043ec9fd6b4619b57f679"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-rnv4"
I20260709 13:21:46.927575 17963 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57402
I20260709 13:21:46.932457  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:46.936462 18177 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.937346  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:21:46.937769  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-2-root
uuid: "c89811f1c6a043ec9fd6b4619b57f679"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-rnv4"
I20260709 13:21:46.938031  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:46.966948  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:46.968338  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:46.969861  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:46.972544  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:46.972797  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:46.973073  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:46.973279  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:47.023022  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.131:33749
I20260709 13:21:47.023133 18239 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.131:33749 every 8 connection(s)
I20260709 13:21:47.039935 18240 heartbeater.cc:344] Connected to a master server at 127.6.214.190:45705
I20260709 13:21:47.040385 18240 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:47.041282 18240 heartbeater.cc:507] Master 127.6.214.190:45705 requested a full tablet report, sending...
I20260709 13:21:47.043404 17963 ts_manager.cc:194] Registered new tserver with Master: c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:47.043932  7002 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016694743s
I20260709 13:21:47.045163 17963 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57404
I20260709 13:21:47.074731 17963 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57418:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:47.078158 17963 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:47.159013 18205 tablet_service.cc:1511] Processing CreateTablet for tablet ce1cc92dba1843028a805534b79edea1 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:21:47.160828 18205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1cc92dba1843028a805534b79edea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.161265 18204 tablet_service.cc:1511] Processing CreateTablet for tablet 1d157177661a4d5ea5876de22d306bd7 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:21:47.162856 18204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d157177661a4d5ea5876de22d306bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.165913 18203 tablet_service.cc:1511] Processing CreateTablet for tablet c03d770241db4724ad3a2da951a8043c (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:21:47.174889 18203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c03d770241db4724ad3a2da951a8043c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.178187 18056 tablet_service.cc:1511] Processing CreateTablet for tablet ce1cc92dba1843028a805534b79edea1 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:21:47.179813 18056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1cc92dba1843028a805534b79edea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.181912 18202 tablet_service.cc:1511] Processing CreateTablet for tablet f5a81fc72cf94b51b8bb531ba1545f40 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:21:47.183596 18202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5a81fc72cf94b51b8bb531ba1545f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.190910 18055 tablet_service.cc:1511] Processing CreateTablet for tablet 1d157177661a4d5ea5876de22d306bd7 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:21:47.191843 18131 tablet_service.cc:1511] Processing CreateTablet for tablet ce1cc92dba1843028a805534b79edea1 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:21:47.192651 18055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d157177661a4d5ea5876de22d306bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.193228 18131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1cc92dba1843028a805534b79edea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.195466 18130 tablet_service.cc:1511] Processing CreateTablet for tablet 1d157177661a4d5ea5876de22d306bd7 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:21:47.196950 18130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d157177661a4d5ea5876de22d306bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.198686 18129 tablet_service.cc:1511] Processing CreateTablet for tablet c03d770241db4724ad3a2da951a8043c (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:21:47.200174 18129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c03d770241db4724ad3a2da951a8043c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.201778 18054 tablet_service.cc:1511] Processing CreateTablet for tablet c03d770241db4724ad3a2da951a8043c (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:21:47.203256 18054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c03d770241db4724ad3a2da951a8043c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.203019 18128 tablet_service.cc:1511] Processing CreateTablet for tablet f5a81fc72cf94b51b8bb531ba1545f40 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:21:47.206705 18201 tablet_service.cc:1511] Processing CreateTablet for tablet b6f43efc325c40b8a1a5ec72c30ad467 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:21:47.208175 18201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6f43efc325c40b8a1a5ec72c30ad467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.210721 18127 tablet_service.cc:1511] Processing CreateTablet for tablet b6f43efc325c40b8a1a5ec72c30ad467 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:21:47.213217 18200 tablet_service.cc:1511] Processing CreateTablet for tablet 6843c3778d8e4fd79ff4710ba3350432 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:21:47.214859 18200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6843c3778d8e4fd79ff4710ba3350432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.217171 18199 tablet_service.cc:1511] Processing CreateTablet for tablet 9567be35d4cf463a86c8eb635ccae469 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:21:47.218987 18127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6f43efc325c40b8a1a5ec72c30ad467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.210736 18126 tablet_service.cc:1511] Processing CreateTablet for tablet 6843c3778d8e4fd79ff4710ba3350432 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:21:47.221761 18126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6843c3778d8e4fd79ff4710ba3350432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.223493 18198 tablet_service.cc:1511] Processing CreateTablet for tablet 49afc43f04b9442493ac4faf8684d0ed (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:21:47.219025 18199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9567be35d4cf463a86c8eb635ccae469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.230614 18197 tablet_service.cc:1511] Processing CreateTablet for tablet 296d87ca32624ba7a553284774cde523 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:21:47.230415 18125 tablet_service.cc:1511] Processing CreateTablet for tablet 9567be35d4cf463a86c8eb635ccae469 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:21:47.232353 18198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49afc43f04b9442493ac4faf8684d0ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.233985 18124 tablet_service.cc:1511] Processing CreateTablet for tablet 49afc43f04b9442493ac4faf8684d0ed (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:21:47.236083 18197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296d87ca32624ba7a553284774cde523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.236961 18196 tablet_service.cc:1511] Processing CreateTablet for tablet b0e545f828c54d88a93b453b009bcd03 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:21:47.238412 18196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e545f828c54d88a93b453b009bcd03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.237895 18123 tablet_service.cc:1511] Processing CreateTablet for tablet 296d87ca32624ba7a553284774cde523 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:21:47.223532 18128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5a81fc72cf94b51b8bb531ba1545f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.249336 18123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296d87ca32624ba7a553284774cde523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.253975 18124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49afc43f04b9442493ac4faf8684d0ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.258790 18125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9567be35d4cf463a86c8eb635ccae469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.299441 18053 tablet_service.cc:1511] Processing CreateTablet for tablet f5a81fc72cf94b51b8bb531ba1545f40 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:21:47.301081 18053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5a81fc72cf94b51b8bb531ba1545f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.311203 18052 tablet_service.cc:1511] Processing CreateTablet for tablet b6f43efc325c40b8a1a5ec72c30ad467 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:21:47.312846 18052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6f43efc325c40b8a1a5ec72c30ad467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.323334 18051 tablet_service.cc:1511] Processing CreateTablet for tablet 6843c3778d8e4fd79ff4710ba3350432 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:21:47.323895 18122 tablet_service.cc:1511] Processing CreateTablet for tablet b0e545f828c54d88a93b453b009bcd03 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:21:47.325878 18051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6843c3778d8e4fd79ff4710ba3350432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.326187 18122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e545f828c54d88a93b453b009bcd03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.359444 18050 tablet_service.cc:1511] Processing CreateTablet for tablet 9567be35d4cf463a86c8eb635ccae469 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:21:47.361743 18050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9567be35d4cf463a86c8eb635ccae469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.371953 18049 tablet_service.cc:1511] Processing CreateTablet for tablet 49afc43f04b9442493ac4faf8684d0ed (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:21:47.374221 18049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49afc43f04b9442493ac4faf8684d0ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.386933 18256 tablet_bootstrap.cc:492] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9: Bootstrap starting.
I20260709 13:21:47.403156 18048 tablet_service.cc:1511] Processing CreateTablet for tablet 296d87ca32624ba7a553284774cde523 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:21:47.404729 18048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 296d87ca32624ba7a553284774cde523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.411329 18047 tablet_service.cc:1511] Processing CreateTablet for tablet b0e545f828c54d88a93b453b009bcd03 (DEFAULT_TABLE table=test-workload [id=dc01480dcab446868971181e62cb5546]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:21:47.412834 18047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e545f828c54d88a93b453b009bcd03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:47.443590 18256 tablet_bootstrap.cc:654] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.490440 18255 tablet_bootstrap.cc:492] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679: Bootstrap starting.
I20260709 13:21:47.506803 18257 tablet_bootstrap.cc:492] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:47.507050 18255 tablet_bootstrap.cc:654] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.508874 18256 tablet_bootstrap.cc:492] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9: No bootstrap required, opened a new log
I20260709 13:21:47.509539 18256 ts_tablet_manager.cc:1403] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9: Time spent bootstrapping tablet: real 0.123s	user 0.019s	sys 0.009s
I20260709 13:21:47.514483 18257 tablet_bootstrap.cc:654] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.514314 18256 raft_consensus.cc:359] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.515769 18256 raft_consensus.cc:385] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.516103 18256 raft_consensus.cc:740] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.517455 18256 consensus_queue.cc:260] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.518632 18255 tablet_bootstrap.cc:492] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679: No bootstrap required, opened a new log
I20260709 13:21:47.519375 18255 ts_tablet_manager.cc:1403] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.000s
I20260709 13:21:47.522881 18166 heartbeater.cc:499] Master 127.6.214.190:45705 was elected leader, sending a full tablet report...
I20260709 13:21:47.523729 18256 ts_tablet_manager.cc:1434] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 13:21:47.524755 18255 raft_consensus.cc:359] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.525569 18256 tablet_bootstrap.cc:492] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9: Bootstrap starting.
I20260709 13:21:47.525704 18255 raft_consensus.cc:385] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.526141 18255 raft_consensus.cc:740] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.526633 18257 tablet_bootstrap.cc:492] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c: No bootstrap required, opened a new log
I20260709 13:21:47.527364 18257 ts_tablet_manager.cc:1403] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 13:21:47.527005 18255 consensus_queue.cc:260] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.530745 18257 raft_consensus.cc:359] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.531634 18257 raft_consensus.cc:385] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.531996 18257 raft_consensus.cc:740] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.532658 18256 tablet_bootstrap.cc:654] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.533217 18257 consensus_queue.cc:260] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.552933 18091 heartbeater.cc:499] Master 127.6.214.190:45705 was elected leader, sending a full tablet report...
I20260709 13:21:47.552919 18255 ts_tablet_manager.cc:1434] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.020s
I20260709 13:21:47.553534 18256 tablet_bootstrap.cc:492] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9: No bootstrap required, opened a new log
I20260709 13:21:47.553534 18257 ts_tablet_manager.cc:1434] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.026s	user 0.011s	sys 0.013s
I20260709 13:21:47.554347 18256 ts_tablet_manager.cc:1403] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.015s
I20260709 13:21:47.554958 18257 tablet_bootstrap.cc:492] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:47.558149 18240 heartbeater.cc:499] Master 127.6.214.190:45705 was elected leader, sending a full tablet report...
I20260709 13:21:47.557920 18256 raft_consensus.cc:359] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.558764 18256 raft_consensus.cc:385] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.559095 18256 raft_consensus.cc:740] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.560040 18256 consensus_queue.cc:260] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.562444 18257 tablet_bootstrap.cc:654] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.562696 18256 ts_tablet_manager.cc:1434] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:21:47.562783 18255 tablet_bootstrap.cc:492] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679: Bootstrap starting.
I20260709 13:21:47.563922 18256 tablet_bootstrap.cc:492] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9: Bootstrap starting.
W20260709 13:21:47.566592 18011 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:47.572280 18256 tablet_bootstrap.cc:654] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.578605 18256 tablet_bootstrap.cc:492] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9: No bootstrap required, opened a new log
I20260709 13:21:47.579210 18256 ts_tablet_manager.cc:1403] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 13:21:47.582062 18255 tablet_bootstrap.cc:654] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.582671 18256 raft_consensus.cc:359] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } } peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } }
I20260709 13:21:47.583645 18256 raft_consensus.cc:385] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.583981 18256 raft_consensus.cc:740] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.584367 18263 raft_consensus.cc:493] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:47.584952 18263 raft_consensus.cc:515] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.584947 18256 consensus_queue.cc:260] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } } peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } }
I20260709 13:21:47.588374 18256 ts_tablet_manager.cc:1434] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:21:47.590247 18256 tablet_bootstrap.cc:492] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9: Bootstrap starting.
I20260709 13:21:47.590234 18263 leader_election.cc:290] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:47.599439 18256 tablet_bootstrap.cc:654] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.599665 18257 tablet_bootstrap.cc:492] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c: No bootstrap required, opened a new log
I20260709 13:21:47.603515 18257 ts_tablet_manager.cc:1403] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.001s
I20260709 13:21:47.603907 18255 tablet_bootstrap.cc:492] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679: No bootstrap required, opened a new log
I20260709 13:21:47.604480 18255 ts_tablet_manager.cc:1403] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.000s
I20260709 13:21:47.607810 18257 raft_consensus.cc:359] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.608179 18255 raft_consensus.cc:359] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.608729 18257 raft_consensus.cc:385] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.608960 18255 raft_consensus.cc:385] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.609215 18257 raft_consensus.cc:740] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.609339 18255 raft_consensus.cc:740] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.610357 18255 consensus_queue.cc:260] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.610435 18257 consensus_queue.cc:260] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.612459 18257 ts_tablet_manager.cc:1434] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:21:47.613145 18255 ts_tablet_manager.cc:1434] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:47.613349 18257 tablet_bootstrap.cc:492] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:47.614178 18255 tablet_bootstrap.cc:492] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679: Bootstrap starting.
I20260709 13:21:47.620198 18257 tablet_bootstrap.cc:654] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.622292 18255 tablet_bootstrap.cc:654] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.625080 18256 tablet_bootstrap.cc:492] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9: No bootstrap required, opened a new log
I20260709 13:21:47.626264 18256 ts_tablet_manager.cc:1403] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.009s
I20260709 13:21:47.630796 18256 raft_consensus.cc:359] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.632074 18256 raft_consensus.cc:385] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.632591 18256 raft_consensus.cc:740] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.633829 18256 consensus_queue.cc:260] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.638360 18256 ts_tablet_manager.cc:1434] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:21:47.638782 18257 tablet_bootstrap.cc:492] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c: No bootstrap required, opened a new log
I20260709 13:21:47.639881 18256 tablet_bootstrap.cc:492] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9: Bootstrap starting.
I20260709 13:21:47.643913 18255 tablet_bootstrap.cc:492] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679: No bootstrap required, opened a new log
I20260709 13:21:47.644187 18257 ts_tablet_manager.cc:1403] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.012s
I20260709 13:21:47.644502 18255 ts_tablet_manager.cc:1403] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.008s
I20260709 13:21:47.647904 18256 tablet_bootstrap.cc:654] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.647956 18255 raft_consensus.cc:359] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.648964 18255 raft_consensus.cc:385] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.649277 18255 raft_consensus.cc:740] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.650230 18255 consensus_queue.cc:260] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.653699 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e545f828c54d88a93b453b009bcd03" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679" is_pre_election: true
W20260709 13:21:47.654685 18167 tablet.cc:2406] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:21:47.654733 18215 raft_consensus.cc:2468] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59282fcc26e74b65bb74d4e2b39f848c in term 0.
I20260709 13:21:47.656390 18255 ts_tablet_manager.cc:1434] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:21:47.656889 18030 leader_election.cc:304] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:47.657548 18255 tablet_bootstrap.cc:492] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679: Bootstrap starting.
I20260709 13:21:47.658352 18263 raft_consensus.cc:2804] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:47.658878 18263 raft_consensus.cc:493] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:47.659324 18263 raft_consensus.cc:3060] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:47.664589 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e545f828c54d88a93b453b009bcd03" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9" is_pre_election: true
W20260709 13:21:47.666446 18032 leader_election.cc:343] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.647581 18257 raft_consensus.cc:359] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.670414 18255 tablet_bootstrap.cc:654] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.672019 18263 raft_consensus.cc:515] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.670475 18257 raft_consensus.cc:385] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.676010 18257 raft_consensus.cc:740] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.677439 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e545f828c54d88a93b453b009bcd03" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
I20260709 13:21:47.677609 18257 consensus_queue.cc:260] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
W20260709 13:21:47.679692 18032 leader_election.cc:343] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.681871 18263 leader_election.cc:290] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 election: Requested vote from peers 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:47.684010 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e545f828c54d88a93b453b009bcd03" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
I20260709 13:21:47.684845 18255 tablet_bootstrap.cc:492] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679: No bootstrap required, opened a new log
I20260709 13:21:47.684914 18215 raft_consensus.cc:3060] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:47.685822 18255 ts_tablet_manager.cc:1403] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.006s
I20260709 13:21:47.690764 18261 raft_consensus.cc:493] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:47.691613 18261 raft_consensus.cc:515] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } } peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } }
I20260709 13:21:47.702538 18215 raft_consensus.cc:2468] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59282fcc26e74b65bb74d4e2b39f848c in term 1.
I20260709 13:21:47.701720 18261 leader_election.cc:290] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749), 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019)
I20260709 13:21:47.708132 18257 ts_tablet_manager.cc:1434] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.064s	user 0.014s	sys 0.008s
I20260709 13:21:47.707684 18255 raft_consensus.cc:359] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.709729 18257 tablet_bootstrap.cc:492] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:47.709583 18030 leader_election.cc:304] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, c89811f1c6a043ec9fd6b4619b57f679; no voters: 6d8b172f07c347c097df022dcda9aab9
I20260709 13:21:47.711382 18263 raft_consensus.cc:2804] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:47.711946 18256 tablet_bootstrap.cc:492] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9: No bootstrap required, opened a new log
I20260709 13:21:47.711937 18263 raft_consensus.cc:697] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 LEADER]: Becoming Leader. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Running, Role: LEADER
I20260709 13:21:47.712918 18256 ts_tablet_manager.cc:1403] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9: Time spent bootstrapping tablet: real 0.073s	user 0.030s	sys 0.020s
I20260709 13:21:47.713163 18263 consensus_queue.cc:237] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.716571 18256 raft_consensus.cc:359] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.717492 18255 raft_consensus.cc:385] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.718060 18255 raft_consensus.cc:740] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.719300 18255 consensus_queue.cc:260] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.719803 18257 tablet_bootstrap.cc:654] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.722065 18255 ts_tablet_manager.cc:1434] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.005s
I20260709 13:21:47.727258 18255 tablet_bootstrap.cc:492] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679: Bootstrap starting.
I20260709 13:21:47.732285 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cc92dba1843028a805534b79edea1" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679" is_pre_election: true
W20260709 13:21:47.734012 18105 leader_election.cc:343] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.722410 18256 raft_consensus.cc:385] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.735198 18256 raft_consensus.cc:740] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.736652 18255 tablet_bootstrap.cc:654] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.739290 18066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cc92dba1843028a805534b79edea1" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c" is_pre_election: true
I20260709 13:21:47.736272 18256 consensus_queue.cc:260] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
W20260709 13:21:47.741474 18104 leader_election.cc:343] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.742008 18104 leader_election.cc:304] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9; no voters: 59282fcc26e74b65bb74d4e2b39f848c, c89811f1c6a043ec9fd6b4619b57f679
I20260709 13:21:47.743485 18256 ts_tablet_manager.cc:1434] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.004s
I20260709 13:21:47.743424 18261 raft_consensus.cc:2749] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:47.744848 18256 tablet_bootstrap.cc:492] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9: Bootstrap starting.
I20260709 13:21:47.745570 17961 catalog_manager.cc:5697] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c reported cstate change: term changed from 0 to 1, leader changed from <none> to 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129). New cstate: current_term: 1 leader_uuid: "59282fcc26e74b65bb74d4e2b39f848c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:47.751612 18257 tablet_bootstrap.cc:492] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c: No bootstrap required, opened a new log
I20260709 13:21:47.753154 18257 ts_tablet_manager.cc:1403] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.005s
I20260709 13:21:47.754455 18256 tablet_bootstrap.cc:654] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.756863 18257 raft_consensus.cc:359] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.757810 18257 raft_consensus.cc:385] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.758162 18257 raft_consensus.cc:740] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.759474 18255 tablet_bootstrap.cc:492] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679: No bootstrap required, opened a new log
I20260709 13:21:47.759087 18257 consensus_queue.cc:260] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.760228 18255 ts_tablet_manager.cc:1403] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.001s
I20260709 13:21:47.762192 18257 ts_tablet_manager.cc:1434] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:21:47.763422 18257 tablet_bootstrap.cc:492] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:47.764047 18255 raft_consensus.cc:359] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } } peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } }
I20260709 13:21:47.765033 18255 raft_consensus.cc:385] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.765465 18255 raft_consensus.cc:740] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.766623 18255 consensus_queue.cc:260] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } } peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } }
I20260709 13:21:47.771872 18257 tablet_bootstrap.cc:654] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.775456 18256 tablet_bootstrap.cc:492] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9: No bootstrap required, opened a new log
I20260709 13:21:47.776346 18256 ts_tablet_manager.cc:1403] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.014s
I20260709 13:21:47.778589 18255 ts_tablet_manager.cc:1434] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:21:47.779676 18261 raft_consensus.cc:493] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:47.780222 18256 raft_consensus.cc:359] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.780323 18261 raft_consensus.cc:515] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.781220 18256 raft_consensus.cc:385] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.781618 18256 raft_consensus.cc:740] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.782488 18256 consensus_queue.cc:260] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.784224 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679" is_pre_election: true
I20260709 13:21:47.785300 18066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c" is_pre_election: true
I20260709 13:21:47.786324 18066 raft_consensus.cc:2468] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 0.
I20260709 13:21:47.788357 18262 raft_consensus.cc:493] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:47.788751 18105 leader_election.cc:343] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.789325 18262 raft_consensus.cc:515] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.790105 18104 leader_election.cc:304] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, 6d8b172f07c347c097df022dcda9aab9; no voters: c89811f1c6a043ec9fd6b4619b57f679
I20260709 13:21:47.791884 18261 leader_election.cc:290] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:47.792564 18261 raft_consensus.cc:2804] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:47.792964 18261 raft_consensus.cc:493] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:47.793347 18261 raft_consensus.cc:3060] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:47.794915 18256 ts_tablet_manager.cc:1434] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:21:47.800284 18256 tablet_bootstrap.cc:492] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9: Bootstrap starting.
I20260709 13:21:47.802135 18288 raft_consensus.cc:493] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:47.803826 18288 raft_consensus.cc:515] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.805308 18261 raft_consensus.cc:515] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.807654 18066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296d87ca32624ba7a553284774cde523" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c" is_pre_election: true
I20260709 13:21:47.808815 18262 leader_election.cc:290] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
W20260709 13:21:47.809614 18104 leader_election.cc:343] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.815613 18261 leader_election.cc:290] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:47.812690 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
I20260709 13:21:47.816497 18255 tablet_bootstrap.cc:492] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679: Bootstrap starting.
W20260709 13:21:47.817687 18105 leader_election.cc:343] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.817994 18257 tablet_bootstrap.cc:492] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c: No bootstrap required, opened a new log
I20260709 13:21:47.818583 18257 ts_tablet_manager.cc:1403] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.055s	user 0.029s	sys 0.019s
I20260709 13:21:47.818748 18066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
I20260709 13:21:47.819451 18066 raft_consensus.cc:3060] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:47.819583 18262 raft_consensus.cc:493] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:47.820223 18262 raft_consensus.cc:515] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.822470 18262 leader_election.cc:290] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:47.822218 18257 raft_consensus.cc:359] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.823132 18257 raft_consensus.cc:385] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.823575 18257 raft_consensus.cc:740] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.824826 18288 leader_election.cc:290] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:47.824453 18257 consensus_queue.cc:260] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.826220 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296d87ca32624ba7a553284774cde523" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679" is_pre_election: true
I20260709 13:21:47.827123 18257 ts_tablet_manager.cc:1434] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
W20260709 13:21:47.827924 18105 leader_election.cc:343] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.828313 18257 tablet_bootstrap.cc:492] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:47.828439 18105 leader_election.cc:304] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9; no voters: 59282fcc26e74b65bb74d4e2b39f848c, c89811f1c6a043ec9fd6b4619b57f679
I20260709 13:21:47.833500 18256 tablet_bootstrap.cc:654] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.834415 18066 raft_consensus.cc:2468] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 1.
I20260709 13:21:47.835911 18104 leader_election.cc:304] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, 6d8b172f07c347c097df022dcda9aab9; no voters: c89811f1c6a043ec9fd6b4619b57f679
I20260709 13:21:47.836627 18257 tablet_bootstrap.cc:654] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.837270 18261 raft_consensus.cc:2749] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:47.838192 18261 raft_consensus.cc:2804] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:47.838711 18261 raft_consensus.cc:697] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:47.839638 18261 consensus_queue.cc:237] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.840947 18255 tablet_bootstrap.cc:654] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.847030 18262 raft_consensus.cc:493] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:47.847880 18262 raft_consensus.cc:515] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } } peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } }
I20260709 13:21:47.851989 18262 leader_election.cc:290] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:47.855530 18263 raft_consensus.cc:493] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:47.856354 18263 raft_consensus.cc:515] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.860613 18288 raft_consensus.cc:493] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:47.861464 18288 raft_consensus.cc:515] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.864065 18263 leader_election.cc:290] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:47.863732 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d157177661a4d5ea5876de22d306bd7" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679" is_pre_election: true
I20260709 13:21:47.865195 18215 raft_consensus.cc:2468] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59282fcc26e74b65bb74d4e2b39f848c in term 0.
I20260709 13:21:47.867113 18030 leader_election.cc:304] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:47.864320 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d157177661a4d5ea5876de22d306bd7" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9" is_pre_election: true
W20260709 13:21:47.869834 18032 leader_election.cc:343] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.869946 18263 raft_consensus.cc:2804] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:47.870666 18263 raft_consensus.cc:493] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:47.871126 18263 raft_consensus.cc:3060] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:47.878394 18256 tablet_bootstrap.cc:492] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9: No bootstrap required, opened a new log
I20260709 13:21:47.879042 18256 ts_tablet_manager.cc:1403] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.016s
I20260709 13:21:47.882709 18256 raft_consensus.cc:359] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.883210 18065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6843c3778d8e4fd79ff4710ba3350432" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c" is_pre_election: true
I20260709 13:21:47.883497 18256 raft_consensus.cc:385] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.883862 18256 raft_consensus.cc:740] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.884730 18064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9567be35d4cf463a86c8eb635ccae469" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c" is_pre_election: true
I20260709 13:21:47.884976 18256 consensus_queue.cc:260] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.888070 18256 ts_tablet_manager.cc:1434] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:21:47.888860 18063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cc92dba1843028a805534b79edea1" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c" is_pre_election: true
I20260709 13:21:47.889216 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6843c3778d8e4fd79ff4710ba3350432" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679" is_pre_election: true
I20260709 13:21:47.889338 18288 leader_election.cc:290] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:47.889885 18215 raft_consensus.cc:2468] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 0.
I20260709 13:21:47.889168 18256 tablet_bootstrap.cc:492] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9: Bootstrap starting.
I20260709 13:21:47.891218 18105 leader_election.cc:304] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:47.892586 18288 raft_consensus.cc:2804] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:47.893122 18288 raft_consensus.cc:493] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:47.893667 18288 raft_consensus.cc:3060] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:47.893554 17963 catalog_manager.cc:5697] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "6d8b172f07c347c097df022dcda9aab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:47.899037 18256 tablet_bootstrap.cc:654] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.899243 18263 raft_consensus.cc:515] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.903105 18140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9567be35d4cf463a86c8eb635ccae469" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9" is_pre_election: true
I20260709 13:21:47.903488 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6843c3778d8e4fd79ff4710ba3350432" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9" is_pre_election: true
I20260709 13:21:47.903991 18140 raft_consensus.cc:2468] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 0.
I20260709 13:21:47.905362 18139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cc92dba1843028a805534b79edea1" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9" is_pre_election: true
I20260709 13:21:47.906376 18139 raft_consensus.cc:2468] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 0.
I20260709 13:21:47.907846 18139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d157177661a4d5ea5876de22d306bd7" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
I20260709 13:21:47.911276 18181 leader_election.cc:304] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:47.912482 18181 leader_election.cc:304] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
W20260709 13:21:47.913139 18178 leader_election.cc:343] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:47.914028 18178 leader_election.cc:343] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.914834 18262 raft_consensus.cc:2804] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:21:47.915302 18178 leader_election.cc:343] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.915525 18262 raft_consensus.cc:493] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:47.916059 18262 raft_consensus.cc:3060] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:47.909843 18032 leader_election.cc:343] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.918906 18063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6843c3778d8e4fd79ff4710ba3350432" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c" is_pre_election: true
W20260709 13:21:47.920747 18104 leader_election.cc:343] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.931243 18263 leader_election.cc:290] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 election: Requested vote from peers 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:47.932446 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d157177661a4d5ea5876de22d306bd7" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
I20260709 13:21:47.933075 18215 raft_consensus.cc:3060] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:47.934298 18262 raft_consensus.cc:515] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.936589 18262 leader_election.cc:290] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:47.937142 18262 raft_consensus.cc:2804] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:47.939927 18255 tablet_bootstrap.cc:492] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679: No bootstrap required, opened a new log
I20260709 13:21:47.940521 18255 ts_tablet_manager.cc:1403] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.016s
I20260709 13:21:47.941295 18139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9567be35d4cf463a86c8eb635ccae469" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
I20260709 13:21:47.942031 18139 raft_consensus.cc:3060] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:47.942487 18262 raft_consensus.cc:493] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:47.942922 18262 raft_consensus.cc:3060] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:47.943061 18063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9567be35d4cf463a86c8eb635ccae469" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
I20260709 13:21:47.944237 18257 tablet_bootstrap.cc:492] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c: No bootstrap required, opened a new log
I20260709 13:21:47.944816 18257 ts_tablet_manager.cc:1403] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.117s	user 0.043s	sys 0.054s
I20260709 13:21:47.941112 18215 raft_consensus.cc:2468] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59282fcc26e74b65bb74d4e2b39f848c in term 1.
W20260709 13:21:47.946074 18178 leader_election.cc:343] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.946821 18255 raft_consensus.cc:359] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.947414 18030 leader_election.cc:304] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, c89811f1c6a043ec9fd6b4619b57f679; no voters: 6d8b172f07c347c097df022dcda9aab9
I20260709 13:21:47.948041 18255 raft_consensus.cc:385] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.948576 18255 raft_consensus.cc:740] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.948770 18263 raft_consensus.cc:2804] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:47.951222 18255 consensus_queue.cc:260] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.951843 18263 raft_consensus.cc:697] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 LEADER]: Becoming Leader. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Running, Role: LEADER
I20260709 13:21:47.953039 18257 raft_consensus.cc:359] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.955019 18257 raft_consensus.cc:385] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.954555 18263 consensus_queue.cc:237] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.955524 18257 raft_consensus.cc:740] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.955708 18288 raft_consensus.cc:515] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.957036 18257 consensus_queue.cc:260] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.957947 18262 raft_consensus.cc:515] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } } peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } }
I20260709 13:21:47.960389 18257 ts_tablet_manager.cc:1434] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:21:47.960089 18256 tablet_bootstrap.cc:492] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9: No bootstrap required, opened a new log
I20260709 13:21:47.961827 18256 ts_tablet_manager.cc:1403] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.005s
I20260709 13:21:47.961546 18257 tablet_bootstrap.cc:492] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:47.962766 18066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cc92dba1843028a805534b79edea1" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
W20260709 13:21:47.965672 18178 leader_election.cc:343] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.967319 18255 ts_tablet_manager.cc:1434] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 13:21:47.959753 18141 raft_consensus.cc:2393] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c89811f1c6a043ec9fd6b4619b57f679 in current term 1: Already voted for candidate 6d8b172f07c347c097df022dcda9aab9 in this term.
I20260709 13:21:47.969583 18255 tablet_bootstrap.cc:492] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679: Bootstrap starting.
I20260709 13:21:47.971892 18257 tablet_bootstrap.cc:654] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.972651 18181 leader_election.cc:304] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c89811f1c6a043ec9fd6b4619b57f679; no voters: 59282fcc26e74b65bb74d4e2b39f848c, 6d8b172f07c347c097df022dcda9aab9
I20260709 13:21:47.973819 18295 raft_consensus.cc:3060] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:47.980443 18255 tablet_bootstrap.cc:654] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:47.982673 17962 catalog_manager.cc:5697] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c reported cstate change: term changed from 0 to 1, leader changed from <none> to 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129). New cstate: current_term: 1 leader_uuid: "59282fcc26e74b65bb74d4e2b39f848c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:47.951922 18139 raft_consensus.cc:2468] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 1.
I20260709 13:21:47.960134 18063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6843c3778d8e4fd79ff4710ba3350432" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
I20260709 13:21:47.963627 18140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cc92dba1843028a805534b79edea1" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
I20260709 13:21:47.987551 18140 raft_consensus.cc:3060] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:47.990677 18295 raft_consensus.cc:2749] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:47.962131 18262 leader_election.cc:290] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:47.967145 18256 raft_consensus.cc:359] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.991746 18256 raft_consensus.cc:385] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:47.992063 18256 raft_consensus.cc:740] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Initialized, Role: FOLLOWER
I20260709 13:21:47.992815 18256 consensus_queue.cc:260] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:47.987589 18181 leader_election.cc:304] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 59282fcc26e74b65bb74d4e2b39f848c
I20260709 13:21:47.994972 18256 ts_tablet_manager.cc:1434] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:21:47.958499 18288 leader_election.cc:290] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:47.959718 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6843c3778d8e4fd79ff4710ba3350432" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
W20260709 13:21:47.995651 18104 leader_election.cc:343] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:47.997375 18295 raft_consensus.cc:2804] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:47.998894 18295 raft_consensus.cc:697] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 LEADER]: Becoming Leader. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Running, Role: LEADER
I20260709 13:21:47.999091 18140 raft_consensus.cc:2468] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 1.
I20260709 13:21:48.000357 18181 leader_election.cc:304] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 59282fcc26e74b65bb74d4e2b39f848c
I20260709 13:21:48.001322 18262 raft_consensus.cc:2804] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:48.000530 18295 consensus_queue.cc:237] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.004335 18256 tablet_bootstrap.cc:492] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9: Bootstrap starting.
I20260709 13:21:48.003159 18215 raft_consensus.cc:2468] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 1.
I20260709 13:21:48.005841 18105 leader_election.cc:304] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 59282fcc26e74b65bb74d4e2b39f848c
I20260709 13:21:48.006937 18288 raft_consensus.cc:2804] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:48.007463 18288 raft_consensus.cc:697] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:48.008318 18288 consensus_queue.cc:237] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.030131 18256 tablet_bootstrap.cc:654] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.048593 18262 raft_consensus.cc:697] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 LEADER]: Becoming Leader. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Running, Role: LEADER
I20260709 13:21:48.051251 18262 consensus_queue.cc:237] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } } peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } }
I20260709 13:21:48.059330 18255 tablet_bootstrap.cc:492] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679: No bootstrap required, opened a new log
I20260709 13:21:48.054641 17962 catalog_manager.cc:5697] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 reported cstate change: term changed from 0 to 1, leader changed from <none> to c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131). New cstate: current_term: 1 leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:48.060215 18255 ts_tablet_manager.cc:1403] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679: Time spent bootstrapping tablet: real 0.091s	user 0.023s	sys 0.027s
I20260709 13:21:48.060523 17960 catalog_manager.cc:5697] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "6d8b172f07c347c097df022dcda9aab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:48.066335 18257 tablet_bootstrap.cc:492] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c: No bootstrap required, opened a new log
I20260709 13:21:48.067301 18256 tablet_bootstrap.cc:492] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9: No bootstrap required, opened a new log
I20260709 13:21:48.067376 18257 ts_tablet_manager.cc:1403] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.106s	user 0.027s	sys 0.045s
I20260709 13:21:48.067952 18256 ts_tablet_manager.cc:1403] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.005s
I20260709 13:21:48.068486 18255 raft_consensus.cc:359] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.069744 18255 raft_consensus.cc:385] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.070207 18255 raft_consensus.cc:740] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.071110 18255 consensus_queue.cc:260] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.071532 18256 raft_consensus.cc:359] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.072309 18256 raft_consensus.cc:385] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.072114 18257 raft_consensus.cc:359] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } } peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } }
I20260709 13:21:48.072639 18256 raft_consensus.cc:740] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.072916 18257 raft_consensus.cc:385] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.073261 18257 raft_consensus.cc:740] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.073544 18255 ts_tablet_manager.cc:1434] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:21:48.073559 18256 consensus_queue.cc:260] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.074618 18255 tablet_bootstrap.cc:492] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679: Bootstrap starting.
I20260709 13:21:48.074170 18257 consensus_queue.cc:260] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } } peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } }
I20260709 13:21:48.076713 18256 ts_tablet_manager.cc:1434] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:21:48.077888 18257 ts_tablet_manager.cc:1434] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:21:48.078105 18256 tablet_bootstrap.cc:492] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9: Bootstrap starting.
I20260709 13:21:48.079077 18257 tablet_bootstrap.cc:492] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:48.083806 18255 tablet_bootstrap.cc:654] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.085304 18288 raft_consensus.cc:493] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.085901 18288 raft_consensus.cc:515] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.087034 18257 tablet_bootstrap.cc:654] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.089713 18288 leader_election.cc:290] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:48.089809 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49afc43f04b9442493ac4faf8684d0ed" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679" is_pre_election: true
I20260709 13:21:48.090260 18063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49afc43f04b9442493ac4faf8684d0ed" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c" is_pre_election: true
I20260709 13:21:48.090909 18063 raft_consensus.cc:2468] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 0.
W20260709 13:21:48.091547 18105 leader_election.cc:343] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:48.092201 18256 tablet_bootstrap.cc:654] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.092667 18104 leader_election.cc:304] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, 6d8b172f07c347c097df022dcda9aab9; no voters: c89811f1c6a043ec9fd6b4619b57f679
I20260709 13:21:48.094040 18288 raft_consensus.cc:2804] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:48.094460 18288 raft_consensus.cc:493] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:48.094830 18288 raft_consensus.cc:3060] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.104252 18288 raft_consensus.cc:515] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.107574 18063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49afc43f04b9442493ac4faf8684d0ed" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
I20260709 13:21:48.108369 18063 raft_consensus.cc:3060] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.115535 18261 raft_consensus.cc:493] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.116214 18261 raft_consensus.cc:515] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.118763 18261 leader_election.cc:290] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:48.120836 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03d770241db4724ad3a2da951a8043c" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679" is_pre_election: true
I20260709 13:21:48.121770 18215 raft_consensus.cc:2468] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 0.
I20260709 13:21:48.122649 18063 raft_consensus.cc:2468] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 1.
I20260709 13:21:48.123402 18105 leader_election.cc:304] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:48.125919 18104 leader_election.cc:304] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, 6d8b172f07c347c097df022dcda9aab9; no voters: 
I20260709 13:21:48.126438 18288 leader_election.cc:290] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:48.127682 18287 raft_consensus.cc:2804] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:48.127926 18288 raft_consensus.cc:2804] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:48.128093 18287 raft_consensus.cc:493] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:48.128499 18287 raft_consensus.cc:3060] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.129735 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49afc43f04b9442493ac4faf8684d0ed" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
W20260709 13:21:48.131160 18105 leader_election.cc:343] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:48.134788 17959 catalog_manager.cc:5697] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 reported cstate change: term changed from 0 to 1, leader changed from <none> to c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131). New cstate: current_term: 1 leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:48.137887 18063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03d770241db4724ad3a2da951a8043c" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c" is_pre_election: true
W20260709 13:21:48.139647 18104 leader_election.cc:343] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:48.143739 18287 raft_consensus.cc:515] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.147002 18257 tablet_bootstrap.cc:492] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c: No bootstrap required, opened a new log
I20260709 13:21:48.147619 18257 ts_tablet_manager.cc:1403] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.000s
I20260709 13:21:48.128477 18288 raft_consensus.cc:697] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:48.153926 18288 consensus_queue.cc:237] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.151959 18257 raft_consensus.cc:359] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.156075 18257 raft_consensus.cc:385] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.156440 18257 raft_consensus.cc:740] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.157218 18257 consensus_queue.cc:260] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.158582 18255 tablet_bootstrap.cc:492] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679: No bootstrap required, opened a new log
I20260709 13:21:48.159358 18255 ts_tablet_manager.cc:1403] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.060s
I20260709 13:21:48.160145 18256 tablet_bootstrap.cc:492] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9: No bootstrap required, opened a new log
I20260709 13:21:48.164778 18256 ts_tablet_manager.cc:1403] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9: Time spent bootstrapping tablet: real 0.087s	user 0.033s	sys 0.041s
I20260709 13:21:48.162833 18255 raft_consensus.cc:359] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.165320 18255 raft_consensus.cc:385] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.165745 18255 raft_consensus.cc:740] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.166452 18063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03d770241db4724ad3a2da951a8043c" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
I20260709 13:21:48.166601 18255 consensus_queue.cc:260] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.167508 18063 raft_consensus.cc:3060] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.167789 18256 raft_consensus.cc:359] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.168563 18256 raft_consensus.cc:385] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.168859 18256 raft_consensus.cc:740] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.169857 18255 ts_tablet_manager.cc:1434] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:21:48.169612 18256 consensus_queue.cc:260] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.171197 18255 tablet_bootstrap.cc:492] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679: Bootstrap starting.
I20260709 13:21:48.174431 18257 ts_tablet_manager.cc:1434] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:21:48.175806 18257 tablet_bootstrap.cc:492] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:48.176159 18263 consensus_queue.cc:1048] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:48.178269 18255 tablet_bootstrap.cc:654] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.183640 18256 ts_tablet_manager.cc:1434] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:21:48.185146 18257 tablet_bootstrap.cc:654] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.186931 18214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03d770241db4724ad3a2da951a8043c" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
I20260709 13:21:48.187610 18214 raft_consensus.cc:3060] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.191072 18255 tablet_bootstrap.cc:492] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679: No bootstrap required, opened a new log
I20260709 13:21:48.191915 18255 ts_tablet_manager.cc:1403] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 13:21:48.195858 18214 raft_consensus.cc:2468] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 1.
I20260709 13:21:48.196116 18255 raft_consensus.cc:359] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.197790 18255 raft_consensus.cc:385] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.197587 18105 leader_election.cc:304] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:48.198899 18261 raft_consensus.cc:2804] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:48.200008 18255 raft_consensus.cc:740] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.201054 18255 consensus_queue.cc:260] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.209046 18255 ts_tablet_manager.cc:1434] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:21:48.210275 18261 raft_consensus.cc:697] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Becoming Leader. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:48.211194 18261 consensus_queue.cc:237] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.214563 18255 tablet_bootstrap.cc:492] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679: Bootstrap starting.
I20260709 13:21:48.217715 18275 raft_consensus.cc:493] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.218565 18275 raft_consensus.cc:515] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.219679 18257 tablet_bootstrap.cc:492] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c: No bootstrap required, opened a new log
I20260709 13:21:48.220309 18257 ts_tablet_manager.cc:1403] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.005s
I20260709 13:21:48.220948 18255 tablet_bootstrap.cc:654] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.223050 18140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f43efc325c40b8a1a5ec72c30ad467" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9" is_pre_election: true
I20260709 13:21:48.223999 18140 raft_consensus.cc:2468] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59282fcc26e74b65bb74d4e2b39f848c in term 0.
I20260709 13:21:48.223481 18257 raft_consensus.cc:359] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.224920 18257 raft_consensus.cc:385] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.225816 18257 raft_consensus.cc:740] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.225914 18275 leader_election.cc:290] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:48.227332 18032 leader_election.cc:304] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, 6d8b172f07c347c097df022dcda9aab9; no voters: 
I20260709 13:21:48.228768 18275 raft_consensus.cc:2804] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:48.228951 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f43efc325c40b8a1a5ec72c30ad467" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679" is_pre_election: true
I20260709 13:21:48.229398 18275 raft_consensus.cc:493] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:48.230171 18275 raft_consensus.cc:3060] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:48.232407 18030 leader_election.cc:343] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:48.235636 18287 leader_election.cc:290] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 1 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:48.232859 18257 consensus_queue.cc:260] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.252554 18255 tablet_bootstrap.cc:492] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679: No bootstrap required, opened a new log
I20260709 13:21:48.253338 18255 ts_tablet_manager.cc:1403] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.021s
I20260709 13:21:48.257684 18255 raft_consensus.cc:359] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.258684 18255 raft_consensus.cc:385] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.259043 18255 raft_consensus.cc:740] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.249936 18275 raft_consensus.cc:515] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.266371 18139 raft_consensus.cc:3060] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.264544 18140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f43efc325c40b8a1a5ec72c30ad467" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
I20260709 13:21:48.260062 18255 consensus_queue.cc:260] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.267532 18140 raft_consensus.cc:3060] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.267668 18257 ts_tablet_manager.cc:1434] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.047s	user 0.018s	sys 0.010s
I20260709 13:21:48.269040 18257 tablet_bootstrap.cc:492] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:48.269716 18255 ts_tablet_manager.cc:1434] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:21:48.263384 18275 leader_election.cc:290] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 election: Requested vote from peers 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:48.259624 18063 raft_consensus.cc:2468] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 1.
I20260709 13:21:48.275143 18300 raft_consensus.cc:493] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.275743 18300 raft_consensus.cc:515] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.278185 18300 leader_election.cc:290] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:48.280098 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9" is_pre_election: true
I20260709 13:21:48.280881 18063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c" is_pre_election: true
I20260709 13:21:48.281812 18063 raft_consensus.cc:2393] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c89811f1c6a043ec9fd6b4619b57f679 in current term 1: Already voted for candidate 6d8b172f07c347c097df022dcda9aab9 in this term.
I20260709 13:21:48.284142 18257 tablet_bootstrap.cc:654] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:48.285771 18181 leader_election.cc:304] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c89811f1c6a043ec9fd6b4619b57f679; no voters: 59282fcc26e74b65bb74d4e2b39f848c, 6d8b172f07c347c097df022dcda9aab9
I20260709 13:21:48.287485 18300 raft_consensus.cc:3060] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.265142 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f43efc325c40b8a1a5ec72c30ad467" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
I20260709 13:21:48.291884 18318 raft_consensus.cc:493] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.292274 18140 raft_consensus.cc:2468] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59282fcc26e74b65bb74d4e2b39f848c in term 1.
I20260709 13:21:48.292503 18318 raft_consensus.cc:515] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.296406 18215 raft_consensus.cc:3060] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.296516 18275 raft_consensus.cc:493] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.302397 18275 raft_consensus.cc:515] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } } peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } }
I20260709 13:21:48.304059 18032 leader_election.cc:304] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, 6d8b172f07c347c097df022dcda9aab9; no voters: 
I20260709 13:21:48.306034 18275 leader_election.cc:290] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:48.301359 18318 leader_election.cc:290] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:48.306279 17963 catalog_manager.cc:5697] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "6d8b172f07c347c097df022dcda9aab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:48.309515 18214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296d87ca32624ba7a553284774cde523" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679" is_pre_election: true
I20260709 13:21:48.311896 18213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cc92dba1843028a805534b79edea1" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679" is_pre_election: true
I20260709 13:21:48.312551 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce1cc92dba1843028a805534b79edea1" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9" is_pre_election: true
I20260709 13:21:48.312772 18214 raft_consensus.cc:2468] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59282fcc26e74b65bb74d4e2b39f848c in term 0.
I20260709 13:21:48.313390 18141 raft_consensus.cc:2393] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59282fcc26e74b65bb74d4e2b39f848c in current term 1: Already voted for candidate c89811f1c6a043ec9fd6b4619b57f679 in this term.
I20260709 13:21:48.314805 18030 leader_election.cc:304] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:48.309643 18263 consensus_queue.cc:1048] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:21:48.311709 18140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296d87ca32624ba7a553284774cde523" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9" is_pre_election: true
I20260709 13:21:48.316431 18140 raft_consensus.cc:2468] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59282fcc26e74b65bb74d4e2b39f848c in term 0.
I20260709 13:21:48.317070 18263 raft_consensus.cc:2804] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:48.317629 18263 raft_consensus.cc:697] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 LEADER]: Becoming Leader. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Running, Role: LEADER
I20260709 13:21:48.318456 18263 consensus_queue.cc:237] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.325519 18263 raft_consensus.cc:493] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.326802 18263 raft_consensus.cc:515] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.331127 18139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9567be35d4cf463a86c8eb635ccae469" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9" is_pre_election: true
I20260709 13:21:48.332031 18139 raft_consensus.cc:2393] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59282fcc26e74b65bb74d4e2b39f848c in current term 1: Already voted for candidate c89811f1c6a043ec9fd6b4619b57f679 in this term.
I20260709 13:21:48.332690 18215 raft_consensus.cc:2468] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59282fcc26e74b65bb74d4e2b39f848c in term 1.
I20260709 13:21:48.333667 18275 raft_consensus.cc:2804] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:48.334482 18275 raft_consensus.cc:493] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:48.335299 18275 raft_consensus.cc:3060] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.346562 18139 raft_consensus.cc:3060] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.309413 18300 raft_consensus.cc:2749] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:48.338318 18263 leader_election.cc:290] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:48.357750 18275 raft_consensus.cc:515] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.368045 18257 tablet_bootstrap.cc:492] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c: No bootstrap required, opened a new log
I20260709 13:21:48.368217 18275 leader_election.cc:290] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 election: Requested vote from peers 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
W20260709 13:21:48.364084 18030 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.131:33749, user_credentials={real_user=slave}} blocked reactor thread for 49404.6us
I20260709 13:21:48.365358 18288 consensus_queue.cc:1048] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:48.368711 18257 ts_tablet_manager.cc:1403] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.100s	user 0.042s	sys 0.029s
I20260709 13:21:48.369879 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296d87ca32624ba7a553284774cde523" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
I20260709 13:21:48.370241 18030 leader_election.cc:304] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c; no voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679
I20260709 13:21:48.370564 18141 raft_consensus.cc:3060] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.372669 18257 raft_consensus.cc:359] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.373376 18257 raft_consensus.cc:385] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:48.373603 18213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9567be35d4cf463a86c8eb635ccae469" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679" is_pre_election: true
I20260709 13:21:48.373602 18215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296d87ca32624ba7a553284774cde523" candidate_uuid: "59282fcc26e74b65bb74d4e2b39f848c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
I20260709 13:21:48.373715 18275 raft_consensus.cc:3060] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.373677 18257 raft_consensus.cc:740] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:48.376447 18215 raft_consensus.cc:3060] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.377215 18257 consensus_queue.cc:260] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.379830 18257 ts_tablet_manager.cc:1434] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:21:48.384860 18141 raft_consensus.cc:2468] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59282fcc26e74b65bb74d4e2b39f848c in term 1.
I20260709 13:21:48.385535 18275 raft_consensus.cc:2749] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:48.386922 18263 consensus_queue.cc:1048] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:48.384860 18215 raft_consensus.cc:2468] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59282fcc26e74b65bb74d4e2b39f848c in term 1.
I20260709 13:21:48.388775 18032 leader_election.cc:304] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, 6d8b172f07c347c097df022dcda9aab9; no voters: 
I20260709 13:21:48.388260 17959 catalog_manager.cc:5697] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "6d8b172f07c347c097df022dcda9aab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:48.389739 18263 raft_consensus.cc:2804] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:48.387724 17961 catalog_manager.cc:5697] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c reported cstate change: term changed from 0 to 1, leader changed from <none> to 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129). New cstate: current_term: 1 leader_uuid: "59282fcc26e74b65bb74d4e2b39f848c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:48.392473 18288 consensus_queue.cc:1048] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:21:48.397176 18263 raft_consensus.cc:697] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 LEADER]: Becoming Leader. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Running, Role: LEADER
I20260709 13:21:48.398152 18263 consensus_queue.cc:237] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.391319 18030 leader_election.cc:304] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c; no voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679
I20260709 13:21:48.399420 18275 raft_consensus.cc:3060] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.408704 18275 raft_consensus.cc:2749] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:48.421250 18300 consensus_queue.cc:1048] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:48.436548 18063 raft_consensus.cc:3060] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.443358 18321 consensus_queue.cc:1048] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:48.448387 18300 consensus_queue.cc:1048] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:48.451293 17961 catalog_manager.cc:5697] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c reported cstate change: term changed from 0 to 1, leader changed from <none> to 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129). New cstate: current_term: 1 leader_uuid: "59282fcc26e74b65bb74d4e2b39f848c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:48.459609 18287 consensus_queue.cc:1048] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:48.483155 18312 consensus_queue.cc:1048] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:48.484649 18300 consensus_queue.cc:1048] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:48.503487 18295 raft_consensus.cc:493] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:48.504187 18295 raft_consensus.cc:515] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:48.507043 18295 leader_election.cc:290] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:48.508826 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49afc43f04b9442493ac4faf8684d0ed" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9" is_pre_election: true
I20260709 13:21:48.508670 18295 consensus_queue.cc:1048] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:48.511032 18063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49afc43f04b9442493ac4faf8684d0ed" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c" is_pre_election: true
I20260709 13:21:48.512234 18063 raft_consensus.cc:2393] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c89811f1c6a043ec9fd6b4619b57f679 in current term 1: Already voted for candidate 6d8b172f07c347c097df022dcda9aab9 in this term.
I20260709 13:21:48.513316 18178 leader_election.cc:304] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c89811f1c6a043ec9fd6b4619b57f679; no voters: 59282fcc26e74b65bb74d4e2b39f848c, 6d8b172f07c347c097df022dcda9aab9
I20260709 13:21:48.514835 18295 raft_consensus.cc:3060] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:48.522105 18295 raft_consensus.cc:2749] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:48.638260  7002 ts_manager.cc:295] Set tserver state for 59282fcc26e74b65bb74d4e2b39f848c to MAINTENANCE_MODE
I20260709 13:21:48.639130  7002 tablet_server.cc:179] TabletServer@127.6.214.129:0 shutting down...
I20260709 13:21:48.661661  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:48.662580  7002 tablet_replica.cc:333] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c: stopping tablet replica
I20260709 13:21:48.663429  7002 raft_consensus.cc:2243] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:48.663914  7002 raft_consensus.cc:2272] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:48.666608  7002 tablet_replica.cc:333] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c: stopping tablet replica
I20260709 13:21:48.667290  7002 raft_consensus.cc:2243] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:48.667739  7002 raft_consensus.cc:2272] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:48.670034  7002 tablet_replica.cc:333] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c: stopping tablet replica
I20260709 13:21:48.671013  7002 raft_consensus.cc:2243] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:48.671687  7002 raft_consensus.cc:2272] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:48.673913  7002 tablet_replica.cc:333] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c: stopping tablet replica
I20260709 13:21:48.674490  7002 raft_consensus.cc:2243] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:48.675135  7002 pending_rounds.cc:70] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c: Trying to abort 1 pending ops.
I20260709 13:21:48.675343  7002 pending_rounds.cc:77] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305639150881669120 op_type: NO_OP noop_request { }
I20260709 13:21:48.675664  7002 raft_consensus.cc:2889] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:48.675971  7002 raft_consensus.cc:2272] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:48.678117  7002 tablet_replica.cc:333] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c: stopping tablet replica
I20260709 13:21:48.678654  7002 raft_consensus.cc:2243] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:48.679064  7002 raft_consensus.cc:2272] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:48.680805  7002 tablet_replica.cc:333] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c: stopping tablet replica
I20260709 13:21:48.681268  7002 raft_consensus.cc:2243] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:48.681661  7002 raft_consensus.cc:2272] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:48.683219  7002 tablet_replica.cc:333] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c: stopping tablet replica
I20260709 13:21:48.683687  7002 raft_consensus.cc:2243] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:48.684206  7002 pending_rounds.cc:70] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c: Trying to abort 1 pending ops.
I20260709 13:21:48.684361  7002 pending_rounds.cc:77] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305639151209218048 op_type: NO_OP noop_request { }
I20260709 13:21:48.684582  7002 raft_consensus.cc:2889] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:48.684943  7002 raft_consensus.cc:2272] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:48.687345 18104 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 236 similar messages]
I20260709 13:21:48.687775  7002 tablet_replica.cc:333] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c: stopping tablet replica
I20260709 13:21:48.688373  7002 raft_consensus.cc:2243] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:48.688818  7002 raft_consensus.cc:2272] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:48.690676 18104 consensus_peers.cc:597] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:48.691066  7002 tablet_replica.cc:333] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c: stopping tablet replica
I20260709 13:21:48.691665  7002 raft_consensus.cc:2243] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:48.692430  7002 raft_consensus.cc:2272] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:48.694644  7002 tablet_replica.cc:333] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c: stopping tablet replica
I20260709 13:21:48.695158  7002 raft_consensus.cc:2243] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:48.695938  7002 raft_consensus.cc:2272] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:48.727748  7002 tablet_server.cc:196] TabletServer@127.6.214.129:0 shutdown complete.
W20260709 13:21:48.733345 18104 consensus_peers.cc:597] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:48.737643 18312 consensus_queue.cc:1048] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:48.764531 18288 consensus_queue.cc:1048] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:48.861418 18178 consensus_peers.cc:597] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:48.863566 18104 consensus_peers.cc:597] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:48.921182 18178 consensus_peers.cc:597] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:49.023159 18104 consensus_peers.cc:597] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:49.582530 18011 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:49.706601 18295 raft_consensus.cc:493] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59282fcc26e74b65bb74d4e2b39f848c)
I20260709 13:21:49.707156 18295 raft_consensus.cc:515] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:49.708807 18295 leader_election.cc:290] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:49.709939 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e545f828c54d88a93b453b009bcd03" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9" is_pre_election: true
W20260709 13:21:49.712430 18178 leader_election.cc:336] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111)
I20260709 13:21:49.712842 18178 leader_election.cc:304] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c89811f1c6a043ec9fd6b4619b57f679; no voters: 59282fcc26e74b65bb74d4e2b39f848c, 6d8b172f07c347c097df022dcda9aab9
I20260709 13:21:49.713560 18295 raft_consensus.cc:2749] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:49.828549 18261 raft_consensus.cc:493] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59282fcc26e74b65bb74d4e2b39f848c)
I20260709 13:21:49.829101 18261 raft_consensus.cc:515] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:49.831108 18261 leader_election.cc:290] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:49.832429 18213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e545f828c54d88a93b453b009bcd03" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679" is_pre_election: true
I20260709 13:21:49.833099 18213 raft_consensus.cc:2468] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 1.
I20260709 13:21:49.834318 18105 leader_election.cc:304] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:49.835040 18261 raft_consensus.cc:2804] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:21:49.835117 18104 leader_election.cc:336] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111)
I20260709 13:21:49.835436 18261 raft_consensus.cc:493] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59282fcc26e74b65bb74d4e2b39f848c)
I20260709 13:21:49.835840 18261 raft_consensus.cc:3060] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:49.841068 18261 raft_consensus.cc:515] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:49.842921 18261 leader_election.cc:290] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:49.844164 18213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e545f828c54d88a93b453b009bcd03" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
I20260709 13:21:49.844992 18213 raft_consensus.cc:3060] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:49.847222 18104 leader_election.cc:336] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111)
I20260709 13:21:49.851161 18213 raft_consensus.cc:2468] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 2.
I20260709 13:21:49.852375 18105 leader_election.cc:304] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 59282fcc26e74b65bb74d4e2b39f848c
I20260709 13:21:49.853197 18261 raft_consensus.cc:2804] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:49.853521 18312 raft_consensus.cc:493] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:49.853740 18261 raft_consensus.cc:697] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [term 2 LEADER]: Becoming Leader. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:49.854115 18312 raft_consensus.cc:515] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:49.854763 18261 consensus_queue.cc:237] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:49.855906 18312 leader_election.cc:290] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:49.856978 18213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f43efc325c40b8a1a5ec72c30ad467" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679" is_pre_election: true
I20260709 13:21:49.857667 18213 raft_consensus.cc:2468] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 1.
I20260709 13:21:49.858973 18105 leader_election.cc:304] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:49.860158 18312 raft_consensus.cc:2804] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:49.860530 18312 raft_consensus.cc:493] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:49.860867 18104 leader_election.cc:336] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111)
I20260709 13:21:49.860880 18312 raft_consensus.cc:3060] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:49.863992 17959 catalog_manager.cc:5697] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 reported cstate change: term changed from 1 to 2, leader changed from 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129) to 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "6d8b172f07c347c097df022dcda9aab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.870373 18312 raft_consensus.cc:515] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:49.872644 18312 leader_election.cc:290] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:49.873960 18213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f43efc325c40b8a1a5ec72c30ad467" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
I20260709 13:21:49.874545 18213 raft_consensus.cc:3060] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:49.878158 18104 leader_election.cc:336] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111)
I20260709 13:21:49.880735 18213 raft_consensus.cc:2468] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 2.
I20260709 13:21:49.882011 18105 leader_election.cc:304] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 59282fcc26e74b65bb74d4e2b39f848c
I20260709 13:21:49.882853 18312 raft_consensus.cc:2804] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:49.883347 18312 raft_consensus.cc:697] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 2 LEADER]: Becoming Leader. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:49.884080 18312 consensus_queue.cc:237] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:49.891790 17959 catalog_manager.cc:5697] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 reported cstate change: term changed from 1 to 2, leader changed from 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129) to 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "6d8b172f07c347c097df022dcda9aab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.939567 18312 raft_consensus.cc:493] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59282fcc26e74b65bb74d4e2b39f848c)
I20260709 13:21:49.940155 18312 raft_consensus.cc:515] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:49.942507 18312 leader_election.cc:290] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:49.943897 18213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d157177661a4d5ea5876de22d306bd7" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679" is_pre_election: true
W20260709 13:21:49.945999 18104 leader_election.cc:336] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111)
I20260709 13:21:49.946363 18104 leader_election.cc:304] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9; no voters: 59282fcc26e74b65bb74d4e2b39f848c, c89811f1c6a043ec9fd6b4619b57f679
I20260709 13:21:49.946926 18312 raft_consensus.cc:2749] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:49.952766 18295 raft_consensus.cc:493] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59282fcc26e74b65bb74d4e2b39f848c)
I20260709 13:21:49.953372 18295 raft_consensus.cc:515] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:49.955402 18295 leader_election.cc:290] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:49.956655 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d157177661a4d5ea5876de22d306bd7" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9" is_pre_election: true
I20260709 13:21:49.957489 18141 raft_consensus.cc:2468] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 1.
I20260709 13:21:49.958591 18181 leader_election.cc:304] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
W20260709 13:21:49.959265 18178 leader_election.cc:336] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111)
I20260709 13:21:49.959394 18295 raft_consensus.cc:2804] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:49.959847 18295 raft_consensus.cc:493] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59282fcc26e74b65bb74d4e2b39f848c)
I20260709 13:21:49.960215 18295 raft_consensus.cc:3060] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:49.965611 18295 raft_consensus.cc:515] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:49.967396 18295 leader_election.cc:290] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:49.968649 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d157177661a4d5ea5876de22d306bd7" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
I20260709 13:21:49.969368 18141 raft_consensus.cc:3060] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:49.971717 18178 leader_election.cc:336] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111)
I20260709 13:21:49.975684 18141 raft_consensus.cc:2468] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 2.
I20260709 13:21:49.976969 18181 leader_election.cc:304] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 59282fcc26e74b65bb74d4e2b39f848c
I20260709 13:21:49.977809 18295 raft_consensus.cc:2804] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:49.978699 18295 raft_consensus.cc:697] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Becoming Leader. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Running, Role: LEADER
I20260709 13:21:49.979601 18295 consensus_queue.cc:237] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:49.987320 17959 catalog_manager.cc:5697] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 reported cstate change: term changed from 1 to 2, leader changed from 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129) to c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:50.012820 18349 raft_consensus.cc:493] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:50.013304 18349 raft_consensus.cc:515] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:50.014995 18349 leader_election.cc:290] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:50.016055 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296d87ca32624ba7a553284774cde523" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9" is_pre_election: true
I20260709 13:21:50.016654 18141 raft_consensus.cc:2468] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 1.
I20260709 13:21:50.018062 18181 leader_election.cc:304] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:50.018784 18349 raft_consensus.cc:2804] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:21:50.019084 18178 leader_election.cc:336] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111)
I20260709 13:21:50.019109 18349 raft_consensus.cc:493] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:50.019865 18349 raft_consensus.cc:3060] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.025792 18349 raft_consensus.cc:515] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:50.027413 18349 leader_election.cc:290] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:50.028475 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "296d87ca32624ba7a553284774cde523" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
I20260709 13:21:50.029035 18141 raft_consensus.cc:3060] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:50.030902 18178 leader_election.cc:336] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111)
I20260709 13:21:50.034340 18141 raft_consensus.cc:2468] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 2.
I20260709 13:21:50.035537 18181 leader_election.cc:304] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 59282fcc26e74b65bb74d4e2b39f848c
I20260709 13:21:50.036311 18349 raft_consensus.cc:2804] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:50.036880 18349 raft_consensus.cc:697] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Becoming Leader. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Running, Role: LEADER
I20260709 13:21:50.037739 18349 consensus_queue.cc:237] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:50.045997 17959 catalog_manager.cc:5697] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 reported cstate change: term changed from 1 to 2, leader changed from 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129) to c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:50.305935 18104 consensus_peers.cc:597] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.334009 18213 raft_consensus.cc:1275] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Refusing update from remote peer 6d8b172f07c347c097df022dcda9aab9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:50.335459 18312 consensus_queue.cc:1048] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:50.342192 18215 raft_consensus.cc:1275] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Refusing update from remote peer 6d8b172f07c347c097df022dcda9aab9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:50.343747 18287 consensus_queue.cc:1048] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:50.361821 18104 consensus_peers.cc:597] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.376220 18178 consensus_peers.cc:597] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.454545 18141 raft_consensus.cc:1275] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Refusing update from remote peer c89811f1c6a043ec9fd6b4619b57f679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:50.455734 18349 consensus_queue.cc:1048] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:50.516140 18178 consensus_peers.cc:597] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.518436 18141 raft_consensus.cc:1275] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Refusing update from remote peer c89811f1c6a043ec9fd6b4619b57f679: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:50.520008 18357 consensus_queue.cc:1048] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:50.583606 18011 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:50.897608 18104 consensus_peers.cc:597] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:50.966166 18104 consensus_peers.cc:597] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:51.204918 18104 consensus_peers.cc:597] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:51.290479 18178 consensus_peers.cc:597] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:51.433849 18178 consensus_peers.cc:597] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:51.532290 18104 consensus_peers.cc:597] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:51.584546 18011 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:52.585878 18011 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:52.598980 18104 consensus_peers.cc:597] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:52.697995 18104 consensus_peers.cc:597] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:52.868925 18178 consensus_peers.cc:597] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:52.998643 18178 consensus_peers.cc:597] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:53.497686 18104 consensus_peers.cc:597] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:53.586880 18011 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:53.643177 18104 consensus_peers.cc:597] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:53.654969 18104 consensus_peers.cc:597] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:53.750857  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:53.757329 18362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:53.758273 18363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:53.761104 18365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:53.765236  7002 server_base.cc:1061] running on GCE node
I20260709 13:21:53.767824  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:53.768047  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:53.768203  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603313768183 us; error 0 us; skew 500 ppm
I20260709 13:21:53.768682  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:53.771263  7002 webserver.cc:533] Webserver started at http://127.6.214.129:39113/ using document root <none> and password file <none>
I20260709 13:21:53.771757  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:53.771909  7002 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:21:53.775740  7002 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:21:53.779600 18370 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:53.780455  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:53.780926  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-0-root
uuid: "59282fcc26e74b65bb74d4e2b39f848c"
format_stamp: "Formatted at 2026-07-09 13:21:46 on dist-test-slave-rnv4"
I20260709 13:21:53.781260  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602923898527-7002-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:53.797976  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:53.799027  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:53.800454  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:53.803973 18377 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:21:53.855026  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:21:53.855365  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.052s	user 0.002s	sys 0.000s
I20260709 13:21:53.855835  7002 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
W20260709 13:21:53.860018 18178 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111) [suppressed 101 similar messages]
I20260709 13:21:53.862393 18377 tablet_bootstrap.cc:492] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:53.877241 18377 tablet_bootstrap.cc:492] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:53.878160 18377 tablet_bootstrap.cc:492] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap complete.
I20260709 13:21:53.879007 18377 ts_tablet_manager.cc:1403] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:21:53.881063 18377 raft_consensus.cc:359] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:53.881678 18377 raft_consensus.cc:740] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.882408 18377 consensus_queue.cc:260] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:53.884819 18377 ts_tablet_manager.cc:1434] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:21:53.885684 18377 tablet_bootstrap.cc:492] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:53.900172 18377 tablet_bootstrap.cc:492] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:53.901031 18377 tablet_bootstrap.cc:492] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap complete.
I20260709 13:21:53.901705 18377 ts_tablet_manager.cc:1403] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.016s	user 0.003s	sys 0.012s
I20260709 13:21:53.903661 18377 raft_consensus.cc:359] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:53.903971  7002 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:21:53.904172 18377 raft_consensus.cc:740] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.904590  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.049s	user 0.046s	sys 0.000s
I20260709 13:21:53.905162 18377 consensus_queue.cc:260] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:53.907009 18377 ts_tablet_manager.cc:1434] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:53.907706 18377 tablet_bootstrap.cc:492] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:53.921113 18377 tablet_bootstrap.cc:492] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:21:53.922379 18377 tablet_bootstrap.cc:492] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap complete.
I20260709 13:21:53.923113 18377 ts_tablet_manager.cc:1403] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:21:53.925809 18377 raft_consensus.cc:359] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:53.926714 18377 raft_consensus.cc:740] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.928412 18377 consensus_queue.cc:260] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:53.930893 18377 ts_tablet_manager.cc:1434] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:53.931526 18377 tablet_bootstrap.cc:492] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
W20260709 13:21:53.942747 18178 consensus_peers.cc:597] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:53.947070 18377 tablet_bootstrap.cc:492] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:21:53.947908 18377 tablet_bootstrap.cc:492] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap complete.
I20260709 13:21:53.948560 18377 ts_tablet_manager.cc:1403] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.005s
I20260709 13:21:53.951120 18377 raft_consensus.cc:359] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:53.951817 18377 raft_consensus.cc:740] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.952466 18377 consensus_queue.cc:260] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:53.954131 18377 ts_tablet_manager.cc:1434] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:21:53.954764 18377 tablet_bootstrap.cc:492] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:53.965970 18377 tablet_bootstrap.cc:492] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:53.966766 18377 tablet_bootstrap.cc:492] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap complete.
I20260709 13:21:53.967335 18377 ts_tablet_manager.cc:1403] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:21:53.969487 18377 raft_consensus.cc:359] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } } peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } }
I20260709 13:21:53.970158 18377 raft_consensus.cc:740] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:53.971304 18377 consensus_queue.cc:260] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } } peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } }
I20260709 13:21:53.974114 18377 ts_tablet_manager.cc:1434] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:53.974802 18377 tablet_bootstrap.cc:492] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:53.977794  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.129:35019
I20260709 13:21:53.977917 18439 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.129:35019 every 8 connection(s)
I20260709 13:21:53.982905  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:53.996626 18377 tablet_bootstrap.cc:492] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:53.997812 18377 tablet_bootstrap.cc:492] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap complete.
I20260709 13:21:53.998555 18377 ts_tablet_manager.cc:1403] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.000s
I20260709 13:21:54.002063 18377 raft_consensus.cc:359] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.002985 18377 raft_consensus.cc:740] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.003921 18377 consensus_queue.cc:260] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.006594 18377 ts_tablet_manager.cc:1434] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:54.007536 18377 tablet_bootstrap.cc:492] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:54.014331 18440 heartbeater.cc:344] Connected to a master server at 127.6.214.190:45705
I20260709 13:21:54.014853 18440 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:54.015856 18440 heartbeater.cc:507] Master 127.6.214.190:45705 requested a full tablet report, sending...
I20260709 13:21:54.023690 17959 ts_manager.cc:194] Re-registered known tserver with Master: 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019)
I20260709 13:21:54.031174 18377 tablet_bootstrap.cc:492] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:54.032666 18377 tablet_bootstrap.cc:492] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap complete.
I20260709 13:21:54.033583 18377 ts_tablet_manager.cc:1403] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.003s
I20260709 13:21:54.034375 18413 raft_consensus.cc:3060] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:54.037029 18377 raft_consensus.cc:359] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.038012 18377 raft_consensus.cc:740] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
W20260709 13:21:54.038275 18178 consensus_peers.cc:597] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:54.039153 18377 consensus_queue.cc:260] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.040252 17959 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47660
I20260709 13:21:54.041872 18377 ts_tablet_manager.cc:1434] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:54.042577 18141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6843c3778d8e4fd79ff4710ba3350432"
dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
mode: GRACEFUL
new_leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
 from {username='slave'} at 127.0.0.1:36510
I20260709 13:21:54.043459 18141 raft_consensus.cc:606] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Received request to transfer leadership to TS c89811f1c6a043ec9fd6b4619b57f679
I20260709 13:21:54.044420 18440 heartbeater.cc:499] Master 127.6.214.190:45705 was elected leader, sending a full tablet report...
I20260709 13:21:54.046778 18377 tablet_bootstrap.cc:492] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:54.047642 18141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40"
dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
mode: GRACEFUL
new_leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
 from {username='slave'} at 127.0.0.1:36510
I20260709 13:21:54.048266 18412 raft_consensus.cc:3060] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:54.048393 18141 raft_consensus.cc:606] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Received request to transfer leadership to TS c89811f1c6a043ec9fd6b4619b57f679
I20260709 13:21:54.050307 18413 pending_rounds.cc:85] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c: Aborting all ops after (but not including) 0
I20260709 13:21:54.051016  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:21:54.052033  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:54.052917  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:54.053159 18413 pending_rounds.cc:107] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:21:54.053681 18413 raft_consensus.cc:2889] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:54.071619 18377 tablet_bootstrap.cc:492] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:54.072697 18377 tablet_bootstrap.cc:492] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap complete.
I20260709 13:21:54.073513 18377 ts_tablet_manager.cc:1403] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.027s	user 0.023s	sys 0.000s
I20260709 13:21:54.075894 18377 raft_consensus.cc:359] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.076634 18377 raft_consensus.cc:740] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.077347 18377 consensus_queue.cc:260] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.079457 18377 ts_tablet_manager.cc:1434] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:54.080132 18377 tablet_bootstrap.cc:492] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:54.093266 18377 tablet_bootstrap.cc:492] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:54.094184 18377 tablet_bootstrap.cc:492] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap complete.
I20260709 13:21:54.094951 18377 ts_tablet_manager.cc:1403] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:21:54.095146 18261 raft_consensus.cc:993] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9: : Instructing follower c89811f1c6a043ec9fd6b4619b57f679 to start an election
I20260709 13:21:54.095757 18450 raft_consensus.cc:1081] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Signalling peer c89811f1c6a043ec9fd6b4619b57f679 to start an election
I20260709 13:21:54.097409 18213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40"
dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
 from {username='slave'} at 127.0.0.1:41812
I20260709 13:21:54.098107 18213 raft_consensus.cc:493] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:54.097712 18377 raft_consensus.cc:359] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.098497 18213 raft_consensus.cc:3060] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:54.098615 18377 raft_consensus.cc:740] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.099661 18377 consensus_queue.cc:260] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.101686 18377 ts_tablet_manager.cc:1434] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:21:54.102486 18377 tablet_bootstrap.cc:492] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap starting.
I20260709 13:21:54.105068 18213 raft_consensus.cc:515] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.108824 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
I20260709 13:21:54.108867 18213 leader_election.cc:290] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:54.109109 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
I20260709 13:21:54.109578 18412 raft_consensus.cc:3060] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:54.109853 18141 raft_consensus.cc:3055] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:54.110280 18141 raft_consensus.cc:740] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:54.111150 18141 consensus_queue.cc:260] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.112162 18141 raft_consensus.cc:3060] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:54.116088 18377 tablet_bootstrap.cc:492] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:54.117077 18377 tablet_bootstrap.cc:492] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c: Bootstrap complete.
I20260709 13:21:54.117830 18377 ts_tablet_manager.cc:1403] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:21:54.119529 18141 raft_consensus.cc:2468] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 2.
I20260709 13:21:54.120757 18377 raft_consensus.cc:359] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.121389 18261 raft_consensus.cc:993] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9: : Instructing follower c89811f1c6a043ec9fd6b4619b57f679 to start an election
I20260709 13:21:54.121616 18377 raft_consensus.cc:740] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59282fcc26e74b65bb74d4e2b39f848c, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.121748 18181 leader_election.cc:304] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d8b172f07c347c097df022dcda9aab9, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:54.122038 18261 raft_consensus.cc:1081] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Signalling peer c89811f1c6a043ec9fd6b4619b57f679 to start an election
I20260709 13:21:54.122496 18377 consensus_queue.cc:260] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.122848 18360 raft_consensus.cc:2804] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:54.124094 18360 raft_consensus.cc:697] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Becoming Leader. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Running, Role: LEADER
I20260709 13:21:54.124877 18377 ts_tablet_manager.cc:1434] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:21:54.125002 18360 consensus_queue.cc:237] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.125751 18412 raft_consensus.cc:2468] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 2.
I20260709 13:21:54.129204 18213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6843c3778d8e4fd79ff4710ba3350432"
dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
 from {username='slave'} at 127.0.0.1:41812
I20260709 13:21:54.129880 18213 raft_consensus.cc:493] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:54.130296 18213 raft_consensus.cc:3060] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:54.137573 18213 raft_consensus.cc:515] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.137073 17959 catalog_manager.cc:5697] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 reported cstate change: term changed from 1 to 2, leader changed from 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130) to c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:54.139361 18213 leader_election.cc:290] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:54.140506 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6843c3778d8e4fd79ff4710ba3350432" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
I20260709 13:21:54.140513 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6843c3778d8e4fd79ff4710ba3350432" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
I20260709 13:21:54.141254 18141 raft_consensus.cc:3055] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:54.141667 18412 raft_consensus.cc:3060] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:54.141737 18141 raft_consensus.cc:740] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:54.142865 18141 consensus_queue.cc:260] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.144162 18141 raft_consensus.cc:3060] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:54.149144 18412 raft_consensus.cc:2468] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 2.
I20260709 13:21:54.150684 18178 leader_election.cc:304] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:54.152396 18360 raft_consensus.cc:2804] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:54.152882 18360 raft_consensus.cc:697] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Becoming Leader. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Running, Role: LEADER
I20260709 13:21:54.152952 18141 raft_consensus.cc:2468] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 2.
I20260709 13:21:54.153838 18360 consensus_queue.cc:237] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:54.162230 17959 catalog_manager.cc:5697] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 reported cstate change: term changed from 1 to 2, leader changed from 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130) to c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:54.300872 18412 raft_consensus.cc:3060] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:54.504850 18412 raft_consensus.cc:3060] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:54.510248 18412 pending_rounds.cc:85] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c: Aborting all ops after (but not including) 0
I20260709 13:21:54.510584 18412 pending_rounds.cc:107] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:21:54.510841 18412 raft_consensus.cc:2889] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:54.518457 18412 raft_consensus.cc:1275] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Refusing update from remote peer c89811f1c6a043ec9fd6b4619b57f679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:54.519863 18466 consensus_queue.cc:1048] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:54.531499 18141 raft_consensus.cc:1275] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Refusing update from remote peer c89811f1c6a043ec9fd6b4619b57f679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:54.533403 18466 consensus_queue.cc:1048] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:21:54.588020 18011 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:54.657214 18141 raft_consensus.cc:1275] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Refusing update from remote peer c89811f1c6a043ec9fd6b4619b57f679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:54.658883 18295 consensus_queue.cc:1048] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:54.667695 18412 raft_consensus.cc:1275] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Refusing update from remote peer c89811f1c6a043ec9fd6b4619b57f679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:54.669386 18360 consensus_queue.cc:1048] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:55.064487  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:55.083451 18213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9567be35d4cf463a86c8eb635ccae469"
dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
mode: GRACEFUL
new_leader_uuid: "6d8b172f07c347c097df022dcda9aab9"
 from {username='slave'} at 127.0.0.1:43094
I20260709 13:21:55.084024 18213 raft_consensus.cc:606] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 LEADER]: Received request to transfer leadership to TS 6d8b172f07c347c097df022dcda9aab9
I20260709 13:21:55.086652 18213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40"
dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
mode: GRACEFUL
new_leader_uuid: "6d8b172f07c347c097df022dcda9aab9"
 from {username='slave'} at 127.0.0.1:43094
I20260709 13:21:55.087200 18213 raft_consensus.cc:606] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Received request to transfer leadership to TS 6d8b172f07c347c097df022dcda9aab9
I20260709 13:21:55.088330  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:21:55.088814  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:55.089506  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:55.403939 18466 raft_consensus.cc:993] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679: : Instructing follower 6d8b172f07c347c097df022dcda9aab9 to start an election
I20260709 13:21:55.404570 18466 raft_consensus.cc:1081] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Signalling peer 6d8b172f07c347c097df022dcda9aab9 to start an election
I20260709 13:21:55.406145 18141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40"
dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
 from {username='slave'} at 127.0.0.1:40278
I20260709 13:21:55.406673 18141 raft_consensus.cc:493] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:55.406993 18141 raft_consensus.cc:3060] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:55.412144 18141 raft_consensus.cc:515] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:55.413853 18141 leader_election.cc:290] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 3 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:55.414909 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
I20260709 13:21:55.415010 18213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
I20260709 13:21:55.415759 18412 raft_consensus.cc:3060] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:55.415786 18213 raft_consensus.cc:3055] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:55.416262 18213 raft_consensus.cc:740] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Running, Role: LEADER
I20260709 13:21:55.417112 18213 consensus_queue.cc:260] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:55.418437 18213 raft_consensus.cc:3060] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:55.423585 18412 raft_consensus.cc:2468] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 3.
I20260709 13:21:55.424849 18104 leader_election.cc:304] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, 6d8b172f07c347c097df022dcda9aab9; no voters: 
I20260709 13:21:55.425244 18213 raft_consensus.cc:2468] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 3.
I20260709 13:21:55.425607 18474 raft_consensus.cc:2804] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:55.426117 18474 raft_consensus.cc:697] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 3 LEADER]: Becoming Leader. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:55.426918 18474 consensus_queue.cc:237] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:55.433899 17959 catalog_manager.cc:5697] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 reported cstate change: term changed from 2 to 3, leader changed from c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131) to 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "6d8b172f07c347c097df022dcda9aab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:55.588928 18011 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:55.602661 18295 raft_consensus.cc:993] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679: : Instructing follower 6d8b172f07c347c097df022dcda9aab9 to start an election
I20260709 13:21:55.603240 18466 raft_consensus.cc:1081] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 LEADER]: Signalling peer 6d8b172f07c347c097df022dcda9aab9 to start an election
I20260709 13:21:55.604770 18141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9567be35d4cf463a86c8eb635ccae469"
dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
 from {username='slave'} at 127.0.0.1:40278
I20260709 13:21:55.605268 18141 raft_consensus.cc:493] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:55.605634 18141 raft_consensus.cc:3060] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:55.610215 18141 raft_consensus.cc:515] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:55.611740 18141 leader_election.cc:290] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:55.612740 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9567be35d4cf463a86c8eb635ccae469" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
I20260709 13:21:55.612818 18213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9567be35d4cf463a86c8eb635ccae469" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
I20260709 13:21:55.613332 18412 raft_consensus.cc:3060] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:55.613610 18213 raft_consensus.cc:3055] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:55.614032 18213 raft_consensus.cc:740] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Running, Role: LEADER
I20260709 13:21:55.614724 18213 consensus_queue.cc:260] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:55.615634 18213 raft_consensus.cc:3060] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:55.618956 18412 raft_consensus.cc:2468] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 2.
I20260709 13:21:55.620152 18104 leader_election.cc:304] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, 6d8b172f07c347c097df022dcda9aab9; no voters: 
I20260709 13:21:55.620353 18213 raft_consensus.cc:2468] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 2.
I20260709 13:21:55.620841 18474 raft_consensus.cc:2804] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:55.621352 18474 raft_consensus.cc:697] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 2 LEADER]: Becoming Leader. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:55.622177 18474 consensus_queue.cc:237] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:55.629720 17959 catalog_manager.cc:5697] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 reported cstate change: term changed from 1 to 2, leader changed from c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131) to 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "6d8b172f07c347c097df022dcda9aab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.891804 18213 raft_consensus.cc:1275] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Refusing update from remote peer 6d8b172f07c347c097df022dcda9aab9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:55.893289 18474 consensus_queue.cc:1048] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:55.903403 18413 raft_consensus.cc:1275] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Refusing update from remote peer 6d8b172f07c347c097df022dcda9aab9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:55.905085 18486 consensus_queue.cc:1048] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:56.025933 18413 raft_consensus.cc:1275] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Refusing update from remote peer 6d8b172f07c347c097df022dcda9aab9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:56.027278 18486 consensus_queue.cc:1048] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:56.036659 18213 raft_consensus.cc:1275] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Refusing update from remote peer 6d8b172f07c347c097df022dcda9aab9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:56.038385 18474 consensus_queue.cc:1048] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:56.095764  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:56.103286 18141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9567be35d4cf463a86c8eb635ccae469"
dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
mode: GRACEFUL
new_leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
 from {username='slave'} at 127.0.0.1:36510
I20260709 13:21:56.103884 18141 raft_consensus.cc:606] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 2 LEADER]: Received request to transfer leadership to TS c89811f1c6a043ec9fd6b4619b57f679
I20260709 13:21:56.106245 18141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c03d770241db4724ad3a2da951a8043c"
dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
mode: GRACEFUL
new_leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
 from {username='slave'} at 127.0.0.1:36510
I20260709 13:21:56.106694 18141 raft_consensus.cc:606] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Received request to transfer leadership to TS c89811f1c6a043ec9fd6b4619b57f679
I20260709 13:21:56.107739  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:21:56.108237  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:56.108803  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:56.510648 18474 raft_consensus.cc:993] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9: : Instructing follower c89811f1c6a043ec9fd6b4619b57f679 to start an election
I20260709 13:21:56.511152 18450 raft_consensus.cc:1081] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Signalling peer c89811f1c6a043ec9fd6b4619b57f679 to start an election
I20260709 13:21:56.512831 18213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c03d770241db4724ad3a2da951a8043c"
dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
 from {username='slave'} at 127.0.0.1:41812
I20260709 13:21:56.513300 18213 raft_consensus.cc:493] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:56.513602 18213 raft_consensus.cc:3060] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.518460 18213 raft_consensus.cc:515] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:56.519984 18213 leader_election.cc:290] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:56.520939 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03d770241db4724ad3a2da951a8043c" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
I20260709 13:21:56.520963 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03d770241db4724ad3a2da951a8043c" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
I20260709 13:21:56.521649 18412 raft_consensus.cc:3060] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.521824 18141 raft_consensus.cc:3055] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:56.522287 18141 raft_consensus.cc:740] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:56.522974 18141 consensus_queue.cc:260] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:56.524052 18141 raft_consensus.cc:3060] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.529084 18412 raft_consensus.cc:2468] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 2.
I20260709 13:21:56.529645 18141 raft_consensus.cc:2468] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 2.
I20260709 13:21:56.530535 18178 leader_election.cc:304] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:56.531423 18493 raft_consensus.cc:2804] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:56.531873 18493 raft_consensus.cc:697] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Becoming Leader. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Running, Role: LEADER
I20260709 13:21:56.532595 18493 consensus_queue.cc:237] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:56.540262 17959 catalog_manager.cc:5697] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 reported cstate change: term changed from 1 to 2, leader changed from 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130) to c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131). New cstate: current_term: 2 leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:56.579192 18474 raft_consensus.cc:993] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9: : Instructing follower c89811f1c6a043ec9fd6b4619b57f679 to start an election
I20260709 13:21:56.579715 18450 raft_consensus.cc:1081] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 2 LEADER]: Signalling peer c89811f1c6a043ec9fd6b4619b57f679 to start an election
I20260709 13:21:56.581600 18213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9567be35d4cf463a86c8eb635ccae469"
dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
 from {username='slave'} at 127.0.0.1:41812
I20260709 13:21:56.582140 18213 raft_consensus.cc:493] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:56.582597 18213 raft_consensus.cc:3060] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:56.588225 18213 raft_consensus.cc:515] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:56.589744 18213 leader_election.cc:290] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 3 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
W20260709 13:21:56.589972 18011 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:56.590811 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9567be35d4cf463a86c8eb635ccae469" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
I20260709 13:21:56.590824 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9567be35d4cf463a86c8eb635ccae469" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
I20260709 13:21:56.591324 18141 raft_consensus.cc:3055] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:56.591506 18412 raft_consensus.cc:3060] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:56.591676 18141 raft_consensus.cc:740] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:56.592429 18141 consensus_queue.cc:260] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:56.593403 18141 raft_consensus.cc:3060] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:56.597771 18412 raft_consensus.cc:2468] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 3.
I20260709 13:21:56.598249 18141 raft_consensus.cc:2468] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 3.
I20260709 13:21:56.598855 18178 leader_election.cc:304] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:56.599620 18493 raft_consensus.cc:2804] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:56.600028 18493 raft_consensus.cc:697] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 LEADER]: Becoming Leader. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Running, Role: LEADER
I20260709 13:21:56.600777 18493 consensus_queue.cc:237] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:56.606552 17959 catalog_manager.cc:5697] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 reported cstate change: term changed from 2 to 3, leader changed from 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130) to c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131). New cstate: current_term: 3 leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:56.917018 18412 raft_consensus.cc:1275] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Refusing update from remote peer c89811f1c6a043ec9fd6b4619b57f679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:56.918906 18493 consensus_queue.cc:1048] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:56.941597 18141 raft_consensus.cc:1275] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Refusing update from remote peer c89811f1c6a043ec9fd6b4619b57f679: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:56.943522 18493 consensus_queue.cc:1048] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:57.089655 18141 raft_consensus.cc:1275] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Refusing update from remote peer c89811f1c6a043ec9fd6b4619b57f679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:57.091109 18504 consensus_queue.cc:1048] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:57.103506 18413 raft_consensus.cc:1275] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Refusing update from remote peer c89811f1c6a043ec9fd6b4619b57f679: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:57.105468 18502 consensus_queue.cc:1048] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:57.117537  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:57.129372 18213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d157177661a4d5ea5876de22d306bd7"
dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
mode: GRACEFUL
new_leader_uuid: "6d8b172f07c347c097df022dcda9aab9"
 from {username='slave'} at 127.0.0.1:43094
I20260709 13:21:57.130035 18213 raft_consensus.cc:606] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Received request to transfer leadership to TS 6d8b172f07c347c097df022dcda9aab9
I20260709 13:21:57.132866 18213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c03d770241db4724ad3a2da951a8043c"
dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
mode: GRACEFUL
new_leader_uuid: "6d8b172f07c347c097df022dcda9aab9"
 from {username='slave'} at 127.0.0.1:43094
I20260709 13:21:57.133374 18213 raft_consensus.cc:606] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Received request to transfer leadership to TS 6d8b172f07c347c097df022dcda9aab9
I20260709 13:21:57.134783  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:21:57.135493  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:57.136418  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:57.141891 18504 raft_consensus.cc:993] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679: : Instructing follower 6d8b172f07c347c097df022dcda9aab9 to start an election
I20260709 13:21:57.142576 18502 raft_consensus.cc:1081] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Signalling peer 6d8b172f07c347c097df022dcda9aab9 to start an election
I20260709 13:21:57.144325 18141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d157177661a4d5ea5876de22d306bd7"
dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
 from {username='slave'} at 127.0.0.1:40278
I20260709 13:21:57.144850 18141 raft_consensus.cc:493] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:57.145131 18141 raft_consensus.cc:3060] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:57.153653 18141 raft_consensus.cc:515] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:57.155397 18141 leader_election.cc:290] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 3 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:57.156347 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d157177661a4d5ea5876de22d306bd7" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
I20260709 13:21:57.156656 18213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d157177661a4d5ea5876de22d306bd7" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
I20260709 13:21:57.157147 18412 raft_consensus.cc:3060] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:57.157213 18213 raft_consensus.cc:3055] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:57.157722 18213 raft_consensus.cc:740] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Running, Role: LEADER
I20260709 13:21:57.158834 18213 consensus_queue.cc:260] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:57.160247 18213 raft_consensus.cc:3060] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:57.167083 18412 raft_consensus.cc:2468] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 3.
I20260709 13:21:57.168721 18104 leader_election.cc:304] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, 6d8b172f07c347c097df022dcda9aab9; no voters: 
I20260709 13:21:57.169781 18450 raft_consensus.cc:2804] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:57.170241 18213 raft_consensus.cc:2468] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 3.
I20260709 13:21:57.170347 18450 raft_consensus.cc:697] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 3 LEADER]: Becoming Leader. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:57.171880 18450 consensus_queue.cc:237] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:57.180210 17959 catalog_manager.cc:5697] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 reported cstate change: term changed from 2 to 3, leader changed from c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131) to 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "6d8b172f07c347c097df022dcda9aab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:57.366168 18504 raft_consensus.cc:993] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679: : Instructing follower 6d8b172f07c347c097df022dcda9aab9 to start an election
I20260709 13:21:57.366750 18502 raft_consensus.cc:1081] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Signalling peer 6d8b172f07c347c097df022dcda9aab9 to start an election
I20260709 13:21:57.368430 18141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c03d770241db4724ad3a2da951a8043c"
dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
 from {username='slave'} at 127.0.0.1:40278
I20260709 13:21:57.369100 18141 raft_consensus.cc:493] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:57.369498 18141 raft_consensus.cc:3060] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:57.374886 18141 raft_consensus.cc:515] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:57.376509 18141 leader_election.cc:290] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 3 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131:33749)
I20260709 13:21:57.377620 18412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03d770241db4724ad3a2da951a8043c" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
I20260709 13:21:57.377640 18213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03d770241db4724ad3a2da951a8043c" candidate_uuid: "6d8b172f07c347c097df022dcda9aab9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
I20260709 13:21:57.378365 18412 raft_consensus.cc:3060] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:57.378484 18213 raft_consensus.cc:3055] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:57.378957 18213 raft_consensus.cc:740] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Running, Role: LEADER
I20260709 13:21:57.379717 18213 consensus_queue.cc:260] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:57.380748 18213 raft_consensus.cc:3060] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:57.384249 18412 raft_consensus.cc:2468] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 3.
I20260709 13:21:57.385457 18104 leader_election.cc:304] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, 6d8b172f07c347c097df022dcda9aab9; no voters: 
I20260709 13:21:57.386308 18450 raft_consensus.cc:2804] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:57.386798 18450 raft_consensus.cc:697] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 3 LEADER]: Becoming Leader. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:57.387091 18213 raft_consensus.cc:2468] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d8b172f07c347c097df022dcda9aab9 in term 3.
I20260709 13:21:57.387817 18450 consensus_queue.cc:237] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:57.394615 17959 catalog_manager.cc:5697] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 reported cstate change: term changed from 2 to 3, leader changed from c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131) to 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130). New cstate: current_term: 3 leader_uuid: "6d8b172f07c347c097df022dcda9aab9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:57.591349 18011 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:57.743908 18412 raft_consensus.cc:1275] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Refusing update from remote peer 6d8b172f07c347c097df022dcda9aab9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:57.745379 18450 consensus_queue.cc:1048] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:57.753387 18213 raft_consensus.cc:1275] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Refusing update from remote peer 6d8b172f07c347c097df022dcda9aab9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:57.755064 18450 consensus_queue.cc:1048] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:57.893805 18412 raft_consensus.cc:1275] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Refusing update from remote peer 6d8b172f07c347c097df022dcda9aab9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:57.895191 18516 consensus_queue.cc:1048] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:57.903129 18213 raft_consensus.cc:1275] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Refusing update from remote peer 6d8b172f07c347c097df022dcda9aab9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:57.904980 18516 consensus_queue.cc:1048] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:58.145283  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:58.154510 18141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6f43efc325c40b8a1a5ec72c30ad467"
dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
mode: GRACEFUL
new_leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
 from {username='slave'} at 127.0.0.1:36510
I20260709 13:21:58.155088 18141 raft_consensus.cc:606] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 2 LEADER]: Received request to transfer leadership to TS c89811f1c6a043ec9fd6b4619b57f679
I20260709 13:21:58.157961 18141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40"
dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
mode: GRACEFUL
new_leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
 from {username='slave'} at 127.0.0.1:36510
I20260709 13:21:58.158527 18141 raft_consensus.cc:606] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 3 LEADER]: Received request to transfer leadership to TS c89811f1c6a043ec9fd6b4619b57f679
I20260709 13:21:58.160053  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:21:58.160621  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:58.161211  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:21:58.592412 18011 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:58.614343 18474 raft_consensus.cc:993] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9: : Instructing follower c89811f1c6a043ec9fd6b4619b57f679 to start an election
I20260709 13:21:58.614887 18516 raft_consensus.cc:1081] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 3 LEADER]: Signalling peer c89811f1c6a043ec9fd6b4619b57f679 to start an election
I20260709 13:21:58.616501 18213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40"
dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
 from {username='slave'} at 127.0.0.1:41812
I20260709 13:21:58.617010 18213 raft_consensus.cc:493] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:58.617308 18213 raft_consensus.cc:3060] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:58.622949 18213 raft_consensus.cc:515] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:58.624946 18213 leader_election.cc:290] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 4 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:58.626116 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
I20260709 13:21:58.626145 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a81fc72cf94b51b8bb531ba1545f40" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
I20260709 13:21:58.627008 18413 raft_consensus.cc:3060] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:58.627210 18141 raft_consensus.cc:3055] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:21:58.627592 18141 raft_consensus.cc:740] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:58.628383 18141 consensus_queue.cc:260] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:58.629379 18141 raft_consensus.cc:3060] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:21:58.633883 18413 raft_consensus.cc:2468] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 4.
I20260709 13:21:58.635126 18141 raft_consensus.cc:2468] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 4.
I20260709 13:21:58.635320 18178 leader_election.cc:304] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:58.636242 18502 raft_consensus.cc:2804] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:21:58.637177 18502 raft_consensus.cc:697] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 4 LEADER]: Becoming Leader. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Running, Role: LEADER
I20260709 13:21:58.638170 18502 consensus_queue.cc:237] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:58.645299 17963 catalog_manager.cc:5697] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 reported cstate change: term changed from 3 to 4, leader changed from 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130) to c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131). New cstate: current_term: 4 leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:58.664801 18450 raft_consensus.cc:993] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9: : Instructing follower c89811f1c6a043ec9fd6b4619b57f679 to start an election
I20260709 13:21:58.665269 18474 raft_consensus.cc:1081] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 2 LEADER]: Signalling peer c89811f1c6a043ec9fd6b4619b57f679 to start an election
I20260709 13:21:58.666952 18213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6f43efc325c40b8a1a5ec72c30ad467"
dest_uuid: "c89811f1c6a043ec9fd6b4619b57f679"
 from {username='slave'} at 127.0.0.1:41812
I20260709 13:21:58.667462 18213 raft_consensus.cc:493] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:58.667768 18213 raft_consensus.cc:3060] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:58.673324 18213 raft_consensus.cc:515] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:58.675149 18213 leader_election.cc:290] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 3 election: Requested vote from peers 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019), 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935)
I20260709 13:21:58.675894 18413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f43efc325c40b8a1a5ec72c30ad467" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "59282fcc26e74b65bb74d4e2b39f848c"
I20260709 13:21:58.676241 18141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6f43efc325c40b8a1a5ec72c30ad467" candidate_uuid: "c89811f1c6a043ec9fd6b4619b57f679" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6d8b172f07c347c097df022dcda9aab9"
I20260709 13:21:58.676615 18413 raft_consensus.cc:3060] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:58.676939 18141 raft_consensus.cc:3055] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:58.677309 18141 raft_consensus.cc:740] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d8b172f07c347c097df022dcda9aab9, State: Running, Role: LEADER
I20260709 13:21:58.678172 18141 consensus_queue.cc:260] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:58.679126 18141 raft_consensus.cc:3060] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:58.682368 18413 raft_consensus.cc:2468] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 3.
I20260709 13:21:58.683568 18178 leader_election.cc:304] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59282fcc26e74b65bb74d4e2b39f848c, c89811f1c6a043ec9fd6b4619b57f679; no voters: 
I20260709 13:21:58.683985 18141 raft_consensus.cc:2468] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c89811f1c6a043ec9fd6b4619b57f679 in term 3.
I20260709 13:21:58.684561 18502 raft_consensus.cc:2804] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:58.685120 18502 raft_consensus.cc:697] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 LEADER]: Becoming Leader. State: Replica: c89811f1c6a043ec9fd6b4619b57f679, State: Running, Role: LEADER
I20260709 13:21:58.686064 18502 consensus_queue.cc:237] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } }
I20260709 13:21:58.693688 17963 catalog_manager.cc:5697] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 reported cstate change: term changed from 2 to 3, leader changed from 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130) to c89811f1c6a043ec9fd6b4619b57f679 (127.6.214.131). New cstate: current_term: 3 leader_uuid: "c89811f1c6a043ec9fd6b4619b57f679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c89811f1c6a043ec9fd6b4619b57f679" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 33749 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:59.063845 18141 raft_consensus.cc:1275] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 4 FOLLOWER]: Refusing update from remote peer c89811f1c6a043ec9fd6b4619b57f679: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:21:59.065223 18520 consensus_queue.cc:1048] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:21:59.065755 18413 raft_consensus.cc:1275] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 4 FOLLOWER]: Refusing update from remote peer c89811f1c6a043ec9fd6b4619b57f679: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:21:59.067091 18520 consensus_queue.cc:1048] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:21:59.113623 18413 raft_consensus.cc:1275] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Refusing update from remote peer c89811f1c6a043ec9fd6b4619b57f679: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:59.114856 18520 consensus_queue.cc:1048] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59282fcc26e74b65bb74d4e2b39f848c" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 35019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:59.129736 18141 raft_consensus.cc:1275] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Refusing update from remote peer c89811f1c6a043ec9fd6b4619b57f679: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:59.131891 18532 consensus_queue.cc:1048] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d8b172f07c347c097df022dcda9aab9" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 33935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:59.167599  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:59.201179  7002 tablet_server.cc:179] TabletServer@127.6.214.129:35019 shutting down...
I20260709 13:21:59.224648  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:59.225652  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:59.226621  7002 raft_consensus.cc:2243] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.227213  7002 raft_consensus.cc:2272] T 49afc43f04b9442493ac4faf8684d0ed P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.229873  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:59.230569  7002 raft_consensus.cc:2243] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.231038  7002 raft_consensus.cc:2272] T c03d770241db4724ad3a2da951a8043c P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.233145  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:59.233777  7002 raft_consensus.cc:2243] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.234257  7002 raft_consensus.cc:2272] T 6843c3778d8e4fd79ff4710ba3350432 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.236539  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:59.237088  7002 raft_consensus.cc:2243] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.237633  7002 raft_consensus.cc:2272] T b0e545f828c54d88a93b453b009bcd03 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.240053  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:59.240653  7002 raft_consensus.cc:2243] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.241123  7002 raft_consensus.cc:2272] T f5a81fc72cf94b51b8bb531ba1545f40 P 59282fcc26e74b65bb74d4e2b39f848c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.243966  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:59.244508  7002 raft_consensus.cc:2243] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.244978  7002 raft_consensus.cc:2272] T 296d87ca32624ba7a553284774cde523 P 59282fcc26e74b65bb74d4e2b39f848c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.247452  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:59.247968  7002 raft_consensus.cc:2243] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.248399  7002 raft_consensus.cc:2272] T 9567be35d4cf463a86c8eb635ccae469 P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.250727  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:59.251272  7002 raft_consensus.cc:2243] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.251716  7002 raft_consensus.cc:2272] T ce1cc92dba1843028a805534b79edea1 P 59282fcc26e74b65bb74d4e2b39f848c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.254163  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:59.254679  7002 raft_consensus.cc:2243] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.255134  7002 raft_consensus.cc:2272] T b6f43efc325c40b8a1a5ec72c30ad467 P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.258096  7002 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:59.258613  7002 raft_consensus.cc:2243] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.259016  7002 raft_consensus.cc:2272] T 1d157177661a4d5ea5876de22d306bd7 P 59282fcc26e74b65bb74d4e2b39f848c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.281275  7002 tablet_server.cc:196] TabletServer@127.6.214.129:35019 shutdown complete.
I20260709 13:21:59.307986  7002 tablet_server.cc:179] TabletServer@127.6.214.130:0 shutting down...
W20260709 13:21:59.322340 18104 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260709 13:21:59.333091 18104 consensus_peers.cc:597] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:59.343849  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:59.344805  7002 tablet_replica.cc:333] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9: stopping tablet replica
I20260709 13:21:59.345821  7002 raft_consensus.cc:2243] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.346652  7002 raft_consensus.cc:2272] T 1d157177661a4d5ea5876de22d306bd7 P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.349184  7002 tablet_replica.cc:333] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9: stopping tablet replica
I20260709 13:21:59.349901  7002 raft_consensus.cc:2243] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.350304  7002 raft_consensus.cc:2272] T b6f43efc325c40b8a1a5ec72c30ad467 P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.352954  7002 tablet_replica.cc:333] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9: stopping tablet replica
I20260709 13:21:59.353678  7002 raft_consensus.cc:2243] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.354560  7002 raft_consensus.cc:2272] T b0e545f828c54d88a93b453b009bcd03 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.357245  7002 tablet_replica.cc:333] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9: stopping tablet replica
I20260709 13:21:59.357888  7002 raft_consensus.cc:2243] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.358722  7002 raft_consensus.cc:2272] T c03d770241db4724ad3a2da951a8043c P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.361056  7002 tablet_replica.cc:333] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9: stopping tablet replica
I20260709 13:21:59.361704  7002 raft_consensus.cc:2243] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.362655  7002 raft_consensus.cc:2272] T 49afc43f04b9442493ac4faf8684d0ed P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.365180  7002 tablet_replica.cc:333] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9: stopping tablet replica
I20260709 13:21:59.365865  7002 raft_consensus.cc:2243] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.366374  7002 raft_consensus.cc:2272] T ce1cc92dba1843028a805534b79edea1 P 6d8b172f07c347c097df022dcda9aab9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.368881  7002 tablet_replica.cc:333] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9: stopping tablet replica
I20260709 13:21:59.369477  7002 raft_consensus.cc:2243] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.369973  7002 raft_consensus.cc:2272] T 9567be35d4cf463a86c8eb635ccae469 P 6d8b172f07c347c097df022dcda9aab9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.372287  7002 tablet_replica.cc:333] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9: stopping tablet replica
I20260709 13:21:59.372888  7002 raft_consensus.cc:2243] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.373375  7002 raft_consensus.cc:2272] T 6843c3778d8e4fd79ff4710ba3350432 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.375722  7002 tablet_replica.cc:333] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9: stopping tablet replica
I20260709 13:21:59.376339  7002 raft_consensus.cc:2243] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.376850  7002 raft_consensus.cc:2272] T 296d87ca32624ba7a553284774cde523 P 6d8b172f07c347c097df022dcda9aab9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.379289  7002 tablet_replica.cc:333] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9: stopping tablet replica
I20260709 13:21:59.379921  7002 raft_consensus.cc:2243] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.380398  7002 raft_consensus.cc:2272] T f5a81fc72cf94b51b8bb531ba1545f40 P 6d8b172f07c347c097df022dcda9aab9 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:59.391661 18178 consensus_peers.cc:597] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:59.399217 18181 consensus_peers.cc:597] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 -> Peer 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935): Couldn't send request to peer 6d8b172f07c347c097df022dcda9aab9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:59.420445  7002 tablet_server.cc:196] TabletServer@127.6.214.130:0 shutdown complete.
I20260709 13:21:59.446132  7002 tablet_server.cc:179] TabletServer@127.6.214.131:0 shutting down...
W20260709 13:21:59.471088 18178 consensus_peers.cc:597] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 -> Peer 59282fcc26e74b65bb74d4e2b39f848c (127.6.214.129:35019): Couldn't send request to peer 59282fcc26e74b65bb74d4e2b39f848c. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:35019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:59.482127 18181 consensus_peers.cc:597] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 -> Peer 6d8b172f07c347c097df022dcda9aab9 (127.6.214.130:33935): Couldn't send request to peer 6d8b172f07c347c097df022dcda9aab9. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:33935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:59.484828  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:59.485965  7002 tablet_replica.cc:333] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679: stopping tablet replica
I20260709 13:21:59.486737  7002 raft_consensus.cc:2243] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.487732  7002 raft_consensus.cc:2272] T b6f43efc325c40b8a1a5ec72c30ad467 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.490598  7002 tablet_replica.cc:333] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679: stopping tablet replica
I20260709 13:21:59.491250  7002 raft_consensus.cc:2243] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.492120  7002 raft_consensus.cc:2272] T 296d87ca32624ba7a553284774cde523 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.494555  7002 tablet_replica.cc:333] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679: stopping tablet replica
I20260709 13:21:59.495144  7002 raft_consensus.cc:2243] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.495872  7002 raft_consensus.cc:2272] T f5a81fc72cf94b51b8bb531ba1545f40 P c89811f1c6a043ec9fd6b4619b57f679 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.498776  7002 tablet_replica.cc:333] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679: stopping tablet replica
I20260709 13:21:59.499329  7002 raft_consensus.cc:2243] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.499764  7002 raft_consensus.cc:2272] T 49afc43f04b9442493ac4faf8684d0ed P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.502008  7002 tablet_replica.cc:333] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679: stopping tablet replica
I20260709 13:21:59.502516  7002 raft_consensus.cc:2243] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.502911  7002 raft_consensus.cc:2272] T c03d770241db4724ad3a2da951a8043c P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.505024  7002 tablet_replica.cc:333] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679: stopping tablet replica
I20260709 13:21:59.505693  7002 raft_consensus.cc:2243] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.506486  7002 raft_consensus.cc:2272] T 9567be35d4cf463a86c8eb635ccae469 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.508764  7002 tablet_replica.cc:333] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679: stopping tablet replica
I20260709 13:21:59.509402  7002 raft_consensus.cc:2243] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.510325  7002 raft_consensus.cc:2272] T ce1cc92dba1843028a805534b79edea1 P c89811f1c6a043ec9fd6b4619b57f679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.512657  7002 tablet_replica.cc:333] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679: stopping tablet replica
I20260709 13:21:59.513808  7002 raft_consensus.cc:2243] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.514899  7002 raft_consensus.cc:2272] T b0e545f828c54d88a93b453b009bcd03 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.517287  7002 tablet_replica.cc:333] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679: stopping tablet replica
I20260709 13:21:59.517936  7002 raft_consensus.cc:2243] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.519014  7002 raft_consensus.cc:2272] T 6843c3778d8e4fd79ff4710ba3350432 P c89811f1c6a043ec9fd6b4619b57f679 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.521454  7002 tablet_replica.cc:333] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679: stopping tablet replica
I20260709 13:21:59.522001  7002 raft_consensus.cc:2243] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.522470  7002 raft_consensus.cc:2272] T 1d157177661a4d5ea5876de22d306bd7 P c89811f1c6a043ec9fd6b4619b57f679 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.559306  7002 tablet_server.cc:196] TabletServer@127.6.214.131:0 shutdown complete.
I20260709 13:21:59.584962  7002 master.cc:562] Master@127.6.214.190:45705 shutting down...
W20260709 13:21:59.593420 18011 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:59.609895  7002 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.610488  7002 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.610847  7002 tablet_replica.cc:333] T 00000000000000000000000000000000 P f8d04f54f531478bbad2588929075186: stopping tablet replica
I20260709 13:21:59.633026  7002 master.cc:584] Master@127.6.214.190:45705 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13255 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:21:59.681295  7002 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.214.190:33229
I20260709 13:21:59.682603  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:59.689019 18543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:59.689181 18544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:59.690465 18546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:59.690798  7002 server_base.cc:1061] running on GCE node
I20260709 13:21:59.691926  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:59.692201  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:59.692387  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603319692365 us; error 0 us; skew 500 ppm
I20260709 13:21:59.693017  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:59.695649  7002 webserver.cc:533] Webserver started at http://127.6.214.190:33187/ using document root <none> and password file <none>
I20260709 13:21:59.696216  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:59.696429  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:59.696768  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:59.698256  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/master-0-root/instance:
uuid: "145036ba47b0489b939757b15fcc8743"
format_stamp: "Formatted at 2026-07-09 13:21:59 on dist-test-slave-rnv4"
I20260709 13:21:59.703076  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:21:59.706740 18551 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:59.707617  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:21:59.707967  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/master-0-root
uuid: "145036ba47b0489b939757b15fcc8743"
format_stamp: "Formatted at 2026-07-09 13:21:59 on dist-test-slave-rnv4"
I20260709 13:21:59.708261  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:59.724256  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:59.725620  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:59.767005  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.190:33229
I20260709 13:21:59.767110 18602 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.190:33229 every 8 connection(s)
I20260709 13:21:59.771134 18603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:59.782811 18603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743: Bootstrap starting.
I20260709 13:21:59.787703 18603 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:59.792133 18603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743: No bootstrap required, opened a new log
I20260709 13:21:59.794482 18603 raft_consensus.cc:359] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "145036ba47b0489b939757b15fcc8743" member_type: VOTER }
I20260709 13:21:59.794890 18603 raft_consensus.cc:385] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:59.795147 18603 raft_consensus.cc:740] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 145036ba47b0489b939757b15fcc8743, State: Initialized, Role: FOLLOWER
I20260709 13:21:59.795753 18603 consensus_queue.cc:260] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "145036ba47b0489b939757b15fcc8743" member_type: VOTER }
I20260709 13:21:59.796226 18603 raft_consensus.cc:399] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:59.796437 18603 raft_consensus.cc:493] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:59.796722 18603 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:59.801736 18603 raft_consensus.cc:515] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "145036ba47b0489b939757b15fcc8743" member_type: VOTER }
I20260709 13:21:59.802270 18603 leader_election.cc:304] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 145036ba47b0489b939757b15fcc8743; no voters: 
I20260709 13:21:59.803411 18603 leader_election.cc:290] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:59.803771 18606 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:59.805197 18606 raft_consensus.cc:697] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [term 1 LEADER]: Becoming Leader. State: Replica: 145036ba47b0489b939757b15fcc8743, State: Running, Role: LEADER
I20260709 13:21:59.805899 18606 consensus_queue.cc:237] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "145036ba47b0489b939757b15fcc8743" member_type: VOTER }
I20260709 13:21:59.806399 18603 sys_catalog.cc:565] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:59.810480 18607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "145036ba47b0489b939757b15fcc8743" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "145036ba47b0489b939757b15fcc8743" member_type: VOTER } }
I20260709 13:21:59.811266 18607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:59.812254 18608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 145036ba47b0489b939757b15fcc8743. Latest consensus state: current_term: 1 leader_uuid: "145036ba47b0489b939757b15fcc8743" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "145036ba47b0489b939757b15fcc8743" member_type: VOTER } }
I20260709 13:21:59.812922 18608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:59.814553 18612 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:59.822448 18612 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:59.823473  7002 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:59.831575 18612 catalog_manager.cc:1383] Generated new cluster ID: 25dde9cec5c0452db5448ab066d6b0f4
I20260709 13:21:59.831919 18612 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:59.850126 18612 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:59.851536 18612 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:59.866247 18612 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743: Generated new TSK 0
I20260709 13:21:59.866964 18612 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:59.891000  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:59.897715 18624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:59.898574 18625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:59.901156  7002 server_base.cc:1061] running on GCE node
W20260709 13:21:59.901063 18627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:59.902565  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:59.902757  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:59.902928  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603319902912 us; error 0 us; skew 500 ppm
I20260709 13:21:59.903422  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:59.905993  7002 webserver.cc:533] Webserver started at http://127.6.214.129:46837/ using document root <none> and password file <none>
I20260709 13:21:59.906451  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:59.906613  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:59.906836  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:59.908030  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/ts-0-root/instance:
uuid: "cb076c85c4934024a0dae115ebeb161d"
format_stamp: "Formatted at 2026-07-09 13:21:59 on dist-test-slave-rnv4"
I20260709 13:21:59.913216  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:21:59.916949 18632 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:59.918018  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:21:59.918321  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/ts-0-root
uuid: "cb076c85c4934024a0dae115ebeb161d"
format_stamp: "Formatted at 2026-07-09 13:21:59 on dist-test-slave-rnv4"
I20260709 13:21:59.918603  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:59.937736  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:59.939060  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:59.940673  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:59.943332  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:59.943532  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:59.943874  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:59.944067  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:59.990207  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.129:37363
I20260709 13:21:59.990341 18694 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.129:37363 every 8 connection(s)
I20260709 13:21:59.996506  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:00.005486 18699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:00.005649 18700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:00.008633 18702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:00.009732  7002 server_base.cc:1061] running on GCE node
I20260709 13:22:00.010288 18695 heartbeater.cc:344] Connected to a master server at 127.6.214.190:33229
I20260709 13:22:00.010800 18695 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:00.011287  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:00.011595  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:00.011530 18695 heartbeater.cc:507] Master 127.6.214.190:33229 requested a full tablet report, sending...
I20260709 13:22:00.012077  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603320012053 us; error 0 us; skew 500 ppm
I20260709 13:22:00.012789  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:00.014197 18568 ts_manager.cc:194] Registered new tserver with Master: cb076c85c4934024a0dae115ebeb161d (127.6.214.129:37363)
I20260709 13:22:00.016286 18568 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48024
I20260709 13:22:00.016320  7002 webserver.cc:533] Webserver started at http://127.6.214.130:35329/ using document root <none> and password file <none>
I20260709 13:22:00.017019  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:00.017268  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:00.017606  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:00.019340  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/ts-1-root/instance:
uuid: "fa23ebc02a334604a7a20b2166d90c2f"
format_stamp: "Formatted at 2026-07-09 13:22:00 on dist-test-slave-rnv4"
I20260709 13:22:00.024317  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:00.027822 18707 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:00.028628  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:00.028985  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/ts-1-root
uuid: "fa23ebc02a334604a7a20b2166d90c2f"
format_stamp: "Formatted at 2026-07-09 13:22:00 on dist-test-slave-rnv4"
I20260709 13:22:00.029282  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:00.053885  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:00.055259  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:00.056950  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:00.059433  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:00.059685  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:00.059995  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:00.060197  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:00.106618  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.130:37685
I20260709 13:22:00.106786 18769 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.130:37685 every 8 connection(s)
I20260709 13:22:00.112426  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:00.121346 18773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:00.122743 18774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:00.124853 18776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:00.125005 18770 heartbeater.cc:344] Connected to a master server at 127.6.214.190:33229
I20260709 13:22:00.125727 18770 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:00.126924 18770 heartbeater.cc:507] Master 127.6.214.190:33229 requested a full tablet report, sending...
I20260709 13:22:00.129833 18568 ts_manager.cc:194] Registered new tserver with Master: fa23ebc02a334604a7a20b2166d90c2f (127.6.214.130:37685)
I20260709 13:22:00.130440  7002 server_base.cc:1061] running on GCE node
I20260709 13:22:00.131799  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:00.132102  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:00.131999 18568 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48032
I20260709 13:22:00.132504  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603320132480 us; error 0 us; skew 500 ppm
I20260709 13:22:00.133459  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:00.136260  7002 webserver.cc:533] Webserver started at http://127.6.214.131:37533/ using document root <none> and password file <none>
I20260709 13:22:00.136824  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:00.137053  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:00.137360  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:00.138674  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/ts-2-root/instance:
uuid: "10ae19afea094d389a12beacef3876be"
format_stamp: "Formatted at 2026-07-09 13:22:00 on dist-test-slave-rnv4"
I20260709 13:22:00.143684  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:22:00.147526 18781 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:00.148336  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:00.148770  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/ts-2-root
uuid: "10ae19afea094d389a12beacef3876be"
format_stamp: "Formatted at 2026-07-09 13:22:00 on dist-test-slave-rnv4"
I20260709 13:22:00.149118  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602923898527-7002-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:00.168854  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:00.170149  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:00.171698  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:00.174010  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:00.174243  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:00.174489  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:00.174664  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:00.218892  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.131:41001
I20260709 13:22:00.218981 18843 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.131:41001 every 8 connection(s)
I20260709 13:22:00.234918 18844 heartbeater.cc:344] Connected to a master server at 127.6.214.190:33229
I20260709 13:22:00.235422 18844 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:00.236308 18844 heartbeater.cc:507] Master 127.6.214.190:33229 requested a full tablet report, sending...
I20260709 13:22:00.238446 18568 ts_manager.cc:194] Registered new tserver with Master: 10ae19afea094d389a12beacef3876be (127.6.214.131:41001)
I20260709 13:22:00.238617  7002 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016382188s
I20260709 13:22:00.240036 18568 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48038
I20260709 13:22:00.268226 18568 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48052:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:00.270792 18568 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:00.339154 18809 tablet_service.cc:1511] Processing CreateTablet for tablet 20247642e7ea4131818f961f92145831 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=efdc6f1c43d04b72aebb867b2b7fd333]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:00.340253 18808 tablet_service.cc:1511] Processing CreateTablet for tablet 8e170f6fe49d4119b50770e64f13cd2a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=efdc6f1c43d04b72aebb867b2b7fd333]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:00.340852 18809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20247642e7ea4131818f961f92145831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:00.341929 18808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e170f6fe49d4119b50770e64f13cd2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:00.342690 18660 tablet_service.cc:1511] Processing CreateTablet for tablet 20247642e7ea4131818f961f92145831 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=efdc6f1c43d04b72aebb867b2b7fd333]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:00.343869 18659 tablet_service.cc:1511] Processing CreateTablet for tablet 8e170f6fe49d4119b50770e64f13cd2a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=efdc6f1c43d04b72aebb867b2b7fd333]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:00.344312 18660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20247642e7ea4131818f961f92145831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:00.344933 18735 tablet_service.cc:1511] Processing CreateTablet for tablet 20247642e7ea4131818f961f92145831 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=efdc6f1c43d04b72aebb867b2b7fd333]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:00.345379 18659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e170f6fe49d4119b50770e64f13cd2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:00.345549 18734 tablet_service.cc:1511] Processing CreateTablet for tablet 8e170f6fe49d4119b50770e64f13cd2a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=efdc6f1c43d04b72aebb867b2b7fd333]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:00.346372 18735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20247642e7ea4131818f961f92145831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:00.349530 18734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e170f6fe49d4119b50770e64f13cd2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:00.373152 18859 tablet_bootstrap.cc:492] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d: Bootstrap starting.
I20260709 13:22:00.381183 18859 tablet_bootstrap.cc:654] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.385627 18860 tablet_bootstrap.cc:492] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f: Bootstrap starting.
I20260709 13:22:00.387302 18861 tablet_bootstrap.cc:492] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be: Bootstrap starting.
I20260709 13:22:00.389779 18859 tablet_bootstrap.cc:492] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d: No bootstrap required, opened a new log
I20260709 13:22:00.390378 18859 ts_tablet_manager.cc:1403] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:22:00.394323 18861 tablet_bootstrap.cc:654] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.393851 18859 raft_consensus.cc:359] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.394905 18860 tablet_bootstrap.cc:654] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.394933 18859 raft_consensus.cc:385] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.395452 18859 raft_consensus.cc:740] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb076c85c4934024a0dae115ebeb161d, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.396299 18859 consensus_queue.cc:260] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.399984 18859 ts_tablet_manager.cc:1434] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:22:00.400209 18695 heartbeater.cc:499] Master 127.6.214.190:33229 was elected leader, sending a full tablet report...
I20260709 13:22:00.400894 18861 tablet_bootstrap.cc:492] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be: No bootstrap required, opened a new log
I20260709 13:22:00.401125 18859 tablet_bootstrap.cc:492] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d: Bootstrap starting.
I20260709 13:22:00.401201 18860 tablet_bootstrap.cc:492] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f: No bootstrap required, opened a new log
I20260709 13:22:00.401448 18861 ts_tablet_manager.cc:1403] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be: Time spent bootstrapping tablet: real 0.015s	user 0.003s	sys 0.008s
I20260709 13:22:00.401973 18860 ts_tablet_manager.cc:1403] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:22:00.404534 18860 raft_consensus.cc:359] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.405107 18860 raft_consensus.cc:385] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.405452 18860 raft_consensus.cc:740] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa23ebc02a334604a7a20b2166d90c2f, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.406210 18860 consensus_queue.cc:260] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.409026 18859 tablet_bootstrap.cc:654] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.411016 18861 raft_consensus.cc:359] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.412467 18861 raft_consensus.cc:385] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.412940 18861 raft_consensus.cc:740] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10ae19afea094d389a12beacef3876be, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.414072 18861 consensus_queue.cc:260] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.415189 18770 heartbeater.cc:499] Master 127.6.214.190:33229 was elected leader, sending a full tablet report...
I20260709 13:22:00.416097 18860 ts_tablet_manager.cc:1434] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:22:00.417887 18844 heartbeater.cc:499] Master 127.6.214.190:33229 was elected leader, sending a full tablet report...
I20260709 13:22:00.418530 18860 tablet_bootstrap.cc:492] T 20247642e7ea4131818f961f92145831 P fa23ebc02a334604a7a20b2166d90c2f: Bootstrap starting.
I20260709 13:22:00.421314 18861 ts_tablet_manager.cc:1434] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:22:00.422554 18861 tablet_bootstrap.cc:492] T 20247642e7ea4131818f961f92145831 P 10ae19afea094d389a12beacef3876be: Bootstrap starting.
I20260709 13:22:00.433725 18861 tablet_bootstrap.cc:654] T 20247642e7ea4131818f961f92145831 P 10ae19afea094d389a12beacef3876be: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.435057 18860 tablet_bootstrap.cc:654] T 20247642e7ea4131818f961f92145831 P fa23ebc02a334604a7a20b2166d90c2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.443866 18859 tablet_bootstrap.cc:492] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d: No bootstrap required, opened a new log
I20260709 13:22:00.444680 18859 ts_tablet_manager.cc:1403] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.019s
I20260709 13:22:00.448591 18859 raft_consensus.cc:359] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } } peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } }
I20260709 13:22:00.449330 18859 raft_consensus.cc:385] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.449761 18859 raft_consensus.cc:740] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb076c85c4934024a0dae115ebeb161d, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.450026 18861 tablet_bootstrap.cc:492] T 20247642e7ea4131818f961f92145831 P 10ae19afea094d389a12beacef3876be: No bootstrap required, opened a new log
I20260709 13:22:00.450084 18860 tablet_bootstrap.cc:492] T 20247642e7ea4131818f961f92145831 P fa23ebc02a334604a7a20b2166d90c2f: No bootstrap required, opened a new log
I20260709 13:22:00.450680 18861 ts_tablet_manager.cc:1403] T 20247642e7ea4131818f961f92145831 P 10ae19afea094d389a12beacef3876be: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.008s
I20260709 13:22:00.450770 18860 ts_tablet_manager.cc:1403] T 20247642e7ea4131818f961f92145831 P fa23ebc02a334604a7a20b2166d90c2f: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.009s
I20260709 13:22:00.450506 18859 consensus_queue.cc:260] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } } peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } }
I20260709 13:22:00.452893 18859 ts_tablet_manager.cc:1434] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.007s
I20260709 13:22:00.453977 18861 raft_consensus.cc:359] T 20247642e7ea4131818f961f92145831 P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } } peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } }
I20260709 13:22:00.454283 18860 raft_consensus.cc:359] T 20247642e7ea4131818f961f92145831 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } } peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } }
I20260709 13:22:00.454800 18861 raft_consensus.cc:385] T 20247642e7ea4131818f961f92145831 P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.454953 18860 raft_consensus.cc:385] T 20247642e7ea4131818f961f92145831 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.455174 18861 raft_consensus.cc:740] T 20247642e7ea4131818f961f92145831 P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10ae19afea094d389a12beacef3876be, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.455319 18860 raft_consensus.cc:740] T 20247642e7ea4131818f961f92145831 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa23ebc02a334604a7a20b2166d90c2f, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.456241 18860 consensus_queue.cc:260] T 20247642e7ea4131818f961f92145831 P fa23ebc02a334604a7a20b2166d90c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } } peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } }
I20260709 13:22:00.456081 18861 consensus_queue.cc:260] T 20247642e7ea4131818f961f92145831 P 10ae19afea094d389a12beacef3876be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } } peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } }
I20260709 13:22:00.458742 18861 ts_tablet_manager.cc:1434] T 20247642e7ea4131818f961f92145831 P 10ae19afea094d389a12beacef3876be: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:00.459991 18860 ts_tablet_manager.cc:1434] T 20247642e7ea4131818f961f92145831 P fa23ebc02a334604a7a20b2166d90c2f: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:22:00.465533 18866 raft_consensus.cc:493] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.466115 18866 raft_consensus.cc:515] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.468776 18866 leader_election.cc:290] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb076c85c4934024a0dae115ebeb161d (127.6.214.129:37363), 10ae19afea094d389a12beacef3876be (127.6.214.131:41001)
I20260709 13:22:00.481371 18819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e170f6fe49d4119b50770e64f13cd2a" candidate_uuid: "fa23ebc02a334604a7a20b2166d90c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10ae19afea094d389a12beacef3876be" is_pre_election: true
I20260709 13:22:00.482241 18819 raft_consensus.cc:2468] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa23ebc02a334604a7a20b2166d90c2f in term 0.
I20260709 13:22:00.483390 18710 leader_election.cc:304] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10ae19afea094d389a12beacef3876be, fa23ebc02a334604a7a20b2166d90c2f; no voters: 
I20260709 13:22:00.484372 18866 raft_consensus.cc:2804] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.484880 18866 raft_consensus.cc:493] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:00.485257 18866 raft_consensus.cc:3060] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.486960 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e170f6fe49d4119b50770e64f13cd2a" candidate_uuid: "fa23ebc02a334604a7a20b2166d90c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb076c85c4934024a0dae115ebeb161d" is_pre_election: true
I20260709 13:22:00.487797 18670 raft_consensus.cc:2468] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa23ebc02a334604a7a20b2166d90c2f in term 0.
I20260709 13:22:00.492170 18866 raft_consensus.cc:515] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.494127 18866 leader_election.cc:290] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [CANDIDATE]: Term 1 election: Requested vote from peers cb076c85c4934024a0dae115ebeb161d (127.6.214.129:37363), 10ae19afea094d389a12beacef3876be (127.6.214.131:41001)
I20260709 13:22:00.494872 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e170f6fe49d4119b50770e64f13cd2a" candidate_uuid: "fa23ebc02a334604a7a20b2166d90c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb076c85c4934024a0dae115ebeb161d"
I20260709 13:22:00.495122 18819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e170f6fe49d4119b50770e64f13cd2a" candidate_uuid: "fa23ebc02a334604a7a20b2166d90c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10ae19afea094d389a12beacef3876be"
I20260709 13:22:00.495604 18670 raft_consensus.cc:3060] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.495718 18819 raft_consensus.cc:3060] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.504243 18670 raft_consensus.cc:2468] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa23ebc02a334604a7a20b2166d90c2f in term 1.
I20260709 13:22:00.504243 18819 raft_consensus.cc:2468] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa23ebc02a334604a7a20b2166d90c2f in term 1.
I20260709 13:22:00.506083 18711 leader_election.cc:304] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb076c85c4934024a0dae115ebeb161d, fa23ebc02a334604a7a20b2166d90c2f; no voters: 
I20260709 13:22:00.506958 18866 raft_consensus.cc:2804] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:00.508733 18866 raft_consensus.cc:697] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 1 LEADER]: Becoming Leader. State: Replica: fa23ebc02a334604a7a20b2166d90c2f, State: Running, Role: LEADER
I20260709 13:22:00.509786 18866 consensus_queue.cc:237] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.511492 18864 raft_consensus.cc:493] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.512197 18864 raft_consensus.cc:515] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } } peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } }
I20260709 13:22:00.515022 18864 leader_election.cc:290] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa23ebc02a334604a7a20b2166d90c2f (127.6.214.130:37685), 10ae19afea094d389a12beacef3876be (127.6.214.131:41001)
I20260709 13:22:00.521375 18566 catalog_manager.cc:5697] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f reported cstate change: term changed from 0 to 1, leader changed from <none> to fa23ebc02a334604a7a20b2166d90c2f (127.6.214.130). New cstate: current_term: 1 leader_uuid: "fa23ebc02a334604a7a20b2166d90c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:00.526939 18745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20247642e7ea4131818f961f92145831" candidate_uuid: "cb076c85c4934024a0dae115ebeb161d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa23ebc02a334604a7a20b2166d90c2f" is_pre_election: true
I20260709 13:22:00.528008 18745 raft_consensus.cc:2468] T 20247642e7ea4131818f961f92145831 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb076c85c4934024a0dae115ebeb161d in term 0.
I20260709 13:22:00.529325 18635 leader_election.cc:304] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb076c85c4934024a0dae115ebeb161d, fa23ebc02a334604a7a20b2166d90c2f; no voters: 
I20260709 13:22:00.530252 18864 raft_consensus.cc:2804] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.530277 18819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20247642e7ea4131818f961f92145831" candidate_uuid: "cb076c85c4934024a0dae115ebeb161d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10ae19afea094d389a12beacef3876be" is_pre_election: true
I20260709 13:22:00.530786 18864 raft_consensus.cc:493] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:00.531226 18864 raft_consensus.cc:3060] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.531176 18819 raft_consensus.cc:2468] T 20247642e7ea4131818f961f92145831 P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb076c85c4934024a0dae115ebeb161d in term 0.
I20260709 13:22:00.538125 18864 raft_consensus.cc:515] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } } peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } }
I20260709 13:22:00.540030 18864 leader_election.cc:290] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [CANDIDATE]: Term 1 election: Requested vote from peers fa23ebc02a334604a7a20b2166d90c2f (127.6.214.130:37685), 10ae19afea094d389a12beacef3876be (127.6.214.131:41001)
I20260709 13:22:00.540902 18745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20247642e7ea4131818f961f92145831" candidate_uuid: "cb076c85c4934024a0dae115ebeb161d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa23ebc02a334604a7a20b2166d90c2f"
I20260709 13:22:00.541095 18819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20247642e7ea4131818f961f92145831" candidate_uuid: "cb076c85c4934024a0dae115ebeb161d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10ae19afea094d389a12beacef3876be"
I20260709 13:22:00.541567 18745 raft_consensus.cc:3060] T 20247642e7ea4131818f961f92145831 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.541724 18819 raft_consensus.cc:3060] T 20247642e7ea4131818f961f92145831 P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.547595 18819 raft_consensus.cc:2468] T 20247642e7ea4131818f961f92145831 P 10ae19afea094d389a12beacef3876be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb076c85c4934024a0dae115ebeb161d in term 1.
I20260709 13:22:00.548173 18745 raft_consensus.cc:2468] T 20247642e7ea4131818f961f92145831 P fa23ebc02a334604a7a20b2166d90c2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb076c85c4934024a0dae115ebeb161d in term 1.
I20260709 13:22:00.548550 18635 leader_election.cc:304] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10ae19afea094d389a12beacef3876be, cb076c85c4934024a0dae115ebeb161d; no voters: 
I20260709 13:22:00.549475 18864 raft_consensus.cc:2804] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:00.550509 18864 raft_consensus.cc:697] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [term 1 LEADER]: Becoming Leader. State: Replica: cb076c85c4934024a0dae115ebeb161d, State: Running, Role: LEADER
I20260709 13:22:00.551393 18864 consensus_queue.cc:237] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } } peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } }
I20260709 13:22:00.558283 18566 catalog_manager.cc:5697] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d reported cstate change: term changed from 0 to 1, leader changed from <none> to cb076c85c4934024a0dae115ebeb161d (127.6.214.129). New cstate: current_term: 1 leader_uuid: "cb076c85c4934024a0dae115ebeb161d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:00.620047 18566 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48060:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:00.622265 18566 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:00.647580 18659 tablet_service.cc:1511] Processing CreateTablet for tablet 713fc706977a4a539ef88c24c84d7cb4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=09207ac4b4864ef5b62e297d6883c32f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:00.649024 18659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713fc706977a4a539ef88c24c84d7cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:00.649048 18735 tablet_service.cc:1511] Processing CreateTablet for tablet 713fc706977a4a539ef88c24c84d7cb4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=09207ac4b4864ef5b62e297d6883c32f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:00.650895 18735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713fc706977a4a539ef88c24c84d7cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:00.651185 18808 tablet_service.cc:1511] Processing CreateTablet for tablet 713fc706977a4a539ef88c24c84d7cb4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=09207ac4b4864ef5b62e297d6883c32f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:00.652558 18808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713fc706977a4a539ef88c24c84d7cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:00.652318 18660 tablet_service.cc:1511] Processing CreateTablet for tablet 871f42e94dba46b095e3d40414050e85 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=09207ac4b4864ef5b62e297d6883c32f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:00.653623 18660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871f42e94dba46b095e3d40414050e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:00.655572 18809 tablet_service.cc:1511] Processing CreateTablet for tablet 871f42e94dba46b095e3d40414050e85 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=09207ac4b4864ef5b62e297d6883c32f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:00.656879 18809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871f42e94dba46b095e3d40414050e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:00.655570 18734 tablet_service.cc:1511] Processing CreateTablet for tablet 871f42e94dba46b095e3d40414050e85 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=09207ac4b4864ef5b62e297d6883c32f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:00.658883 18734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871f42e94dba46b095e3d40414050e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:00.670950 18860 tablet_bootstrap.cc:492] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f: Bootstrap starting.
I20260709 13:22:00.678848 18861 tablet_bootstrap.cc:492] T 871f42e94dba46b095e3d40414050e85 P 10ae19afea094d389a12beacef3876be: Bootstrap starting.
I20260709 13:22:00.679481 18860 tablet_bootstrap.cc:654] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.687285 18861 tablet_bootstrap.cc:654] T 871f42e94dba46b095e3d40414050e85 P 10ae19afea094d389a12beacef3876be: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.690279 18859 tablet_bootstrap.cc:492] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d: Bootstrap starting.
I20260709 13:22:00.700301 18860 tablet_bootstrap.cc:492] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f: No bootstrap required, opened a new log
I20260709 13:22:00.700855 18859 tablet_bootstrap.cc:654] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.700901 18860 ts_tablet_manager.cc:1403] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f: Time spent bootstrapping tablet: real 0.030s	user 0.024s	sys 0.005s
I20260709 13:22:00.703008 18861 tablet_bootstrap.cc:492] T 871f42e94dba46b095e3d40414050e85 P 10ae19afea094d389a12beacef3876be: No bootstrap required, opened a new log
I20260709 13:22:00.707257 18861 ts_tablet_manager.cc:1403] T 871f42e94dba46b095e3d40414050e85 P 10ae19afea094d389a12beacef3876be: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.004s
I20260709 13:22:00.706434 18860 raft_consensus.cc:359] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.709344 18860 raft_consensus.cc:385] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.709712 18860 raft_consensus.cc:740] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa23ebc02a334604a7a20b2166d90c2f, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.710346 18861 raft_consensus.cc:359] T 871f42e94dba46b095e3d40414050e85 P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.711158 18861 raft_consensus.cc:385] T 871f42e94dba46b095e3d40414050e85 P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.711752 18861 raft_consensus.cc:740] T 871f42e94dba46b095e3d40414050e85 P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10ae19afea094d389a12beacef3876be, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.710999 18860 consensus_queue.cc:260] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.714214 18860 ts_tablet_manager.cc:1434] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:22:00.714563 18859 tablet_bootstrap.cc:492] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d: No bootstrap required, opened a new log
I20260709 13:22:00.712881 18861 consensus_queue.cc:260] T 871f42e94dba46b095e3d40414050e85 P 10ae19afea094d389a12beacef3876be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.715126 18859 ts_tablet_manager.cc:1403] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.003s
I20260709 13:22:00.717061 18861 ts_tablet_manager.cc:1434] T 871f42e94dba46b095e3d40414050e85 P 10ae19afea094d389a12beacef3876be: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:22:00.718209 18861 tablet_bootstrap.cc:492] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be: Bootstrap starting.
I20260709 13:22:00.717163 18860 tablet_bootstrap.cc:492] T 871f42e94dba46b095e3d40414050e85 P fa23ebc02a334604a7a20b2166d90c2f: Bootstrap starting.
I20260709 13:22:00.719738 18859 raft_consensus.cc:359] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.721638 18859 raft_consensus.cc:385] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.721959 18859 raft_consensus.cc:740] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb076c85c4934024a0dae115ebeb161d, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.722808 18859 consensus_queue.cc:260] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.726243 18861 tablet_bootstrap.cc:654] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.729265 18860 tablet_bootstrap.cc:654] T 871f42e94dba46b095e3d40414050e85 P fa23ebc02a334604a7a20b2166d90c2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.733233 18859 ts_tablet_manager.cc:1434] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:22:00.736464 18859 tablet_bootstrap.cc:492] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d: Bootstrap starting.
I20260709 13:22:00.741940 18860 tablet_bootstrap.cc:492] T 871f42e94dba46b095e3d40414050e85 P fa23ebc02a334604a7a20b2166d90c2f: No bootstrap required, opened a new log
I20260709 13:22:00.742609 18860 ts_tablet_manager.cc:1403] T 871f42e94dba46b095e3d40414050e85 P fa23ebc02a334604a7a20b2166d90c2f: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.004s
I20260709 13:22:00.743263 18861 tablet_bootstrap.cc:492] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be: No bootstrap required, opened a new log
I20260709 13:22:00.743896 18861 ts_tablet_manager.cc:1403] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.006s
I20260709 13:22:00.744661 18859 tablet_bootstrap.cc:654] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.745862 18860 raft_consensus.cc:359] T 871f42e94dba46b095e3d40414050e85 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.746671 18860 raft_consensus.cc:385] T 871f42e94dba46b095e3d40414050e85 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.746975 18860 raft_consensus.cc:740] T 871f42e94dba46b095e3d40414050e85 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa23ebc02a334604a7a20b2166d90c2f, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.747192 18861 raft_consensus.cc:359] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.748100 18861 raft_consensus.cc:385] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.747864 18860 consensus_queue.cc:260] T 871f42e94dba46b095e3d40414050e85 P fa23ebc02a334604a7a20b2166d90c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.748462 18861 raft_consensus.cc:740] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10ae19afea094d389a12beacef3876be, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.749356 18861 consensus_queue.cc:260] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.751701 18861 ts_tablet_manager.cc:1434] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:22:00.753607 18860 ts_tablet_manager.cc:1434] T 871f42e94dba46b095e3d40414050e85 P fa23ebc02a334604a7a20b2166d90c2f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:22:00.756353 18859 tablet_bootstrap.cc:492] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d: No bootstrap required, opened a new log
I20260709 13:22:00.756875 18859 ts_tablet_manager.cc:1403] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:22:00.760110 18859 raft_consensus.cc:359] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.760907 18859 raft_consensus.cc:385] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.761225 18859 raft_consensus.cc:740] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb076c85c4934024a0dae115ebeb161d, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.762094 18859 consensus_queue.cc:260] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.764544 18859 ts_tablet_manager.cc:1434] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:22:00.817413 18616 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:00.824483 18864 raft_consensus.cc:493] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:00.825094 18864 raft_consensus.cc:515] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.827014 18864 leader_election.cc:290] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa23ebc02a334604a7a20b2166d90c2f (127.6.214.130:37685), 10ae19afea094d389a12beacef3876be (127.6.214.131:41001)
I20260709 13:22:00.827903 18745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f42e94dba46b095e3d40414050e85" candidate_uuid: "cb076c85c4934024a0dae115ebeb161d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa23ebc02a334604a7a20b2166d90c2f" is_pre_election: true
I20260709 13:22:00.828308 18819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f42e94dba46b095e3d40414050e85" candidate_uuid: "cb076c85c4934024a0dae115ebeb161d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10ae19afea094d389a12beacef3876be" is_pre_election: true
I20260709 13:22:00.828744 18745 raft_consensus.cc:2468] T 871f42e94dba46b095e3d40414050e85 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb076c85c4934024a0dae115ebeb161d in term 0.
I20260709 13:22:00.828934 18819 raft_consensus.cc:2468] T 871f42e94dba46b095e3d40414050e85 P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb076c85c4934024a0dae115ebeb161d in term 0.
I20260709 13:22:00.829888 18635 leader_election.cc:304] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb076c85c4934024a0dae115ebeb161d, fa23ebc02a334604a7a20b2166d90c2f; no voters: 
I20260709 13:22:00.830526 18864 raft_consensus.cc:2804] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:00.830943 18864 raft_consensus.cc:493] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:00.831334 18864 raft_consensus.cc:3060] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.836875 18864 raft_consensus.cc:515] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.839241 18864 leader_election.cc:290] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [CANDIDATE]: Term 1 election: Requested vote from peers fa23ebc02a334604a7a20b2166d90c2f (127.6.214.130:37685), 10ae19afea094d389a12beacef3876be (127.6.214.131:41001)
I20260709 13:22:00.840094 18745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f42e94dba46b095e3d40414050e85" candidate_uuid: "cb076c85c4934024a0dae115ebeb161d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa23ebc02a334604a7a20b2166d90c2f"
I20260709 13:22:00.840482 18819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871f42e94dba46b095e3d40414050e85" candidate_uuid: "cb076c85c4934024a0dae115ebeb161d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10ae19afea094d389a12beacef3876be"
I20260709 13:22:00.840837 18745 raft_consensus.cc:3060] T 871f42e94dba46b095e3d40414050e85 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.841055 18819 raft_consensus.cc:3060] T 871f42e94dba46b095e3d40414050e85 P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.848395 18745 raft_consensus.cc:2468] T 871f42e94dba46b095e3d40414050e85 P fa23ebc02a334604a7a20b2166d90c2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb076c85c4934024a0dae115ebeb161d in term 1.
I20260709 13:22:00.848395 18819 raft_consensus.cc:2468] T 871f42e94dba46b095e3d40414050e85 P 10ae19afea094d389a12beacef3876be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb076c85c4934024a0dae115ebeb161d in term 1.
I20260709 13:22:00.849953 18635 leader_election.cc:304] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10ae19afea094d389a12beacef3876be, cb076c85c4934024a0dae115ebeb161d; no voters: 
I20260709 13:22:00.850621 18864 raft_consensus.cc:2804] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:00.851151 18864 raft_consensus.cc:697] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [term 1 LEADER]: Becoming Leader. State: Replica: cb076c85c4934024a0dae115ebeb161d, State: Running, Role: LEADER
I20260709 13:22:00.851981 18864 consensus_queue.cc:237] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:00.859054 18565 catalog_manager.cc:5697] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d reported cstate change: term changed from 0 to 1, leader changed from <none> to cb076c85c4934024a0dae115ebeb161d (127.6.214.129). New cstate: current_term: 1 leader_uuid: "cb076c85c4934024a0dae115ebeb161d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:00.973318 18866 consensus_queue.cc:1048] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:00.986133 18866 consensus_queue.cc:1048] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.012929 18872 raft_consensus.cc:493] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:01.013381 18872 raft_consensus.cc:515] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:01.015273 18872 leader_election.cc:290] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb076c85c4934024a0dae115ebeb161d (127.6.214.129:37363), 10ae19afea094d389a12beacef3876be (127.6.214.131:41001)
I20260709 13:22:01.016301 18819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713fc706977a4a539ef88c24c84d7cb4" candidate_uuid: "fa23ebc02a334604a7a20b2166d90c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10ae19afea094d389a12beacef3876be" is_pre_election: true
I20260709 13:22:01.016304 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713fc706977a4a539ef88c24c84d7cb4" candidate_uuid: "fa23ebc02a334604a7a20b2166d90c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb076c85c4934024a0dae115ebeb161d" is_pre_election: true
I20260709 13:22:01.017304 18819 raft_consensus.cc:2468] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa23ebc02a334604a7a20b2166d90c2f in term 0.
I20260709 13:22:01.017416 18670 raft_consensus.cc:2468] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa23ebc02a334604a7a20b2166d90c2f in term 0.
I20260709 13:22:01.018641 18710 leader_election.cc:304] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10ae19afea094d389a12beacef3876be, fa23ebc02a334604a7a20b2166d90c2f; no voters: 
I20260709 13:22:01.019369 18872 raft_consensus.cc:2804] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:01.019752 18872 raft_consensus.cc:493] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:01.020067 18872 raft_consensus.cc:3060] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.025452 18872 raft_consensus.cc:515] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:01.027422 18872 leader_election.cc:290] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [CANDIDATE]: Term 1 election: Requested vote from peers cb076c85c4934024a0dae115ebeb161d (127.6.214.129:37363), 10ae19afea094d389a12beacef3876be (127.6.214.131:41001)
I20260709 13:22:01.028450 18819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713fc706977a4a539ef88c24c84d7cb4" candidate_uuid: "fa23ebc02a334604a7a20b2166d90c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10ae19afea094d389a12beacef3876be"
I20260709 13:22:01.028316 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713fc706977a4a539ef88c24c84d7cb4" candidate_uuid: "fa23ebc02a334604a7a20b2166d90c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb076c85c4934024a0dae115ebeb161d"
I20260709 13:22:01.029129 18819 raft_consensus.cc:3060] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.029175 18670 raft_consensus.cc:3060] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.034850 18670 raft_consensus.cc:2468] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa23ebc02a334604a7a20b2166d90c2f in term 1.
I20260709 13:22:01.036013 18711 leader_election.cc:304] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb076c85c4934024a0dae115ebeb161d, fa23ebc02a334604a7a20b2166d90c2f; no voters: 
I20260709 13:22:01.036083 18819 raft_consensus.cc:2468] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa23ebc02a334604a7a20b2166d90c2f in term 1.
I20260709 13:22:01.036927 18872 raft_consensus.cc:2804] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:01.037552 18872 raft_consensus.cc:697] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 1 LEADER]: Becoming Leader. State: Replica: fa23ebc02a334604a7a20b2166d90c2f, State: Running, Role: LEADER
I20260709 13:22:01.038431 18872 consensus_queue.cc:237] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:01.038717 18864 consensus_queue.cc:1048] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.047163 18565 catalog_manager.cc:5697] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f reported cstate change: term changed from 0 to 1, leader changed from <none> to fa23ebc02a334604a7a20b2166d90c2f (127.6.214.130). New cstate: current_term: 1 leader_uuid: "fa23ebc02a334604a7a20b2166d90c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:01.053797 18876 consensus_queue.cc:1048] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [LEADER]: Connected to new peer: Peer: permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:01.091284 18745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e170f6fe49d4119b50770e64f13cd2a"
dest_uuid: "fa23ebc02a334604a7a20b2166d90c2f"
mode: GRACEFUL
new_leader_uuid: "10ae19afea094d389a12beacef3876be"
 from {username='slave'} at 127.0.0.1:55646
I20260709 13:22:01.091859 18745 raft_consensus.cc:606] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 1 LEADER]: Received request to transfer leadership to TS 10ae19afea094d389a12beacef3876be
I20260709 13:22:01.098488 18745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "713fc706977a4a539ef88c24c84d7cb4"
dest_uuid: "fa23ebc02a334604a7a20b2166d90c2f"
mode: GRACEFUL
new_leader_uuid: "cb076c85c4934024a0dae115ebeb161d"
 from {username='slave'} at 127.0.0.1:55646
I20260709 13:22:01.099090 18745 raft_consensus.cc:606] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 1 LEADER]: Received request to transfer leadership to TS cb076c85c4934024a0dae115ebeb161d
I20260709 13:22:01.370787 18876 consensus_queue.cc:1048] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [LEADER]: Connected to new peer: Peer: permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.377405 18876 consensus_queue.cc:1048] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.437915 18866 raft_consensus.cc:993] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f: : Instructing follower 10ae19afea094d389a12beacef3876be to start an election
I20260709 13:22:01.438405 18903 raft_consensus.cc:1081] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 1 LEADER]: Signalling peer 10ae19afea094d389a12beacef3876be to start an election
I20260709 13:22:01.440253 18819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e170f6fe49d4119b50770e64f13cd2a"
dest_uuid: "10ae19afea094d389a12beacef3876be"
 from {username='slave'} at 127.0.0.1:35618
I20260709 13:22:01.441049 18819 raft_consensus.cc:493] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:01.441347 18819 raft_consensus.cc:3060] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.446987 18819 raft_consensus.cc:515] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:01.449088 18819 leader_election.cc:290] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [CANDIDATE]: Term 2 election: Requested vote from peers cb076c85c4934024a0dae115ebeb161d (127.6.214.129:37363), fa23ebc02a334604a7a20b2166d90c2f (127.6.214.130:37685)
I20260709 13:22:01.461525 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e170f6fe49d4119b50770e64f13cd2a" candidate_uuid: "10ae19afea094d389a12beacef3876be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb076c85c4934024a0dae115ebeb161d"
I20260709 13:22:01.461649 18745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e170f6fe49d4119b50770e64f13cd2a" candidate_uuid: "10ae19afea094d389a12beacef3876be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa23ebc02a334604a7a20b2166d90c2f"
I20260709 13:22:01.462240 18670 raft_consensus.cc:3060] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.462307 18745 raft_consensus.cc:3055] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:01.462778 18745 raft_consensus.cc:740] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa23ebc02a334604a7a20b2166d90c2f, State: Running, Role: LEADER
I20260709 13:22:01.463537 18745 consensus_queue.cc:260] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:01.464529 18745 raft_consensus.cc:3060] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.467936 18670 raft_consensus.cc:2468] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10ae19afea094d389a12beacef3876be in term 2.
I20260709 13:22:01.469153 18785 leader_election.cc:304] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10ae19afea094d389a12beacef3876be, cb076c85c4934024a0dae115ebeb161d; no voters: 
I20260709 13:22:01.470033 18868 raft_consensus.cc:2804] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:01.470194 18745 raft_consensus.cc:2468] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10ae19afea094d389a12beacef3876be in term 2.
I20260709 13:22:01.471482 18868 raft_consensus.cc:697] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [term 2 LEADER]: Becoming Leader. State: Replica: 10ae19afea094d389a12beacef3876be, State: Running, Role: LEADER
I20260709 13:22:01.472429 18868 consensus_queue.cc:237] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:01.473999 18903 consensus_queue.cc:1048] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.479887 18565 catalog_manager.cc:5697] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be reported cstate change: term changed from 1 to 2, leader changed from fa23ebc02a334604a7a20b2166d90c2f (127.6.214.130) to 10ae19afea094d389a12beacef3876be (127.6.214.131). New cstate: current_term: 2 leader_uuid: "10ae19afea094d389a12beacef3876be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:01.486161 18866 consensus_queue.cc:1048] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:01.493881 18872 raft_consensus.cc:993] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f: : Instructing follower cb076c85c4934024a0dae115ebeb161d to start an election
I20260709 13:22:01.494393 18866 raft_consensus.cc:1081] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 1 LEADER]: Signalling peer cb076c85c4934024a0dae115ebeb161d to start an election
I20260709 13:22:01.496034 18670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "713fc706977a4a539ef88c24c84d7cb4"
dest_uuid: "cb076c85c4934024a0dae115ebeb161d"
 from {username='slave'} at 127.0.0.1:45340
I20260709 13:22:01.496556 18670 raft_consensus.cc:493] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:01.496873 18670 raft_consensus.cc:3060] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.502477 18670 raft_consensus.cc:515] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:01.504650 18670 leader_election.cc:290] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [CANDIDATE]: Term 2 election: Requested vote from peers fa23ebc02a334604a7a20b2166d90c2f (127.6.214.130:37685), 10ae19afea094d389a12beacef3876be (127.6.214.131:41001)
I20260709 13:22:01.505466 18745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713fc706977a4a539ef88c24c84d7cb4" candidate_uuid: "cb076c85c4934024a0dae115ebeb161d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa23ebc02a334604a7a20b2166d90c2f"
I20260709 13:22:01.505839 18819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713fc706977a4a539ef88c24c84d7cb4" candidate_uuid: "cb076c85c4934024a0dae115ebeb161d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10ae19afea094d389a12beacef3876be"
I20260709 13:22:01.506120 18745 raft_consensus.cc:3055] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:01.506529 18745 raft_consensus.cc:740] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa23ebc02a334604a7a20b2166d90c2f, State: Running, Role: LEADER
I20260709 13:22:01.506551 18819 raft_consensus.cc:3060] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.507359 18745 consensus_queue.cc:260] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:01.508486 18745 raft_consensus.cc:3060] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.512837 18819 raft_consensus.cc:2468] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb076c85c4934024a0dae115ebeb161d in term 2.
I20260709 13:22:01.513821 18745 raft_consensus.cc:2468] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb076c85c4934024a0dae115ebeb161d in term 2.
I20260709 13:22:01.514256 18635 leader_election.cc:304] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10ae19afea094d389a12beacef3876be, cb076c85c4934024a0dae115ebeb161d; no voters: 
I20260709 13:22:01.515223 18897 raft_consensus.cc:2804] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:01.515704 18897 raft_consensus.cc:697] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 2 LEADER]: Becoming Leader. State: Replica: cb076c85c4934024a0dae115ebeb161d, State: Running, Role: LEADER
I20260709 13:22:01.516543 18897 consensus_queue.cc:237] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:01.522907 18568 catalog_manager.cc:5697] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d reported cstate change: term changed from 1 to 2, leader changed from fa23ebc02a334604a7a20b2166d90c2f (127.6.214.130) to cb076c85c4934024a0dae115ebeb161d (127.6.214.129). New cstate: current_term: 2 leader_uuid: "cb076c85c4934024a0dae115ebeb161d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:01.563092  7002 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:22:01.564707  7002 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:22:01.565133  7002 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:22:01.577827 18670 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "713fc706977a4a539ef88c24c84d7cb4"
dest_uuid: "cb076c85c4934024a0dae115ebeb161d"
mode: GRACEFUL
new_leader_uuid: "fa23ebc02a334604a7a20b2166d90c2f"
 from {username='slave'} at 127.0.0.1:45350
I20260709 13:22:01.578445 18670 raft_consensus.cc:606] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 2 LEADER]: Received request to transfer leadership to TS fa23ebc02a334604a7a20b2166d90c2f
I20260709 13:22:01.579713  7002 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:22:01.890311 18670 raft_consensus.cc:1275] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d [term 2 FOLLOWER]: Refusing update from remote peer 10ae19afea094d389a12beacef3876be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:01.891836 18868 consensus_queue.cc:1048] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:01.901530 18745 raft_consensus.cc:1275] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 2 FOLLOWER]: Refusing update from remote peer 10ae19afea094d389a12beacef3876be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:01.903954 18868 consensus_queue.cc:1048] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:01.918439 18745 raft_consensus.cc:1275] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 2 FOLLOWER]: Refusing update from remote peer cb076c85c4934024a0dae115ebeb161d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:01.920229 18897 consensus_queue.cc:1048] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:01.925803 18864 raft_consensus.cc:993] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d: : Instructing follower fa23ebc02a334604a7a20b2166d90c2f to start an election
I20260709 13:22:01.926316 18897 raft_consensus.cc:1081] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 2 LEADER]: Signalling peer fa23ebc02a334604a7a20b2166d90c2f to start an election
I20260709 13:22:01.934020 18744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "713fc706977a4a539ef88c24c84d7cb4"
dest_uuid: "fa23ebc02a334604a7a20b2166d90c2f"
 from {username='slave'} at 127.0.0.1:55638
I20260709 13:22:01.934438 18819 raft_consensus.cc:1275] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be [term 2 FOLLOWER]: Refusing update from remote peer cb076c85c4934024a0dae115ebeb161d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:01.934638 18744 raft_consensus.cc:493] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:01.935016 18744 raft_consensus.cc:3060] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:01.944031 18897 consensus_queue.cc:1048] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [LEADER]: Connected to new peer: Peer: permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:01.943859 18744 raft_consensus.cc:515] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:01.947211 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713fc706977a4a539ef88c24c84d7cb4" candidate_uuid: "fa23ebc02a334604a7a20b2166d90c2f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb076c85c4934024a0dae115ebeb161d"
I20260709 13:22:01.947966 18670 raft_consensus.cc:3055] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:01.947805 18818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713fc706977a4a539ef88c24c84d7cb4" candidate_uuid: "fa23ebc02a334604a7a20b2166d90c2f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10ae19afea094d389a12beacef3876be"
I20260709 13:22:01.948531 18670 raft_consensus.cc:740] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb076c85c4934024a0dae115ebeb161d, State: Running, Role: LEADER
I20260709 13:22:01.949378 18670 consensus_queue.cc:260] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:01.950342 18670 raft_consensus.cc:3060] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:01.952167 18744 leader_election.cc:290] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [CANDIDATE]: Term 3 election: Requested vote from peers cb076c85c4934024a0dae115ebeb161d (127.6.214.129:37363), 10ae19afea094d389a12beacef3876be (127.6.214.131:41001)
I20260709 13:22:01.957732 18670 raft_consensus.cc:2468] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa23ebc02a334604a7a20b2166d90c2f in term 3.
I20260709 13:22:01.958990 18711 leader_election.cc:304] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cb076c85c4934024a0dae115ebeb161d, fa23ebc02a334604a7a20b2166d90c2f; no voters: 10ae19afea094d389a12beacef3876be
I20260709 13:22:01.959860 18866 raft_consensus.cc:2804] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:01.960475 18866 raft_consensus.cc:697] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 3 LEADER]: Becoming Leader. State: Replica: fa23ebc02a334604a7a20b2166d90c2f, State: Running, Role: LEADER
I20260709 13:22:01.961144 18866 consensus_queue.cc:237] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } }
I20260709 13:22:01.968025 18568 catalog_manager.cc:5697] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f reported cstate change: term changed from 2 to 3, leader changed from cb076c85c4934024a0dae115ebeb161d (127.6.214.129) to fa23ebc02a334604a7a20b2166d90c2f (127.6.214.130). New cstate: current_term: 3 leader_uuid: "fa23ebc02a334604a7a20b2166d90c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb076c85c4934024a0dae115ebeb161d" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa23ebc02a334604a7a20b2166d90c2f" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10ae19afea094d389a12beacef3876be" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 41001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.208156  7002 tablet_server.cc:179] TabletServer@127.6.214.129:0 shutting down...
I20260709 13:22:02.229351  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:02.230165  7002 tablet_replica.cc:333] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d: stopping tablet replica
I20260709 13:22:02.230705  7002 raft_consensus.cc:2243] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:02.231528  7002 raft_consensus.cc:2272] T 871f42e94dba46b095e3d40414050e85 P cb076c85c4934024a0dae115ebeb161d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.233853  7002 tablet_replica.cc:333] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d: stopping tablet replica
I20260709 13:22:02.234350  7002 raft_consensus.cc:2243] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.234732  7002 raft_consensus.cc:2272] T 713fc706977a4a539ef88c24c84d7cb4 P cb076c85c4934024a0dae115ebeb161d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.236996  7002 tablet_replica.cc:333] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d: stopping tablet replica
I20260709 13:22:02.237718  7002 raft_consensus.cc:2243] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:02.238526  7002 raft_consensus.cc:2272] T 20247642e7ea4131818f961f92145831 P cb076c85c4934024a0dae115ebeb161d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.240382  7002 tablet_replica.cc:333] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d: stopping tablet replica
I20260709 13:22:02.240983  7002 raft_consensus.cc:2243] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.241470  7002 raft_consensus.cc:2272] T 8e170f6fe49d4119b50770e64f13cd2a P cb076c85c4934024a0dae115ebeb161d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.255000  7002 tablet_server.cc:196] TabletServer@127.6.214.129:0 shutdown complete.
I20260709 13:22:02.267701  7002 tablet_server.cc:179] TabletServer@127.6.214.130:0 shutting down...
I20260709 13:22:02.287657  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:02.288405  7002 tablet_replica.cc:333] T 871f42e94dba46b095e3d40414050e85 P fa23ebc02a334604a7a20b2166d90c2f: stopping tablet replica
I20260709 13:22:02.289039  7002 raft_consensus.cc:2243] T 871f42e94dba46b095e3d40414050e85 P fa23ebc02a334604a7a20b2166d90c2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.289693  7002 raft_consensus.cc:2272] T 871f42e94dba46b095e3d40414050e85 P fa23ebc02a334604a7a20b2166d90c2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.292296  7002 tablet_replica.cc:333] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f: stopping tablet replica
I20260709 13:22:02.292897  7002 raft_consensus.cc:2243] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:02.293812  7002 pending_rounds.cc:70] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f: Trying to abort 1 pending ops.
I20260709 13:22:02.294052  7002 pending_rounds.cc:77] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305639206760824832 op_type: NO_OP noop_request { }
I20260709 13:22:02.294409  7002 raft_consensus.cc:2889] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:22:02.294719  7002 raft_consensus.cc:2272] T 713fc706977a4a539ef88c24c84d7cb4 P fa23ebc02a334604a7a20b2166d90c2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.297195  7002 tablet_replica.cc:333] T 20247642e7ea4131818f961f92145831 P fa23ebc02a334604a7a20b2166d90c2f: stopping tablet replica
I20260709 13:22:02.297924  7002 raft_consensus.cc:2243] T 20247642e7ea4131818f961f92145831 P fa23ebc02a334604a7a20b2166d90c2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.298497  7002 raft_consensus.cc:2272] T 20247642e7ea4131818f961f92145831 P fa23ebc02a334604a7a20b2166d90c2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.300917  7002 tablet_replica.cc:333] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f: stopping tablet replica
I20260709 13:22:02.301523  7002 raft_consensus.cc:2243] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.301988  7002 raft_consensus.cc:2272] T 8e170f6fe49d4119b50770e64f13cd2a P fa23ebc02a334604a7a20b2166d90c2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.315712  7002 tablet_server.cc:196] TabletServer@127.6.214.130:0 shutdown complete.
I20260709 13:22:02.329083  7002 tablet_server.cc:179] TabletServer@127.6.214.131:0 shutting down...
I20260709 13:22:02.349532  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:02.350175  7002 tablet_replica.cc:333] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be: stopping tablet replica
I20260709 13:22:02.350723  7002 raft_consensus.cc:2243] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.351333  7002 raft_consensus.cc:2272] T 713fc706977a4a539ef88c24c84d7cb4 P 10ae19afea094d389a12beacef3876be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.354017  7002 tablet_replica.cc:333] T 871f42e94dba46b095e3d40414050e85 P 10ae19afea094d389a12beacef3876be: stopping tablet replica
I20260709 13:22:02.354562  7002 raft_consensus.cc:2243] T 871f42e94dba46b095e3d40414050e85 P 10ae19afea094d389a12beacef3876be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.355186  7002 raft_consensus.cc:2272] T 871f42e94dba46b095e3d40414050e85 P 10ae19afea094d389a12beacef3876be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.358500  7002 tablet_replica.cc:333] T 20247642e7ea4131818f961f92145831 P 10ae19afea094d389a12beacef3876be: stopping tablet replica
I20260709 13:22:02.359277  7002 raft_consensus.cc:2243] T 20247642e7ea4131818f961f92145831 P 10ae19afea094d389a12beacef3876be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.359889  7002 raft_consensus.cc:2272] T 20247642e7ea4131818f961f92145831 P 10ae19afea094d389a12beacef3876be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.362573  7002 tablet_replica.cc:333] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be: stopping tablet replica
I20260709 13:22:02.363278  7002 raft_consensus.cc:2243] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:02.364032  7002 raft_consensus.cc:2272] T 8e170f6fe49d4119b50770e64f13cd2a P 10ae19afea094d389a12beacef3876be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.388903  7002 tablet_server.cc:196] TabletServer@127.6.214.131:0 shutdown complete.
I20260709 13:22:02.400918  7002 master.cc:562] Master@127.6.214.190:33229 shutting down...
I20260709 13:22:02.417286  7002 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:02.417984  7002 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.418262  7002 tablet_replica.cc:333] T 00000000000000000000000000000000 P 145036ba47b0489b939757b15fcc8743: stopping tablet replica
I20260709 13:22:02.436594  7002 master.cc:584] Master@127.6.214.190:33229 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2784 ms)
[----------] 6 tests from LeaderRebalancerTest (398401 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:22:02.465854  7002 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.214.190:40473
I20260709 13:22:02.466910  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:02.472649 18914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:02.473816 18915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:02.478185 18917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:02.478339  7002 server_base.cc:1061] running on GCE node
I20260709 13:22:02.479902  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:02.480150  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:02.480355  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603322480336 us; error 0 us; skew 500 ppm
I20260709 13:22:02.481012  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:02.483714  7002 webserver.cc:533] Webserver started at http://127.6.214.190:43693/ using document root <none> and password file <none>
I20260709 13:22:02.484252  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:02.484500  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:02.484809  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:02.486151  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/master-0-root/instance:
uuid: "979229bf4e3e4837b004eabadd8da6fb"
format_stamp: "Formatted at 2026-07-09 13:22:02 on dist-test-slave-rnv4"
I20260709 13:22:02.491394  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:22:02.495342 18922 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:02.496272  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:22:02.496548  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/master-0-root
uuid: "979229bf4e3e4837b004eabadd8da6fb"
format_stamp: "Formatted at 2026-07-09 13:22:02 on dist-test-slave-rnv4"
I20260709 13:22:02.496815  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:02.515632  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:02.516750  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:02.558035  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.190:40473
I20260709 13:22:02.558144 18973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.190:40473 every 8 connection(s)
I20260709 13:22:02.562408 18974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:02.574105 18974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb: Bootstrap starting.
I20260709 13:22:02.579049 18974 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.584101 18974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb: No bootstrap required, opened a new log
I20260709 13:22:02.586627 18974 raft_consensus.cc:359] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979229bf4e3e4837b004eabadd8da6fb" member_type: VOTER }
I20260709 13:22:02.587092 18974 raft_consensus.cc:385] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.587337 18974 raft_consensus.cc:740] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 979229bf4e3e4837b004eabadd8da6fb, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.588091 18974 consensus_queue.cc:260] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979229bf4e3e4837b004eabadd8da6fb" member_type: VOTER }
I20260709 13:22:02.588627 18974 raft_consensus.cc:399] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:02.588896 18974 raft_consensus.cc:493] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:02.589162 18974 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.594676 18974 raft_consensus.cc:515] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979229bf4e3e4837b004eabadd8da6fb" member_type: VOTER }
I20260709 13:22:02.595265 18974 leader_election.cc:304] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 979229bf4e3e4837b004eabadd8da6fb; no voters: 
I20260709 13:22:02.596570 18974 leader_election.cc:290] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:02.596963 18977 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:02.598450 18977 raft_consensus.cc:697] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [term 1 LEADER]: Becoming Leader. State: Replica: 979229bf4e3e4837b004eabadd8da6fb, State: Running, Role: LEADER
I20260709 13:22:02.599131 18977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979229bf4e3e4837b004eabadd8da6fb" member_type: VOTER }
I20260709 13:22:02.599817 18974 sys_catalog.cc:565] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:02.602356 18979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 979229bf4e3e4837b004eabadd8da6fb. Latest consensus state: current_term: 1 leader_uuid: "979229bf4e3e4837b004eabadd8da6fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979229bf4e3e4837b004eabadd8da6fb" member_type: VOTER } }
I20260709 13:22:02.602298 18978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "979229bf4e3e4837b004eabadd8da6fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979229bf4e3e4837b004eabadd8da6fb" member_type: VOTER } }
I20260709 13:22:02.603040 18979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:02.603116 18978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:02.607949 18982 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:02.613188 18982 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:02.616307  7002 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:02.623600 18982 catalog_manager.cc:1383] Generated new cluster ID: 463c52891f984a6cbaf370c71c539945
I20260709 13:22:02.623896 18982 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:02.646343 18982 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:02.647955 18982 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:02.675768 18982 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb: Generated new TSK 0
I20260709 13:22:02.676543 18982 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:02.683073  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:02.688997 18995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:02.689950 18996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:02.691591 18998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:02.692762  7002 server_base.cc:1061] running on GCE node
I20260709 13:22:02.693856  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:02.694090  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:02.694279  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603322694259 us; error 0 us; skew 500 ppm
I20260709 13:22:02.694885  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:02.697683  7002 webserver.cc:533] Webserver started at http://127.6.214.129:36603/ using document root <none> and password file <none>
I20260709 13:22:02.698233  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:02.698451  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:02.698845  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:02.700022  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/ts-0-root/instance:
uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
format_stamp: "Formatted at 2026-07-09 13:22:02 on dist-test-slave-rnv4"
I20260709 13:22:02.705055  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:22:02.708941 19003 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:02.710068  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:22:02.710400  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/ts-0-root
uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
format_stamp: "Formatted at 2026-07-09 13:22:02 on dist-test-slave-rnv4"
I20260709 13:22:02.710721  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:02.728087  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:02.729387  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:02.731141  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:02.733804  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:02.734067  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:02.734387  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:02.734604  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:02.780373  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.129:43901
I20260709 13:22:02.780509 19065 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.129:43901 every 8 connection(s)
I20260709 13:22:02.785955  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:02.794042 19070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:02.795526 19071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:02.797271 19073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:02.799322  7002 server_base.cc:1061] running on GCE node
I20260709 13:22:02.800135 19066 heartbeater.cc:344] Connected to a master server at 127.6.214.190:40473
I20260709 13:22:02.800639 19066 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:02.801412  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:02.801788  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:02.801715 19066 heartbeater.cc:507] Master 127.6.214.190:40473 requested a full tablet report, sending...
I20260709 13:22:02.802184  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603322802163 us; error 0 us; skew 500 ppm
I20260709 13:22:02.803022  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:02.804847 18939 ts_manager.cc:194] Registered new tserver with Master: c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901)
I20260709 13:22:02.806524  7002 webserver.cc:533] Webserver started at http://127.6.214.130:44193/ using document root <none> and password file <none>
I20260709 13:22:02.807276  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:02.807580  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:02.807930  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:02.807921 18939 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50416
I20260709 13:22:02.809859  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/ts-1-root/instance:
uuid: "e83f5fba2ee14240b2fbc847592de0a4"
format_stamp: "Formatted at 2026-07-09 13:22:02 on dist-test-slave-rnv4"
I20260709 13:22:02.815366  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:22:02.819434 19078 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:02.820410  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:22:02.820773  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/ts-1-root
uuid: "e83f5fba2ee14240b2fbc847592de0a4"
format_stamp: "Formatted at 2026-07-09 13:22:02 on dist-test-slave-rnv4"
I20260709 13:22:02.821197  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:02.837904  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:02.839224  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:02.840845  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:02.843416  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:02.843678  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:02.843973  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:02.844172  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:02.896232  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.130:37443
I20260709 13:22:02.896355 19140 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.130:37443 every 8 connection(s)
I20260709 13:22:02.902684  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:02.913245 19144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:02.914285 19145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:02.916884 19141 heartbeater.cc:344] Connected to a master server at 127.6.214.190:40473
I20260709 13:22:02.917586 19141 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:02.918148  7002 server_base.cc:1061] running on GCE node
I20260709 13:22:02.918601 19141 heartbeater.cc:507] Master 127.6.214.190:40473 requested a full tablet report, sending...
W20260709 13:22:02.919155 19147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:02.920387  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:02.920867  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:02.921115 18939 ts_manager.cc:194] Registered new tserver with Master: e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:02.921233  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603322921197 us; error 0 us; skew 500 ppm
I20260709 13:22:02.922187  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:02.922909 18939 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50418
I20260709 13:22:02.925005  7002 webserver.cc:533] Webserver started at http://127.6.214.131:44745/ using document root <none> and password file <none>
I20260709 13:22:02.925632  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:02.925855  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:02.926141  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:02.927254  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/ts-2-root/instance:
uuid: "71b10608b007487ebfb9e047eaf4cd0a"
format_stamp: "Formatted at 2026-07-09 13:22:02 on dist-test-slave-rnv4"
I20260709 13:22:02.931948  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:22:02.935606 19152 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:02.936647  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:22:02.937031  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/ts-2-root
uuid: "71b10608b007487ebfb9e047eaf4cd0a"
format_stamp: "Formatted at 2026-07-09 13:22:02 on dist-test-slave-rnv4"
I20260709 13:22:02.937347  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602923898527-7002-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:02.948815  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:02.950017  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:02.952533  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:02.956215  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:02.956522  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:02.956826  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:02.957073  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:03.001533  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.131:35969
I20260709 13:22:03.001670 19214 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.131:35969 every 8 connection(s)
I20260709 13:22:03.017247 19215 heartbeater.cc:344] Connected to a master server at 127.6.214.190:40473
I20260709 13:22:03.017845 19215 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:03.019021 19215 heartbeater.cc:507] Master 127.6.214.190:40473 requested a full tablet report, sending...
I20260709 13:22:03.021723 18939 ts_manager.cc:194] Registered new tserver with Master: 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:03.021970  7002 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017161662s
I20260709 13:22:03.023962 18939 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50422
I20260709 13:22:03.051967 18939 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50426:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:03.054591 18939 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:03.139252 19031 tablet_service.cc:1511] Processing CreateTablet for tablet d817f3a613834a79bcea8fafa547b64a (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:03.140727 19031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d817f3a613834a79bcea8fafa547b64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.147784 19106 tablet_service.cc:1511] Processing CreateTablet for tablet d817f3a613834a79bcea8fafa547b64a (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:03.148423 19105 tablet_service.cc:1511] Processing CreateTablet for tablet 43e34daa36f341509f8cbea46184e476 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:03.149672 19106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d817f3a613834a79bcea8fafa547b64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.150427 19105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e34daa36f341509f8cbea46184e476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.152145 19030 tablet_service.cc:1511] Processing CreateTablet for tablet 43e34daa36f341509f8cbea46184e476 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:03.153723 19030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e34daa36f341509f8cbea46184e476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.153484 19104 tablet_service.cc:1511] Processing CreateTablet for tablet bbde267020e049928693787ee5ff42a7 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:03.155092 19104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbde267020e049928693787ee5ff42a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.162778 19103 tablet_service.cc:1511] Processing CreateTablet for tablet 400116f7ebba4af48c18dabc32bec377 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:03.164407 19103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400116f7ebba4af48c18dabc32bec377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.175278 19106 tablet_service.cc:1511] Processing CreateTablet for tablet a3253d2ad2b64c8c9248f22c5120e3d3 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:03.176931 19106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3253d2ad2b64c8c9248f22c5120e3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.176390 19102 tablet_service.cc:1511] Processing CreateTablet for tablet 029eef820bfd4d72aa620e37e109c44d (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:03.178532 19102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 029eef820bfd4d72aa620e37e109c44d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.187552 19029 tablet_service.cc:1511] Processing CreateTablet for tablet bbde267020e049928693787ee5ff42a7 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:03.189198 19029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbde267020e049928693787ee5ff42a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.188735 19028 tablet_service.cc:1511] Processing CreateTablet for tablet 400116f7ebba4af48c18dabc32bec377 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:03.190835 19028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400116f7ebba4af48c18dabc32bec377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.196024 19027 tablet_service.cc:1511] Processing CreateTablet for tablet a3253d2ad2b64c8c9248f22c5120e3d3 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:03.198323 19027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3253d2ad2b64c8c9248f22c5120e3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.207106 19026 tablet_service.cc:1511] Processing CreateTablet for tablet 029eef820bfd4d72aa620e37e109c44d (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:03.208981 19104 tablet_service.cc:1511] Processing CreateTablet for tablet 68fef2ec1a33423dab70f94865974ef6 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:03.210119 19180 tablet_service.cc:1511] Processing CreateTablet for tablet d817f3a613834a79bcea8fafa547b64a (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:03.211867 19180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d817f3a613834a79bcea8fafa547b64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.212641 19101 tablet_service.cc:1511] Processing CreateTablet for tablet 6b888baeb8304aa6bc76a3bba3765667 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:03.213621 19179 tablet_service.cc:1511] Processing CreateTablet for tablet 43e34daa36f341509f8cbea46184e476 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:03.215339 19179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e34daa36f341509f8cbea46184e476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.215724 19106 tablet_service.cc:1511] Processing CreateTablet for tablet f408b6da07994e6b8404d08de526968e (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:03.218881 19178 tablet_service.cc:1511] Processing CreateTablet for tablet bbde267020e049928693787ee5ff42a7 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:03.220785 19178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbde267020e049928693787ee5ff42a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.222903 19177 tablet_service.cc:1511] Processing CreateTablet for tablet 400116f7ebba4af48c18dabc32bec377 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:03.224738 19177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400116f7ebba4af48c18dabc32bec377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.226620 19175 tablet_service.cc:1511] Processing CreateTablet for tablet 029eef820bfd4d72aa620e37e109c44d (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:03.228106 19175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 029eef820bfd4d72aa620e37e109c44d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.230723 19174 tablet_service.cc:1511] Processing CreateTablet for tablet f408b6da07994e6b8404d08de526968e (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:03.234710 19172 tablet_service.cc:1511] Processing CreateTablet for tablet 6b888baeb8304aa6bc76a3bba3765667 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:03.237154 19176 tablet_service.cc:1511] Processing CreateTablet for tablet a3253d2ad2b64c8c9248f22c5120e3d3 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:03.233139 19173 tablet_service.cc:1511] Processing CreateTablet for tablet 68fef2ec1a33423dab70f94865974ef6 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:03.210530 19104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68fef2ec1a33423dab70f94865974ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.241034 19101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b888baeb8304aa6bc76a3bba3765667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.241509 19026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 029eef820bfd4d72aa620e37e109c44d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.246248 19025 tablet_service.cc:1511] Processing CreateTablet for tablet f408b6da07994e6b8404d08de526968e (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:03.247884 19025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f408b6da07994e6b8404d08de526968e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.249768 19106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f408b6da07994e6b8404d08de526968e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.251096 19024 tablet_service.cc:1511] Processing CreateTablet for tablet 68fef2ec1a33423dab70f94865974ef6 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:03.252619 19024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68fef2ec1a33423dab70f94865974ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.264112 19174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f408b6da07994e6b8404d08de526968e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.266007 19172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b888baeb8304aa6bc76a3bba3765667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.267722 19173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68fef2ec1a33423dab70f94865974ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.269474 19176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3253d2ad2b64c8c9248f22c5120e3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.310359 19031 tablet_service.cc:1511] Processing CreateTablet for tablet 6b888baeb8304aa6bc76a3bba3765667 (DEFAULT_TABLE table=test-workload [id=4f7a4cbfba6e4b41b0805d24625744fa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:03.311810 19031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b888baeb8304aa6bc76a3bba3765667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:03.366331 19231 tablet_bootstrap.cc:492] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:03.371647 19230 tablet_bootstrap.cc:492] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:03.409147 19230 tablet_bootstrap.cc:654] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.410213 19231 tablet_bootstrap.cc:654] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.420536 19232 tablet_bootstrap.cc:492] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:03.427536 19232 tablet_bootstrap.cc:654] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.428336 19230 tablet_bootstrap.cc:492] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:03.428840 19230 ts_tablet_manager.cc:1403] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.017s
I20260709 13:22:03.429275 19231 tablet_bootstrap.cc:492] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:03.429812 19231 ts_tablet_manager.cc:1403] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.002s
I20260709 13:22:03.431568 19230 raft_consensus.cc:359] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.432236 19230 raft_consensus.cc:385] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.432495 19230 raft_consensus.cc:740] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.432636 19232 tablet_bootstrap.cc:492] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:03.432754 19231 raft_consensus.cc:359] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.433300 19232 ts_tablet_manager.cc:1403] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:22:03.433204 19230 consensus_queue.cc:260] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.433631 19231 raft_consensus.cc:385] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.434072 19231 raft_consensus.cc:740] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.435066 19231 consensus_queue.cc:260] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.435868 19141 heartbeater.cc:499] Master 127.6.214.190:40473 was elected leader, sending a full tablet report...
I20260709 13:22:03.436420 19230 ts_tablet_manager.cc:1434] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:03.437386 19230 tablet_bootstrap.cc:492] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:03.437062 19232 raft_consensus.cc:359] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.438146 19232 raft_consensus.cc:385] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.438557 19232 raft_consensus.cc:740] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.439796 19232 consensus_queue.cc:260] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.443641 19230 tablet_bootstrap.cc:654] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.448946 19215 heartbeater.cc:499] Master 127.6.214.190:40473 was elected leader, sending a full tablet report...
I20260709 13:22:03.449769 19232 ts_tablet_manager.cc:1434] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.009s
I20260709 13:22:03.451319 19232 tablet_bootstrap.cc:492] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:03.459685 19232 tablet_bootstrap.cc:654] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.461478 19066 heartbeater.cc:499] Master 127.6.214.190:40473 was elected leader, sending a full tablet report...
I20260709 13:22:03.462751 19231 ts_tablet_manager.cc:1434] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.033s	user 0.019s	sys 0.011s
I20260709 13:22:03.464196 19231 tablet_bootstrap.cc:492] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:03.472653 19231 tablet_bootstrap.cc:654] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.476182 19232 tablet_bootstrap.cc:492] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:03.476812 19232 ts_tablet_manager.cc:1403] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.008s
I20260709 13:22:03.480705 19232 raft_consensus.cc:359] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.481958 19230 tablet_bootstrap.cc:492] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:03.482005 19232 raft_consensus.cc:385] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.482699 19232 raft_consensus.cc:740] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.483708 19232 consensus_queue.cc:260] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.482605 19230 ts_tablet_manager.cc:1403] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.001s
I20260709 13:22:03.486014 19232 ts_tablet_manager.cc:1434] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.006s
I20260709 13:22:03.487041 19232 tablet_bootstrap.cc:492] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:03.487993 19236 raft_consensus.cc:493] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:03.488291 19231 tablet_bootstrap.cc:492] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:03.488914 19231 ts_tablet_manager.cc:1403] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.011s
I20260709 13:22:03.488556 19236 raft_consensus.cc:515] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.492054 19231 raft_consensus.cc:359] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.492918 19231 raft_consensus.cc:385] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.493209 19231 raft_consensus.cc:740] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.493408 19232 tablet_bootstrap.cc:654] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.494304 19231 consensus_queue.cc:260] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.496893 19231 ts_tablet_manager.cc:1434] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:03.498217 19231 tablet_bootstrap.cc:492] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:03.499766 19230 raft_consensus.cc:359] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } }
I20260709 13:22:03.500569 19230 raft_consensus.cc:385] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.500844 19230 raft_consensus.cc:740] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.501698 19230 consensus_queue.cc:260] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } }
I20260709 13:22:03.503031 19237 raft_consensus.cc:493] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:03.507412 19237 raft_consensus.cc:515] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.506528 19231 tablet_bootstrap.cc:654] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.505631 19232 tablet_bootstrap.cc:492] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:03.509567 19232 ts_tablet_manager.cc:1403] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:22:03.512763 19232 raft_consensus.cc:359] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.513583 19232 raft_consensus.cc:385] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.513897 19232 raft_consensus.cc:740] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.514685 19232 consensus_queue.cc:260] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.517719 19232 ts_tablet_manager.cc:1434] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:03.497035 19236 leader_election.cc:290] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:03.519316 19232 tablet_bootstrap.cc:492] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:03.527199 19237 leader_election.cc:290] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:03.508126 19230 ts_tablet_manager.cc:1434] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 13:22:03.529747 19232 tablet_bootstrap.cc:654] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.530678 19231 tablet_bootstrap.cc:492] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:03.531268 19231 ts_tablet_manager.cc:1403] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.001s
I20260709 13:22:03.533228 19230 tablet_bootstrap.cc:492] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:03.534974 19231 raft_consensus.cc:359] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } }
I20260709 13:22:03.536088 19231 raft_consensus.cc:385] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.536491 19231 raft_consensus.cc:740] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.537842 19231 consensus_queue.cc:260] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } }
I20260709 13:22:03.553941 19231 ts_tablet_manager.cc:1434] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.008s
I20260709 13:22:03.555441 19230 tablet_bootstrap.cc:654] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.556349 19232 tablet_bootstrap.cc:492] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:03.557075 19231 tablet_bootstrap.cc:492] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:03.557179 19232 ts_tablet_manager.cc:1403] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.010s
I20260709 13:22:03.560858 19232 raft_consensus.cc:359] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.561774 19232 raft_consensus.cc:385] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.562134 19232 raft_consensus.cc:740] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.562959 19232 consensus_queue.cc:260] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.565322 19232 ts_tablet_manager.cc:1434] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:22:03.566684 19232 tablet_bootstrap.cc:492] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:03.575059 19232 tablet_bootstrap.cc:654] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.578284 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbde267020e049928693787ee5ff42a7" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:03.579138 19190 raft_consensus.cc:2468] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 0.
I20260709 13:22:03.580574 19231 tablet_bootstrap.cc:654] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.580665 19005 leader_election.cc:304] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
I20260709 13:22:03.582077 19237 raft_consensus.cc:2804] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:03.582482 19237 raft_consensus.cc:493] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:03.582846 19237 raft_consensus.cc:3060] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:03.583480 19041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e34daa36f341509f8cbea46184e476" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:03.584219 19041 raft_consensus.cc:2468] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
I20260709 13:22:03.586773 19238 raft_consensus.cc:493] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:03.587620 19238 raft_consensus.cc:515] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.588779 19232 tablet_bootstrap.cc:492] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:03.589445 19232 ts_tablet_manager.cc:1403] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.004s
I20260709 13:22:03.592958 19232 raft_consensus.cc:359] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } }
I20260709 13:22:03.594002 19232 raft_consensus.cc:385] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.594857 19232 raft_consensus.cc:740] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.596318 19080 leader_election.cc:304] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:03.596060 19232 consensus_queue.cc:260] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } }
I20260709 13:22:03.596491 19238 leader_election.cc:290] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:03.601994 19236 raft_consensus.cc:2804] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:03.602596 19236 raft_consensus.cc:493] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:03.603046 19236 raft_consensus.cc:3060] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:03.611251 18987 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:03.630221 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbde267020e049928693787ee5ff42a7" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
I20260709 13:22:03.632283 19238 raft_consensus.cc:493] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:22:03.632447 19004 leader_election.cc:343] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:03.632879 19238 raft_consensus.cc:515] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.634392 19244 raft_consensus.cc:493] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:03.620759 19237 raft_consensus.cc:515] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.635272 19238 leader_election.cc:290] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:03.634941 19244 raft_consensus.cc:515] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } }
I20260709 13:22:03.641367 19244 leader_election.cc:290] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:03.642735 19041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d817f3a613834a79bcea8fafa547b64a" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:03.643708 19041 raft_consensus.cc:2468] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
I20260709 13:22:03.645278 19080 leader_election.cc:304] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:03.646593 19244 raft_consensus.cc:2804] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:03.647090 19244 raft_consensus.cc:493] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:03.647540 19244 raft_consensus.cc:3060] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:03.650483 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbde267020e049928693787ee5ff42a7" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:03.652154 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e34daa36f341509f8cbea46184e476" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:03.653087 19190 raft_consensus.cc:2468] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
W20260709 13:22:03.652230 19004 leader_election.cc:343] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:03.655937 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d817f3a613834a79bcea8fafa547b64a" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:03.656877 19190 raft_consensus.cc:2468] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
I20260709 13:22:03.641300 19230 tablet_bootstrap.cc:492] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:03.665506 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbde267020e049928693787ee5ff42a7" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:03.666582 19230 ts_tablet_manager.cc:1403] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.003s
I20260709 13:22:03.666636 19190 raft_consensus.cc:3060] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:03.671015 19230 raft_consensus.cc:359] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.672169 19230 raft_consensus.cc:385] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.672590 19230 raft_consensus.cc:740] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.673579 19237 leader_election.cc:290] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 election: Requested vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:03.677111 19231 tablet_bootstrap.cc:492] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:03.677803 19231 ts_tablet_manager.cc:1403] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.121s	user 0.056s	sys 0.034s
I20260709 13:22:03.677238 19230 consensus_queue.cc:260] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.675299 19236 raft_consensus.cc:515] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.679881 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029eef820bfd4d72aa620e37e109c44d" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:03.681375 19231 raft_consensus.cc:359] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.681613 19041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e34daa36f341509f8cbea46184e476" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:03.682217 19231 raft_consensus.cc:385] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:22:03.686327 19154 leader_election.cc:343] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:03.688042 19190 raft_consensus.cc:2468] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 1.
I20260709 13:22:03.683251 19189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e34daa36f341509f8cbea46184e476" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:03.683167 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e34daa36f341509f8cbea46184e476" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:03.682919 19236 leader_election.cc:290] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:03.697561 19189 raft_consensus.cc:3060] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:03.690639 19244 raft_consensus.cc:515] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } }
I20260709 13:22:03.699512 19232 ts_tablet_manager.cc:1434] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.110s	user 0.059s	sys 0.032s
I20260709 13:22:03.682492 19041 raft_consensus.cc:2468] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 0.
I20260709 13:22:03.682581 19231 raft_consensus.cc:740] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.701277 19244 leader_election.cc:290] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:03.690346 19230 ts_tablet_manager.cc:1434] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.004s
I20260709 13:22:03.698216 19005 leader_election.cc:304] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:03.701848 19231 consensus_queue.cc:260] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.702870 19230 tablet_bootstrap.cc:492] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:03.703959 19154 leader_election.cc:304] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
I20260709 13:22:03.705015 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d817f3a613834a79bcea8fafa547b64a" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:03.705644 19190 raft_consensus.cc:3060] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:03.709848 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d817f3a613834a79bcea8fafa547b64a" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:03.710158 19259 raft_consensus.cc:2804] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:03.712543 19040 raft_consensus.cc:3060] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:03.711154 19230 tablet_bootstrap.cc:654] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.721104 19259 raft_consensus.cc:697] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Becoming Leader. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:03.722733 19259 consensus_queue.cc:237] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.724450 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e34daa36f341509f8cbea46184e476" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
I20260709 13:22:03.725737 19116 raft_consensus.cc:2393] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71b10608b007487ebfb9e047eaf4cd0a in current term 1: Already voted for candidate e83f5fba2ee14240b2fbc847592de0a4 in this term.
I20260709 13:22:03.714953 19232 tablet_bootstrap.cc:492] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:03.717496 19189 raft_consensus.cc:2468] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 1.
I20260709 13:22:03.727075 19115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029eef820bfd4d72aa620e37e109c44d" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
I20260709 13:22:03.711879 19231 ts_tablet_manager.cc:1434] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.004s
I20260709 13:22:03.727803 19257 raft_consensus.cc:2764] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:22:03.728969 19231 tablet_bootstrap.cc:492] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
W20260709 13:22:03.729987 19153 leader_election.cc:343] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:03.730511 19153 leader_election.cc:304] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a; no voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:03.731711 19238 raft_consensus.cc:2749] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:03.732239 19080 leader_election.cc:304] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, e83f5fba2ee14240b2fbc847592de0a4; no voters: c7efbbf28df8445093a7ecf94e0b6b47
I20260709 13:22:03.734133 19258 raft_consensus.cc:2804] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:03.734681 19258 raft_consensus.cc:697] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Becoming Leader. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:03.735726 19258 consensus_queue.cc:237] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.736719 19231 tablet_bootstrap.cc:654] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.741839 18937 catalog_manager.cc:5697] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:03.716979 19190 raft_consensus.cc:2468] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 1.
I20260709 13:22:03.744421 19040 raft_consensus.cc:2468] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 1.
I20260709 13:22:03.744911 19080 leader_election.cc:304] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:03.746577 19244 raft_consensus.cc:2804] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:03.747229 19244 raft_consensus.cc:697] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Becoming Leader. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:03.747663 19232 tablet_bootstrap.cc:654] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.748137 19244 consensus_queue.cc:237] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } }
I20260709 13:22:03.752365 19230 tablet_bootstrap.cc:492] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:03.753183 19230 ts_tablet_manager.cc:1403] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.051s	user 0.005s	sys 0.013s
I20260709 13:22:03.757326 19230 raft_consensus.cc:359] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.758538 19230 raft_consensus.cc:385] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.758934 19230 raft_consensus.cc:740] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.759966 19230 consensus_queue.cc:260] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.763962 19230 ts_tablet_manager.cc:1434] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:22:03.764130 19232 tablet_bootstrap.cc:492] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:03.764995 19232 ts_tablet_manager.cc:1403] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.010s
I20260709 13:22:03.769855 19232 raft_consensus.cc:359] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.775002 19232 raft_consensus.cc:385] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.770785 19230 tablet_bootstrap.cc:492] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:03.775324 19232 raft_consensus.cc:740] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.776176 19232 consensus_queue.cc:260] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.774561 19231 tablet_bootstrap.cc:492] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:03.778839 19231 ts_tablet_manager.cc:1403] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.050s	user 0.026s	sys 0.020s
I20260709 13:22:03.781209 19232 ts_tablet_manager.cc:1434] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:22:03.780975 18938 catalog_manager.cc:5697] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:03.782388 19232 tablet_bootstrap.cc:492] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:03.782173 19231 raft_consensus.cc:359] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.782951 19231 raft_consensus.cc:385] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.783270 19231 raft_consensus.cc:740] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.784132 19231 consensus_queue.cc:260] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.786331 19231 ts_tablet_manager.cc:1434] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:22:03.787341 19231 tablet_bootstrap.cc:492] T 029eef820bfd4d72aa620e37e109c44d P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:03.793949 19231 tablet_bootstrap.cc:654] T 029eef820bfd4d72aa620e37e109c44d P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.795742 19230 tablet_bootstrap.cc:654] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.793967 19232 tablet_bootstrap.cc:654] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.820672 19231 tablet_bootstrap.cc:492] T 029eef820bfd4d72aa620e37e109c44d P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:03.820683 19230 tablet_bootstrap.cc:492] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:03.821444 19231 ts_tablet_manager.cc:1403] T 029eef820bfd4d72aa620e37e109c44d P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.027s
I20260709 13:22:03.821475 19230 ts_tablet_manager.cc:1403] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.006s
I20260709 13:22:03.822193 18938 catalog_manager.cc:5697] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:03.825021 19230 raft_consensus.cc:359] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.825224 19231 raft_consensus.cc:359] T 029eef820bfd4d72aa620e37e109c44d P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.825882 19230 raft_consensus.cc:385] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.826104 19231 raft_consensus.cc:385] T 029eef820bfd4d72aa620e37e109c44d P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.826670 19231 raft_consensus.cc:740] T 029eef820bfd4d72aa620e37e109c44d P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.826231 19230 raft_consensus.cc:740] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.827481 19231 consensus_queue.cc:260] T 029eef820bfd4d72aa620e37e109c44d P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.827744 19230 consensus_queue.cc:260] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.829890 19231 ts_tablet_manager.cc:1434] T 029eef820bfd4d72aa620e37e109c44d P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:03.830616 19230 ts_tablet_manager.cc:1434] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:22:03.830983 19231 tablet_bootstrap.cc:492] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:03.831717 19230 tablet_bootstrap.cc:492] T 6b888baeb8304aa6bc76a3bba3765667 P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:03.836212 19232 tablet_bootstrap.cc:492] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:03.836786 19232 ts_tablet_manager.cc:1403] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.019s
I20260709 13:22:03.838496 19231 tablet_bootstrap.cc:654] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.840004 19232 raft_consensus.cc:359] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.840862 19232 raft_consensus.cc:385] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.841125 19230 tablet_bootstrap.cc:654] T 6b888baeb8304aa6bc76a3bba3765667 P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.841192 19232 raft_consensus.cc:740] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.842471 19232 consensus_queue.cc:260] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.847889 19232 ts_tablet_manager.cc:1434] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:22:03.849097 19232 tablet_bootstrap.cc:492] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:03.851533 19231 tablet_bootstrap.cc:492] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:03.851944 19230 tablet_bootstrap.cc:492] T 6b888baeb8304aa6bc76a3bba3765667 P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:03.852172 19231 ts_tablet_manager.cc:1403] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:22:03.852437 19230 ts_tablet_manager.cc:1403] T 6b888baeb8304aa6bc76a3bba3765667 P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
I20260709 13:22:03.855365 19231 raft_consensus.cc:359] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.855683 19230 raft_consensus.cc:359] T 6b888baeb8304aa6bc76a3bba3765667 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.856238 19231 raft_consensus.cc:385] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.856366 19230 raft_consensus.cc:385] T 6b888baeb8304aa6bc76a3bba3765667 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.856513 19232 tablet_bootstrap.cc:654] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.856604 19231 raft_consensus.cc:740] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.857370 19230 raft_consensus.cc:740] T 6b888baeb8304aa6bc76a3bba3765667 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.857692 19231 consensus_queue.cc:260] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.858165 19230 consensus_queue.cc:260] T 6b888baeb8304aa6bc76a3bba3765667 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.860178 19231 ts_tablet_manager.cc:1434] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:03.861231 19230 ts_tablet_manager.cc:1434] T 6b888baeb8304aa6bc76a3bba3765667 P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:03.861519 19231 tablet_bootstrap.cc:492] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:03.862589 19230 tablet_bootstrap.cc:492] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:03.870159 19231 tablet_bootstrap.cc:654] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.871814 19230 tablet_bootstrap.cc:654] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.880951 19232 tablet_bootstrap.cc:492] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:03.881515 19232 ts_tablet_manager.cc:1403] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.012s
I20260709 13:22:03.882344 19231 tablet_bootstrap.cc:492] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:03.882860 19231 ts_tablet_manager.cc:1403] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 13:22:03.883491 19230 tablet_bootstrap.cc:492] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:03.884131 19230 ts_tablet_manager.cc:1403] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 13:22:03.884181 19232 raft_consensus.cc:359] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.884835 19257 raft_consensus.cc:493] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:03.885097 19232 raft_consensus.cc:385] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.885610 19232 raft_consensus.cc:740] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.885453 19231 raft_consensus.cc:359] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.885659 19257 raft_consensus.cc:515] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.886270 19231 raft_consensus.cc:385] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.886775 19231 raft_consensus.cc:740] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.886744 19232 consensus_queue.cc:260] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.887636 19230 raft_consensus.cc:359] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.887919 19231 consensus_queue.cc:260] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.888448 19230 raft_consensus.cc:385] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.888797 19230 raft_consensus.cc:740] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.889606 19232 ts_tablet_manager.cc:1434] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:22:03.889539 19230 consensus_queue.cc:260] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.890456 19231 ts_tablet_manager.cc:1434] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:22:03.890841 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400116f7ebba4af48c18dabc32bec377" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:03.891077 19232 tablet_bootstrap.cc:492] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:03.891532 19231 tablet_bootstrap.cc:492] T 6b888baeb8304aa6bc76a3bba3765667 P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:03.891522 19040 raft_consensus.cc:2468] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 0.
I20260709 13:22:03.892001 19230 ts_tablet_manager.cc:1434] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:03.892823 19115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400116f7ebba4af48c18dabc32bec377" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
I20260709 13:22:03.893514 19115 raft_consensus.cc:2468] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 0.
I20260709 13:22:03.894127 19154 leader_election.cc:304] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
I20260709 13:22:03.895051 19238 raft_consensus.cc:2804] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:03.895535 19238 raft_consensus.cc:493] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:03.895943 19238 raft_consensus.cc:3060] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:03.899075 19230 tablet_bootstrap.cc:492] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:03.899125 19231 tablet_bootstrap.cc:654] T 6b888baeb8304aa6bc76a3bba3765667 P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.895560 19257 leader_election.cc:290] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:03.907503 19230 tablet_bootstrap.cc:654] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.907641 19238 raft_consensus.cc:515] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.914513 19232 tablet_bootstrap.cc:654] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.916453 19231 tablet_bootstrap.cc:492] T 6b888baeb8304aa6bc76a3bba3765667 P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:03.917068 19231 ts_tablet_manager.cc:1403] T 6b888baeb8304aa6bc76a3bba3765667 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 13:22:03.919759 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400116f7ebba4af48c18dabc32bec377" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:03.920015 19231 raft_consensus.cc:359] T 6b888baeb8304aa6bc76a3bba3765667 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.920465 19040 raft_consensus.cc:3060] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:03.920708 19231 raft_consensus.cc:385] T 6b888baeb8304aa6bc76a3bba3765667 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.921042 19231 raft_consensus.cc:740] T 6b888baeb8304aa6bc76a3bba3765667 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.922103 19231 consensus_queue.cc:260] T 6b888baeb8304aa6bc76a3bba3765667 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.925263 19231 ts_tablet_manager.cc:1434] T 6b888baeb8304aa6bc76a3bba3765667 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:03.929355 19040 raft_consensus.cc:2468] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 1.
I20260709 13:22:03.930117 19238 leader_election.cc:290] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:03.930748 19154 leader_election.cc:304] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
I20260709 13:22:03.931721 19115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400116f7ebba4af48c18dabc32bec377" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:03.932691 19115 raft_consensus.cc:3060] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:03.931886 19238 raft_consensus.cc:2804] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:03.934309 19232 tablet_bootstrap.cc:492] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:03.934885 19232 ts_tablet_manager.cc:1403] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.003s
I20260709 13:22:03.934309 19230 tablet_bootstrap.cc:492] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:03.935766 19230 ts_tablet_manager.cc:1403] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.016s
I20260709 13:22:03.937906 19232 raft_consensus.cc:359] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.934830 19238 raft_consensus.cc:697] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Becoming Leader. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Running, Role: LEADER
I20260709 13:22:03.938719 19232 raft_consensus.cc:385] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.938862 19257 raft_consensus.cc:493] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:03.939034 19232 raft_consensus.cc:740] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.939489 19238 consensus_queue.cc:237] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.939527 19257 raft_consensus.cc:515] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.939867 19232 consensus_queue.cc:260] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.942319 19257 leader_election.cc:290] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:03.938385 19230 raft_consensus.cc:359] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.944205 19230 raft_consensus.cc:385] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:03.944621 19230 raft_consensus.cc:740] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:03.944985 19258 raft_consensus.cc:493] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:03.945564 19258 raft_consensus.cc:515] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.945457 19230 consensus_queue.cc:260] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.945591 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b888baeb8304aa6bc76a3bba3765667" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
I20260709 13:22:03.947093 19116 raft_consensus.cc:2468] T 6b888baeb8304aa6bc76a3bba3765667 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 0.
I20260709 13:22:03.948093 19258 leader_election.cc:290] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:03.948096 19230 ts_tablet_manager.cc:1434] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:22:03.948617 19153 leader_election.cc:304] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:03.949604 19230 tablet_bootstrap.cc:492] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:03.950295 19041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbde267020e049928693787ee5ff42a7" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:03.950486 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbde267020e049928693787ee5ff42a7" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:03.951277 19190 raft_consensus.cc:2393] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e83f5fba2ee14240b2fbc847592de0a4 in current term 1: Already voted for candidate c7efbbf28df8445093a7ecf94e0b6b47 in this term.
I20260709 13:22:03.952459 19257 raft_consensus.cc:2804] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:03.952883 19080 leader_election.cc:304] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e83f5fba2ee14240b2fbc847592de0a4; no voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47
I20260709 13:22:03.953868 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b888baeb8304aa6bc76a3bba3765667" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:03.954375 19244 raft_consensus.cc:3060] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:03.954638 19040 raft_consensus.cc:2468] T 6b888baeb8304aa6bc76a3bba3765667 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 0.
I20260709 13:22:03.952981 19257 raft_consensus.cc:493] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:03.956673 19257 raft_consensus.cc:3060] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:03.964892 19244 raft_consensus.cc:2749] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:03.967609 19230 tablet_bootstrap.cc:654] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:03.969547 19257 raft_consensus.cc:515] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.976168 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b888baeb8304aa6bc76a3bba3765667" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:03.976819 19040 raft_consensus.cc:3060] T 6b888baeb8304aa6bc76a3bba3765667 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:03.977627 19232 ts_tablet_manager.cc:1434] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.042s	user 0.017s	sys 0.017s
I20260709 13:22:03.980329 18937 catalog_manager.cc:5697] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71b10608b007487ebfb9e047eaf4cd0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:03.982568 19257 leader_election.cc:290] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:03.971180 19238 raft_consensus.cc:493] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:03.946545 19115 raft_consensus.cc:2468] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 1.
I20260709 13:22:03.983915 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b888baeb8304aa6bc76a3bba3765667" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:03.983757 19238 raft_consensus.cc:515] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.984855 19040 raft_consensus.cc:2468] T 6b888baeb8304aa6bc76a3bba3765667 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 1.
I20260709 13:22:03.984570 19116 raft_consensus.cc:3060] T 6b888baeb8304aa6bc76a3bba3765667 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:03.986092 19154 leader_election.cc:304] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
I20260709 13:22:03.987787 19238 leader_election.cc:290] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:03.988999 19238 raft_consensus.cc:2804] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:03.990070 19115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3253d2ad2b64c8c9248f22c5120e3d3" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
I20260709 13:22:03.990191 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3253d2ad2b64c8c9248f22c5120e3d3" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:03.991349 19040 raft_consensus.cc:2468] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 0.
I20260709 13:22:03.991739 19115 raft_consensus.cc:2468] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 0.
I20260709 13:22:03.992645 19154 leader_election.cc:304] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
I20260709 13:22:03.993762 19238 raft_consensus.cc:697] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Becoming Leader. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Running, Role: LEADER
I20260709 13:22:03.994542 19257 raft_consensus.cc:2804] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:03.994999 19257 raft_consensus.cc:493] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:03.995345 19257 raft_consensus.cc:3060] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:03.995291 19238 consensus_queue.cc:237] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:03.995329 19116 raft_consensus.cc:2468] T 6b888baeb8304aa6bc76a3bba3765667 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 1.
I20260709 13:22:04.008172 19257 raft_consensus.cc:515] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.013082 19230 tablet_bootstrap.cc:492] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:04.013695 19230 ts_tablet_manager.cc:1403] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.024s
I20260709 13:22:04.013535 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3253d2ad2b64c8c9248f22c5120e3d3" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:04.014243 19116 raft_consensus.cc:3060] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:04.014338 19257 leader_election.cc:290] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:04.016600 19230 raft_consensus.cc:359] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.017321 19230 raft_consensus.cc:385] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:04.017619 19230 raft_consensus.cc:740] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:04.014250 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3253d2ad2b64c8c9248f22c5120e3d3" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:04.019102 19040 raft_consensus.cc:3060] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:04.018251 18937 catalog_manager.cc:5697] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71b10608b007487ebfb9e047eaf4cd0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:04.022367 19116 raft_consensus.cc:2468] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 1.
I20260709 13:22:04.018294 19230 consensus_queue.cc:260] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.025303 19230 ts_tablet_manager.cc:1434] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:22:04.025264 19153 leader_election.cc:304] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:04.027050 19257 raft_consensus.cc:2804] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:04.027809 19257 raft_consensus.cc:697] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Becoming Leader. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Running, Role: LEADER
I20260709 13:22:04.028129 19040 raft_consensus.cc:2468] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 1.
I20260709 13:22:04.028803 19257 consensus_queue.cc:237] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.037560 18936 catalog_manager.cc:5697] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71b10608b007487ebfb9e047eaf4cd0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:04.112419 19244 raft_consensus.cc:493] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:04.113229 19244 raft_consensus.cc:515] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.115164 19244 leader_election.cc:290] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:04.116164 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029eef820bfd4d72aa620e37e109c44d" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:04.116407 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029eef820bfd4d72aa620e37e109c44d" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:04.116977 19040 raft_consensus.cc:2468] T 029eef820bfd4d72aa620e37e109c44d P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
I20260709 13:22:04.117204 19190 raft_consensus.cc:2468] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
I20260709 13:22:04.118316 19080 leader_election.cc:304] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:04.119244 19244 raft_consensus.cc:2804] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:04.119655 19244 raft_consensus.cc:493] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:04.119993 19244 raft_consensus.cc:3060] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:04.120411 19258 consensus_queue.cc:1048] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:04.129635 19244 raft_consensus.cc:515] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.133757 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029eef820bfd4d72aa620e37e109c44d" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:04.134660 19040 raft_consensus.cc:3060] T 029eef820bfd4d72aa620e37e109c44d P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:04.139564 19244 leader_election.cc:290] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:04.140863 19189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029eef820bfd4d72aa620e37e109c44d" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:04.141681 19189 raft_consensus.cc:3060] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:04.146436 19040 raft_consensus.cc:2468] T 029eef820bfd4d72aa620e37e109c44d P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 1.
I20260709 13:22:04.147804 19080 leader_election.cc:304] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:04.148779 19258 raft_consensus.cc:2804] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:04.149931 19189 raft_consensus.cc:2468] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 1.
I20260709 13:22:04.151129 19040 raft_consensus.cc:3060] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:04.152568 19258 raft_consensus.cc:697] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Becoming Leader. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:04.153622 19258 consensus_queue.cc:237] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.161013 19258 consensus_queue.cc:1048] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:04.164775 18936 catalog_manager.cc:5697] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:04.172160 19259 consensus_queue.cc:1048] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:04.181715 19258 raft_consensus.cc:493] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:04.182308 19258 raft_consensus.cc:515] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.184684 19258 leader_election.cc:290] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:04.188237 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f408b6da07994e6b8404d08de526968e" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:04.189036 19190 raft_consensus.cc:2468] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
I20260709 13:22:04.189170 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f408b6da07994e6b8404d08de526968e" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:04.189898 19040 raft_consensus.cc:2468] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
I20260709 13:22:04.190390 19080 leader_election.cc:304] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:04.191241 19259 consensus_queue.cc:1048] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:04.192209 19258 raft_consensus.cc:2804] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:04.192690 19258 raft_consensus.cc:493] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:04.193114 19258 raft_consensus.cc:3060] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:04.204672 19258 raft_consensus.cc:515] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.208565 19258 leader_election.cc:290] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:04.209550 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f408b6da07994e6b8404d08de526968e" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:04.209762 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f408b6da07994e6b8404d08de526968e" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:04.210276 19190 raft_consensus.cc:3060] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:04.210276 19040 raft_consensus.cc:3060] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:04.218758 19040 raft_consensus.cc:2468] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 1.
I20260709 13:22:04.218761 19190 raft_consensus.cc:2468] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 1.
I20260709 13:22:04.220417 19080 leader_election.cc:304] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:04.221320 19258 raft_consensus.cc:2804] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:04.222168 19258 raft_consensus.cc:697] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Becoming Leader. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:04.223853 19258 consensus_queue.cc:237] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.228176 19258 consensus_queue.cc:1048] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:04.230509 19258 consensus_queue.cc:1048] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:04.232909 19257 raft_consensus.cc:493] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:04.233685 19257 raft_consensus.cc:515] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.234445 18937 catalog_manager.cc:5697] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:04.242372 19237 raft_consensus.cc:493] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:04.243155 19237 raft_consensus.cc:515] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.244758 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68fef2ec1a33423dab70f94865974ef6" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
I20260709 13:22:04.245093 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68fef2ec1a33423dab70f94865974ef6" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:04.245539 19116 raft_consensus.cc:2468] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 0.
I20260709 13:22:04.245842 19040 raft_consensus.cc:2468] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 0.
I20260709 13:22:04.246778 19189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68fef2ec1a33423dab70f94865974ef6" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:04.247898 19189 raft_consensus.cc:2468] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 0.
I20260709 13:22:04.249698 19005 leader_election.cc:304] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
I20260709 13:22:04.246858 19153 leader_election.cc:304] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:04.250887 19259 raft_consensus.cc:2804] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:04.247306 19257 leader_election.cc:290] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:04.251271 19238 raft_consensus.cc:2804] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:04.251725 19259 raft_consensus.cc:493] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:04.251905 19238 raft_consensus.cc:493] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:04.252310 19259 raft_consensus.cc:3060] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:04.252401 19238 raft_consensus.cc:3060] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:04.260411 19259 raft_consensus.cc:515] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.261579 19237 leader_election.cc:290] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:04.261685 19238 raft_consensus.cc:515] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.263181 19259 leader_election.cc:290] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 election: Requested vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:04.264231 19189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68fef2ec1a33423dab70f94865974ef6" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:04.265048 19189 raft_consensus.cc:2393] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c7efbbf28df8445093a7ecf94e0b6b47 in current term 1: Already voted for candidate 71b10608b007487ebfb9e047eaf4cd0a in this term.
I20260709 13:22:04.263553 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68fef2ec1a33423dab70f94865974ef6" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
I20260709 13:22:04.265949 19116 raft_consensus.cc:2468] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 0.
I20260709 13:22:04.267591 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68fef2ec1a33423dab70f94865974ef6" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:04.268649 19040 raft_consensus.cc:2393] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 71b10608b007487ebfb9e047eaf4cd0a in current term 1: Already voted for candidate c7efbbf28df8445093a7ecf94e0b6b47 in this term.
I20260709 13:22:04.268744 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68fef2ec1a33423dab70f94865974ef6" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:04.271428 19116 raft_consensus.cc:3060] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:04.271529 19238 leader_election.cc:290] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:04.273835 19115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68fef2ec1a33423dab70f94865974ef6" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:04.275713 19153 leader_election.cc:304] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a; no voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:04.276648 19238 raft_consensus.cc:2749] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:04.281862 19116 raft_consensus.cc:2468] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 1.
I20260709 13:22:04.282984 19004 leader_election.cc:304] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 71b10608b007487ebfb9e047eaf4cd0a
I20260709 13:22:04.283900 19259 raft_consensus.cc:2804] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:04.284437 19259 raft_consensus.cc:697] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Becoming Leader. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:04.285123 19259 consensus_queue.cc:237] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.293360 18937 catalog_manager.cc:5697] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:04.329372 19238 consensus_queue.cc:1048] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:04.343179 19238 consensus_queue.cc:1048] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:04.385285 19238 consensus_queue.cc:1048] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:04.397531 19238 consensus_queue.cc:1048] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:04.431334 19238 consensus_queue.cc:1048] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:04.443818 19281 consensus_queue.cc:1048] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:04.524052 19116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d817f3a613834a79bcea8fafa547b64a"
dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
mode: GRACEFUL
new_leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
 from {username='slave'} at 127.0.0.1:36320
I20260709 13:22:04.524564 19116 raft_consensus.cc:606] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Received request to transfer leadership to TS c7efbbf28df8445093a7ecf94e0b6b47
I20260709 13:22:04.531095 19116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43e34daa36f341509f8cbea46184e476"
dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
mode: GRACEFUL
new_leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
 from {username='slave'} at 127.0.0.1:36320
I20260709 13:22:04.531590 19116 raft_consensus.cc:606] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Received request to transfer leadership to TS c7efbbf28df8445093a7ecf94e0b6b47
I20260709 13:22:04.550869 19190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "400116f7ebba4af48c18dabc32bec377"
dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
mode: GRACEFUL
new_leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
 from {username='slave'} at 127.0.0.1:47520
I20260709 13:22:04.551488 19190 raft_consensus.cc:606] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Received request to transfer leadership to TS c7efbbf28df8445093a7ecf94e0b6b47
I20260709 13:22:04.557659 19190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3253d2ad2b64c8c9248f22c5120e3d3"
dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
mode: GRACEFUL
new_leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
 from {username='slave'} at 127.0.0.1:47520
I20260709 13:22:04.558243 19190 raft_consensus.cc:606] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Received request to transfer leadership to TS e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:04.581081 19040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68fef2ec1a33423dab70f94865974ef6"
dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
mode: GRACEFUL
new_leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:22:04.581713 19040 raft_consensus.cc:606] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Received request to transfer leadership to TS e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:04.591449 19258 consensus_queue.cc:1048] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:04.604082 19236 consensus_queue.cc:1048] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:04.645258 19258 raft_consensus.cc:993] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4: : Instructing follower c7efbbf28df8445093a7ecf94e0b6b47 to start an election
I20260709 13:22:04.645812 19236 raft_consensus.cc:1081] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Signalling peer c7efbbf28df8445093a7ecf94e0b6b47 to start an election
I20260709 13:22:04.647323 19040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d817f3a613834a79bcea8fafa547b64a"
dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
 from {username='slave'} at 127.0.0.1:55602
I20260709 13:22:04.647801 19040 raft_consensus.cc:493] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:04.648067 19040 raft_consensus.cc:3060] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.653079 19040 raft_consensus.cc:515] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } }
I20260709 13:22:04.654772 19040 leader_election.cc:290] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 2 election: Requested vote from peers 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:04.655884 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d817f3a613834a79bcea8fafa547b64a" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:04.655982 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d817f3a613834a79bcea8fafa547b64a" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:04.656900 19190 raft_consensus.cc:3060] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.656947 19116 raft_consensus.cc:3055] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:04.657533 19116 raft_consensus.cc:740] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:04.658505 19116 consensus_queue.cc:260] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } }
I20260709 13:22:04.659946 19116 raft_consensus.cc:3060] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.665724 19190 raft_consensus.cc:2468] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 2.
I20260709 13:22:04.668180 19116 raft_consensus.cc:2468] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 2.
I20260709 13:22:04.667963 19005 leader_election.cc:304] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
I20260709 13:22:04.669960 19237 raft_consensus.cc:2804] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:04.670488 19237 raft_consensus.cc:697] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Becoming Leader. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:04.671178 19237 consensus_queue.cc:237] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } }
I20260709 13:22:04.674860 19259 consensus_queue.cc:1048] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:04.679466 18937 catalog_manager.cc:5697] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 reported cstate change: term changed from 1 to 2, leader changed from e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130) to c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:04.685391 19237 raft_consensus.cc:993] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47: : Instructing follower e83f5fba2ee14240b2fbc847592de0a4 to start an election
I20260709 13:22:04.686003 19294 raft_consensus.cc:1081] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Signalling peer e83f5fba2ee14240b2fbc847592de0a4 to start an election
I20260709 13:22:04.688601 19115 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68fef2ec1a33423dab70f94865974ef6"
dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
 from {username='slave'} at 127.0.0.1:36292
I20260709 13:22:04.690515 19237 consensus_queue.cc:1048] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:04.691051 19115 raft_consensus.cc:493] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:04.691526 19115 raft_consensus.cc:3060] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.694118 19289 raft_consensus.cc:993] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4: : Instructing follower c7efbbf28df8445093a7ecf94e0b6b47 to start an election
I20260709 13:22:04.694633 19289 raft_consensus.cc:1081] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Signalling peer c7efbbf28df8445093a7ecf94e0b6b47 to start an election
I20260709 13:22:04.698832 19040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43e34daa36f341509f8cbea46184e476"
dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
 from {username='slave'} at 127.0.0.1:55602
I20260709 13:22:04.699435 19040 raft_consensus.cc:493] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:04.699819 19040 raft_consensus.cc:3060] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.704790 19115 raft_consensus.cc:515] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.707399 19040 raft_consensus.cc:515] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.710969 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e34daa36f341509f8cbea46184e476" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:04.711597 19190 raft_consensus.cc:3060] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.712508 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e34daa36f341509f8cbea46184e476" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:04.713186 19116 raft_consensus.cc:3055] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:04.713567 19116 raft_consensus.cc:740] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:04.713598 19189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68fef2ec1a33423dab70f94865974ef6" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:04.714382 19189 raft_consensus.cc:3060] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.714639 19116 consensus_queue.cc:260] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.715835 19116 raft_consensus.cc:3060] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.712165 19040 leader_election.cc:290] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 2 election: Requested vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:04.720110 19190 raft_consensus.cc:2468] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 2.
I20260709 13:22:04.712550 19115 leader_election.cc:290] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 2 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:04.722014 19005 leader_election.cc:304] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
I20260709 13:22:04.720167 19189 raft_consensus.cc:2468] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 2.
I20260709 13:22:04.723091 19237 raft_consensus.cc:2804] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:04.724339 19080 leader_election.cc:304] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:04.724687 19237 raft_consensus.cc:697] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Becoming Leader. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:04.724887 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68fef2ec1a33423dab70f94865974ef6" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:04.725244 19289 raft_consensus.cc:2804] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:04.725401 19116 raft_consensus.cc:2468] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 2.
I20260709 13:22:04.726012 19289 raft_consensus.cc:697] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 LEADER]: Becoming Leader. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:04.725855 19237 consensus_queue.cc:237] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.726028 19040 raft_consensus.cc:3055] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:04.726943 19289 consensus_queue.cc:237] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.727634 19040 raft_consensus.cc:740] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:04.728713 19040 consensus_queue.cc:260] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.730185 19040 raft_consensus.cc:3060] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.735754 18937 catalog_manager.cc:5697] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 reported cstate change: term changed from 1 to 2, leader changed from e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130) to c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:04.736857 19040 raft_consensus.cc:2468] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 2.
I20260709 13:22:04.738766 18936 catalog_manager.cc:5697] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 reported cstate change: term changed from 1 to 2, leader changed from c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129) to e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:04.744791 19289 consensus_queue.cc:1048] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:04.758169 19244 consensus_queue.cc:1048] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:04.804322 19281 raft_consensus.cc:993] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a: : Instructing follower c7efbbf28df8445093a7ecf94e0b6b47 to start an election
I20260709 13:22:04.805080 19257 raft_consensus.cc:1081] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Signalling peer c7efbbf28df8445093a7ecf94e0b6b47 to start an election
I20260709 13:22:04.807278 19040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "400116f7ebba4af48c18dabc32bec377"
dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
 from {username='slave'} at 127.0.0.1:55616
I20260709 13:22:04.807768 19040 raft_consensus.cc:493] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:04.808043 19040 raft_consensus.cc:3060] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.813877 19040 raft_consensus.cc:515] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.816205 19040 leader_election.cc:290] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 2 election: Requested vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:04.817155 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400116f7ebba4af48c18dabc32bec377" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:04.817318 19189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400116f7ebba4af48c18dabc32bec377" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:04.817862 19116 raft_consensus.cc:3060] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.818197 19189 raft_consensus.cc:3055] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:04.819016 19189 raft_consensus.cc:740] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Running, Role: LEADER
I20260709 13:22:04.819810 19189 consensus_queue.cc:260] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.820847 19189 raft_consensus.cc:3060] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.824361 19116 raft_consensus.cc:2468] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 2.
I20260709 13:22:04.825999 19004 leader_election.cc:304] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:04.826855 19237 raft_consensus.cc:2804] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:04.826987 19189 raft_consensus.cc:2468] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 2.
I20260709 13:22:04.827437 19237 raft_consensus.cc:697] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Becoming Leader. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:04.828282 19237 consensus_queue.cc:237] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:04.836417 18937 catalog_manager.cc:5697] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 reported cstate change: term changed from 1 to 2, leader changed from 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131) to c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:05.056844 19257 raft_consensus.cc:993] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a: : Instructing follower e83f5fba2ee14240b2fbc847592de0a4 to start an election
I20260709 13:22:05.057499 19238 raft_consensus.cc:1081] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Signalling peer e83f5fba2ee14240b2fbc847592de0a4 to start an election
I20260709 13:22:05.059767 19116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3253d2ad2b64c8c9248f22c5120e3d3"
dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
 from {username='slave'} at 127.0.0.1:36306
I20260709 13:22:05.060443 19116 raft_consensus.cc:493] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:05.060786 19116 raft_consensus.cc:3060] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:05.067029 19116 raft_consensus.cc:515] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:05.069300 19116 leader_election.cc:290] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 2 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:05.070627 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3253d2ad2b64c8c9248f22c5120e3d3" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:05.071044 19189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3253d2ad2b64c8c9248f22c5120e3d3" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:05.071461 19040 raft_consensus.cc:3060] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:05.071720 19189 raft_consensus.cc:3055] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:05.072113 19189 raft_consensus.cc:740] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Running, Role: LEADER
I20260709 13:22:05.072772 19189 consensus_queue.cc:260] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:05.073819 19189 raft_consensus.cc:3060] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:05.076995 19040 raft_consensus.cc:2468] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 2.
I20260709 13:22:05.078333 19080 leader_election.cc:304] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:05.079223 19244 raft_consensus.cc:2804] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:05.079334 19189 raft_consensus.cc:2468] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 2.
I20260709 13:22:05.079690 19244 raft_consensus.cc:697] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 LEADER]: Becoming Leader. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:05.081173 19244 consensus_queue.cc:237] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:05.087803 18937 catalog_manager.cc:5697] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 reported cstate change: term changed from 1 to 2, leader changed from 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131) to e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:05.113744 19189 raft_consensus.cc:1275] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Refusing update from remote peer c7efbbf28df8445093a7ecf94e0b6b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:05.115069 19237 consensus_queue.cc:1048] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:05.126282 19116 raft_consensus.cc:1275] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Refusing update from remote peer c7efbbf28df8445093a7ecf94e0b6b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:05.127928 19294 consensus_queue.cc:1048] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:05.200928 19116 raft_consensus.cc:1275] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Refusing update from remote peer c7efbbf28df8445093a7ecf94e0b6b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:05.202524 19294 consensus_queue.cc:1048] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:05.212064 19189 raft_consensus.cc:1275] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Refusing update from remote peer c7efbbf28df8445093a7ecf94e0b6b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:05.214213 19190 raft_consensus.cc:1275] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Refusing update from remote peer e83f5fba2ee14240b2fbc847592de0a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:05.214376 19116 raft_consensus.cc:1275] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Refusing update from remote peer c7efbbf28df8445093a7ecf94e0b6b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:05.216331 19237 consensus_queue.cc:1048] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:05.216728 19316 consensus_queue.cc:1048] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:05.219012 19244 consensus_queue.cc:1048] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:05.228008 19040 raft_consensus.cc:1275] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Refusing update from remote peer e83f5fba2ee14240b2fbc847592de0a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:05.228724 19189 raft_consensus.cc:1275] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Refusing update from remote peer c7efbbf28df8445093a7ecf94e0b6b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:05.230257 19294 consensus_queue.cc:1048] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:05.233577 19289 consensus_queue.cc:1048] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:05.533011 19040 raft_consensus.cc:1275] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Refusing update from remote peer e83f5fba2ee14240b2fbc847592de0a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:05.534422 19244 consensus_queue.cc:1048] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:05.544147 19190 raft_consensus.cc:1275] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Refusing update from remote peer e83f5fba2ee14240b2fbc847592de0a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:05.545854 19236 consensus_queue.cc:1048] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:07.621681 18936 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50436:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:07.624903 18936 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 13:22:07.655248 18987 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:07.690804 19031 tablet_service.cc:1511] Processing CreateTablet for tablet b5c7f01cae2e42059c0c563044db5397 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:07.691972 19104 tablet_service.cc:1511] Processing CreateTablet for tablet b5c7f01cae2e42059c0c563044db5397 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:07.693248 19031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c7f01cae2e42059c0c563044db5397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.693874 19104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c7f01cae2e42059c0c563044db5397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.696508 19105 tablet_service.cc:1511] Processing CreateTablet for tablet 21ab1224b9f046f78d1d5216c7f14444 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:07.698092 19105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21ab1224b9f046f78d1d5216c7f14444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.697925 19173 tablet_service.cc:1511] Processing CreateTablet for tablet 21ab1224b9f046f78d1d5216c7f14444 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:07.699702 19173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21ab1224b9f046f78d1d5216c7f14444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.699608 19025 tablet_service.cc:1511] Processing CreateTablet for tablet 21ab1224b9f046f78d1d5216c7f14444 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:07.693465 19174 tablet_service.cc:1511] Processing CreateTablet for tablet b5c7f01cae2e42059c0c563044db5397 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:07.702289 19174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c7f01cae2e42059c0c563044db5397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.703819 19106 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb7cc6644bb40ba83130a39dca0ae78 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:07.705262 19106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb7cc6644bb40ba83130a39dca0ae78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.705536 19177 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb7cc6644bb40ba83130a39dca0ae78 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:07.707320 19025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21ab1224b9f046f78d1d5216c7f14444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.709510 19103 tablet_service.cc:1511] Processing CreateTablet for tablet 365043cafcff491b9bc231758de19173 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:07.711004 19103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 365043cafcff491b9bc231758de19173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.711225 19176 tablet_service.cc:1511] Processing CreateTablet for tablet 365043cafcff491b9bc231758de19173 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:07.712682 19028 tablet_service.cc:1511] Processing CreateTablet for tablet 824e7a4eab344663bcb8445e41420e77 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:07.714222 19028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824e7a4eab344663bcb8445e41420e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.714656 19027 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb7cc6644bb40ba83130a39dca0ae78 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:07.716073 19027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb7cc6644bb40ba83130a39dca0ae78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.718689 19026 tablet_service.cc:1511] Processing CreateTablet for tablet 365043cafcff491b9bc231758de19173 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:07.720268 19026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 365043cafcff491b9bc231758de19173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.721063 19102 tablet_service.cc:1511] Processing CreateTablet for tablet 7d6a510430a047e3a4e1f148dcc1f8f6 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:07.722682 19102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d6a510430a047e3a4e1f148dcc1f8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.722731 19101 tablet_service.cc:1511] Processing CreateTablet for tablet 824e7a4eab344663bcb8445e41420e77 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:07.724244 19101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824e7a4eab344663bcb8445e41420e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.726357 19176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 365043cafcff491b9bc231758de19173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.727571 19100 tablet_service.cc:1511] Processing CreateTablet for tablet 5f73dde38f9f490e956b5b005432d729 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:07.728526 19177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb7cc6644bb40ba83130a39dca0ae78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.730943 19180 tablet_service.cc:1511] Processing CreateTablet for tablet 824e7a4eab344663bcb8445e41420e77 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:07.732334 19099 tablet_service.cc:1511] Processing CreateTablet for tablet 4d33cab399124767afa0cb7a78079d60 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:07.732913 19180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824e7a4eab344663bcb8445e41420e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.734768 19178 tablet_service.cc:1511] Processing CreateTablet for tablet 7d6a510430a047e3a4e1f148dcc1f8f6 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:07.741631 19178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d6a510430a047e3a4e1f148dcc1f8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.735396 19100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f73dde38f9f490e956b5b005432d729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.745766 19099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d33cab399124767afa0cb7a78079d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.737252 19024 tablet_service.cc:1511] Processing CreateTablet for tablet 7d6a510430a047e3a4e1f148dcc1f8f6 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:07.747381 19024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d6a510430a047e3a4e1f148dcc1f8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.758091 19030 tablet_service.cc:1511] Processing CreateTablet for tablet 4d33cab399124767afa0cb7a78079d60 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:07.757169 19029 tablet_service.cc:1511] Processing CreateTablet for tablet 5f73dde38f9f490e956b5b005432d729 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:07.758915 19172 tablet_service.cc:1511] Processing CreateTablet for tablet 5f73dde38f9f490e956b5b005432d729 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:07.759828 19030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d33cab399124767afa0cb7a78079d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.760277 19172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f73dde38f9f490e956b5b005432d729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.762168 19029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f73dde38f9f490e956b5b005432d729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.768419 19098 tablet_service.cc:1511] Processing CreateTablet for tablet b330263f08554d608f9a07da0016b0de (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:07.770562 19098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b330263f08554d608f9a07da0016b0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.790719 19023 tablet_service.cc:1511] Processing CreateTablet for tablet b330263f08554d608f9a07da0016b0de (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:07.792275 19023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b330263f08554d608f9a07da0016b0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.821722 19175 tablet_service.cc:1511] Processing CreateTablet for tablet 4d33cab399124767afa0cb7a78079d60 (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:07.823239 19175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d33cab399124767afa0cb7a78079d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.831260 19179 tablet_service.cc:1511] Processing CreateTablet for tablet b330263f08554d608f9a07da0016b0de (DEFAULT_TABLE table=soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:07.832969 19179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b330263f08554d608f9a07da0016b0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.903774 19333 tablet_bootstrap.cc:492] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:07.906687 19334 tablet_bootstrap.cc:492] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:07.920809 19334 tablet_bootstrap.cc:654] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.926755 19332 tablet_bootstrap.cc:492] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:07.936169 19332 tablet_bootstrap.cc:654] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.936426 19333 tablet_bootstrap.cc:654] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.949939 19333 tablet_bootstrap.cc:492] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:07.950470 19333 ts_tablet_manager.cc:1403] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.006s
I20260709 13:22:07.953104 19334 tablet_bootstrap.cc:492] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:07.953774 19334 ts_tablet_manager.cc:1403] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.009s
I20260709 13:22:07.955175 19332 tablet_bootstrap.cc:492] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:07.956012 19332 ts_tablet_manager.cc:1403] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.014s
I20260709 13:22:07.955174 19333 raft_consensus.cc:359] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:07.956462 19333 raft_consensus.cc:385] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.956873 19333 raft_consensus.cc:740] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.956588 19334 raft_consensus.cc:359] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:07.957562 19334 raft_consensus.cc:385] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.957877 19334 raft_consensus.cc:740] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.957785 19333 consensus_queue.cc:260] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:07.959443 19332 raft_consensus.cc:359] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:07.960052 19333 ts_tablet_manager.cc:1434] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:22:07.960263 19332 raft_consensus.cc:385] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.960608 19332 raft_consensus.cc:740] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.961309 19333 tablet_bootstrap.cc:492] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:07.961360 19332 consensus_queue.cc:260] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:07.964573 19332 ts_tablet_manager.cc:1434] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:07.965656 19332 tablet_bootstrap.cc:492] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:07.970072 19334 consensus_queue.cc:260] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:07.972925 19332 tablet_bootstrap.cc:654] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.973642 19334 ts_tablet_manager.cc:1434] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 13:22:07.975008 19334 tablet_bootstrap.cc:492] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:07.982534 19333 tablet_bootstrap.cc:654] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.986073 19334 tablet_bootstrap.cc:654] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.026278 19332 tablet_bootstrap.cc:492] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:08.026432 19333 tablet_bootstrap.cc:492] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:08.027172 19332 ts_tablet_manager.cc:1403] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.062s	user 0.029s	sys 0.022s
I20260709 13:22:08.027254 19333 ts_tablet_manager.cc:1403] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.027s
I20260709 13:22:08.028504 19334 tablet_bootstrap.cc:492] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:08.029059 19334 ts_tablet_manager.cc:1403] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.009s
I20260709 13:22:08.031028 19332 raft_consensus.cc:359] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.031852 19332 raft_consensus.cc:385] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.031479 19333 raft_consensus.cc:359] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.032250 19332 raft_consensus.cc:740] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.032490 19333 raft_consensus.cc:385] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.032873 19333 raft_consensus.cc:740] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.032896 19334 raft_consensus.cc:359] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.033196 19332 consensus_queue.cc:260] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.034020 19334 raft_consensus.cc:385] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.033831 19333 consensus_queue.cc:260] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.034385 19334 raft_consensus.cc:740] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.035320 19334 consensus_queue.cc:260] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.036576 19333 ts_tablet_manager.cc:1434] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:08.037765 19333 tablet_bootstrap.cc:492] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:08.037966 19334 ts_tablet_manager.cc:1434] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:22:08.038981 19334 tablet_bootstrap.cc:492] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:08.039755 19332 ts_tablet_manager.cc:1434] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:22:08.040894 19332 tablet_bootstrap.cc:492] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:08.045202 19333 tablet_bootstrap.cc:654] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.048945 19332 tablet_bootstrap.cc:654] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.058384 19333 tablet_bootstrap.cc:492] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:08.059177 19333 ts_tablet_manager.cc:1403] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:22:08.062314 19334 tablet_bootstrap.cc:654] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.062772 19333 raft_consensus.cc:359] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.063524 19332 tablet_bootstrap.cc:492] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:08.063871 19333 raft_consensus.cc:385] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.064311 19332 ts_tablet_manager.cc:1403] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.011s
I20260709 13:22:08.064543 19333 raft_consensus.cc:740] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.065773 19333 consensus_queue.cc:260] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.068674 19332 raft_consensus.cc:359] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.069342 19333 ts_tablet_manager.cc:1434] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:22:08.069715 19332 raft_consensus.cc:385] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.070108 19332 raft_consensus.cc:740] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.071048 19333 tablet_bootstrap.cc:492] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:08.071184 19332 consensus_queue.cc:260] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.074100 19332 ts_tablet_manager.cc:1434] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.001s
I20260709 13:22:08.075207 19332 tablet_bootstrap.cc:492] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:08.075387 19238 raft_consensus.cc:493] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.075950 19238 raft_consensus.cc:515] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.079272 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f73dde38f9f490e956b5b005432d729" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:08.081876 19333 tablet_bootstrap.cc:654] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.082201 19332 tablet_bootstrap.cc:654] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:08.082548 19154 leader_election.cc:343] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.087765 19334 tablet_bootstrap.cc:492] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:08.089592 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f73dde38f9f490e956b5b005432d729" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
I20260709 13:22:08.090286 19334 ts_tablet_manager.cc:1403] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.004s
W20260709 13:22:08.091585 19153 leader_election.cc:343] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.092303 19332 tablet_bootstrap.cc:492] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:08.092837 19332 ts_tablet_manager.cc:1403] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.001s
I20260709 13:22:08.092111 19153 leader_election.cc:304] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a; no voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:08.093956 19334 raft_consensus.cc:359] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.094775 19334 raft_consensus.cc:385] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.095083 19334 raft_consensus.cc:740] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.095788 19333 tablet_bootstrap.cc:492] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:08.096405 19333 ts_tablet_manager.cc:1403] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.003s
I20260709 13:22:08.097270 19238 leader_election.cc:290] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:08.095985 19334 consensus_queue.cc:260] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.096099 19332 raft_consensus.cc:359] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.098764 19332 raft_consensus.cc:385] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.099107 19332 raft_consensus.cc:740] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.099891 19332 consensus_queue.cc:260] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.097617 19346 raft_consensus.cc:2749] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:08.100534 19333 raft_consensus.cc:359] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.101512 19333 raft_consensus.cc:385] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.101888 19333 raft_consensus.cc:740] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.102826 19333 consensus_queue.cc:260] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.103348 19334 ts_tablet_manager.cc:1434] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 13:22:08.104485 19334 tablet_bootstrap.cc:492] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:08.105352 19333 ts_tablet_manager.cc:1434] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:08.107174 19332 ts_tablet_manager.cc:1434] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:22:08.115589 19334 tablet_bootstrap.cc:654] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.114818 19333 tablet_bootstrap.cc:492] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:08.124233 19333 tablet_bootstrap.cc:654] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.125447 19332 tablet_bootstrap.cc:492] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:08.129778 19334 tablet_bootstrap.cc:492] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:08.130357 19334 ts_tablet_manager.cc:1403] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.012s
I20260709 13:22:08.134085 19332 tablet_bootstrap.cc:654] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.133858 19334 raft_consensus.cc:359] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.134730 19334 raft_consensus.cc:385] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.135099 19334 raft_consensus.cc:740] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.135882 19334 consensus_queue.cc:260] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.140470 19334 ts_tablet_manager.cc:1434] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:22:08.141736 19334 tablet_bootstrap.cc:492] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:08.148151 19332 tablet_bootstrap.cc:492] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:08.148952 19334 tablet_bootstrap.cc:654] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.148978 19332 ts_tablet_manager.cc:1403] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.008s
I20260709 13:22:08.151283 19236 raft_consensus.cc:493] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.153553 19332 raft_consensus.cc:359] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.154632 19332 raft_consensus.cc:385] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.155105 19332 raft_consensus.cc:740] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.156350 19332 consensus_queue.cc:260] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.159067 19332 ts_tablet_manager.cc:1434] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:22:08.160210 19332 tablet_bootstrap.cc:492] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:08.151795 19236 raft_consensus.cc:515] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.165038 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ab1224b9f046f78d1d5216c7f14444" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:08.165954 19040 raft_consensus.cc:2468] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
I20260709 13:22:08.167356 19080 leader_election.cc:304] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:08.169636 19334 tablet_bootstrap.cc:492] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:08.170290 19334 ts_tablet_manager.cc:1403] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.012s
I20260709 13:22:08.171308 19332 tablet_bootstrap.cc:654] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.171432 19236 leader_election.cc:290] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.172646 19346 raft_consensus.cc:493] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.173162 19346 raft_consensus.cc:515] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.173542 19334 raft_consensus.cc:359] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.174291 19334 raft_consensus.cc:385] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.174610 19334 raft_consensus.cc:740] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.175518 19346 leader_election.cc:290] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:08.175407 19334 consensus_queue.cc:260] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.177271 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365043cafcff491b9bc231758de19173" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:08.177474 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365043cafcff491b9bc231758de19173" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
W20260709 13:22:08.178503 19154 leader_election.cc:343] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:08.179546 19153 leader_election.cc:343] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.180188 19153 leader_election.cc:304] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a; no voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:08.181133 19334 ts_tablet_manager.cc:1434] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:22:08.181757 19346 raft_consensus.cc:2749] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:08.182662 19334 tablet_bootstrap.cc:492] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:08.172147 19236 raft_consensus.cc:2804] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.185387 19236 raft_consensus.cc:493] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.188759 19333 tablet_bootstrap.cc:492] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:08.189401 19333 ts_tablet_manager.cc:1403] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.082s	user 0.008s	sys 0.040s
I20260709 13:22:08.191516 19334 tablet_bootstrap.cc:654] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.192692 19333 raft_consensus.cc:359] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.193526 19333 raft_consensus.cc:385] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.193831 19333 raft_consensus.cc:740] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.194830 19333 consensus_queue.cc:260] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.195524 19316 raft_consensus.cc:493] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.196007 19316 raft_consensus.cc:515] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.199339 19353 raft_consensus.cc:493] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.199887 19353 raft_consensus.cc:515] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.200255 19316 leader_election.cc:290] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.185781 19236 raft_consensus.cc:3060] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.200165 19189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f73dde38f9f490e956b5b005432d729" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:08.201781 19189 raft_consensus.cc:2468] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 0.
I20260709 13:22:08.202333 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ab1224b9f046f78d1d5216c7f14444" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:08.204006 19005 leader_election.cc:304] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
W20260709 13:22:08.204378 19080 leader_election.cc:343] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.205242 19316 raft_consensus.cc:2804] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.205688 19316 raft_consensus.cc:493] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.206073 19316 raft_consensus.cc:3060] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.207710 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c7f01cae2e42059c0c563044db5397" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:08.208417 19040 raft_consensus.cc:2468] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
I20260709 13:22:08.200131 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f73dde38f9f490e956b5b005432d729" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
I20260709 13:22:08.209766 19080 leader_election.cc:304] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
W20260709 13:22:08.210851 19004 leader_election.cc:343] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.214277 19353 leader_election.cc:290] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.214859 19353 raft_consensus.cc:2804] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.215219 19353 raft_consensus.cc:493] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.215431 19332 tablet_bootstrap.cc:492] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:08.215564 19353 raft_consensus.cc:3060] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.216148 19332 ts_tablet_manager.cc:1403] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.025s
I20260709 13:22:08.217998 19316 raft_consensus.cc:515] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.220822 19333 ts_tablet_manager.cc:1434] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.003s
I20260709 13:22:08.222011 19333 tablet_bootstrap.cc:492] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:08.224478 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f73dde38f9f490e956b5b005432d729" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:08.224790 19316 leader_election.cc:290] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 election: Requested vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.225334 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f73dde38f9f490e956b5b005432d729" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:08.226076 19190 raft_consensus.cc:3060] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.225982 19236 raft_consensus.cc:515] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
W20260709 13:22:08.227124 19004 leader_election.cc:343] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.224368 19189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c7f01cae2e42059c0c563044db5397" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:08.228037 19189 raft_consensus.cc:2468] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
I20260709 13:22:08.228824 19236 leader_election.cc:290] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.219794 19332 raft_consensus.cc:359] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.229622 19332 raft_consensus.cc:385] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.230018 19332 raft_consensus.cc:740] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.231009 19332 consensus_queue.cc:260] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.233719 19332 ts_tablet_manager.cc:1434] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 13:22:08.234695 19332 tablet_bootstrap.cc:492] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:08.241379 19190 raft_consensus.cc:2468] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 1.
I20260709 13:22:08.242949 19005 leader_election.cc:304] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:08.243716 19346 raft_consensus.cc:493] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.244098 19316 raft_consensus.cc:2804] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.244259 19346 raft_consensus.cc:515] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.244619 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ab1224b9f046f78d1d5216c7f14444" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:08.245180 19040 raft_consensus.cc:3060] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.246745 19334 tablet_bootstrap.cc:492] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:08.247313 19334 ts_tablet_manager.cc:1403] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.013s
I20260709 13:22:08.247351 19346 leader_election.cc:290] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:08.248764 19332 tablet_bootstrap.cc:654] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.248972 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6a510430a047e3a4e1f148dcc1f8f6" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
W20260709 13:22:08.250398 19153 leader_election.cc:343] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.250873 19041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6a510430a047e3a4e1f148dcc1f8f6" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:08.250598 19334 raft_consensus.cc:359] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.244678 19316 raft_consensus.cc:697] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Becoming Leader. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:08.251555 19334 raft_consensus.cc:385] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.252197 19334 raft_consensus.cc:740] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.251616 19041 raft_consensus.cc:2468] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 0.
I20260709 13:22:08.253300 19334 consensus_queue.cc:260] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.255023 19154 leader_election.cc:304] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:08.256321 19346 raft_consensus.cc:2804] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.256814 19334 ts_tablet_manager.cc:1434] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:22:08.258466 19334 tablet_bootstrap.cc:492] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:08.252616 19316 consensus_queue.cc:237] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.256760 19346 raft_consensus.cc:493] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.261234 19333 tablet_bootstrap.cc:654] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.261651 19346 raft_consensus.cc:3060] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.263577 19356 raft_consensus.cc:493] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.264248 19353 raft_consensus.cc:515] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.264307 19356 raft_consensus.cc:515] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.265710 19334 tablet_bootstrap.cc:654] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.268482 19039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb7cc6644bb40ba83130a39dca0ae78" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:08.269280 19039 raft_consensus.cc:2468] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
I20260709 13:22:08.271102 19080 leader_election.cc:304] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:08.271368 19040 raft_consensus.cc:2468] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 1.
I20260709 13:22:08.273155 19236 raft_consensus.cc:2804] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.273720 19236 raft_consensus.cc:493] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.273869 19041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c7f01cae2e42059c0c563044db5397" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:08.274819 19041 raft_consensus.cc:3060] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.275053 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ab1224b9f046f78d1d5216c7f14444" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
W20260709 13:22:08.277845 19080 leader_election.cc:343] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.278772 19080 leader_election.cc:304] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 71b10608b007487ebfb9e047eaf4cd0a
I20260709 13:22:08.278650 19346 raft_consensus.cc:515] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.280550 19356 leader_election.cc:290] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.281322 19356 raft_consensus.cc:2804] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.281888 19356 raft_consensus.cc:697] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Becoming Leader. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:08.282943 19356 consensus_queue.cc:237] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.282961 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6a510430a047e3a4e1f148dcc1f8f6" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:08.284780 19040 raft_consensus.cc:3060] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.288813 19353 leader_election.cc:290] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.289325 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb7cc6644bb40ba83130a39dca0ae78" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:08.290038 19190 raft_consensus.cc:2468] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
I20260709 13:22:08.291967 19189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c7f01cae2e42059c0c563044db5397" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:08.292829 19189 raft_consensus.cc:3060] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.294205 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6a510430a047e3a4e1f148dcc1f8f6" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:08.295215 19346 leader_election.cc:290] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
W20260709 13:22:08.296157 19153 leader_election.cc:343] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.304360 19333 tablet_bootstrap.cc:492] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:08.305069 19333 ts_tablet_manager.cc:1403] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.012s
I20260709 13:22:08.307126 19334 tablet_bootstrap.cc:492] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:08.307756 19334 ts_tablet_manager.cc:1403] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.025s
I20260709 13:22:08.308423 19333 raft_consensus.cc:359] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.309234 19333 raft_consensus.cc:385] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.309551 19333 raft_consensus.cc:740] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.311051 19040 raft_consensus.cc:2468] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 1.
I20260709 13:22:08.311131 19334 raft_consensus.cc:359] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.312757 19154 leader_election.cc:304] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:08.313031 19334 raft_consensus.cc:385] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.313510 19334 raft_consensus.cc:740] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.314399 19347 raft_consensus.cc:493] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.314486 19334 consensus_queue.cc:260] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.315088 19347 raft_consensus.cc:515] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.317799 19346 raft_consensus.cc:2804] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.317312 19333 consensus_queue.cc:260] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.274214 19236 raft_consensus.cc:3060] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.318493 19346 raft_consensus.cc:697] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Becoming Leader. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Running, Role: LEADER
I20260709 13:22:08.319788 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365043cafcff491b9bc231758de19173" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:08.319959 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365043cafcff491b9bc231758de19173" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
W20260709 13:22:08.322098 19004 leader_election.cc:343] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.322463 19333 ts_tablet_manager.cc:1434] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.004s
I20260709 13:22:08.320665 19190 raft_consensus.cc:2468] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 0.
I20260709 13:22:08.323822 19333 tablet_bootstrap.cc:492] T 365043cafcff491b9bc231758de19173 P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:08.324316 19005 leader_election.cc:304] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:08.317399 19347 leader_election.cc:290] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.325707 19316 raft_consensus.cc:2804] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.326325 19316 raft_consensus.cc:493] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.326931 19316 raft_consensus.cc:3060] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.326434 18939 catalog_manager.cc:5697] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.329778 19334 ts_tablet_manager.cc:1434] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:22:08.319846 19346 consensus_queue.cc:237] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.331502 19334 tablet_bootstrap.cc:492] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:08.334028 19041 raft_consensus.cc:2468] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 1.
I20260709 13:22:08.335913 19080 leader_election.cc:304] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:08.337239 19357 raft_consensus.cc:2804] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.337930 19357 raft_consensus.cc:697] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Becoming Leader. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:08.338990 19357 consensus_queue.cc:237] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.341995 19333 tablet_bootstrap.cc:654] T 365043cafcff491b9bc231758de19173 P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.346091 19334 tablet_bootstrap.cc:654] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.358451 18936 catalog_manager.cc:5697] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.373718 19189 raft_consensus.cc:2468] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 1.
I20260709 13:22:08.381592 19334 tablet_bootstrap.cc:492] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:08.382690 19334 ts_tablet_manager.cc:1403] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.052s	user 0.023s	sys 0.022s
I20260709 13:22:08.386022 19332 tablet_bootstrap.cc:492] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:08.386658 19332 ts_tablet_manager.cc:1403] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.152s	user 0.033s	sys 0.034s
I20260709 13:22:08.386721 19334 raft_consensus.cc:359] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.387638 19334 raft_consensus.cc:385] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.388161 19334 raft_consensus.cc:740] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.389142 19334 consensus_queue.cc:260] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.390461 19332 raft_consensus.cc:359] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.391237 19332 raft_consensus.cc:385] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.391688 19332 raft_consensus.cc:740] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.392730 19334 ts_tablet_manager.cc:1434] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:22:08.392366 18937 catalog_manager.cc:5697] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131). New cstate: current_term: 1 leader_uuid: "71b10608b007487ebfb9e047eaf4cd0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:08.392875 19332 consensus_queue.cc:260] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.394034 19334 tablet_bootstrap.cc:492] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47: Bootstrap starting.
I20260709 13:22:08.395154 19347 raft_consensus.cc:493] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.395730 19333 tablet_bootstrap.cc:492] T 365043cafcff491b9bc231758de19173 P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:08.395740 19347 raft_consensus.cc:515] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.396679 19333 ts_tablet_manager.cc:1403] T 365043cafcff491b9bc231758de19173 P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.073s	user 0.027s	sys 0.002s
I20260709 13:22:08.398936 19347 leader_election.cc:290] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.399549 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b330263f08554d608f9a07da0016b0de" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
I20260709 13:22:08.400049 19333 raft_consensus.cc:359] T 365043cafcff491b9bc231758de19173 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.400293 19116 raft_consensus.cc:2468] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 0.
I20260709 13:22:08.401456 19357 raft_consensus.cc:493] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.401974 19357 raft_consensus.cc:515] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.402107 19004 leader_election.cc:304] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:08.402961 19347 raft_consensus.cc:2804] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.403187 19332 ts_tablet_manager.cc:1434] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:22:08.403317 19347 raft_consensus.cc:493] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.403838 19347 raft_consensus.cc:3060] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.400241 19189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b330263f08554d608f9a07da0016b0de" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:08.404362 19332 tablet_bootstrap.cc:492] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:08.405246 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824e7a4eab344663bcb8445e41420e77" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:08.405936 19190 raft_consensus.cc:2468] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
I20260709 13:22:08.403841 19357 leader_election.cc:290] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.407457 19080 leader_election.cc:304] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:08.408308 19334 tablet_bootstrap.cc:654] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:08.405296 19005 leader_election.cc:343] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.408842 19357 raft_consensus.cc:2804] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.401160 19333 raft_consensus.cc:385] T 365043cafcff491b9bc231758de19173 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.409260 19357 raft_consensus.cc:493] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.409745 19357 raft_consensus.cc:3060] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.410070 19041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824e7a4eab344663bcb8445e41420e77" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:08.410537 19333 raft_consensus.cc:740] T 365043cafcff491b9bc231758de19173 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
W20260709 13:22:08.411448 19080 leader_election.cc:343] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.411352 19333 consensus_queue.cc:260] T 365043cafcff491b9bc231758de19173 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.415143 19333 ts_tablet_manager.cc:1434] T 365043cafcff491b9bc231758de19173 P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 13:22:08.416369 19333 tablet_bootstrap.cc:492] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:08.416488 19316 raft_consensus.cc:515] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.419543 19316 leader_election.cc:290] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 election: Requested vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.420258 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365043cafcff491b9bc231758de19173" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:08.420919 19116 raft_consensus.cc:3060] T 365043cafcff491b9bc231758de19173 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.420933 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365043cafcff491b9bc231758de19173" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:08.421937 19190 raft_consensus.cc:3060] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.422192 19332 tablet_bootstrap.cc:654] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.424969 19333 tablet_bootstrap.cc:654] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.427573 19357 raft_consensus.cc:515] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.431331 19347 raft_consensus.cc:515] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.431381 19190 raft_consensus.cc:2468] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 1.
I20260709 13:22:08.433784 19236 raft_consensus.cc:515] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.435235 19005 leader_election.cc:304] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
I20260709 13:22:08.437085 19116 raft_consensus.cc:2468] T 365043cafcff491b9bc231758de19173 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 1.
I20260709 13:22:08.436040 19316 raft_consensus.cc:2804] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.436077 19236 leader_election.cc:290] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.437196 19041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb7cc6644bb40ba83130a39dca0ae78" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:08.439092 19316 raft_consensus.cc:697] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Becoming Leader. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:08.439795 19041 raft_consensus.cc:3060] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.441246 19316 consensus_queue.cc:237] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.442899 19347 leader_election.cc:290] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 election: Requested vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.445906 19189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb7cc6644bb40ba83130a39dca0ae78" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:08.446208 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824e7a4eab344663bcb8445e41420e77" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:08.444736 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b330263f08554d608f9a07da0016b0de" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:08.446614 19189 raft_consensus.cc:3060] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.449102 19116 raft_consensus.cc:3060] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.449919 19334 tablet_bootstrap.cc:492] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47: No bootstrap required, opened a new log
I20260709 13:22:08.450356 19334 ts_tablet_manager.cc:1403] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.000s
I20260709 13:22:08.453231 19188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824e7a4eab344663bcb8445e41420e77" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:08.455737 19188 raft_consensus.cc:3060] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.444494 19357 leader_election.cc:290] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
W20260709 13:22:08.461416 19080 leader_election.cc:343] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.448882 19190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b330263f08554d608f9a07da0016b0de" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:08.466957 19334 raft_consensus.cc:359] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.467976 19334 raft_consensus.cc:385] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.468384 19334 raft_consensus.cc:740] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Initialized, Role: FOLLOWER
W20260709 13:22:08.475559 19005 leader_election.cc:343] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:08.477684 19189 raft_consensus.cc:2468] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 1.
I20260709 13:22:08.479163 19188 raft_consensus.cc:2468] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 1.
I20260709 13:22:08.481580 19333 tablet_bootstrap.cc:492] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:08.482128 19333 ts_tablet_manager.cc:1403] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.008s
I20260709 13:22:08.485016 19333 raft_consensus.cc:359] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.485688 19333 raft_consensus.cc:385] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.485975 19333 raft_consensus.cc:740] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.486521 19080 leader_election.cc:304] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:08.486585 19333 consensus_queue.cc:260] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.487885 19357 raft_consensus.cc:2804] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.488382 19357 raft_consensus.cc:697] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Becoming Leader. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:08.488795 19333 ts_tablet_manager.cc:1434] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:22:08.489511 19332 tablet_bootstrap.cc:492] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:08.489234 19357 consensus_queue.cc:237] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.490026 19332 ts_tablet_manager.cc:1403] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.086s	user 0.019s	sys 0.008s
I20260709 13:22:08.490070 19333 tablet_bootstrap.cc:492] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4: Bootstrap starting.
I20260709 13:22:08.493160 19332 raft_consensus.cc:359] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.494043 19332 raft_consensus.cc:385] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.494403 19332 raft_consensus.cc:740] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.495152 19332 consensus_queue.cc:260] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.495946 19334 consensus_queue.cc:260] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.493458 19080 leader_election.cc:304] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, e83f5fba2ee14240b2fbc847592de0a4; no voters: c7efbbf28df8445093a7ecf94e0b6b47
I20260709 13:22:08.497926 19236 raft_consensus.cc:2804] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.498497 19236 raft_consensus.cc:697] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Becoming Leader. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:08.498611 19333 tablet_bootstrap.cc:654] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.499467 19236 consensus_queue.cc:237] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.500460 19334 ts_tablet_manager.cc:1434] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:22:08.504886 19347 raft_consensus.cc:493] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.505537 19347 raft_consensus.cc:515] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.508327 19347 leader_election.cc:290] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.509318 19115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824e7a4eab344663bcb8445e41420e77" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
I20260709 13:22:08.509325 19332 ts_tablet_manager.cc:1434] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:08.510181 19188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824e7a4eab344663bcb8445e41420e77" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:08.511220 19188 raft_consensus.cc:2393] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7efbbf28df8445093a7ecf94e0b6b47 in current term 1: Already voted for candidate e83f5fba2ee14240b2fbc847592de0a4 in this term.
I20260709 13:22:08.512423 19332 tablet_bootstrap.cc:492] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a: Bootstrap starting.
I20260709 13:22:08.514422 19005 leader_election.cc:304] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47; no voters: 71b10608b007487ebfb9e047eaf4cd0a, e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:08.516620 19356 raft_consensus.cc:493] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.517194 19356 raft_consensus.cc:515] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.520141 19356 leader_election.cc:290] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.521042 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d33cab399124767afa0cb7a78079d60" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:08.522038 19040 raft_consensus.cc:2468] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
I20260709 13:22:08.521121 19347 raft_consensus.cc:3060] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.527372 19080 leader_election.cc:304] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:08.528592 19356 raft_consensus.cc:2804] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.529114 19356 raft_consensus.cc:493] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.529574 19356 raft_consensus.cc:3060] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.534541 19333 tablet_bootstrap.cc:492] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4: No bootstrap required, opened a new log
I20260709 13:22:08.535189 19333 ts_tablet_manager.cc:1403] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.016s
I20260709 13:22:08.538139 19333 raft_consensus.cc:359] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.539073 19333 raft_consensus.cc:385] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.539776 19333 raft_consensus.cc:740] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.539762 19356 raft_consensus.cc:515] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.538158 19188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d33cab399124767afa0cb7a78079d60" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:08.541146 19333 consensus_queue.cc:260] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.541821 19188 raft_consensus.cc:2468] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 0.
I20260709 13:22:08.543708 19333 ts_tablet_manager.cc:1434] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:08.545786 19041 raft_consensus.cc:2468] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 1.
I20260709 13:22:08.546823 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d33cab399124767afa0cb7a78079d60" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:08.547514 19040 raft_consensus.cc:3060] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.550390 19332 tablet_bootstrap.cc:654] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:08.533070 18937 catalog_manager.cc:5697] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.555780 19040 raft_consensus.cc:2468] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 1.
I20260709 13:22:08.560256 19188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d33cab399124767afa0cb7a78079d60" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:08.561194 19188 raft_consensus.cc:3060] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.569579 19356 leader_election.cc:290] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.571445 19080 leader_election.cc:304] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:08.572939 19356 raft_consensus.cc:2804] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.573923 19356 raft_consensus.cc:697] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Becoming Leader. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:08.575052 19356 consensus_queue.cc:237] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.578680 19347 raft_consensus.cc:2749] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:08.576881 19116 raft_consensus.cc:2468] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 1.
I20260709 13:22:08.581302 19004 leader_election.cc:304] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 71b10608b007487ebfb9e047eaf4cd0a
I20260709 13:22:08.582463 19316 raft_consensus.cc:2804] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.582940 19316 raft_consensus.cc:697] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Becoming Leader. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:08.583093 19188 raft_consensus.cc:2468] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 1.
I20260709 13:22:08.583959 19316 consensus_queue.cc:237] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.591046 19332 tablet_bootstrap.cc:492] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a: No bootstrap required, opened a new log
I20260709 13:22:08.591620 19332 ts_tablet_manager.cc:1403] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.034s
I20260709 13:22:08.593750 19332 raft_consensus.cc:359] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.594666 19332 raft_consensus.cc:385] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:08.595137 19332 raft_consensus.cc:740] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.594599 18937 catalog_manager.cc:5697] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.595816 19332 consensus_queue.cc:260] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.596508 18937 catalog_manager.cc:5697] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.597685 19332 ts_tablet_manager.cc:1434] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:22:08.607143 18939 catalog_manager.cc:5697] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 reported cstate change: term changed from 0 to 1, leader changed from <none> to c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.617247 18937 catalog_manager.cc:5697] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.619012 18937 catalog_manager.cc:5697] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.641806 19356 raft_consensus.cc:493] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.642410 19356 raft_consensus.cc:515] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.644275 19356 leader_election.cc:290] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.645534 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6a510430a047e3a4e1f148dcc1f8f6" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:08.645771 19188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6a510430a047e3a4e1f148dcc1f8f6" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a" is_pre_election: true
I20260709 13:22:08.646346 19040 raft_consensus.cc:2393] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e83f5fba2ee14240b2fbc847592de0a4 in current term 1: Already voted for candidate 71b10608b007487ebfb9e047eaf4cd0a in this term.
I20260709 13:22:08.647699 19080 leader_election.cc:304] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e83f5fba2ee14240b2fbc847592de0a4; no voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47
I20260709 13:22:08.648406 19356 raft_consensus.cc:3060] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.654719 19356 raft_consensus.cc:2749] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:08.674722 19116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5c7f01cae2e42059c0c563044db5397"
dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
mode: GRACEFUL
new_leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
 from {username='slave'} at 127.0.0.1:36320
I20260709 13:22:08.675559 19116 raft_consensus.cc:606] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Received request to transfer leadership to TS c7efbbf28df8445093a7ecf94e0b6b47
I20260709 13:22:08.681964 19116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21ab1224b9f046f78d1d5216c7f14444"
dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
mode: GRACEFUL
new_leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
 from {username='slave'} at 127.0.0.1:36320
I20260709 13:22:08.682508 19116 raft_consensus.cc:606] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Received request to transfer leadership to TS c7efbbf28df8445093a7ecf94e0b6b47
I20260709 13:22:08.687893 19116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb7cc6644bb40ba83130a39dca0ae78"
dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
mode: GRACEFUL
new_leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
 from {username='slave'} at 127.0.0.1:36320
I20260709 13:22:08.688416 19116 raft_consensus.cc:606] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Received request to transfer leadership to TS c7efbbf28df8445093a7ecf94e0b6b47
I20260709 13:22:08.700506 19188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d6a510430a047e3a4e1f148dcc1f8f6"
dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
mode: GRACEFUL
new_leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
 from {username='slave'} at 127.0.0.1:47520
I20260709 13:22:08.701257 19188 raft_consensus.cc:606] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Received request to transfer leadership to TS e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:08.707151 19040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f73dde38f9f490e956b5b005432d729"
dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
mode: GRACEFUL
new_leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:22:08.707798 19040 raft_consensus.cc:606] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Received request to transfer leadership to TS e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:08.717036 19316 consensus_queue.cc:1048] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:08.717265 19040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b330263f08554d608f9a07da0016b0de"
dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
mode: GRACEFUL
new_leader_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
 from {username='slave'} at 127.0.0.1:55618
I20260709 13:22:08.717926 19040 raft_consensus.cc:606] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Received request to transfer leadership to TS 71b10608b007487ebfb9e047eaf4cd0a
I20260709 13:22:08.728031 19116 raft_consensus.cc:3060] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.736125 19316 consensus_queue.cc:1048] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:08.744997 19348 raft_consensus.cc:993] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47: : Instructing follower e83f5fba2ee14240b2fbc847592de0a4 to start an election
I20260709 13:22:08.745517 19348 raft_consensus.cc:1081] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Signalling peer e83f5fba2ee14240b2fbc847592de0a4 to start an election
I20260709 13:22:08.747382 19116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f73dde38f9f490e956b5b005432d729"
dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
 from {username='slave'} at 127.0.0.1:36292
I20260709 13:22:08.748106 19116 raft_consensus.cc:493] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:08.748477 19116 raft_consensus.cc:3060] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.755115 19116 raft_consensus.cc:515] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.757707 19116 leader_election.cc:290] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 2 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.758437 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f73dde38f9f490e956b5b005432d729" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:08.759205 19040 raft_consensus.cc:3055] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:08.759734 19040 raft_consensus.cc:740] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:08.760466 19188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f73dde38f9f490e956b5b005432d729" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:08.760584 19040 consensus_queue.cc:260] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.761188 19188 raft_consensus.cc:3060] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.762122 19040 raft_consensus.cc:3060] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.767799 19188 raft_consensus.cc:2468] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 2.
I20260709 13:22:08.767908 19040 raft_consensus.cc:2468] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 2.
I20260709 13:22:08.769073 19080 leader_election.cc:304] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:08.769779 19356 raft_consensus.cc:2804] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:08.770272 19356 raft_consensus.cc:697] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 LEADER]: Becoming Leader. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:08.771014 19356 consensus_queue.cc:237] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.778667 19356 consensus_queue.cc:1048] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:08.778400 18937 catalog_manager.cc:5697] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 reported cstate change: term changed from 1 to 2, leader changed from c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129) to e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.792543 19353 consensus_queue.cc:1048] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:08.801800 19362 raft_consensus.cc:993] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4: : Instructing follower c7efbbf28df8445093a7ecf94e0b6b47 to start an election
I20260709 13:22:08.802289 19353 raft_consensus.cc:1081] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Signalling peer c7efbbf28df8445093a7ecf94e0b6b47 to start an election
I20260709 13:22:08.804698 19346 raft_consensus.cc:493] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.805269 19346 raft_consensus.cc:515] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.805608 19040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5c7f01cae2e42059c0c563044db5397"
dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
 from {username='slave'} at 127.0.0.1:55602
I20260709 13:22:08.806264 19040 raft_consensus.cc:493] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:08.806615 19040 raft_consensus.cc:3060] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.807487 19346 leader_election.cc:290] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:08.808470 19041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ab1224b9f046f78d1d5216c7f14444" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:08.808689 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ab1224b9f046f78d1d5216c7f14444" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
I20260709 13:22:08.809401 19041 raft_consensus.cc:2393] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71b10608b007487ebfb9e047eaf4cd0a in current term 1: Already voted for candidate e83f5fba2ee14240b2fbc847592de0a4 in this term.
I20260709 13:22:08.810989 19154 leader_election.cc:304] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a; no voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:08.811926 19346 raft_consensus.cc:3060] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.814137 19040 raft_consensus.cc:515] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.816380 19040 leader_election.cc:290] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 2 election: Requested vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.817510 19116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c7f01cae2e42059c0c563044db5397" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:08.818117 19116 raft_consensus.cc:3055] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:08.817998 19188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c7f01cae2e42059c0c563044db5397" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:08.818513 19116 raft_consensus.cc:740] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:08.818753 19188 raft_consensus.cc:3060] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.819285 19116 consensus_queue.cc:260] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.819669 19346 raft_consensus.cc:2749] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:08.820261 19116 raft_consensus.cc:3060] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.825181 19188 raft_consensus.cc:2468] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 2.
I20260709 13:22:08.825268 19116 raft_consensus.cc:2468] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 2.
I20260709 13:22:08.826730 19004 leader_election.cc:304] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:08.827694 19348 raft_consensus.cc:2804] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:08.828169 19348 raft_consensus.cc:697] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Becoming Leader. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:08.829101 19348 consensus_queue.cc:237] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.836054 18937 catalog_manager.cc:5697] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 reported cstate change: term changed from 1 to 2, leader changed from e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130) to c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.848404 19346 consensus_queue.cc:1048] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:08.861126 19238 consensus_queue.cc:1048] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:08.872676 19390 raft_consensus.cc:993] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a: : Instructing follower e83f5fba2ee14240b2fbc847592de0a4 to start an election
I20260709 13:22:08.873240 19390 raft_consensus.cc:1081] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Signalling peer e83f5fba2ee14240b2fbc847592de0a4 to start an election
I20260709 13:22:08.877643 19116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d6a510430a047e3a4e1f148dcc1f8f6"
dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
 from {username='slave'} at 127.0.0.1:36306
I20260709 13:22:08.878454 19116 raft_consensus.cc:493] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:08.878993 19116 raft_consensus.cc:3060] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.880816 19353 consensus_queue.cc:1048] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:08.887032 19116 raft_consensus.cc:515] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.889276 19116 leader_election.cc:290] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 2 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.892089 19188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6a510430a047e3a4e1f148dcc1f8f6" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:08.892946 19188 raft_consensus.cc:3055] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:08.893333 19188 raft_consensus.cc:740] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Running, Role: LEADER
I20260709 13:22:08.892302 19356 raft_consensus.cc:993] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4: : Instructing follower c7efbbf28df8445093a7ecf94e0b6b47 to start an election
I20260709 13:22:08.894048 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6a510430a047e3a4e1f148dcc1f8f6" candidate_uuid: "e83f5fba2ee14240b2fbc847592de0a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:08.894454 19356 raft_consensus.cc:1081] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Signalling peer c7efbbf28df8445093a7ecf94e0b6b47 to start an election
I20260709 13:22:08.895138 19040 raft_consensus.cc:3060] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.898000 19188 consensus_queue.cc:260] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.899775 19188 raft_consensus.cc:3060] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.901310 19353 consensus_queue.cc:1048] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:08.903652 19040 raft_consensus.cc:2468] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 2.
I20260709 13:22:08.904006 19041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21ab1224b9f046f78d1d5216c7f14444"
dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
 from {username='slave'} at 127.0.0.1:55602
I20260709 13:22:08.904670 19041 raft_consensus.cc:493] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:08.905036 19041 raft_consensus.cc:3060] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.908588 19080 leader_election.cc:304] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:08.909901 19362 raft_consensus.cc:2804] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:08.910472 19362 raft_consensus.cc:697] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 LEADER]: Becoming Leader. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:08.911397 19362 consensus_queue.cc:237] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.913066 19188 raft_consensus.cc:2468] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83f5fba2ee14240b2fbc847592de0a4 in term 2.
I20260709 13:22:08.913795 19348 consensus_queue.cc:1048] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:08.917662 19362 consensus_queue.cc:1048] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:08.924857 19041 raft_consensus.cc:515] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.930325 19115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ab1224b9f046f78d1d5216c7f14444" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:08.931272 19115 raft_consensus.cc:3055] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:08.931721 19115 raft_consensus.cc:740] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:08.932374 19238 raft_consensus.cc:493] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.932932 19115 consensus_queue.cc:260] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.933668 18939 catalog_manager.cc:5697] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 reported cstate change: term changed from 1 to 2, leader changed from 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131) to e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "e83f5fba2ee14240b2fbc847592de0a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.935004 19115 raft_consensus.cc:3060] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.937119 19353 consensus_queue.cc:1048] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:08.933020 19238 raft_consensus.cc:515] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:08.942989 19238 leader_election.cc:290] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:08.944295 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b330263f08554d608f9a07da0016b0de" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" is_pre_election: true
I20260709 13:22:08.947893 19114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b330263f08554d608f9a07da0016b0de" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4" is_pre_election: true
I20260709 13:22:08.948858 19114 raft_consensus.cc:2393] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71b10608b007487ebfb9e047eaf4cd0a in current term 1: Already voted for candidate c7efbbf28df8445093a7ecf94e0b6b47 in this term.
I20260709 13:22:08.951115 19153 leader_election.cc:304] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a; no voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4
I20260709 13:22:08.953603 19390 raft_consensus.cc:3060] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.954077 19189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ab1224b9f046f78d1d5216c7f14444" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:08.956836 19041 leader_election.cc:290] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 2 election: Requested vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:08.961920 19115 raft_consensus.cc:2468] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 2.
I20260709 13:22:08.964730 19004 leader_election.cc:304] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c7efbbf28df8445093a7ecf94e0b6b47, e83f5fba2ee14240b2fbc847592de0a4; no voters: 71b10608b007487ebfb9e047eaf4cd0a
I20260709 13:22:08.965859 19347 raft_consensus.cc:2804] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:08.966369 19347 raft_consensus.cc:697] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Becoming Leader. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:08.967273 19347 consensus_queue.cc:237] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
W20260709 13:22:09.012670 19004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 48051.7us
W20260709 13:22:09.016059 19080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.6.214.129:43901, user_credentials={real_user=slave}} blocked reactor thread for 50761us
I20260709 13:22:09.017238 19390 raft_consensus.cc:2749] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:09.020208 19236 consensus_queue.cc:1048] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:09.025458 19348 consensus_queue.cc:1048] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:09.041105 19356 raft_consensus.cc:993] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4: : Instructing follower c7efbbf28df8445093a7ecf94e0b6b47 to start an election
I20260709 13:22:09.041919 19357 raft_consensus.cc:1081] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Signalling peer c7efbbf28df8445093a7ecf94e0b6b47 to start an election
I20260709 13:22:09.043426 18939 catalog_manager.cc:5697] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 reported cstate change: term changed from 1 to 2, leader changed from e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130) to c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:09.048745 19041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bb7cc6644bb40ba83130a39dca0ae78"
dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
 from {username='slave'} at 127.0.0.1:55602
I20260709 13:22:09.049690 19041 raft_consensus.cc:493] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:09.050189 19041 raft_consensus.cc:3060] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.062234 19357 consensus_queue.cc:1048] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:09.067790 19356 consensus_queue.cc:1048] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:09.072759 19041 raft_consensus.cc:515] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:09.075176 19039 raft_consensus.cc:1240] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Rejecting Update request from peer e83f5fba2ee14240b2fbc847592de0a4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:09.075862 19041 leader_election.cc:290] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 2 election: Requested vote from peers e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443), 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131:35969)
I20260709 13:22:09.077557 19115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb7cc6644bb40ba83130a39dca0ae78" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:09.078621 19115 raft_consensus.cc:3055] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:09.079010 19115 raft_consensus.cc:740] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:09.079909 19115 consensus_queue.cc:260] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:09.080348 19189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb7cc6644bb40ba83130a39dca0ae78" candidate_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
I20260709 13:22:09.083132 19189 raft_consensus.cc:3060] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.083681 19356 consensus_queue.cc:1059] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:09.089226 19115 raft_consensus.cc:3060] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.092607 19348 consensus_queue.cc:1048] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:09.114694 19115 raft_consensus.cc:2468] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 2.
I20260709 13:22:09.114899 19353 consensus_queue.cc:1048] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:09.109614 19189 raft_consensus.cc:2468] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7efbbf28df8445093a7ecf94e0b6b47 in term 2.
I20260709 13:22:09.116993 19005 leader_election.cc:304] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
I20260709 13:22:09.120146 19316 raft_consensus.cc:2804] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:09.132807 19348 consensus_queue.cc:1048] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:09.136337 19316 raft_consensus.cc:697] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Becoming Leader. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:09.137411 19316 consensus_queue.cc:237] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:09.151602 19316 raft_consensus.cc:993] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47: : Instructing follower 71b10608b007487ebfb9e047eaf4cd0a to start an election
I20260709 13:22:09.152117 19348 raft_consensus.cc:1081] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Signalling peer 71b10608b007487ebfb9e047eaf4cd0a to start an election
I20260709 13:22:09.154029 19189 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b330263f08554d608f9a07da0016b0de"
dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
 from {username='slave'} at 127.0.0.1:47500
I20260709 13:22:09.153416 18936 catalog_manager.cc:5697] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 reported cstate change: term changed from 1 to 2, leader changed from e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130) to c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:09.154685 19189 raft_consensus.cc:493] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:09.155105 19189 raft_consensus.cc:3060] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.162107 19189 raft_consensus.cc:515] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:09.164666 19189 leader_election.cc:290] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 2 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:09.166239 19040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b330263f08554d608f9a07da0016b0de" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:09.167069 19040 raft_consensus.cc:3055] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:09.167393 19040 raft_consensus.cc:740] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:09.167284 19115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b330263f08554d608f9a07da0016b0de" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:09.168205 19115 raft_consensus.cc:3060] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.168697 19040 consensus_queue.cc:260] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:09.170090 19040 raft_consensus.cc:3060] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.177222 19040 raft_consensus.cc:2468] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 2.
I20260709 13:22:09.178818 19154 leader_election.cc:304] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
I20260709 13:22:09.179823 19390 raft_consensus.cc:2804] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:09.180330 19390 raft_consensus.cc:697] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [term 2 LEADER]: Becoming Leader. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Running, Role: LEADER
I20260709 13:22:09.180727 19115 raft_consensus.cc:2468] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 2.
I20260709 13:22:09.182940 19390 consensus_queue.cc:237] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:09.193535 18939 catalog_manager.cc:5697] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a reported cstate change: term changed from 1 to 2, leader changed from c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129) to 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131). New cstate: current_term: 2 leader_uuid: "71b10608b007487ebfb9e047eaf4cd0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:09.196452 19040 raft_consensus.cc:1275] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Refusing update from remote peer e83f5fba2ee14240b2fbc847592de0a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.197798 19353 consensus_queue.cc:1048] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:09.208652 19189 raft_consensus.cc:1275] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Refusing update from remote peer e83f5fba2ee14240b2fbc847592de0a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.211580 19353 consensus_queue.cc:1048] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:09.314786 19115 raft_consensus.cc:1275] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Refusing update from remote peer c7efbbf28df8445093a7ecf94e0b6b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.316154 19402 consensus_queue.cc:1048] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:09.324537 19189 raft_consensus.cc:1275] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Refusing update from remote peer c7efbbf28df8445093a7ecf94e0b6b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.326426 19403 consensus_queue.cc:1048] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:09.372400 19115 raft_consensus.cc:1275] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Refusing update from remote peer c7efbbf28df8445093a7ecf94e0b6b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.374279 19403 consensus_queue.cc:1048] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:09.386735 19189 raft_consensus.cc:3060] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.393404 19189 raft_consensus.cc:1275] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Refusing update from remote peer c7efbbf28df8445093a7ecf94e0b6b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.394831 19402 consensus_queue.cc:1048] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:09.503939 19040 raft_consensus.cc:1275] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Refusing update from remote peer e83f5fba2ee14240b2fbc847592de0a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.505280 19353 consensus_queue.cc:1048] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:09.513055 19189 raft_consensus.cc:1275] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Refusing update from remote peer e83f5fba2ee14240b2fbc847592de0a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.515141 19353 consensus_queue.cc:1048] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:09.524140 19115 raft_consensus.cc:1275] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Refusing update from remote peer c7efbbf28df8445093a7ecf94e0b6b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.525641 19402 consensus_queue.cc:1048] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:09.535254 19189 raft_consensus.cc:1275] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Refusing update from remote peer c7efbbf28df8445093a7ecf94e0b6b47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.536957 19348 consensus_queue.cc:1048] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:09.583238 19040 raft_consensus.cc:1275] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Refusing update from remote peer 71b10608b007487ebfb9e047eaf4cd0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.584656 19390 consensus_queue.cc:1048] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:09.592839 19115 raft_consensus.cc:1275] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Refusing update from remote peer 71b10608b007487ebfb9e047eaf4cd0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.596714 19407 consensus_queue.cc:1048] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:11.721731 18939 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50436:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:22:11.749161 18939 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50436:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:22:11.787359  7002 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:22:11.854617 19434 tablet.cc:1724] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:11.952363 19067 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:21ab1224b9f046f78d1d5216c7f14444)
W20260709 13:22:11.970873 19067 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:21ab1224b9f046f78d1d5216c7f14444)
I20260709 13:22:11.970707 19438 tablet.cc:1724] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:11.972118 19067 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:21ab1224b9f046f78d1d5216c7f14444)
W20260709 13:22:12.035059 19080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:35969, user_credentials={real_user=slave}} blocked reactor thread for 67499.7us
I20260709 13:22:12.050382 19450 tablet.cc:1724] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.073383 19443 tablet.cc:1724] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.083616 19434 tablet.cc:1724] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:12.216759 19005 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:35969, user_credentials={real_user=slave}} blocked reactor thread for 67893.7us
W20260709 13:22:12.238214 19080 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.214.131:35969, user_credentials={real_user=slave}} blocked reactor thread for 49692.3us
I20260709 13:22:12.287449 19039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bb7cc6644bb40ba83130a39dca0ae78"
dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
mode: GRACEFUL
new_leader_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
 from {username='slave'} at 127.0.0.1:55630
I20260709 13:22:12.288467 19039 raft_consensus.cc:606] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Received request to transfer leadership to TS 71b10608b007487ebfb9e047eaf4cd0a
I20260709 13:22:12.314218 19474 tablet.cc:1724] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.268177 19460 tablet.cc:1724] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.331280 19465 tablet.cc:1724] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.277051 19438 tablet.cc:1724] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.370121 19403 raft_consensus.cc:993] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47: : Instructing follower 71b10608b007487ebfb9e047eaf4cd0a to start an election
I20260709 13:22:12.371001 19403 raft_consensus.cc:1081] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Signalling peer 71b10608b007487ebfb9e047eaf4cd0a to start an election
I20260709 13:22:12.370149 19475 tablet.cc:1724] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.376371 19188 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bb7cc6644bb40ba83130a39dca0ae78"
dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
 from {username='slave'} at 127.0.0.1:47500
I20260709 13:22:12.377233 19188 raft_consensus.cc:493] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:12.377688 19188 raft_consensus.cc:3060] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:22:12.378643 19461 log.cc:927] Time spent T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4: Append to log took a long time: real 0.092s	user 0.000s	sys 0.003s
I20260709 13:22:12.356992 19443 tablet.cc:1724] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.432792 19434 tablet.cc:1724] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.435717 19478 tablet.cc:1724] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.440052 19450 tablet.cc:1724] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.445734 19473 tablet.cc:1724] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.450712 19434 tablet.cc:1724] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.462246 19480 tablet.cc:1724] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.463655 19482 tablet.cc:1724] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.465034 19434 tablet.cc:1724] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.506474 19438 tablet.cc:1724] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.512169 19188 raft_consensus.cc:515] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:12.516503 19038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb7cc6644bb40ba83130a39dca0ae78" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:12.517198 19038 raft_consensus.cc:3055] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:12.517524 19038 raft_consensus.cc:740] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:12.518311 19038 consensus_queue.cc:260] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:12.520174 19038 raft_consensus.cc:3060] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:12.508415 19465 tablet.cc:1724] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.515337 19473 tablet.cc:1724] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.548236 19115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d6a510430a047e3a4e1f148dcc1f8f6"
dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
mode: GRACEFUL
new_leader_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
 from {username='slave'} at 127.0.0.1:36330
I20260709 13:22:12.549283 19115 raft_consensus.cc:606] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 LEADER]: Received request to transfer leadership to TS 71b10608b007487ebfb9e047eaf4cd0a
I20260709 13:22:12.550848  7002 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:22:12.551937  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:12.556141 19478 tablet.cc:1724] T 365043cafcff491b9bc231758de19173 P e83f5fba2ee14240b2fbc847592de0a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.557636 19188 leader_election.cc:290] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 3 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:12.560248 19115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb7cc6644bb40ba83130a39dca0ae78" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:12.560976 19115 raft_consensus.cc:3060] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:12.556185 19474 tablet.cc:1724] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.548164 19475 tablet.cc:1724] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.565809 19037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "400116f7ebba4af48c18dabc32bec377"
dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
mode: GRACEFUL
new_leader_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
 from {username='slave'} at 127.0.0.1:55630
I20260709 13:22:12.566568 19037 raft_consensus.cc:606] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Received request to transfer leadership to TS 71b10608b007487ebfb9e047eaf4cd0a
I20260709 13:22:12.572149 19038 raft_consensus.cc:2468] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 3.
I20260709 13:22:12.575238 19154 leader_election.cc:304] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
I20260709 13:22:12.575443 19114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f408b6da07994e6b8404d08de526968e"
dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
mode: GRACEFUL
new_leader_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
 from {username='slave'} at 127.0.0.1:36330
I20260709 13:22:12.576256 19114 raft_consensus.cc:606] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Received request to transfer leadership to TS 71b10608b007487ebfb9e047eaf4cd0a
I20260709 13:22:12.576558 19432 raft_consensus.cc:2804] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:12.577138 19432 raft_consensus.cc:697] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 3 LEADER]: Becoming Leader. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Running, Role: LEADER
I20260709 13:22:12.578011  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:12.578040 19432 consensus_queue.cc:237] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:12.579648  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:12.593966 19450 tablet.cc:1724] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.603096 19482 tablet.cc:1724] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:12.604422 18937 catalog_manager.cc:5697] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a reported cstate change: term changed from 2 to 3, leader changed from c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129) to 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131). New cstate: current_term: 3 leader_uuid: "71b10608b007487ebfb9e047eaf4cd0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:12.632493 19115 raft_consensus.cc:2468] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 3.
I20260709 13:22:12.659861 18936 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb: soft_deleted_table [id=9e645bfb6a1b43519dd4a387b80ba765] alter complete (version 1)
I20260709 13:22:12.681702 19462 raft_consensus.cc:993] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47: : Instructing follower 71b10608b007487ebfb9e047eaf4cd0a to start an election
I20260709 13:22:12.682396 19403 raft_consensus.cc:1081] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Signalling peer 71b10608b007487ebfb9e047eaf4cd0a to start an election
I20260709 13:22:12.684161 19188 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "400116f7ebba4af48c18dabc32bec377"
dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
 from {username='slave'} at 127.0.0.1:47500
I20260709 13:22:12.684846 19188 raft_consensus.cc:493] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:12.685223 19188 raft_consensus.cc:3060] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:12.687685 19471 raft_consensus.cc:993] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4: : Instructing follower 71b10608b007487ebfb9e047eaf4cd0a to start an election
I20260709 13:22:12.688330 19453 raft_consensus.cc:1081] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Signalling peer 71b10608b007487ebfb9e047eaf4cd0a to start an election
I20260709 13:22:12.690325 19184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f408b6da07994e6b8404d08de526968e"
dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
 from {username='slave'} at 127.0.0.1:47512
I20260709 13:22:12.690837 19184 raft_consensus.cc:493] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:12.691206 19184 raft_consensus.cc:3060] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:12.692075 19188 raft_consensus.cc:515] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:12.694114 19188 leader_election.cc:290] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 3 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:12.695003 19038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400116f7ebba4af48c18dabc32bec377" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:12.695322 19115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400116f7ebba4af48c18dabc32bec377" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:12.695703 19038 raft_consensus.cc:3055] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:12.696115 19038 raft_consensus.cc:740] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7efbbf28df8445093a7ecf94e0b6b47, State: Running, Role: LEADER
I20260709 13:22:12.696159 19115 raft_consensus.cc:3060] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:12.697059 19038 consensus_queue.cc:260] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:12.698078 19184 raft_consensus.cc:515] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:12.698659 19038 raft_consensus.cc:3060] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:12.703083 19184 leader_election.cc:290] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 2 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:12.703956 19037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f408b6da07994e6b8404d08de526968e" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:12.704685 19115 raft_consensus.cc:2468] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 3.
I20260709 13:22:12.705072 19114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f408b6da07994e6b8404d08de526968e" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:12.705741 19114 raft_consensus.cc:3055] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:12.706086 19114 raft_consensus.cc:740] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:12.704687 19037 raft_consensus.cc:3060] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:12.706277 19153 leader_election.cc:304] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, e83f5fba2ee14240b2fbc847592de0a4; no voters: 
I20260709 13:22:12.707158 19114 consensus_queue.cc:260] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:12.707480 19432 raft_consensus.cc:2804] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:12.708184 19432 raft_consensus.cc:697] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 3 LEADER]: Becoming Leader. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Running, Role: LEADER
I20260709 13:22:12.708036 19038 raft_consensus.cc:2468] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 3.
I20260709 13:22:12.709187 19432 consensus_queue.cc:237] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:12.710201 19114 raft_consensus.cc:3060] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:12.716303 19037 raft_consensus.cc:2468] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 2.
I20260709 13:22:12.717886 19154 leader_election.cc:304] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
I20260709 13:22:12.719225 19483 raft_consensus.cc:2804] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:12.718467 19114 raft_consensus.cc:2468] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 2.
I20260709 13:22:12.720645 19483 raft_consensus.cc:697] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [term 2 LEADER]: Becoming Leader. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Running, Role: LEADER
I20260709 13:22:12.721756 19483 consensus_queue.cc:237] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:12.723968 18937 catalog_manager.cc:5697] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a reported cstate change: term changed from 2 to 3, leader changed from c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129) to 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131). New cstate: current_term: 3 leader_uuid: "71b10608b007487ebfb9e047eaf4cd0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:12.737939 18937 catalog_manager.cc:5697] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a reported cstate change: term changed from 1 to 2, leader changed from e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130) to 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131). New cstate: current_term: 2 leader_uuid: "71b10608b007487ebfb9e047eaf4cd0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:12.996505 19453 raft_consensus.cc:993] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4: : Instructing follower 71b10608b007487ebfb9e047eaf4cd0a to start an election
I20260709 13:22:12.997038 19471 raft_consensus.cc:1081] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 LEADER]: Signalling peer 71b10608b007487ebfb9e047eaf4cd0a to start an election
I20260709 13:22:12.998996 19184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d6a510430a047e3a4e1f148dcc1f8f6"
dest_uuid: "71b10608b007487ebfb9e047eaf4cd0a"
 from {username='slave'} at 127.0.0.1:47512
I20260709 13:22:12.999543 19184 raft_consensus.cc:493] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:13.000118 19184 raft_consensus.cc:3060] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:13.007460 19184 raft_consensus.cc:515] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:13.009636 19184 leader_election.cc:290] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 3 election: Requested vote from peers c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901), e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443)
I20260709 13:22:13.010565 19037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6a510430a047e3a4e1f148dcc1f8f6" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c7efbbf28df8445093a7ecf94e0b6b47"
I20260709 13:22:13.010790 19114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d6a510430a047e3a4e1f148dcc1f8f6" candidate_uuid: "71b10608b007487ebfb9e047eaf4cd0a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e83f5fba2ee14240b2fbc847592de0a4"
I20260709 13:22:13.011199 19037 raft_consensus.cc:3060] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:13.011475 19114 raft_consensus.cc:3055] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:13.011888 19114 raft_consensus.cc:740] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e83f5fba2ee14240b2fbc847592de0a4, State: Running, Role: LEADER
I20260709 13:22:13.012945 19114 consensus_queue.cc:260] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:13.014719 19114 raft_consensus.cc:3060] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:13.019495 19037 raft_consensus.cc:2468] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 3.
I20260709 13:22:13.021011 19154 leader_election.cc:304] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71b10608b007487ebfb9e047eaf4cd0a, c7efbbf28df8445093a7ecf94e0b6b47; no voters: 
I20260709 13:22:13.021518 19114 raft_consensus.cc:2468] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71b10608b007487ebfb9e047eaf4cd0a in term 3.
I20260709 13:22:13.022253 19483 raft_consensus.cc:2804] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:13.022864 19483 raft_consensus.cc:697] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 3 LEADER]: Becoming Leader. State: Replica: 71b10608b007487ebfb9e047eaf4cd0a, State: Running, Role: LEADER
I20260709 13:22:13.024169 19483 consensus_queue.cc:237] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } }
I20260709 13:22:13.032043 18937 catalog_manager.cc:5697] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a reported cstate change: term changed from 2 to 3, leader changed from e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130) to 71b10608b007487ebfb9e047eaf4cd0a (127.6.214.131). New cstate: current_term: 3 leader_uuid: "71b10608b007487ebfb9e047eaf4cd0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71b10608b007487ebfb9e047eaf4cd0a" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 35969 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:13.046088 19114 raft_consensus.cc:1275] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 3 FOLLOWER]: Refusing update from remote peer 71b10608b007487ebfb9e047eaf4cd0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:13.047602 19483 consensus_queue.cc:1048] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:13.057657 19037 raft_consensus.cc:1275] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 3 FOLLOWER]: Refusing update from remote peer 71b10608b007487ebfb9e047eaf4cd0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:13.060729 19432 consensus_queue.cc:1048] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:13.187543 19037 raft_consensus.cc:1275] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 3 FOLLOWER]: Refusing update from remote peer 71b10608b007487ebfb9e047eaf4cd0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:13.189023 19432 consensus_queue.cc:1048] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:13.200548 19114 raft_consensus.cc:1275] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4 [term 3 FOLLOWER]: Refusing update from remote peer 71b10608b007487ebfb9e047eaf4cd0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:13.202422 19494 consensus_queue.cc:1048] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:13.283845 19037 raft_consensus.cc:1275] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Refusing update from remote peer 71b10608b007487ebfb9e047eaf4cd0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:13.285686 19494 consensus_queue.cc:1048] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:13.298192 19114 raft_consensus.cc:1275] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Refusing update from remote peer 71b10608b007487ebfb9e047eaf4cd0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:13.300472 19433 consensus_queue.cc:1048] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:13.487352 19114 raft_consensus.cc:1275] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 3 FOLLOWER]: Refusing update from remote peer 71b10608b007487ebfb9e047eaf4cd0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:13.488905 19433 consensus_queue.cc:1048] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83f5fba2ee14240b2fbc847592de0a4" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:13.498133 19037 raft_consensus.cc:1275] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 3 FOLLOWER]: Refusing update from remote peer 71b10608b007487ebfb9e047eaf4cd0a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:13.500495 19433 consensus_queue.cc:1048] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7efbbf28df8445093a7ecf94e0b6b47" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:13.655416  7002 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:22:13.661666  7002 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:22:13.662110  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:13.667618  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:22:13.668113  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:14.697518  7002 tablet_server.cc:179] TabletServer@127.6.214.129:0 shutting down...
W20260709 13:22:14.714747 19154 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:22:14.720228 19154 consensus_peers.cc:597] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a -> Peer c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901): Couldn't send request to peer c7efbbf28df8445093a7ecf94e0b6b47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:14.727926  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:14.728859  7002 tablet_replica.cc:333] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.729735  7002 raft_consensus.cc:2243] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.730209  7002 raft_consensus.cc:2272] T 4d33cab399124767afa0cb7a78079d60 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.732100  7002 tablet_replica.cc:333] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.732694  7002 raft_consensus.cc:2243] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.733150  7002 raft_consensus.cc:2272] T b330263f08554d608f9a07da0016b0de P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.734963  7002 tablet_replica.cc:333] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.735495  7002 raft_consensus.cc:2243] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.735941  7002 raft_consensus.cc:2272] T 5f73dde38f9f490e956b5b005432d729 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.738232  7002 tablet_replica.cc:333] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.738967  7002 raft_consensus.cc:2243] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.739413  7002 raft_consensus.cc:2272] T a3253d2ad2b64c8c9248f22c5120e3d3 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.741258  7002 tablet_replica.cc:333] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.741878  7002 raft_consensus.cc:2243] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.742650  7002 raft_consensus.cc:2272] T 365043cafcff491b9bc231758de19173 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.744479  7002 tablet_replica.cc:333] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.745064  7002 raft_consensus.cc:2243] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.745563  7002 raft_consensus.cc:2272] T f408b6da07994e6b8404d08de526968e P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.747426  7002 tablet_replica.cc:333] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.748193  7002 raft_consensus.cc:2243] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.749334  7002 raft_consensus.cc:2272] T d817f3a613834a79bcea8fafa547b64a P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.751652  7002 tablet_replica.cc:333] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.752274  7002 raft_consensus.cc:2243] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.753044  7002 raft_consensus.cc:2272] T b5c7f01cae2e42059c0c563044db5397 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.755002  7002 tablet_replica.cc:333] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.755582  7002 raft_consensus.cc:2243] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.756069  7002 raft_consensus.cc:2272] T 68fef2ec1a33423dab70f94865974ef6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.758064  7002 tablet_replica.cc:333] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.758621  7002 raft_consensus.cc:2243] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.759390  7002 raft_consensus.cc:2272] T 21ab1224b9f046f78d1d5216c7f14444 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.761528  7002 tablet_replica.cc:333] T 029eef820bfd4d72aa620e37e109c44d P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.762219  7002 raft_consensus.cc:2243] T 029eef820bfd4d72aa620e37e109c44d P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.762665  7002 raft_consensus.cc:2272] T 029eef820bfd4d72aa620e37e109c44d P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.764922  7002 tablet_replica.cc:333] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.765614  7002 raft_consensus.cc:2243] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.766163  7002 raft_consensus.cc:2272] T 824e7a4eab344663bcb8445e41420e77 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.768195  7002 tablet_replica.cc:333] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.768765  7002 raft_consensus.cc:2243] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.769651  7002 raft_consensus.cc:2272] T bbde267020e049928693787ee5ff42a7 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.771797  7002 tablet_replica.cc:333] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.772301  7002 raft_consensus.cc:2243] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.772708  7002 raft_consensus.cc:2272] T 0bb7cc6644bb40ba83130a39dca0ae78 P c7efbbf28df8445093a7ecf94e0b6b47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.774472  7002 tablet_replica.cc:333] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.774958  7002 raft_consensus.cc:2243] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.775394  7002 raft_consensus.cc:2272] T 7d6a510430a047e3a4e1f148dcc1f8f6 P c7efbbf28df8445093a7ecf94e0b6b47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.777114  7002 tablet_replica.cc:333] T 6b888baeb8304aa6bc76a3bba3765667 P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.777629  7002 raft_consensus.cc:2243] T 6b888baeb8304aa6bc76a3bba3765667 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.777985  7002 raft_consensus.cc:2272] T 6b888baeb8304aa6bc76a3bba3765667 P c7efbbf28df8445093a7ecf94e0b6b47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.779855  7002 tablet_replica.cc:333] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.780295  7002 raft_consensus.cc:2243] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.781037  7002 raft_consensus.cc:2272] T 43e34daa36f341509f8cbea46184e476 P c7efbbf28df8445093a7ecf94e0b6b47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.783147  7002 tablet_replica.cc:333] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47: stopping tablet replica
I20260709 13:22:14.783617  7002 raft_consensus.cc:2243] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.784027  7002 raft_consensus.cc:2272] T 400116f7ebba4af48c18dabc32bec377 P c7efbbf28df8445093a7ecf94e0b6b47 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:14.797086 19080 consensus_peers.cc:597] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 -> Peer c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901): Couldn't send request to peer c7efbbf28df8445093a7ecf94e0b6b47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:14.828022  7002 tablet_server.cc:196] TabletServer@127.6.214.129:0 shutdown complete.
W20260709 13:22:14.854694 19080 consensus_peers.cc:597] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 -> Peer c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901): Couldn't send request to peer c7efbbf28df8445093a7ecf94e0b6b47. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:14.862957  7002 tablet_server.cc:179] TabletServer@127.6.214.130:0 shutting down...
W20260709 13:22:14.880795 19080 consensus_peers.cc:597] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 -> Peer c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901): Couldn't send request to peer c7efbbf28df8445093a7ecf94e0b6b47. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:14.894443 19153 consensus_peers.cc:597] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a -> Peer e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443): Couldn't send request to peer e83f5fba2ee14240b2fbc847592de0a4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:14.900472  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:14.901561  7002 tablet_replica.cc:333] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.902411  7002 raft_consensus.cc:2243] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.903685  7002 raft_consensus.cc:2272] T 5f73dde38f9f490e956b5b005432d729 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.905690  7002 tablet_replica.cc:333] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.906271  7002 raft_consensus.cc:2243] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.906920  7002 raft_consensus.cc:2272] T b330263f08554d608f9a07da0016b0de P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.908967  7002 tablet_replica.cc:333] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.909673  7002 raft_consensus.cc:2243] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.910568  7002 raft_consensus.cc:2272] T 4d33cab399124767afa0cb7a78079d60 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.912578  7002 tablet_replica.cc:333] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.913187  7002 raft_consensus.cc:2243] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.913707  7002 raft_consensus.cc:2272] T d817f3a613834a79bcea8fafa547b64a P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.916036  7002 tablet_replica.cc:333] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.916703  7002 raft_consensus.cc:2243] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.917220  7002 raft_consensus.cc:2272] T b5c7f01cae2e42059c0c563044db5397 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.919613  7002 tablet_replica.cc:333] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.920266  7002 raft_consensus.cc:2243] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.921221  7002 raft_consensus.cc:2272] T 68fef2ec1a33423dab70f94865974ef6 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.923619  7002 tablet_replica.cc:333] T 365043cafcff491b9bc231758de19173 P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.924248  7002 raft_consensus.cc:2243] T 365043cafcff491b9bc231758de19173 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.924736  7002 raft_consensus.cc:2272] T 365043cafcff491b9bc231758de19173 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.926636  7002 tablet_replica.cc:333] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.927291  7002 raft_consensus.cc:2243] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.927765  7002 raft_consensus.cc:2272] T f408b6da07994e6b8404d08de526968e P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.929813  7002 tablet_replica.cc:333] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.930415  7002 raft_consensus.cc:2243] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.931252  7002 raft_consensus.cc:2272] T a3253d2ad2b64c8c9248f22c5120e3d3 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.933456  7002 tablet_replica.cc:333] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.934072  7002 raft_consensus.cc:2243] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.934563  7002 raft_consensus.cc:2272] T 21ab1224b9f046f78d1d5216c7f14444 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.936508  7002 tablet_replica.cc:333] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.937131  7002 raft_consensus.cc:2243] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.937721  7002 raft_consensus.cc:2272] T 400116f7ebba4af48c18dabc32bec377 P e83f5fba2ee14240b2fbc847592de0a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.940160  7002 tablet_replica.cc:333] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.941252  7002 raft_consensus.cc:2243] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.941771  7002 raft_consensus.cc:2272] T 7d6a510430a047e3a4e1f148dcc1f8f6 P e83f5fba2ee14240b2fbc847592de0a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.943894  7002 tablet_replica.cc:333] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
W20260709 13:22:14.944494 19154 consensus_peers.cc:597] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a -> Peer c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901): Couldn't send request to peer c7efbbf28df8445093a7ecf94e0b6b47. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:14.944509  7002 raft_consensus.cc:2243] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.945389  7002 raft_consensus.cc:2272] T 0bb7cc6644bb40ba83130a39dca0ae78 P e83f5fba2ee14240b2fbc847592de0a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.947268  7002 tablet_replica.cc:333] T 6b888baeb8304aa6bc76a3bba3765667 P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.947793  7002 raft_consensus.cc:2243] T 6b888baeb8304aa6bc76a3bba3765667 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.948143  7002 raft_consensus.cc:2272] T 6b888baeb8304aa6bc76a3bba3765667 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.950160  7002 tablet_replica.cc:333] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.950652  7002 raft_consensus.cc:2243] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.951036  7002 raft_consensus.cc:2272] T 43e34daa36f341509f8cbea46184e476 P e83f5fba2ee14240b2fbc847592de0a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.952983  7002 tablet_replica.cc:333] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.953552  7002 raft_consensus.cc:2243] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.954282  7002 raft_consensus.cc:2272] T 029eef820bfd4d72aa620e37e109c44d P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.956177  7002 tablet_replica.cc:333] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.956626  7002 raft_consensus.cc:2243] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:14.957293  7002 raft_consensus.cc:2272] T 824e7a4eab344663bcb8445e41420e77 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:14.959002  7002 tablet_replica.cc:333] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4: stopping tablet replica
I20260709 13:22:14.959424  7002 raft_consensus.cc:2243] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:14.959775  7002 raft_consensus.cc:2272] T bbde267020e049928693787ee5ff42a7 P e83f5fba2ee14240b2fbc847592de0a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.002586  7002 tablet_server.cc:196] TabletServer@127.6.214.130:0 shutdown complete.
W20260709 13:22:15.003706 19154 consensus_peers.cc:597] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a -> Peer c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901): Couldn't send request to peer c7efbbf28df8445093a7ecf94e0b6b47. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:15.029605 19153 consensus_peers.cc:597] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a -> Peer e83f5fba2ee14240b2fbc847592de0a4 (127.6.214.130:37443): Couldn't send request to peer e83f5fba2ee14240b2fbc847592de0a4. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.130:37443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:15.039124  7002 tablet_server.cc:179] TabletServer@127.6.214.131:0 shutting down...
I20260709 13:22:15.076563  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:15.077493  7002 tablet_replica.cc:333] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.078433  7002 raft_consensus.cc:2243] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.079247  7002 raft_consensus.cc:2272] T 4d33cab399124767afa0cb7a78079d60 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.081280  7002 tablet_replica.cc:333] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.082044  7002 raft_consensus.cc:2243] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.082691  7002 raft_consensus.cc:2272] T 21ab1224b9f046f78d1d5216c7f14444 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.084770  7002 tablet_replica.cc:333] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.085572  7002 raft_consensus.cc:2243] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:22:15.086061 19154 consensus_peers.cc:597] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a -> Peer c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901): Couldn't send request to peer c7efbbf28df8445093a7ecf94e0b6b47. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:15.086416  7002 raft_consensus.cc:2272] T b330263f08554d608f9a07da0016b0de P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.088282  7002 tablet_replica.cc:333] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.088845  7002 raft_consensus.cc:2243] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.089269  7002 raft_consensus.cc:2272] T 5f73dde38f9f490e956b5b005432d729 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.091122  7002 tablet_replica.cc:333] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.091686  7002 raft_consensus.cc:2243] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.092123  7002 raft_consensus.cc:2272] T 365043cafcff491b9bc231758de19173 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.093986  7002 tablet_replica.cc:333] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.094522  7002 raft_consensus.cc:2243] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:15.095301  7002 raft_consensus.cc:2272] T f408b6da07994e6b8404d08de526968e P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.097409  7002 tablet_replica.cc:333] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.098220  7002 raft_consensus.cc:2243] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.098721  7002 raft_consensus.cc:2272] T b5c7f01cae2e42059c0c563044db5397 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.100857  7002 tablet_replica.cc:333] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.101661  7002 raft_consensus.cc:2243] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.102207  7002 raft_consensus.cc:2272] T d817f3a613834a79bcea8fafa547b64a P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:15.102730 19154 consensus_peers.cc:597] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a -> Peer c7efbbf28df8445093a7ecf94e0b6b47 (127.6.214.129:43901): Couldn't send request to peer c7efbbf28df8445093a7ecf94e0b6b47. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:43901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:15.104611  7002 tablet_replica.cc:333] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.105240  7002 raft_consensus.cc:2243] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.105743  7002 raft_consensus.cc:2272] T 68fef2ec1a33423dab70f94865974ef6 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.107678  7002 tablet_replica.cc:333] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.108242  7002 raft_consensus.cc:2243] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.108667  7002 raft_consensus.cc:2272] T a3253d2ad2b64c8c9248f22c5120e3d3 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.110783  7002 tablet_replica.cc:333] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.111330  7002 raft_consensus.cc:2243] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:15.112147  7002 raft_consensus.cc:2272] T 7d6a510430a047e3a4e1f148dcc1f8f6 P 71b10608b007487ebfb9e047eaf4cd0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.114017  7002 tablet_replica.cc:333] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.114578  7002 raft_consensus.cc:2243] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:15.115326  7002 raft_consensus.cc:2272] T 0bb7cc6644bb40ba83130a39dca0ae78 P 71b10608b007487ebfb9e047eaf4cd0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.117364  7002 tablet_replica.cc:333] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.118038  7002 raft_consensus.cc:2243] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.118494  7002 raft_consensus.cc:2272] T 43e34daa36f341509f8cbea46184e476 P 71b10608b007487ebfb9e047eaf4cd0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.120553  7002 tablet_replica.cc:333] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.121088  7002 raft_consensus.cc:2243] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:15.121991  7002 raft_consensus.cc:2272] T 6b888baeb8304aa6bc76a3bba3765667 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.124150  7002 tablet_replica.cc:333] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.124732  7002 raft_consensus.cc:2243] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.125245  7002 raft_consensus.cc:2272] T 824e7a4eab344663bcb8445e41420e77 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.127110  7002 tablet_replica.cc:333] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.127614  7002 raft_consensus.cc:2243] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.128342  7002 raft_consensus.cc:2272] T bbde267020e049928693787ee5ff42a7 P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.130322  7002 tablet_replica.cc:333] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.130836  7002 raft_consensus.cc:2243] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.131269  7002 raft_consensus.cc:2272] T 029eef820bfd4d72aa620e37e109c44d P 71b10608b007487ebfb9e047eaf4cd0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.133234  7002 tablet_replica.cc:333] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a: stopping tablet replica
I20260709 13:22:15.133733  7002 raft_consensus.cc:2243] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:15.134509  7002 raft_consensus.cc:2272] T 400116f7ebba4af48c18dabc32bec377 P 71b10608b007487ebfb9e047eaf4cd0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.177037  7002 tablet_server.cc:196] TabletServer@127.6.214.131:0 shutdown complete.
I20260709 13:22:15.207185  7002 master.cc:562] Master@127.6.214.190:40473 shutting down...
I20260709 13:22:15.228912  7002 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:15.229511  7002 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.229846  7002 tablet_replica.cc:333] T 00000000000000000000000000000000 P 979229bf4e3e4837b004eabadd8da6fb: stopping tablet replica
I20260709 13:22:15.251159  7002 master.cc:584] Master@127.6.214.190:40473 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12836 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:22:15.302789  7002 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.214.190:39421
I20260709 13:22:15.303898  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:15.310015 19506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:15.310114 19505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:15.311471 19508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:15.311735  7002 server_base.cc:1061] running on GCE node
I20260709 13:22:15.312904  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:15.313171  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:15.313346  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603335313326 us; error 0 us; skew 500 ppm
I20260709 13:22:15.313998  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:15.316742  7002 webserver.cc:533] Webserver started at http://127.6.214.190:41929/ using document root <none> and password file <none>
I20260709 13:22:15.317625  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:15.317843  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:15.318130  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:15.319208  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/master-0-root/instance:
uuid: "6802cc11f64840688cbe914fce832caa"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-rnv4"
I20260709 13:22:15.323801  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:22:15.327543 19513 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.328508  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:22:15.328841  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/master-0-root
uuid: "6802cc11f64840688cbe914fce832caa"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-rnv4"
I20260709 13:22:15.329214  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:15.348779  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:15.350131  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:15.390247  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.190:39421
I20260709 13:22:15.390394 19564 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.190:39421 every 8 connection(s)
I20260709 13:22:15.394974 19565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.407450 19565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa: Bootstrap starting.
I20260709 13:22:15.412303 19565 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.416720 19565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa: No bootstrap required, opened a new log
I20260709 13:22:15.419399 19565 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6802cc11f64840688cbe914fce832caa" member_type: VOTER }
I20260709 13:22:15.419777 19565 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.420045 19565 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6802cc11f64840688cbe914fce832caa, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.420728 19565 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6802cc11f64840688cbe914fce832caa" member_type: VOTER }
I20260709 13:22:15.421144 19565 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:15.421422 19565 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:15.421727 19565 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:15.426535 19565 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6802cc11f64840688cbe914fce832caa" member_type: VOTER }
I20260709 13:22:15.427052 19565 leader_election.cc:304] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6802cc11f64840688cbe914fce832caa; no voters: 
I20260709 13:22:15.428246 19565 leader_election.cc:290] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:15.428611 19568 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:15.429998 19568 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [term 1 LEADER]: Becoming Leader. State: Replica: 6802cc11f64840688cbe914fce832caa, State: Running, Role: LEADER
I20260709 13:22:15.430670 19568 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6802cc11f64840688cbe914fce832caa" member_type: VOTER }
I20260709 13:22:15.431783 19565 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:15.435491 19569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6802cc11f64840688cbe914fce832caa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6802cc11f64840688cbe914fce832caa" member_type: VOTER } }
I20260709 13:22:15.435751 19570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6802cc11f64840688cbe914fce832caa. Latest consensus state: current_term: 1 leader_uuid: "6802cc11f64840688cbe914fce832caa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6802cc11f64840688cbe914fce832caa" member_type: VOTER } }
I20260709 13:22:15.436318 19569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:15.438181 19570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:15.443701 19574 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:15.449174 19574 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:15.454983  7002 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:15.459777 19574 catalog_manager.cc:1383] Generated new cluster ID: 2d787aba17b6461382ae95b931b08215
I20260709 13:22:15.460130 19574 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:15.483701 19574 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:15.485116 19574 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:15.504240 19574 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa: Generated new TSK 0
I20260709 13:22:15.504875 19574 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:15.523168  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:15.529757 19586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:15.531582 19587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:15.533576  7002 server_base.cc:1061] running on GCE node
W20260709 13:22:15.533722 19589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:15.535187  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:15.535424  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:15.535597  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603335535573 us; error 0 us; skew 500 ppm
I20260709 13:22:15.536116  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:15.538759  7002 webserver.cc:533] Webserver started at http://127.6.214.129:39221/ using document root <none> and password file <none>
I20260709 13:22:15.539256  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:15.539465  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:15.539742  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:15.541286  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/ts-0-root/instance:
uuid: "297e05fcf4ee40bd8de6f84215563628"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-rnv4"
I20260709 13:22:15.545907  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:15.549659 19594 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.550647  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:22:15.550976  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/ts-0-root
uuid: "297e05fcf4ee40bd8de6f84215563628"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-rnv4"
I20260709 13:22:15.551363  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:15.570801  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:15.572157  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:15.573808  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:15.576138  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:15.576364  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.576611  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:15.576807  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.622280  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.129:37257
I20260709 13:22:15.622496 19656 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.129:37257 every 8 connection(s)
I20260709 13:22:15.627477  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:15.634781 19661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:15.636292 19662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:15.640098 19657 heartbeater.cc:344] Connected to a master server at 127.6.214.190:39421
I20260709 13:22:15.640127  7002 server_base.cc:1061] running on GCE node
I20260709 13:22:15.640776 19657 heartbeater.cc:461] Registering TS with master...
W20260709 13:22:15.640707 19665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:15.641853 19657 heartbeater.cc:507] Master 127.6.214.190:39421 requested a full tablet report, sending...
I20260709 13:22:15.641986  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:15.642313  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:15.642489  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603335642474 us; error 0 us; skew 500 ppm
I20260709 13:22:15.643247  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:15.644002 19530 ts_manager.cc:194] Registered new tserver with Master: 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257)
I20260709 13:22:15.645836  7002 webserver.cc:533] Webserver started at http://127.6.214.130:40839/ using document root <none> and password file <none>
I20260709 13:22:15.646265 19530 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51052
I20260709 13:22:15.646364  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:15.646724  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:15.646999  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:15.648229  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/ts-1-root/instance:
uuid: "22c9846c7aa64d079557e69432deaa08"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-rnv4"
I20260709 13:22:15.653113  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:22:15.656630 19669 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.657644  7002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:15.657904  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/ts-1-root
uuid: "22c9846c7aa64d079557e69432deaa08"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-rnv4"
I20260709 13:22:15.658166  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:15.678376  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:15.679445  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:15.681244  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:15.683739  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:15.683933  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.684248  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:15.684410  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.724758  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.130:44333
I20260709 13:22:15.724860 19731 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.130:44333 every 8 connection(s)
I20260709 13:22:15.729542  7002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:15.736155 19735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:15.737907 19736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:15.740352 19738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:15.741739  7002 server_base.cc:1061] running on GCE node
I20260709 13:22:15.742666 19732 heartbeater.cc:344] Connected to a master server at 127.6.214.190:39421
I20260709 13:22:15.742858  7002 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:22:15.743156 19732 heartbeater.cc:461] Registering TS with master...
W20260709 13:22:15.743276  7002 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:15.743654  7002 hybrid_clock.cc:648] HybridClock initialized: now 1783603335743625 us; error 0 us; skew 500 ppm
I20260709 13:22:15.744092 19732 heartbeater.cc:507] Master 127.6.214.190:39421 requested a full tablet report, sending...
I20260709 13:22:15.744439  7002 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:15.746556 19530 ts_manager.cc:194] Registered new tserver with Master: 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:15.747300  7002 webserver.cc:533] Webserver started at http://127.6.214.131:36333/ using document root <none> and password file <none>
I20260709 13:22:15.747855  7002 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:15.748064  7002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:15.748116 19530 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51068
I20260709 13:22:15.748353  7002 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:15.750057  7002 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/ts-2-root/instance:
uuid: "357f6c97621e45a198ce354fe0bd763f"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-rnv4"
I20260709 13:22:15.755163  7002 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:22:15.759178 19743 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.760236  7002 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:22:15.760588  7002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/ts-2-root
uuid: "357f6c97621e45a198ce354fe0bd763f"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-rnv4"
I20260709 13:22:15.760856  7002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVKw1QP/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602923898527-7002-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:15.770390  7002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:15.771528  7002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:15.773046  7002 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:15.775379  7002 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:15.775622  7002 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.775866  7002 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:15.776054  7002 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.816325  7002 rpc_server.cc:307] RPC server started. Bound to: 127.6.214.131:44227
I20260709 13:22:15.816425 19805 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.214.131:44227 every 8 connection(s)
I20260709 13:22:15.831278 19806 heartbeater.cc:344] Connected to a master server at 127.6.214.190:39421
I20260709 13:22:15.831813 19806 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:15.832837 19806 heartbeater.cc:507] Master 127.6.214.190:39421 requested a full tablet report, sending...
I20260709 13:22:15.835170 19530 ts_manager.cc:194] Registered new tserver with Master: 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:15.835424  7002 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016024287s
I20260709 13:22:15.836661 19530 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51070
I20260709 13:22:15.862733 19530 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51072:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:15.865381 19530 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:15.954665 19622 tablet_service.cc:1511] Processing CreateTablet for tablet 70fd296c3fc94a1d95d6494ee73a2beb (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:15.956182 19622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70fd296c3fc94a1d95d6494ee73a2beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.958549 19621 tablet_service.cc:1511] Processing CreateTablet for tablet a98c8be586184e7d9265fa9a1b805f00 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:15.959035 19619 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba8b98481394565bee73438c70e34e2 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:15.960042 19621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a98c8be586184e7d9265fa9a1b805f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.961000 19697 tablet_service.cc:1511] Processing CreateTablet for tablet 70fd296c3fc94a1d95d6494ee73a2beb (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:15.961270 19620 tablet_service.cc:1511] Processing CreateTablet for tablet 23edf4f0e2d6432589cde181f8e8d234 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:15.962498 19620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23edf4f0e2d6432589cde181f8e8d234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.963579 19696 tablet_service.cc:1511] Processing CreateTablet for tablet a98c8be586184e7d9265fa9a1b805f00 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:15.965770 19695 tablet_service.cc:1511] Processing CreateTablet for tablet 23edf4f0e2d6432589cde181f8e8d234 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:15.967939 19694 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba8b98481394565bee73438c70e34e2 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:15.969025 19619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba8b98481394565bee73438c70e34e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.962484 19697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70fd296c3fc94a1d95d6494ee73a2beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.971133 19694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba8b98481394565bee73438c70e34e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.977806 19696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a98c8be586184e7d9265fa9a1b805f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.981710 19821 tablet_bootstrap.cc:492] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:15.981878 19695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23edf4f0e2d6432589cde181f8e8d234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.990530 19770 tablet_service.cc:1511] Processing CreateTablet for tablet a98c8be586184e7d9265fa9a1b805f00 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:15.992187 19770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a98c8be586184e7d9265fa9a1b805f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.994738 19769 tablet_service.cc:1511] Processing CreateTablet for tablet 23edf4f0e2d6432589cde181f8e8d234 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:15.996320 19769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23edf4f0e2d6432589cde181f8e8d234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.998731 19768 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba8b98481394565bee73438c70e34e2 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:16.000423 19768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba8b98481394565bee73438c70e34e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.989161 19771 tablet_service.cc:1511] Processing CreateTablet for tablet 70fd296c3fc94a1d95d6494ee73a2beb (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:16.003039 19771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70fd296c3fc94a1d95d6494ee73a2beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.005481 19622 tablet_service.cc:1511] Processing CreateTablet for tablet 6b90dbf31b4c423c9822ef485b8b1987 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:16.007066 19622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b90dbf31b4c423c9822ef485b8b1987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.007537 19693 tablet_service.cc:1511] Processing CreateTablet for tablet 6b90dbf31b4c423c9822ef485b8b1987 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:16.009008 19693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b90dbf31b4c423c9822ef485b8b1987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.013661 19767 tablet_service.cc:1511] Processing CreateTablet for tablet 6b90dbf31b4c423c9822ef485b8b1987 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:16.015233 19767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b90dbf31b4c423c9822ef485b8b1987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.020678 19822 tablet_bootstrap.cc:492] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:16.030572 19620 tablet_service.cc:1511] Processing CreateTablet for tablet c0ad8ec7c1884c85b531bf2e7ae200ff (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:16.032119 19620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ad8ec7c1884c85b531bf2e7ae200ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.034884 19695 tablet_service.cc:1511] Processing CreateTablet for tablet c0ad8ec7c1884c85b531bf2e7ae200ff (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:16.036387 19695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ad8ec7c1884c85b531bf2e7ae200ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.037326 19766 tablet_service.cc:1511] Processing CreateTablet for tablet c0ad8ec7c1884c85b531bf2e7ae200ff (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:16.038942 19766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ad8ec7c1884c85b531bf2e7ae200ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.045665 19622 tablet_service.cc:1511] Processing CreateTablet for tablet ae1d5c2b0d784308b194995f71686278 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:16.047322 19622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1d5c2b0d784308b194995f71686278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.051775 19821 tablet_bootstrap.cc:654] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.058401 19822 tablet_bootstrap.cc:654] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.057960 19765 tablet_service.cc:1511] Processing CreateTablet for tablet ae1d5c2b0d784308b194995f71686278 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:16.059679 19765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1d5c2b0d784308b194995f71686278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.060061 19619 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac7a0da888e40d38a51fcbe7966e1d5 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:16.061573 19619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac7a0da888e40d38a51fcbe7966e1d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.063040 19696 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac7a0da888e40d38a51fcbe7966e1d5 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:16.064664 19696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac7a0da888e40d38a51fcbe7966e1d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.066633 19697 tablet_service.cc:1511] Processing CreateTablet for tablet ae1d5c2b0d784308b194995f71686278 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:16.074589 19764 tablet_service.cc:1511] Processing CreateTablet for tablet 5ac7a0da888e40d38a51fcbe7966e1d5 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:16.078522 19764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac7a0da888e40d38a51fcbe7966e1d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.079828 19697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1d5c2b0d784308b194995f71686278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.080745 19621 tablet_service.cc:1511] Processing CreateTablet for tablet dbb443f6e8544fdea5f5895598ddd879 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:16.084699 19621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb443f6e8544fdea5f5895598ddd879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.087740 19693 tablet_service.cc:1511] Processing CreateTablet for tablet dbb443f6e8544fdea5f5895598ddd879 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:16.089200 19693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb443f6e8544fdea5f5895598ddd879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.093773 19824 tablet_bootstrap.cc:492] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:16.099575 19769 tablet_service.cc:1511] Processing CreateTablet for tablet dbb443f6e8544fdea5f5895598ddd879 (DEFAULT_TABLE table=test-workload [id=ca580a455f274a5b9bc51b2e3aafccc7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:16.101292 19769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb443f6e8544fdea5f5895598ddd879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.114037 19822 tablet_bootstrap.cc:492] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:16.114727 19822 ts_tablet_manager.cc:1403] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.000s
I20260709 13:22:16.117830 19822 raft_consensus.cc:359] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.118602 19822 raft_consensus.cc:385] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.118934 19822 raft_consensus.cc:740] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.119721 19822 consensus_queue.cc:260] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.120980 19824 tablet_bootstrap.cc:654] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.134797 19732 heartbeater.cc:499] Master 127.6.214.190:39421 was elected leader, sending a full tablet report...
I20260709 13:22:16.135123 19822 ts_tablet_manager.cc:1434] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:22:16.136137 19822 tablet_bootstrap.cc:492] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:16.153548 19822 tablet_bootstrap.cc:654] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.156032 19824 tablet_bootstrap.cc:492] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:16.157145 19824 ts_tablet_manager.cc:1403] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.007s
I20260709 13:22:16.160211 19824 raft_consensus.cc:359] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.160974 19824 raft_consensus.cc:385] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.161270 19824 raft_consensus.cc:740] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.162088 19824 consensus_queue.cc:260] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.168207 19806 heartbeater.cc:499] Master 127.6.214.190:39421 was elected leader, sending a full tablet report...
I20260709 13:22:16.169588 19824 ts_tablet_manager.cc:1434] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:22:16.173741 19821 tablet_bootstrap.cc:492] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:16.174571 19821 ts_tablet_manager.cc:1403] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.193s	user 0.018s	sys 0.000s
I20260709 13:22:16.175325 19824 tablet_bootstrap.cc:492] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:16.179185 19821 raft_consensus.cc:359] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } } peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } }
I20260709 13:22:16.180272 19821 raft_consensus.cc:385] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.180678 19821 raft_consensus.cc:740] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.182116 19821 consensus_queue.cc:260] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } } peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } }
I20260709 13:22:16.183729 19824 tablet_bootstrap.cc:654] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.192874 19821 ts_tablet_manager.cc:1434] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:22:16.194099 19657 heartbeater.cc:499] Master 127.6.214.190:39421 was elected leader, sending a full tablet report...
I20260709 13:22:16.198256 19828 raft_consensus.cc:493] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.198848 19828 raft_consensus.cc:515] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.204737 19822 tablet_bootstrap.cc:492] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:16.204936 19821 tablet_bootstrap.cc:492] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:16.205543 19822 ts_tablet_manager.cc:1403] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.026s
I20260709 13:22:16.206481 19828 leader_election.cc:290] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:16.208626 19822 raft_consensus.cc:359] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } } peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } }
I20260709 13:22:16.209705 19822 raft_consensus.cc:385] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.211087 19822 raft_consensus.cc:740] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.212153 19822 consensus_queue.cc:260] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } } peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } }
I20260709 13:22:16.213018 19821 tablet_bootstrap.cc:654] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.218591 19822 ts_tablet_manager.cc:1434] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:22:16.219794 19821 tablet_bootstrap.cc:492] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:16.219820 19822 tablet_bootstrap.cc:492] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:16.220618 19821 ts_tablet_manager.cc:1403] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:22:16.222687 19824 tablet_bootstrap.cc:492] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:16.223332 19824 ts_tablet_manager.cc:1403] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.006s
I20260709 13:22:16.223563 19821 raft_consensus.cc:359] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.224364 19821 raft_consensus.cc:385] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.224668 19821 raft_consensus.cc:740] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.225554 19821 consensus_queue.cc:260] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.228534 19821 ts_tablet_manager.cc:1434] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:16.229542 19821 tablet_bootstrap.cc:492] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:16.231604 19824 raft_consensus.cc:359] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.232679 19824 raft_consensus.cc:385] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.232118 19632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23edf4f0e2d6432589cde181f8e8d234" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:16.233127 19824 raft_consensus.cc:740] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
W20260709 13:22:16.234292 19745 leader_election.cc:343] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.234061 19824 consensus_queue.cc:260] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.236157 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23edf4f0e2d6432589cde181f8e8d234" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:16.236357 19824 ts_tablet_manager.cc:1434] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.006s
I20260709 13:22:16.236858 19707 raft_consensus.cc:2468] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 0.
I20260709 13:22:16.237890 19824 tablet_bootstrap.cc:492] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:16.238270 19745 leader_election.cc:304] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:16.243516 19821 tablet_bootstrap.cc:654] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.244004 19830 raft_consensus.cc:2804] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:16.244441 19830 raft_consensus.cc:493] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:16.244766 19830 raft_consensus.cc:3060] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.245389 19822 tablet_bootstrap.cc:654] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.251132 19830 raft_consensus.cc:515] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.252985 19830 leader_election.cc:290] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:16.253649 19824 tablet_bootstrap.cc:654] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.254324 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23edf4f0e2d6432589cde181f8e8d234" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:16.255784 19821 tablet_bootstrap.cc:492] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:16.255950 19632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23edf4f0e2d6432589cde181f8e8d234" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:16.256682 19821 ts_tablet_manager.cc:1403] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.000s
W20260709 13:22:16.258155 19745 leader_election.cc:343] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.258847 19707 raft_consensus.cc:3060] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.260839 19821 raft_consensus.cc:359] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.261730 19824 tablet_bootstrap.cc:492] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:16.261770 19822 tablet_bootstrap.cc:492] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:16.261749 19821 raft_consensus.cc:385] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.262334 19824 ts_tablet_manager.cc:1403] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.003s
I20260709 13:22:16.262480 19821 raft_consensus.cc:740] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.262650 19822 ts_tablet_manager.cc:1403] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.010s
I20260709 13:22:16.263542 19821 consensus_queue.cc:260] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.265609 19824 raft_consensus.cc:359] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.265945 19822 raft_consensus.cc:359] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.266407 19824 raft_consensus.cc:385] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.266759 19822 raft_consensus.cc:385] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.266845 19824 raft_consensus.cc:740] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.267161 19822 raft_consensus.cc:740] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.267905 19824 consensus_queue.cc:260] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.268335 19707 raft_consensus.cc:2468] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 1.
I20260709 13:22:16.268180 19822 consensus_queue.cc:260] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.269017 19821 ts_tablet_manager.cc:1434] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:22:16.270107 19821 tablet_bootstrap.cc:492] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:16.270990 19824 ts_tablet_manager.cc:1434] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:16.271885 19824 tablet_bootstrap.cc:492] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:16.272944 19745 leader_election.cc:304] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:16.273893 19830 raft_consensus.cc:2804] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:16.274402 19830 raft_consensus.cc:697] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Becoming Leader. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Running, Role: LEADER
I20260709 13:22:16.275287 19830 consensus_queue.cc:237] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.276201 19821 tablet_bootstrap.cc:654] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.277319 19824 tablet_bootstrap.cc:654] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.281100 19822 ts_tablet_manager.cc:1434] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:22:16.282271 19822 tablet_bootstrap.cc:492] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:16.293939 19822 tablet_bootstrap.cc:654] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.297219 19824 tablet_bootstrap.cc:492] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:16.297802 19824 ts_tablet_manager.cc:1403] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.011s
I20260709 13:22:16.298399 19528 catalog_manager.cc:5697] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f reported cstate change: term changed from 0 to 1, leader changed from <none> to 357f6c97621e45a198ce354fe0bd763f (127.6.214.131). New cstate: current_term: 1 leader_uuid: "357f6c97621e45a198ce354fe0bd763f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:16.300595 19824 raft_consensus.cc:359] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.301371 19824 raft_consensus.cc:385] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.301702 19824 raft_consensus.cc:740] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.302506 19824 consensus_queue.cc:260] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.305013 19821 tablet_bootstrap.cc:492] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:16.305078 19824 ts_tablet_manager.cc:1434] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:16.305837 19821 ts_tablet_manager.cc:1403] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.000s
I20260709 13:22:16.307862 19824 tablet_bootstrap.cc:492] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:16.309069 19821 raft_consensus.cc:359] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.309873 19821 raft_consensus.cc:385] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.310182 19821 raft_consensus.cc:740] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.311065 19821 consensus_queue.cc:260] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.311748 19822 tablet_bootstrap.cc:492] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:16.312321 19822 ts_tablet_manager.cc:1403] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.009s
I20260709 13:22:16.315567 19824 tablet_bootstrap.cc:654] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.315421 19822 raft_consensus.cc:359] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.316243 19822 raft_consensus.cc:385] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.316577 19822 raft_consensus.cc:740] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.317377 19822 consensus_queue.cc:260] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.318509 19821 ts_tablet_manager.cc:1434] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:22:16.322118 19822 ts_tablet_manager.cc:1434] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:22:16.323280 19822 tablet_bootstrap.cc:492] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:16.325031 19821 tablet_bootstrap.cc:492] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:16.325637 19831 raft_consensus.cc:493] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.326262 19831 raft_consensus.cc:515] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.330070 19822 tablet_bootstrap.cc:654] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.338670 19825 raft_consensus.cc:493] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.339422 19825 raft_consensus.cc:515] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.341638 19831 leader_election.cc:290] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:16.342612 19822 tablet_bootstrap.cc:492] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:16.343194 19822 ts_tablet_manager.cc:1403] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:22:16.346616 19825 leader_election.cc:290] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:16.349560 19831 raft_consensus.cc:493] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.350273 19831 raft_consensus.cc:515] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.355708 19821 tablet_bootstrap.cc:654] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.363883 19831 leader_election.cc:290] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:16.365177 19824 tablet_bootstrap.cc:492] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:16.365993 19824 ts_tablet_manager.cc:1403] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.058s	user 0.028s	sys 0.020s
I20260709 13:22:16.368038 19822 raft_consensus.cc:359] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.369089 19822 raft_consensus.cc:385] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.369472 19822 raft_consensus.cc:740] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.370469 19822 consensus_queue.cc:260] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.378825 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98c8be586184e7d9265fa9a1b805f00" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:16.379156 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23edf4f0e2d6432589cde181f8e8d234" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:16.379603 19707 raft_consensus.cc:2468] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 0.
I20260709 13:22:16.380080 19821 tablet_bootstrap.cc:492] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:16.380215 19706 raft_consensus.cc:2393] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 297e05fcf4ee40bd8de6f84215563628 in current term 1: Already voted for candidate 357f6c97621e45a198ce354fe0bd763f in this term.
I20260709 13:22:16.380649 19821 ts_tablet_manager.cc:1403] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.012s
I20260709 13:22:16.381520 19596 leader_election.cc:304] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:16.383731 19821 raft_consensus.cc:359] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.384548 19821 raft_consensus.cc:385] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.384693 19822 ts_tablet_manager.cc:1434] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 13:22:16.386051 19822 tablet_bootstrap.cc:492] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:16.384853 19821 raft_consensus.cc:740] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.382907 19831 raft_consensus.cc:2804] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:16.389217 19824 raft_consensus.cc:359] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.389933 19831 raft_consensus.cc:493] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:16.390122 19824 raft_consensus.cc:385] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.390368 19831 raft_consensus.cc:3060] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.390498 19824 raft_consensus.cc:740] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.391363 19824 consensus_queue.cc:260] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.397493 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23edf4f0e2d6432589cde181f8e8d234" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:16.397760 19824 ts_tablet_manager.cc:1434] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.003s
I20260709 13:22:16.389237 19821 consensus_queue.cc:260] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.400710 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98c8be586184e7d9265fa9a1b805f00" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:16.401499 19781 raft_consensus.cc:2468] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 0.
I20260709 13:22:16.402988 19597 leader_election.cc:304] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628; no voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f
I20260709 13:22:16.405746 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8b98481394565bee73438c70e34e2" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
W20260709 13:22:16.407672 19672 leader_election.cc:343] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.409298 19822 tablet_bootstrap.cc:654] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.410249 19824 tablet_bootstrap.cc:492] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:16.418664 19830 raft_consensus.cc:493] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.419270 19830 raft_consensus.cc:515] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.421403 19830 leader_election.cc:290] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:16.423714 19821 ts_tablet_manager.cc:1434] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.043s	user 0.014s	sys 0.009s
I20260709 13:22:16.423923 19632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb443f6e8544fdea5f5895598ddd879" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:16.425237 19821 tablet_bootstrap.cc:492] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
W20260709 13:22:16.426254 19745 leader_election.cc:343] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.425247 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb443f6e8544fdea5f5895598ddd879" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
W20260709 13:22:16.428359 19745 leader_election.cc:343] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.428825 19745 leader_election.cc:304] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 357f6c97621e45a198ce354fe0bd763f; no voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:16.430033 19830 raft_consensus.cc:2749] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:16.430055 19824 tablet_bootstrap.cc:654] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.432320 19831 raft_consensus.cc:515] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.445659 19821 tablet_bootstrap.cc:654] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.445040 19830 raft_consensus.cc:493] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.441772 19632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8b98481394565bee73438c70e34e2" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:16.436069 19822 tablet_bootstrap.cc:492] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:16.441118 19852 raft_consensus.cc:493] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.446424 19830 raft_consensus.cc:515] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.447106 19822 ts_tablet_manager.cc:1403] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.013s
I20260709 13:22:16.447345 19852 raft_consensus.cc:515] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.448136 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98c8be586184e7d9265fa9a1b805f00" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:16.448774 19706 raft_consensus.cc:3060] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:16.449829 19578 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:16.436761 19850 raft_consensus.cc:3060] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.450403 19631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad8ec7c1884c85b531bf2e7ae200ff" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:16.450984 19822 raft_consensus.cc:359] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.451789 19822 raft_consensus.cc:385] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.452170 19822 raft_consensus.cc:740] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
W20260709 13:22:16.452807 19745 leader_election.cc:343] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.453089 19632 raft_consensus.cc:2468] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 0.
I20260709 13:22:16.452186 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad8ec7c1884c85b531bf2e7ae200ff" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:16.453838 19822 consensus_queue.cc:260] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
W20260709 13:22:16.455219 19745 leader_election.cc:343] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.455687 19745 leader_election.cc:304] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 357f6c97621e45a198ce354fe0bd763f; no voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:16.456447 19828 raft_consensus.cc:2749] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:16.456911 19822 ts_tablet_manager.cc:1434] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:22:16.456862 19671 leader_election.cc:304] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 357f6c97621e45a198ce354fe0bd763f
I20260709 13:22:16.453637 19830 leader_election.cc:290] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:16.458350 19825 raft_consensus.cc:2804] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:16.458953 19825 raft_consensus.cc:493] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:16.459095 19822 tablet_bootstrap.cc:492] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:16.459399 19825 raft_consensus.cc:3060] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.465538 19821 tablet_bootstrap.cc:492] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:16.466161 19821 ts_tablet_manager.cc:1403] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.021s
I20260709 13:22:16.466536 19822 tablet_bootstrap.cc:654] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.467175 19706 raft_consensus.cc:2468] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 1.
I20260709 13:22:16.468791 19596 leader_election.cc:304] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:16.470046 19849 raft_consensus.cc:2804] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:16.469833 19821 raft_consensus.cc:359] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.470738 19821 raft_consensus.cc:385] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.471129 19821 raft_consensus.cc:740] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.443656 19824 tablet_bootstrap.cc:492] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:16.472875 19831 leader_election.cc:290] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 election: Requested vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:16.473109 19824 ts_tablet_manager.cc:1403] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.008s
I20260709 13:22:16.473308 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98c8be586184e7d9265fa9a1b805f00" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:16.473938 19781 raft_consensus.cc:3060] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.474575 19855 raft_consensus.cc:493] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.475139 19855 raft_consensus.cc:515] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.476524 19830 raft_consensus.cc:493] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.476363 19824 raft_consensus.cc:359] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.472174 19821 consensus_queue.cc:260] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.477123 19830 raft_consensus.cc:515] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.478665 19849 raft_consensus.cc:697] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Becoming Leader. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Running, Role: LEADER
I20260709 13:22:16.480589 19632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac7a0da888e40d38a51fcbe7966e1d5" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:16.481117 19830 leader_election.cc:290] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:16.481961 19632 raft_consensus.cc:2468] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 0.
I20260709 13:22:16.483876 19852 leader_election.cc:290] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:16.484498 19821 ts_tablet_manager.cc:1434] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 13:22:16.484620 19825 raft_consensus.cc:515] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.485824 19821 tablet_bootstrap.cc:492] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:16.486346 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8b98481394565bee73438c70e34e2" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:16.488232 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8b98481394565bee73438c70e34e2" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
W20260709 13:22:16.489714 19672 leader_election.cc:343] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.489859 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8b98481394565bee73438c70e34e2" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:16.490760 19707 raft_consensus.cc:2393] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 297e05fcf4ee40bd8de6f84215563628 in current term 1: Already voted for candidate 22c9846c7aa64d079557e69432deaa08 in this term.
W20260709 13:22:16.492400 19597 leader_election.cc:343] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.492731 19850 raft_consensus.cc:2749] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:16.477159 19824 raft_consensus.cc:385] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.493278 19821 tablet_bootstrap.cc:654] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.488420 19745 leader_election.cc:304] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:16.493783 19824 raft_consensus.cc:740] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.494406 19830 raft_consensus.cc:2804] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:16.492522 19781 raft_consensus.cc:2468] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 1.
I20260709 13:22:16.494848 19830 raft_consensus.cc:493] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:16.495319 19830 raft_consensus.cc:3060] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.493319 19596 leader_election.cc:304] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628; no voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f
I20260709 13:22:16.502637 19632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8b98481394565bee73438c70e34e2" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:16.502985 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac7a0da888e40d38a51fcbe7966e1d5" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:16.503376 19632 raft_consensus.cc:3060] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.503614 19706 raft_consensus.cc:2468] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 0.
I20260709 13:22:16.481770 19849 consensus_queue.cc:237] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.494834 19824 consensus_queue.cc:260] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.506587 19828 raft_consensus.cc:493] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.507136 19828 raft_consensus.cc:515] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.504782 19830 raft_consensus.cc:515] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.509928 19631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90dbf31b4c423c9822ef485b8b1987" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:16.510637 19631 raft_consensus.cc:2468] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 0.
I20260709 13:22:16.512216 19631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1d5c2b0d784308b194995f71686278" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:16.513098 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac7a0da888e40d38a51fcbe7966e1d5" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
W20260709 13:22:16.513725 19745 leader_election.cc:343] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.513891 19630 raft_consensus.cc:3060] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.486966 19825 leader_election.cc:290] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:16.517911 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90dbf31b4c423c9822ef485b8b1987" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:16.514860 19828 leader_election.cc:290] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:16.518324 19671 leader_election.cc:304] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:16.512970 19632 raft_consensus.cc:2468] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 1.
I20260709 13:22:16.523725 19825 raft_consensus.cc:2804] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:16.523978 19856 raft_consensus.cc:2749] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:16.524341 19825 raft_consensus.cc:493] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:16.524433 19830 leader_election.cc:290] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:16.524860 19825 raft_consensus.cc:3060] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:16.526139 19672 leader_election.cc:343] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.526554 19671 leader_election.cc:304] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 357f6c97621e45a198ce354fe0bd763f
I20260709 13:22:16.515059 19855 leader_election.cc:290] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:16.529353 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac7a0da888e40d38a51fcbe7966e1d5" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:16.529778 19855 raft_consensus.cc:2804] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:16.530400 19707 raft_consensus.cc:3060] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.531085 19855 raft_consensus.cc:697] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Becoming Leader. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:16.532555 19855 consensus_queue.cc:237] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.523733 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1d5c2b0d784308b194995f71686278" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
W20260709 13:22:16.537125 19745 leader_election.cc:343] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.537644 19745 leader_election.cc:304] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 357f6c97621e45a198ce354fe0bd763f; no voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:16.542248 19859 raft_consensus.cc:2749] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:16.551398 19824 ts_tablet_manager.cc:1434] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.078s	user 0.012s	sys 0.005s
I20260709 13:22:16.551247 19529 catalog_manager.cc:5697] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 reported cstate change: term changed from 0 to 1, leader changed from <none> to 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "297e05fcf4ee40bd8de6f84215563628" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.552673 19824 tablet_bootstrap.cc:492] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:16.553288 19707 raft_consensus.cc:2468] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 1.
I20260709 13:22:16.554003 19630 raft_consensus.cc:2468] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 1.
I20260709 13:22:16.554754 19745 leader_election.cc:304] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:16.556876 19859 raft_consensus.cc:2804] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:16.557729 19859 raft_consensus.cc:697] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Becoming Leader. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Running, Role: LEADER
I20260709 13:22:16.558732 19859 consensus_queue.cc:237] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.558851 19825 raft_consensus.cc:515] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.562000 19825 leader_election.cc:290] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:16.563982 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90dbf31b4c423c9822ef485b8b1987" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
W20260709 13:22:16.565752 19672 leader_election.cc:343] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:16.566147 19822 tablet_bootstrap.cc:492] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:16.566744 19822 ts_tablet_manager.cc:1403] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.010s
I20260709 13:22:16.566859 19821 tablet_bootstrap.cc:492] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:16.567471 19821 ts_tablet_manager.cc:1403] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.082s	user 0.018s	sys 0.012s
I20260709 13:22:16.567708 19824 tablet_bootstrap.cc:654] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.570019 19822 raft_consensus.cc:359] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.570866 19822 raft_consensus.cc:385] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.571215 19822 raft_consensus.cc:740] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.570945 19821 raft_consensus.cc:359] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.572464 19822 consensus_queue.cc:260] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.575456 19822 ts_tablet_manager.cc:1434] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:16.571946 19821 raft_consensus.cc:385] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.576206 19821 raft_consensus.cc:740] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.576983 19822 tablet_bootstrap.cc:492] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:16.577420 19821 consensus_queue.cc:260] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
W20260709 13:22:16.579604 19671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:37257, user_credentials={real_user=slave}} blocked reactor thread for 53163.6us
I20260709 13:22:16.581795 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90dbf31b4c423c9822ef485b8b1987" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:16.582526 19630 raft_consensus.cc:3060] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.582882 19824 tablet_bootstrap.cc:492] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:16.583495 19824 ts_tablet_manager.cc:1403] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.004s
I20260709 13:22:16.590898 19822 tablet_bootstrap.cc:654] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.591328 19529 catalog_manager.cc:5697] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22c9846c7aa64d079557e69432deaa08 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "22c9846c7aa64d079557e69432deaa08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.592803 19824 raft_consensus.cc:359] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } } peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } }
I20260709 13:22:16.593658 19824 raft_consensus.cc:385] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.594002 19824 raft_consensus.cc:740] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.594326 19630 raft_consensus.cc:2468] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 1.
I20260709 13:22:16.594995 19824 consensus_queue.cc:260] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } } peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } }
I20260709 13:22:16.596858 19821 ts_tablet_manager.cc:1434] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:22:16.597556 19824 ts_tablet_manager.cc:1434] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:22:16.598284 19821 tablet_bootstrap.cc:492] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:16.598685 19824 tablet_bootstrap.cc:492] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:16.605674 19821 tablet_bootstrap.cc:654] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.605674 19824 tablet_bootstrap.cc:654] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.612202 19671 leader_election.cc:304] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 357f6c97621e45a198ce354fe0bd763f
I20260709 13:22:16.614149 19855 raft_consensus.cc:2804] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:16.615270 19855 raft_consensus.cc:697] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Becoming Leader. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:16.616173 19855 consensus_queue.cc:237] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.617545 19821 tablet_bootstrap.cc:492] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:16.618105 19821 ts_tablet_manager.cc:1403] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 13:22:16.619079 19861 raft_consensus.cc:493] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.619606 19861 raft_consensus.cc:515] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } } peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } }
I20260709 13:22:16.621040 19821 raft_consensus.cc:359] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.621810 19861 leader_election.cc:290] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227), 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257)
I20260709 13:22:16.621804 19821 raft_consensus.cc:385] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.622591 19821 raft_consensus.cc:740] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.623118 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fd296c3fc94a1d95d6494ee73a2beb" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:16.623376 19821 consensus_queue.cc:260] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.623781 19781 raft_consensus.cc:2468] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 0.
I20260709 13:22:16.603785 19528 catalog_manager.cc:5697] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f reported cstate change: term changed from 0 to 1, leader changed from <none> to 357f6c97621e45a198ce354fe0bd763f (127.6.214.131). New cstate: current_term: 1 leader_uuid: "357f6c97621e45a198ce354fe0bd763f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:16.624356 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fd296c3fc94a1d95d6494ee73a2beb" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:16.625703 19630 raft_consensus.cc:2468] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 0.
I20260709 13:22:16.625876 19672 leader_election.cc:304] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:16.626780 19861 raft_consensus.cc:2804] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:16.627151 19861 raft_consensus.cc:493] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:16.627492 19861 raft_consensus.cc:3060] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.629838 19821 ts_tablet_manager.cc:1434] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:22:16.630792 19821 tablet_bootstrap.cc:492] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:16.635569 19861 raft_consensus.cc:515] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } } peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } }
I20260709 13:22:16.636477 19821 tablet_bootstrap.cc:654] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.638767 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fd296c3fc94a1d95d6494ee73a2beb" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:16.639503 19781 raft_consensus.cc:3060] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.648792 19781 raft_consensus.cc:2468] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 1.
I20260709 13:22:16.649091 19822 tablet_bootstrap.cc:492] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:16.649842 19822 ts_tablet_manager.cc:1403] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.073s	user 0.045s	sys 0.017s
I20260709 13:22:16.652729 19822 raft_consensus.cc:359] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.653122 19821 tablet_bootstrap.cc:492] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:16.653854 19822 raft_consensus.cc:385] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.654119 19821 ts_tablet_manager.cc:1403] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
I20260709 13:22:16.654232 19822 raft_consensus.cc:740] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.655412 19822 consensus_queue.cc:260] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.657075 19672 leader_election.cc:304] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:16.657888 19822 ts_tablet_manager.cc:1434] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:16.657564 19821 raft_consensus.cc:359] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.658047 19825 raft_consensus.cc:2804] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:16.658399 19821 raft_consensus.cc:385] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.658701 19821 raft_consensus.cc:740] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.659509 19821 consensus_queue.cc:260] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.662911 19821 ts_tablet_manager.cc:1434] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:22:16.666479 19861 leader_election.cc:290] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Requested vote from peers 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227), 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257)
I20260709 13:22:16.659183 19822 tablet_bootstrap.cc:492] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:16.668378 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fd296c3fc94a1d95d6494ee73a2beb" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:16.670549 19630 raft_consensus.cc:3060] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.679654 19630 raft_consensus.cc:2468] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 1.
I20260709 13:22:16.679627 19859 consensus_queue.cc:1048] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:16.685511 19527 catalog_manager.cc:5697] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22c9846c7aa64d079557e69432deaa08 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "22c9846c7aa64d079557e69432deaa08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.687322 19822 tablet_bootstrap.cc:654] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.705598 19825 raft_consensus.cc:697] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Becoming Leader. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:16.708243 19825 consensus_queue.cc:237] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } } peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } }
I20260709 13:22:16.710801 19824 tablet_bootstrap.cc:492] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:16.711385 19824 ts_tablet_manager.cc:1403] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.113s	user 0.009s	sys 0.044s
I20260709 13:22:16.715076 19824 raft_consensus.cc:359] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.716022 19824 raft_consensus.cc:385] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.716290 19824 raft_consensus.cc:740] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.718178 19822 tablet_bootstrap.cc:492] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:16.717149 19824 consensus_queue.cc:260] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.718873 19822 ts_tablet_manager.cc:1403] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.002s
I20260709 13:22:16.720544 19824 ts_tablet_manager.cc:1434] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:22:16.721730 19824 tablet_bootstrap.cc:492] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:16.723069 19822 raft_consensus.cc:359] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.724082 19822 raft_consensus.cc:385] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.724452 19822 raft_consensus.cc:740] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.725358 19822 consensus_queue.cc:260] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.725962 19856 raft_consensus.cc:493] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.726537 19856 raft_consensus.cc:515] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.728395 19822 ts_tablet_manager.cc:1434] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:22:16.728960 19824 tablet_bootstrap.cc:654] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.730569 19856 leader_election.cc:290] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:16.731333 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad8ec7c1884c85b531bf2e7ae200ff" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:16.731896 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad8ec7c1884c85b531bf2e7ae200ff" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:16.732262 19706 raft_consensus.cc:2468] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 0.
I20260709 13:22:16.732846 19781 raft_consensus.cc:2468] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 0.
I20260709 13:22:16.733857 19859 raft_consensus.cc:493] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.734553 19859 raft_consensus.cc:515] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.738924 19597 leader_election.cc:304] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:16.739347 19632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8b98481394565bee73438c70e34e2" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:16.740031 19856 raft_consensus.cc:2804] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:16.740432 19856 raft_consensus.cc:493] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:16.740475 19632 raft_consensus.cc:2393] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 357f6c97621e45a198ce354fe0bd763f in current term 1: Already voted for candidate 22c9846c7aa64d079557e69432deaa08 in this term.
I20260709 13:22:16.740878 19856 raft_consensus.cc:3060] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.741736 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8b98481394565bee73438c70e34e2" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:16.743846 19830 consensus_queue.cc:1048] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:16.745738 19745 leader_election.cc:304] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 357f6c97621e45a198ce354fe0bd763f; no voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:16.746677 19830 raft_consensus.cc:3060] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.746279 19527 catalog_manager.cc:5697] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22c9846c7aa64d079557e69432deaa08 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "22c9846c7aa64d079557e69432deaa08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:16.749353 19856 raft_consensus.cc:515] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.737303 19859 leader_election.cc:290] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:16.752661 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad8ec7c1884c85b531bf2e7ae200ff" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:16.753204 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad8ec7c1884c85b531bf2e7ae200ff" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:16.753890 19781 raft_consensus.cc:3060] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.753266 19707 raft_consensus.cc:3060] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.768854 19707 raft_consensus.cc:2468] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 1.
I20260709 13:22:16.769889 19781 raft_consensus.cc:2468] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 1.
I20260709 13:22:16.770191 19596 leader_election.cc:304] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:16.776422 19849 raft_consensus.cc:2804] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:16.777129 19849 raft_consensus.cc:697] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Becoming Leader. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Running, Role: LEADER
I20260709 13:22:16.778702 19849 consensus_queue.cc:237] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.781033 19824 tablet_bootstrap.cc:492] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:16.781706 19824 ts_tablet_manager.cc:1403] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.020s
I20260709 13:22:16.774204 19856 leader_election.cc:290] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 election: Requested vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:16.774686 19830 raft_consensus.cc:2749] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:16.785311 19824 raft_consensus.cc:359] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.786342 19824 raft_consensus.cc:385] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.786700 19824 raft_consensus.cc:740] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.787667 19824 consensus_queue.cc:260] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.791918 19824 ts_tablet_manager.cc:1434] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:22:16.793995 19527 catalog_manager.cc:5697] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 reported cstate change: term changed from 0 to 1, leader changed from <none> to 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "297e05fcf4ee40bd8de6f84215563628" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:16.927927 19830 raft_consensus.cc:493] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.928926 19830 raft_consensus.cc:515] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.930754 19825 raft_consensus.cc:493] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.932108 19830 leader_election.cc:290] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:16.931953 19825 raft_consensus.cc:515] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.934127 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90dbf31b4c423c9822ef485b8b1987" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:16.934911 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90dbf31b4c423c9822ef485b8b1987" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:16.935869 19630 raft_consensus.cc:2393] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 357f6c97621e45a198ce354fe0bd763f in current term 1: Already voted for candidate 22c9846c7aa64d079557e69432deaa08 in this term.
I20260709 13:22:16.937390 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb443f6e8544fdea5f5895598ddd879" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:16.937532 19825 leader_election.cc:290] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:16.938431 19630 raft_consensus.cc:2468] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 0.
I20260709 13:22:16.938563 19745 leader_election.cc:304] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 357f6c97621e45a198ce354fe0bd763f; no voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:16.938580 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb443f6e8544fdea5f5895598ddd879" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:16.939837 19781 raft_consensus.cc:2468] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 0.
I20260709 13:22:16.940042 19830 raft_consensus.cc:3060] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.940053 19671 leader_election.cc:304] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:16.941659 19825 raft_consensus.cc:2804] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:16.942135 19825 raft_consensus.cc:493] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:16.942529 19825 raft_consensus.cc:3060] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.946558 19870 consensus_queue.cc:1048] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:16.953670 19830 raft_consensus.cc:2749] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:16.953891 19825 raft_consensus.cc:515] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:16.957702 19825 leader_election.cc:290] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:16.958477 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb443f6e8544fdea5f5895598ddd879" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:16.958627 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb443f6e8544fdea5f5895598ddd879" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:16.959316 19630 raft_consensus.cc:3060] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.959369 19780 raft_consensus.cc:3060] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:16.959965 19849 consensus_queue.cc:1048] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:16.973759 19861 consensus_queue.cc:1048] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:16.991169 19856 consensus_queue.cc:1048] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:17.006964 19630 raft_consensus.cc:2468] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 1.
I20260709 13:22:17.008491 19671 leader_election.cc:304] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:17.009478 19861 raft_consensus.cc:2804] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:17.009979 19861 raft_consensus.cc:697] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Becoming Leader. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:17.011063 19861 consensus_queue.cc:237] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.017071 19780 raft_consensus.cc:2468] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 1.
I20260709 13:22:17.024438 19528 catalog_manager.cc:5697] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22c9846c7aa64d079557e69432deaa08 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "22c9846c7aa64d079557e69432deaa08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:17.032881 19849 raft_consensus.cc:493] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:17.033907 19849 raft_consensus.cc:515] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.036953 19849 leader_election.cc:290] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:17.038028 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1d5c2b0d784308b194995f71686278" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:17.038754 19706 raft_consensus.cc:2468] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 0.
I20260709 13:22:17.039726 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1d5c2b0d784308b194995f71686278" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:17.039934 19596 leader_election.cc:304] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:17.040418 19780 raft_consensus.cc:2468] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 0.
I20260709 13:22:17.040855 19849 raft_consensus.cc:2804] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:17.041215 19849 raft_consensus.cc:493] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:17.041549 19849 raft_consensus.cc:3060] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.047819 19849 raft_consensus.cc:515] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.049583 19849 leader_election.cc:290] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 election: Requested vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:17.050513 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1d5c2b0d784308b194995f71686278" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:17.050709 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1d5c2b0d784308b194995f71686278" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:17.051203 19780 raft_consensus.cc:3060] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.051203 19706 raft_consensus.cc:3060] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.059597 19780 raft_consensus.cc:2468] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 1.
I20260709 13:22:17.060927 19706 raft_consensus.cc:2468] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 1.
I20260709 13:22:17.060940 19597 leader_election.cc:304] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:17.062230 19849 raft_consensus.cc:2804] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:17.062932 19849 raft_consensus.cc:697] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Becoming Leader. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Running, Role: LEADER
I20260709 13:22:17.063913 19849 consensus_queue.cc:237] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.072700 19528 catalog_manager.cc:5697] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 reported cstate change: term changed from 0 to 1, leader changed from <none> to 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "297e05fcf4ee40bd8de6f84215563628" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:17.079671 19861 consensus_queue.cc:1048] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:17.093981 19861 consensus_queue.cc:1048] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:17.108057 19830 consensus_queue.cc:1048] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:17.133759 19828 consensus_queue.cc:1048] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:17.147171 19706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70fd296c3fc94a1d95d6494ee73a2beb"
dest_uuid: "22c9846c7aa64d079557e69432deaa08"
mode: GRACEFUL
new_leader_uuid: "297e05fcf4ee40bd8de6f84215563628"
 from {username='slave'} at 127.0.0.1:34774
I20260709 13:22:17.148105 19706 raft_consensus.cc:606] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Received request to transfer leadership to TS 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:17.150012 19861 consensus_queue.cc:1048] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:17.167448 19861 consensus_queue.cc:1048] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:17.176266 19825 raft_consensus.cc:993] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08: : Instructing follower 297e05fcf4ee40bd8de6f84215563628 to start an election
I20260709 13:22:17.176770 19861 raft_consensus.cc:1081] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Signalling peer 297e05fcf4ee40bd8de6f84215563628 to start an election
I20260709 13:22:17.178622 19630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70fd296c3fc94a1d95d6494ee73a2beb"
dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
 from {username='slave'} at 127.0.0.1:38188
I20260709 13:22:17.179404 19630 raft_consensus.cc:493] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.179809 19630 raft_consensus.cc:3060] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.187108 19780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23edf4f0e2d6432589cde181f8e8d234"
dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
mode: GRACEFUL
new_leader_uuid: "297e05fcf4ee40bd8de6f84215563628"
 from {username='slave'} at 127.0.0.1:40970
I20260709 13:22:17.187827 19780 raft_consensus.cc:606] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Received request to transfer leadership to TS 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:17.188499 19630 raft_consensus.cc:515] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } } peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } }
I20260709 13:22:17.191067 19630 leader_election.cc:290] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 2 election: Requested vote from peers 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:17.191821 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fd296c3fc94a1d95d6494ee73a2beb" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:17.193698 19706 raft_consensus.cc:3055] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:17.194203 19706 raft_consensus.cc:740] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:17.194514 19707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ba8b98481394565bee73438c70e34e2"
dest_uuid: "22c9846c7aa64d079557e69432deaa08"
mode: GRACEFUL
new_leader_uuid: "297e05fcf4ee40bd8de6f84215563628"
 from {username='slave'} at 127.0.0.1:34774
I20260709 13:22:17.195330 19707 raft_consensus.cc:606] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Received request to transfer leadership to TS 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:17.195379 19706 consensus_queue.cc:260] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } } peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } }
I20260709 13:22:17.197271 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fd296c3fc94a1d95d6494ee73a2beb" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:17.197892 19780 raft_consensus.cc:3060] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.197911 19706 raft_consensus.cc:3060] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.204442 19780 raft_consensus.cc:2468] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 2.
I20260709 13:22:17.205706 19597 leader_election.cc:304] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:17.206571 19849 raft_consensus.cc:2804] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:17.207129 19849 raft_consensus.cc:697] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [term 2 LEADER]: Becoming Leader. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Running, Role: LEADER
I20260709 13:22:17.208338 19849 consensus_queue.cc:237] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } } peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } }
I20260709 13:22:17.212293 19706 raft_consensus.cc:2468] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 2.
I20260709 13:22:17.216853 19528 catalog_manager.cc:5697] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 reported cstate change: term changed from 1 to 2, leader changed from 22c9846c7aa64d079557e69432deaa08 (127.6.214.130) to 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "297e05fcf4ee40bd8de6f84215563628" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:17.217813 19630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0ad8ec7c1884c85b531bf2e7ae200ff"
dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
mode: GRACEFUL
new_leader_uuid: "22c9846c7aa64d079557e69432deaa08"
 from {username='slave'} at 127.0.0.1:38196
I20260709 13:22:17.218415 19630 raft_consensus.cc:606] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Received request to transfer leadership to TS 22c9846c7aa64d079557e69432deaa08
I20260709 13:22:17.225276 19630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae1d5c2b0d784308b194995f71686278"
dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
mode: GRACEFUL
new_leader_uuid: "22c9846c7aa64d079557e69432deaa08"
 from {username='slave'} at 127.0.0.1:38196
I20260709 13:22:17.225899 19630 raft_consensus.cc:606] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Received request to transfer leadership to TS 22c9846c7aa64d079557e69432deaa08
I20260709 13:22:17.232272 19780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ac7a0da888e40d38a51fcbe7966e1d5"
dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
mode: GRACEFUL
new_leader_uuid: "22c9846c7aa64d079557e69432deaa08"
 from {username='slave'} at 127.0.0.1:40970
I20260709 13:22:17.232915 19780 raft_consensus.cc:606] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Received request to transfer leadership to TS 22c9846c7aa64d079557e69432deaa08
I20260709 13:22:17.238245 19706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbb443f6e8544fdea5f5895598ddd879"
dest_uuid: "22c9846c7aa64d079557e69432deaa08"
mode: GRACEFUL
new_leader_uuid: "357f6c97621e45a198ce354fe0bd763f"
 from {username='slave'} at 127.0.0.1:34774
I20260709 13:22:17.238780 19706 raft_consensus.cc:606] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Received request to transfer leadership to TS 357f6c97621e45a198ce354fe0bd763f
I20260709 13:22:17.271142 19849 consensus_queue.cc:1048] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:17.278589 19856 raft_consensus.cc:993] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628: : Instructing follower 22c9846c7aa64d079557e69432deaa08 to start an election
I20260709 13:22:17.279237 19850 raft_consensus.cc:1081] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Signalling peer 22c9846c7aa64d079557e69432deaa08 to start an election
I20260709 13:22:17.281646 19707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0ad8ec7c1884c85b531bf2e7ae200ff"
dest_uuid: "22c9846c7aa64d079557e69432deaa08"
 from {username='slave'} at 127.0.0.1:34762
I20260709 13:22:17.285060 19707 raft_consensus.cc:493] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.285562 19707 raft_consensus.cc:3060] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.288300 19850 consensus_queue.cc:1048] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:17.296262 19707 raft_consensus.cc:515] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.301025 19707 leader_election.cc:290] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 2 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:17.302170 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad8ec7c1884c85b531bf2e7ae200ff" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:17.302472 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ad8ec7c1884c85b531bf2e7ae200ff" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:17.302868 19780 raft_consensus.cc:3060] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.303138 19630 raft_consensus.cc:3055] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:17.303510 19630 raft_consensus.cc:740] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Running, Role: LEADER
I20260709 13:22:17.304761 19630 consensus_queue.cc:260] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.306202 19630 raft_consensus.cc:3060] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.309121 19780 raft_consensus.cc:2468] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 2.
I20260709 13:22:17.310464 19672 leader_election.cc:304] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:17.311398 19861 raft_consensus.cc:2804] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:17.311894 19861 raft_consensus.cc:697] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [term 2 LEADER]: Becoming Leader. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:17.312863 19861 consensus_queue.cc:237] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.314116 19630 raft_consensus.cc:2468] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 2.
I20260709 13:22:17.319953 19527 catalog_manager.cc:5697] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 reported cstate change: term changed from 1 to 2, leader changed from 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129) to 22c9846c7aa64d079557e69432deaa08 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "22c9846c7aa64d079557e69432deaa08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:17.343748 19859 raft_consensus.cc:993] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f: : Instructing follower 297e05fcf4ee40bd8de6f84215563628 to start an election
I20260709 13:22:17.344316 19859 raft_consensus.cc:1081] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Signalling peer 297e05fcf4ee40bd8de6f84215563628 to start an election
I20260709 13:22:17.345944 19630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23edf4f0e2d6432589cde181f8e8d234"
dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
 from {username='slave'} at 127.0.0.1:38180
I20260709 13:22:17.346490 19630 raft_consensus.cc:493] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.346846 19630 raft_consensus.cc:3060] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.352499 19630 raft_consensus.cc:515] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.354526 19630 leader_election.cc:290] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 2 election: Requested vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:17.355760 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23edf4f0e2d6432589cde181f8e8d234" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:17.355760 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23edf4f0e2d6432589cde181f8e8d234" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:17.356655 19707 raft_consensus.cc:3060] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.356751 19780 raft_consensus.cc:3055] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:17.357183 19780 raft_consensus.cc:740] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Running, Role: LEADER
I20260709 13:22:17.358160 19780 consensus_queue.cc:260] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.359644 19780 raft_consensus.cc:3060] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.364871 19707 raft_consensus.cc:2468] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 2.
I20260709 13:22:17.366536 19596 leader_election.cc:304] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:17.367007 19780 raft_consensus.cc:2468] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 2.
I20260709 13:22:17.367373 19850 raft_consensus.cc:2804] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:17.368007 19850 raft_consensus.cc:697] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [term 2 LEADER]: Becoming Leader. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Running, Role: LEADER
I20260709 13:22:17.369087 19850 consensus_queue.cc:237] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.377292 19527 catalog_manager.cc:5697] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 reported cstate change: term changed from 1 to 2, leader changed from 357f6c97621e45a198ce354fe0bd763f (127.6.214.131) to 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "297e05fcf4ee40bd8de6f84215563628" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:17.473074 19850 consensus_queue.cc:1048] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:17.480458 19856 raft_consensus.cc:993] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628: : Instructing follower 22c9846c7aa64d079557e69432deaa08 to start an election
I20260709 13:22:17.481001 19849 raft_consensus.cc:1081] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Signalling peer 22c9846c7aa64d079557e69432deaa08 to start an election
I20260709 13:22:17.483122 19706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae1d5c2b0d784308b194995f71686278"
dest_uuid: "22c9846c7aa64d079557e69432deaa08"
 from {username='slave'} at 127.0.0.1:34762
I20260709 13:22:17.484905 19706 raft_consensus.cc:493] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.485368 19706 raft_consensus.cc:3060] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.486303 19850 consensus_queue.cc:1048] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:17.494386 19706 raft_consensus.cc:515] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.498243 19706 leader_election.cc:290] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 2 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:17.498481 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1d5c2b0d784308b194995f71686278" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:17.498831 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1d5c2b0d784308b194995f71686278" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:17.499186 19630 raft_consensus.cc:3055] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:17.499432 19780 raft_consensus.cc:3060] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.499586 19630 raft_consensus.cc:740] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Running, Role: LEADER
I20260709 13:22:17.500473 19630 consensus_queue.cc:260] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.501748 19630 raft_consensus.cc:3060] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.505781 19861 consensus_queue.cc:1048] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:17.508194 19780 raft_consensus.cc:2468] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 2.
I20260709 13:22:17.509611 19630 raft_consensus.cc:2468] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 2.
I20260709 13:22:17.509670 19672 leader_election.cc:304] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:17.510694 19861 raft_consensus.cc:2804] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:17.511258 19861 raft_consensus.cc:697] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [term 2 LEADER]: Becoming Leader. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:17.512220 19861 consensus_queue.cc:237] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.520228 19825 raft_consensus.cc:993] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08: : Instructing follower 357f6c97621e45a198ce354fe0bd763f to start an election
I20260709 13:22:17.520757 19825 raft_consensus.cc:1081] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Signalling peer 357f6c97621e45a198ce354fe0bd763f to start an election
I20260709 13:22:17.523201 19780 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbb443f6e8544fdea5f5895598ddd879"
dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
 from {username='slave'} at 127.0.0.1:40956
I20260709 13:22:17.523254 19527 catalog_manager.cc:5697] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 reported cstate change: term changed from 1 to 2, leader changed from 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129) to 22c9846c7aa64d079557e69432deaa08 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "22c9846c7aa64d079557e69432deaa08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:17.524714 19780 raft_consensus.cc:493] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.525617 19780 raft_consensus.cc:3060] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.532068 19861 consensus_queue.cc:1048] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:17.532743 19780 raft_consensus.cc:515] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.535032 19780 leader_election.cc:290] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 2 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:17.536717 19632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb443f6e8544fdea5f5895598ddd879" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:17.536832 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb443f6e8544fdea5f5895598ddd879" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:17.537772 19706 raft_consensus.cc:3055] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:17.538251 19706 raft_consensus.cc:740] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:17.539304 19706 consensus_queue.cc:260] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.541115 19706 raft_consensus.cc:3060] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.549085 19706 raft_consensus.cc:2468] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 2.
I20260709 13:22:17.550280 19745 leader_election.cc:304] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:17.551388 19859 raft_consensus.cc:2804] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:17.551939 19859 raft_consensus.cc:697] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 2 LEADER]: Becoming Leader. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Running, Role: LEADER
I20260709 13:22:17.552870 19859 consensus_queue.cc:237] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.560742 19528 catalog_manager.cc:5697] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f reported cstate change: term changed from 1 to 2, leader changed from 22c9846c7aa64d079557e69432deaa08 (127.6.214.130) to 357f6c97621e45a198ce354fe0bd763f (127.6.214.131). New cstate: current_term: 2 leader_uuid: "357f6c97621e45a198ce354fe0bd763f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:17.601850 19825 raft_consensus.cc:993] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08: : Instructing follower 297e05fcf4ee40bd8de6f84215563628 to start an election
I20260709 13:22:17.602353 19825 raft_consensus.cc:1081] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Signalling peer 297e05fcf4ee40bd8de6f84215563628 to start an election
I20260709 13:22:17.605247 19780 raft_consensus.cc:1275] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Refusing update from remote peer 297e05fcf4ee40bd8de6f84215563628: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.605990 19630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ba8b98481394565bee73438c70e34e2"
dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
 from {username='slave'} at 127.0.0.1:38188
I20260709 13:22:17.606637 19630 raft_consensus.cc:493] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.607043 19630 raft_consensus.cc:3060] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.607113 19856 consensus_queue.cc:1048] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:17.615150 19630 raft_consensus.cc:515] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.618291 19706 raft_consensus.cc:1275] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Refusing update from remote peer 297e05fcf4ee40bd8de6f84215563628: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.619824 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8b98481394565bee73438c70e34e2" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:17.619905 19849 consensus_queue.cc:1048] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:17.620729 19707 raft_consensus.cc:3055] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:17.621110 19707 raft_consensus.cc:740] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:17.622265 19630 leader_election.cc:290] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 2 election: Requested vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:17.622066 19707 consensus_queue.cc:260] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.623240 19707 raft_consensus.cc:3060] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.626384 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba8b98481394565bee73438c70e34e2" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:17.627130 19780 raft_consensus.cc:3060] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.631738 19707 raft_consensus.cc:2468] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 2.
I20260709 13:22:17.633085 19596 leader_election.cc:304] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:17.634690 19849 raft_consensus.cc:2804] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:17.634908 19859 raft_consensus.cc:993] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f: : Instructing follower 22c9846c7aa64d079557e69432deaa08 to start an election
I20260709 13:22:17.635222 19849 raft_consensus.cc:697] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 2 LEADER]: Becoming Leader. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Running, Role: LEADER
I20260709 13:22:17.635509 19859 raft_consensus.cc:1081] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Signalling peer 22c9846c7aa64d079557e69432deaa08 to start an election
I20260709 13:22:17.636194 19780 raft_consensus.cc:2468] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 2.
I20260709 13:22:17.636255 19849 consensus_queue.cc:237] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.637331 19707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ac7a0da888e40d38a51fcbe7966e1d5"
dest_uuid: "22c9846c7aa64d079557e69432deaa08"
 from {username='slave'} at 127.0.0.1:34752
I20260709 13:22:17.637984 19707 raft_consensus.cc:493] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:17.638381 19707 raft_consensus.cc:3060] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.645530 19707 raft_consensus.cc:515] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.645867 19527 catalog_manager.cc:5697] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 reported cstate change: term changed from 1 to 2, leader changed from 22c9846c7aa64d079557e69432deaa08 (127.6.214.130) to 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "297e05fcf4ee40bd8de6f84215563628" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:17.648005 19707 leader_election.cc:290] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 2 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:17.648597 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac7a0da888e40d38a51fcbe7966e1d5" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:17.649236 19630 raft_consensus.cc:3060] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.649102 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ac7a0da888e40d38a51fcbe7966e1d5" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:17.650234 19780 raft_consensus.cc:3055] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:17.650542 19780 raft_consensus.cc:740] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Running, Role: LEADER
I20260709 13:22:17.651377 19780 consensus_queue.cc:260] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.652774 19780 raft_consensus.cc:3060] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:17.658581 19630 raft_consensus.cc:2468] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 2.
I20260709 13:22:17.660442 19671 leader_election.cc:304] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:17.661484 19861 raft_consensus.cc:2804] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:17.661988 19861 raft_consensus.cc:697] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [term 2 LEADER]: Becoming Leader. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:17.662489 19780 raft_consensus.cc:2468] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 2.
I20260709 13:22:17.663055 19861 consensus_queue.cc:237] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:17.669642 19527 catalog_manager.cc:5697] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 reported cstate change: term changed from 1 to 2, leader changed from 357f6c97621e45a198ce354fe0bd763f (127.6.214.131) to 22c9846c7aa64d079557e69432deaa08 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "22c9846c7aa64d079557e69432deaa08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:17.707026 19780 raft_consensus.cc:1275] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Refusing update from remote peer 22c9846c7aa64d079557e69432deaa08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.708467 19861 consensus_queue.cc:1048] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.718693 19630 raft_consensus.cc:1275] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Refusing update from remote peer 22c9846c7aa64d079557e69432deaa08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.721249 19870 consensus_queue.cc:1048] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.859652 19780 raft_consensus.cc:1275] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Refusing update from remote peer 297e05fcf4ee40bd8de6f84215563628: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.861188 19849 consensus_queue.cc:1048] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.870553 19707 raft_consensus.cc:1275] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Refusing update from remote peer 297e05fcf4ee40bd8de6f84215563628: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.873518 19849 consensus_queue.cc:1048] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.899040 19632 raft_consensus.cc:1275] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Refusing update from remote peer 22c9846c7aa64d079557e69432deaa08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.900475 19870 consensus_queue.cc:1048] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:17.908816 19780 raft_consensus.cc:1275] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Refusing update from remote peer 22c9846c7aa64d079557e69432deaa08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:17.910261 19870 consensus_queue.cc:1048] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.052762 19707 raft_consensus.cc:1275] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Refusing update from remote peer 357f6c97621e45a198ce354fe0bd763f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.054661 19830 consensus_queue.cc:1048] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:18.063190 19632 raft_consensus.cc:3060] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.072352 19632 raft_consensus.cc:1275] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Refusing update from remote peer 357f6c97621e45a198ce354fe0bd763f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.074043 19859 consensus_queue.cc:1048] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.098073 19707 raft_consensus.cc:1275] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Refusing update from remote peer 297e05fcf4ee40bd8de6f84215563628: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.099669 19849 consensus_queue.cc:1048] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.105027 19780 raft_consensus.cc:1275] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Refusing update from remote peer 22c9846c7aa64d079557e69432deaa08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.106714 19870 consensus_queue.cc:1048] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.115007 19780 raft_consensus.cc:1275] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Refusing update from remote peer 297e05fcf4ee40bd8de6f84215563628: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.116241 19632 raft_consensus.cc:1275] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Refusing update from remote peer 22c9846c7aa64d079557e69432deaa08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.116755 19849 consensus_queue.cc:1048] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.117887 19903 consensus_queue.cc:1048] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:20.275734 19528 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51084:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:20.278353 19528 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:20.335791 19621 tablet_service.cc:1511] Processing CreateTablet for tablet bf3beaabaae54ed4b222d46547c30edf (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:20.336803 19697 tablet_service.cc:1511] Processing CreateTablet for tablet bf3beaabaae54ed4b222d46547c30edf (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:20.337908 19621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf3beaabaae54ed4b222d46547c30edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.338608 19697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf3beaabaae54ed4b222d46547c30edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.338676 19767 tablet_service.cc:1511] Processing CreateTablet for tablet bf3beaabaae54ed4b222d46547c30edf (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:20.340304 19767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf3beaabaae54ed4b222d46547c30edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.348395 19620 tablet_service.cc:1511] Processing CreateTablet for tablet 04f605a8a45043499255c6272b178e32 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:20.350180 19620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f605a8a45043499255c6272b178e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.349777 19768 tablet_service.cc:1511] Processing CreateTablet for tablet 04f605a8a45043499255c6272b178e32 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:20.351333 19768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f605a8a45043499255c6272b178e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.358021 19693 tablet_service.cc:1511] Processing CreateTablet for tablet 04f605a8a45043499255c6272b178e32 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:20.358842 19619 tablet_service.cc:1511] Processing CreateTablet for tablet 57b30a25c1cd45e38d5fdd746bf35624 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:20.359830 19693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f605a8a45043499255c6272b178e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.360564 19619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b30a25c1cd45e38d5fdd746bf35624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.362680 19695 tablet_service.cc:1511] Processing CreateTablet for tablet 57b30a25c1cd45e38d5fdd746bf35624 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:20.362792 19696 tablet_service.cc:1511] Processing CreateTablet for tablet e93ae81773754db79876bd5bc2f47005 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:20.364210 19695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b30a25c1cd45e38d5fdd746bf35624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.364967 19696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93ae81773754db79876bd5bc2f47005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.366783 19771 tablet_service.cc:1511] Processing CreateTablet for tablet 57b30a25c1cd45e38d5fdd746bf35624 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:20.368343 19771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b30a25c1cd45e38d5fdd746bf35624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.368106 19765 tablet_service.cc:1511] Processing CreateTablet for tablet e93ae81773754db79876bd5bc2f47005 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:20.366823 19622 tablet_service.cc:1511] Processing CreateTablet for tablet e93ae81773754db79876bd5bc2f47005 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:20.371039 19622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93ae81773754db79876bd5bc2f47005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.373090 19694 tablet_service.cc:1511] Processing CreateTablet for tablet b73e4fbe954d47fc9927075051fc91a7 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:20.374502 19694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b73e4fbe954d47fc9927075051fc91a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.373116 19770 tablet_service.cc:1511] Processing CreateTablet for tablet b73e4fbe954d47fc9927075051fc91a7 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:20.379000 19770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b73e4fbe954d47fc9927075051fc91a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.381924 19765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93ae81773754db79876bd5bc2f47005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.383380 19769 tablet_service.cc:1511] Processing CreateTablet for tablet e552ce780972455abff2c78f22b4bed8 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:20.384797 19769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e552ce780972455abff2c78f22b4bed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.383474 19618 tablet_service.cc:1511] Processing CreateTablet for tablet b73e4fbe954d47fc9927075051fc91a7 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:20.386940 19618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b73e4fbe954d47fc9927075051fc91a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.388710 19766 tablet_service.cc:1511] Processing CreateTablet for tablet 677e1413101d4ff191d9949d890444fa (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:20.390344 19766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 677e1413101d4ff191d9949d890444fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.390058 19617 tablet_service.cc:1511] Processing CreateTablet for tablet e552ce780972455abff2c78f22b4bed8 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:20.391448 19617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e552ce780972455abff2c78f22b4bed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.395116 19616 tablet_service.cc:1511] Processing CreateTablet for tablet 677e1413101d4ff191d9949d890444fa (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:20.396608 19616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 677e1413101d4ff191d9949d890444fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.398252 19764 tablet_service.cc:1511] Processing CreateTablet for tablet daae52fadc9f4edc8731dc294c1ba8e1 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:20.399114 19692 tablet_service.cc:1511] Processing CreateTablet for tablet e552ce780972455abff2c78f22b4bed8 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:20.400216 19764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daae52fadc9f4edc8731dc294c1ba8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.400494 19692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e552ce780972455abff2c78f22b4bed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.407671 19763 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca62d9d27f446e8aeb8850951385e0c (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:20.409298 19763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca62d9d27f446e8aeb8850951385e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.411325 19691 tablet_service.cc:1511] Processing CreateTablet for tablet 677e1413101d4ff191d9949d890444fa (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:20.413014 19691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 677e1413101d4ff191d9949d890444fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.427155 19690 tablet_service.cc:1511] Processing CreateTablet for tablet daae52fadc9f4edc8731dc294c1ba8e1 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:20.431766 19689 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca62d9d27f446e8aeb8850951385e0c (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:20.429297 19690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daae52fadc9f4edc8731dc294c1ba8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.434922 19689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca62d9d27f446e8aeb8850951385e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.447238 19615 tablet_service.cc:1511] Processing CreateTablet for tablet daae52fadc9f4edc8731dc294c1ba8e1 (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:20.448896 19615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daae52fadc9f4edc8731dc294c1ba8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:20.454329 19614 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca62d9d27f446e8aeb8850951385e0c (DEFAULT_TABLE table=soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:20.455984 19614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca62d9d27f446e8aeb8850951385e0c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:20.492192 19578 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:20.582571 19918 tablet_bootstrap.cc:492] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:20.608768 19919 tablet_bootstrap.cc:492] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:20.624056 19919 tablet_bootstrap.cc:654] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.636121 19920 tablet_bootstrap.cc:492] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:20.640617 19918 tablet_bootstrap.cc:654] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.647114 19920 tablet_bootstrap.cc:654] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.658254 19919 tablet_bootstrap.cc:492] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:20.659049 19919 ts_tablet_manager.cc:1403] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.004s
I20260709 13:22:20.661835 19920 tablet_bootstrap.cc:492] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:20.662535 19920 ts_tablet_manager.cc:1403] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.012s
I20260709 13:22:20.663060 19919 raft_consensus.cc:359] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.664148 19919 raft_consensus.cc:385] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.664526 19919 raft_consensus.cc:740] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.665392 19919 consensus_queue.cc:260] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.666174 19920 raft_consensus.cc:359] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.666771 19918 tablet_bootstrap.cc:492] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:20.667464 19920 raft_consensus.cc:385] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.667886 19918 ts_tablet_manager.cc:1403] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.086s	user 0.027s	sys 0.031s
I20260709 13:22:20.668473 19919 ts_tablet_manager.cc:1434] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:22:20.667984 19920 raft_consensus.cc:740] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.670167 19920 consensus_queue.cc:260] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.671209 19918 raft_consensus.cc:359] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.672106 19918 raft_consensus.cc:385] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.672487 19918 raft_consensus.cc:740] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.672946 19920 ts_tablet_manager.cc:1434] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:22:20.673314 19918 consensus_queue.cc:260] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.674279 19920 tablet_bootstrap.cc:492] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:20.678869 19918 ts_tablet_manager.cc:1434] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:22:20.680095 19918 tablet_bootstrap.cc:492] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:20.683280 19920 tablet_bootstrap.cc:654] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:20.687557 19658 tablet.cc:2406] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:22:20.688241 19919 tablet_bootstrap.cc:492] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:20.688406 19918 tablet_bootstrap.cc:654] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.704345 19920 tablet_bootstrap.cc:492] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:20.704689 19919 tablet_bootstrap.cc:654] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.705081 19920 ts_tablet_manager.cc:1403] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.007s
I20260709 13:22:20.704411 19918 tablet_bootstrap.cc:492] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:20.705745 19918 ts_tablet_manager.cc:1403] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.010s
I20260709 13:22:20.708791 19920 raft_consensus.cc:359] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.708964 19918 raft_consensus.cc:359] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.709506 19920 raft_consensus.cc:385] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.709841 19918 raft_consensus.cc:385] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.709895 19920 raft_consensus.cc:740] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.710157 19918 raft_consensus.cc:740] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.711207 19919 tablet_bootstrap.cc:492] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:20.710821 19920 consensus_queue.cc:260] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.710981 19918 consensus_queue.cc:260] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.711740 19919 ts_tablet_manager.cc:1403] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 13:22:20.713371 19920 ts_tablet_manager.cc:1434] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.004s
I20260709 13:22:20.713660 19918 ts_tablet_manager.cc:1434] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:20.714838 19918 tablet_bootstrap.cc:492] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:20.714944 19920 tablet_bootstrap.cc:492] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:20.715118 19919 raft_consensus.cc:359] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.716123 19919 raft_consensus.cc:385] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.716490 19919 raft_consensus.cc:740] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.717481 19919 consensus_queue.cc:260] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.722420 19918 tablet_bootstrap.cc:654] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.723845 19920 tablet_bootstrap.cc:654] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.728633 19919 ts_tablet_manager.cc:1434] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:22:20.740612 19919 tablet_bootstrap.cc:492] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:20.749795 19919 tablet_bootstrap.cc:654] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.762351 19920 tablet_bootstrap.cc:492] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:20.764899 19920 ts_tablet_manager.cc:1403] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.050s	user 0.028s	sys 0.001s
I20260709 13:22:20.771039 19918 tablet_bootstrap.cc:492] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:20.771808 19918 ts_tablet_manager.cc:1403] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.038s
I20260709 13:22:20.771143 19920 raft_consensus.cc:359] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.775584 19918 raft_consensus.cc:359] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.776111 19920 raft_consensus.cc:385] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.776583 19918 raft_consensus.cc:385] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.776618 19920 raft_consensus.cc:740] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.777146 19918 raft_consensus.cc:740] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.777705 19920 consensus_queue.cc:260] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.778046 19918 consensus_queue.cc:260] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.780262 19920 ts_tablet_manager.cc:1434] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 13:22:20.781268 19920 tablet_bootstrap.cc:492] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:20.785372 19919 tablet_bootstrap.cc:492] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:20.788055 19918 ts_tablet_manager.cc:1434] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:22:20.788829 19920 tablet_bootstrap.cc:654] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.788347 19919 ts_tablet_manager.cc:1403] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.005s
I20260709 13:22:20.793211 19918 tablet_bootstrap.cc:492] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:20.793686 19919 raft_consensus.cc:359] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.794520 19919 raft_consensus.cc:385] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.794816 19919 raft_consensus.cc:740] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.795719 19919 consensus_queue.cc:260] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.804982 19918 tablet_bootstrap.cc:654] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.807185 19919 ts_tablet_manager.cc:1434] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:22:20.808449 19919 tablet_bootstrap.cc:492] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:20.808753 19920 tablet_bootstrap.cc:492] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:20.809387 19920 ts_tablet_manager.cc:1403] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.008s
I20260709 13:22:20.813504 19920 raft_consensus.cc:359] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.814631 19920 raft_consensus.cc:385] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.815090 19920 raft_consensus.cc:740] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.815635 19919 tablet_bootstrap.cc:654] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.816120 19920 consensus_queue.cc:260] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.818305 19932 raft_consensus.cc:493] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.818926 19932 raft_consensus.cc:515] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.821842 19932 leader_election.cc:290] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:20.822501 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93ae81773754db79876bd5bc2f47005" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
W20260709 13:22:20.824222 19596 leader_election.cc:343] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.824074 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93ae81773754db79876bd5bc2f47005" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
W20260709 13:22:20.826297 19597 leader_election.cc:343] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.826931 19597 leader_election.cc:304] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628; no voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f
I20260709 13:22:20.828598 19920 ts_tablet_manager.cc:1434] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:22:20.829109 19932 raft_consensus.cc:2749] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:20.831835 19919 tablet_bootstrap.cc:492] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:20.832185 19920 tablet_bootstrap.cc:492] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:20.832895 19919 ts_tablet_manager.cc:1403] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.001s
I20260709 13:22:20.834333 19918 tablet_bootstrap.cc:492] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:20.834895 19918 ts_tablet_manager.cc:1403] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.013s
I20260709 13:22:20.836578 19919 raft_consensus.cc:359] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.837471 19919 raft_consensus.cc:385] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.837776 19919 raft_consensus.cc:740] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.837896 19918 raft_consensus.cc:359] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.838644 19918 raft_consensus.cc:385] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.839077 19918 raft_consensus.cc:740] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.838598 19919 consensus_queue.cc:260] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.839771 19918 consensus_queue.cc:260] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.840237 19920 tablet_bootstrap.cc:654] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.841169 19919 ts_tablet_manager.cc:1434] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.003s
I20260709 13:22:20.843819 19919 tablet_bootstrap.cc:492] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:20.849391 19918 ts_tablet_manager.cc:1434] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:22:20.850605 19918 tablet_bootstrap.cc:492] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:20.852072 19920 tablet_bootstrap.cc:492] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:20.852838 19920 ts_tablet_manager.cc:1403] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:22:20.856129 19920 raft_consensus.cc:359] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.857193 19920 raft_consensus.cc:385] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.857285 19918 tablet_bootstrap.cc:654] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.857609 19920 raft_consensus.cc:740] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.858640 19920 consensus_queue.cc:260] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.861243 19920 ts_tablet_manager.cc:1434] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:20.862661 19920 tablet_bootstrap.cc:492] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:20.863517 19919 tablet_bootstrap.cc:654] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.870931 19920 tablet_bootstrap.cc:654] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.872099 19918 tablet_bootstrap.cc:492] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:20.872713 19918 ts_tablet_manager.cc:1403] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.011s
I20260709 13:22:20.876425 19918 raft_consensus.cc:359] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.877239 19919 tablet_bootstrap.cc:492] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:20.877259 19918 raft_consensus.cc:385] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.877864 19920 tablet_bootstrap.cc:492] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:20.878069 19918 raft_consensus.cc:740] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.878293 19919 ts_tablet_manager.cc:1403] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.000s
I20260709 13:22:20.878754 19920 ts_tablet_manager.cc:1403] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:22:20.879057 19918 consensus_queue.cc:260] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.881088 19918 ts_tablet_manager.cc:1434] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:22:20.882313 19919 raft_consensus.cc:359] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.884387 19919 raft_consensus.cc:385] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.884454 19918 tablet_bootstrap.cc:492] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:20.884800 19919 raft_consensus.cc:740] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.885874 19919 consensus_queue.cc:260] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.887735 19920 raft_consensus.cc:359] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.888347 19919 ts_tablet_manager.cc:1434] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:22:20.888593 19920 raft_consensus.cc:385] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.888957 19920 raft_consensus.cc:740] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.889786 19920 consensus_queue.cc:260] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.893136 19920 ts_tablet_manager.cc:1434] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:22:20.893159 19918 tablet_bootstrap.cc:654] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.896965 19919 tablet_bootstrap.cc:492] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:20.899441 19920 tablet_bootstrap.cc:492] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:20.901140 19859 raft_consensus.cc:493] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.901762 19859 raft_consensus.cc:515] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.904179 19859 leader_election.cc:290] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:20.906360 19632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93ae81773754db79876bd5bc2f47005" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:20.907274 19861 raft_consensus.cc:493] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.908356 19918 tablet_bootstrap.cc:492] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:20.909044 19919 tablet_bootstrap.cc:654] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.914451 19861 raft_consensus.cc:515] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.915024 19918 ts_tablet_manager.cc:1403] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 13:22:20.916756 19861 leader_election.cc:290] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:20.917326 19918 raft_consensus.cc:359] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.918258 19918 raft_consensus.cc:385] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.918578 19918 raft_consensus.cc:740] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.919198 19920 tablet_bootstrap.cc:654] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.919443 19918 consensus_queue.cc:260] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.920717 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daae52fadc9f4edc8731dc294c1ba8e1" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:20.921679 19781 raft_consensus.cc:2468] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 0.
I20260709 13:22:20.928422 19672 leader_election.cc:304] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:20.928906 19919 tablet_bootstrap.cc:492] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:20.929581 19919 ts_tablet_manager.cc:1403] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.008s
I20260709 13:22:20.930616 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daae52fadc9f4edc8731dc294c1ba8e1" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
W20260709 13:22:20.932315 19671 leader_election.cc:343] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.933044 19919 raft_consensus.cc:359] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.934727 19861 raft_consensus.cc:2804] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:20.935300 19919 raft_consensus.cc:385] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.935374 19861 raft_consensus.cc:493] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:20.935740 19919 raft_consensus.cc:740] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.936015 19861 raft_consensus.cc:3060] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.912281 19859 raft_consensus.cc:493] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.906662 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93ae81773754db79876bd5bc2f47005" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:20.936857 19919 consensus_queue.cc:260] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
W20260709 13:22:20.938619 19745 leader_election.cc:343] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.939465 19920 tablet_bootstrap.cc:492] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:20.940111 19920 ts_tablet_manager.cc:1403] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.046s	user 0.002s	sys 0.023s
I20260709 13:22:20.940508 19859 raft_consensus.cc:515] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.944768 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca62d9d27f446e8aeb8850951385e0c" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:20.945724 19630 raft_consensus.cc:2468] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 0.
I20260709 13:22:20.957265 19632 raft_consensus.cc:2468] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 0.
I20260709 13:22:20.962054 19920 raft_consensus.cc:359] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.963299 19920 raft_consensus.cc:385] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:20.947546 19745 leader_election.cc:304] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:20.963660 19920 raft_consensus.cc:740] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:20.964565 19920 consensus_queue.cc:260] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.962477 19919 ts_tablet_manager.cc:1434] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.007s
I20260709 13:22:20.966562 19944 raft_consensus.cc:493] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:20.967265 19919 tablet_bootstrap.cc:492] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:20.967226 19944 raft_consensus.cc:515] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:20.970335 19944 leader_election.cc:290] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:20.974850 19919 tablet_bootstrap.cc:654] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:20.976547 19632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73e4fbe954d47fc9927075051fc91a7" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:20.977303 19632 raft_consensus.cc:2468] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 0.
I20260709 13:22:20.978672 19671 leader_election.cc:304] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:20.982110 19920 ts_tablet_manager.cc:1434] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 13:22:20.981868 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73e4fbe954d47fc9927075051fc91a7" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:20.983723 19920 tablet_bootstrap.cc:492] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
W20260709 13:22:20.985854 19672 leader_election.cc:343] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:20.991483 19948 raft_consensus.cc:2804] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:20.993470 19948 raft_consensus.cc:493] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:20.995162 19948 raft_consensus.cc:3060] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:20.967206 19859 leader_election.cc:290] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:21.002290 19859 raft_consensus.cc:2804] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:21.005661 19859 raft_consensus.cc:493] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.006333 19859 raft_consensus.cc:3060] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.009653 19918 ts_tablet_manager.cc:1434] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.094s	user 0.028s	sys 0.066s
I20260709 13:22:21.010941 19918 tablet_bootstrap.cc:492] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
W20260709 13:22:21.011659 19745 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.214.129:37257, user_credentials={real_user=slave}} blocked reactor thread for 64264us
I20260709 13:22:21.013264 19920 tablet_bootstrap.cc:654] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.013652 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca62d9d27f446e8aeb8850951385e0c" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:21.014427 19706 raft_consensus.cc:2468] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 0.
I20260709 13:22:21.018083 19918 tablet_bootstrap.cc:654] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.032001 19946 raft_consensus.cc:493] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.032758 19946 raft_consensus.cc:515] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.034936 19942 raft_consensus.cc:493] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.035008 19745 leader_election.cc:304] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628, 357f6c97621e45a198ce354fe0bd763f; no voters: 22c9846c7aa64d079557e69432deaa08
I20260709 13:22:21.017257 19932 raft_consensus.cc:493] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.035682 19942 raft_consensus.cc:515] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.037694 19944 raft_consensus.cc:493] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.039367 19951 raft_consensus.cc:2804] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:21.039880 19951 raft_consensus.cc:493] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.040213 19951 raft_consensus.cc:3060] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.040907 19632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3beaabaae54ed4b222d46547c30edf" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:21.041889 19944 raft_consensus.cc:515] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.043237 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3beaabaae54ed4b222d46547c30edf" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:21.043653 19942 leader_election.cc:290] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:21.043967 19706 raft_consensus.cc:2468] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 0.
I20260709 13:22:21.045248 19932 raft_consensus.cc:515] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.045965 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b30a25c1cd45e38d5fdd746bf35624" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:21.046778 19632 raft_consensus.cc:2468] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 0.
W20260709 13:22:21.047593 19672 leader_election.cc:343] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:21.044113 19944 leader_election.cc:290] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.050367 19745 leader_election.cc:304] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:21.050702 19631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e552ce780972455abff2c78f22b4bed8" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:21.014654 19861 raft_consensus.cc:515] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.051498 19631 raft_consensus.cc:2468] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 0.
I20260709 13:22:21.051549 19948 raft_consensus.cc:515] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.052747 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e552ce780972455abff2c78f22b4bed8" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:21.048987 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b30a25c1cd45e38d5fdd746bf35624" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:21.053304 19861 leader_election.cc:290] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.054286 19942 raft_consensus.cc:2804] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:21.053854 19630 raft_consensus.cc:2468] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 0.
I20260709 13:22:21.054678 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daae52fadc9f4edc8731dc294c1ba8e1" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:21.055001 19631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daae52fadc9f4edc8731dc294c1ba8e1" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:21.055366 19780 raft_consensus.cc:3060] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.054721 19942 raft_consensus.cc:493] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.056068 19942 raft_consensus.cc:3060] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.061882 19671 leader_election.cc:304] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 357f6c97621e45a198ce354fe0bd763f
W20260709 13:22:21.063689 19671 leader_election.cc:343] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:21.065780 19745 leader_election.cc:343] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:21.066598 19745 leader_election.cc:304] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628, 357f6c97621e45a198ce354fe0bd763f; no voters: 22c9846c7aa64d079557e69432deaa08
I20260709 13:22:21.067546 19942 raft_consensus.cc:515] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.069566 19861 raft_consensus.cc:2804] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:21.070737 19861 raft_consensus.cc:493] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.071215 19861 raft_consensus.cc:3060] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.072484 19942 leader_election.cc:290] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:21.035285 19946 leader_election.cc:290] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:21.075457 19859 raft_consensus.cc:515] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.078770 19859 leader_election.cc:290] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:21.079543 19942 raft_consensus.cc:2804] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:21.080298 19942 raft_consensus.cc:493] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.080477 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73e4fbe954d47fc9927075051fc91a7" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:21.084198 19631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73e4fbe954d47fc9927075051fc91a7" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:21.085175 19631 raft_consensus.cc:3060] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.088954 19948 leader_election.cc:290] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
W20260709 13:22:21.090781 19672 leader_election.cc:343] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:21.092348 19780 raft_consensus.cc:2468] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 1.
I20260709 13:22:21.095356 19932 leader_election.cc:290] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.095913 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3beaabaae54ed4b222d46547c30edf" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:21.097728 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3beaabaae54ed4b222d46547c30edf" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:21.097856 19706 raft_consensus.cc:2468] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 0.
I20260709 13:22:21.098637 19781 raft_consensus.cc:2393] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 297e05fcf4ee40bd8de6f84215563628 in current term 1: Already voted for candidate 357f6c97621e45a198ce354fe0bd763f in this term.
I20260709 13:22:21.099318 19596 leader_election.cc:304] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:21.080806 19942 raft_consensus.cc:3060] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.107275 19920 tablet_bootstrap.cc:492] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:21.108493 19920 ts_tablet_manager.cc:1403] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.125s	user 0.009s	sys 0.011s
I20260709 13:22:21.106474 19672 leader_election.cc:304] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:21.116060 19932 raft_consensus.cc:2804] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:21.119900 19932 raft_consensus.cc:493] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.120348 19932 raft_consensus.cc:3060] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.148587 19861 raft_consensus.cc:515] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.150359 19920 raft_consensus.cc:359] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.151392 19920 raft_consensus.cc:385] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.151506 19918 tablet_bootstrap.cc:492] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:21.151686 19920 raft_consensus.cc:740] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.152407 19918 ts_tablet_manager.cc:1403] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.142s	user 0.050s	sys 0.023s
I20260709 13:22:21.152634 19920 consensus_queue.cc:260] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.153330 19706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3beaabaae54ed4b222d46547c30edf" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:21.153986 19706 raft_consensus.cc:3060] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.154947 19920 ts_tablet_manager.cc:1434] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.046s	user 0.018s	sys 0.020s
I20260709 13:22:21.156076 19920 tablet_bootstrap.cc:492] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628: Bootstrap starting.
I20260709 13:22:21.156311 19918 raft_consensus.cc:359] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.157140 19918 raft_consensus.cc:385] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.153357 19632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3beaabaae54ed4b222d46547c30edf" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:21.157501 19918 raft_consensus.cc:740] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.158740 19918 consensus_queue.cc:260] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.160868 19918 ts_tablet_manager.cc:1434] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:21.161300 19944 raft_consensus.cc:493] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.162206 19918 tablet_bootstrap.cc:492] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:21.163291 19920 tablet_bootstrap.cc:654] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.162009 19944 raft_consensus.cc:515] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.162679 19948 raft_consensus.cc:2804] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:21.164350 19948 raft_consensus.cc:697] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Becoming Leader. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:21.165584 19706 raft_consensus.cc:2468] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 1.
I20260709 13:22:21.165726 19944 leader_election.cc:290] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.162933 19929 raft_consensus.cc:493] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.166559 19929 raft_consensus.cc:515] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.166985 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f605a8a45043499255c6272b178e32" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:21.167593 19780 raft_consensus.cc:2468] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 0.
I20260709 13:22:21.168743 19929 leader_election.cc:290] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.168865 19672 leader_election.cc:304] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:21.170440 19944 raft_consensus.cc:2804] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:21.170862 19944 raft_consensus.cc:493] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.171211 19944 raft_consensus.cc:3060] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.173089 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f605a8a45043499255c6272b178e32" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:21.173045 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f605a8a45043499255c6272b178e32" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:21.173997 19630 raft_consensus.cc:2468] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 0.
I20260709 13:22:21.174266 19780 raft_consensus.cc:2468] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 0.
I20260709 13:22:21.175370 19597 leader_election.cc:304] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:21.175596 19920 tablet_bootstrap.cc:492] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628: No bootstrap required, opened a new log
I20260709 13:22:21.176218 19920 ts_tablet_manager.cc:1403] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.001s
I20260709 13:22:21.177115 19929 raft_consensus.cc:2804] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:21.177606 19929 raft_consensus.cc:493] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.177989 19929 raft_consensus.cc:3060] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.178066 19705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f605a8a45043499255c6272b178e32" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:21.178833 19948 consensus_queue.cc:237] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.179730 19745 leader_election.cc:304] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:21.185509 19952 raft_consensus.cc:2804] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:21.186372 19952 raft_consensus.cc:697] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Becoming Leader. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Running, Role: LEADER
I20260709 13:22:21.187388 19952 consensus_queue.cc:237] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.189188 19918 tablet_bootstrap.cc:654] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.189530 19631 raft_consensus.cc:2468] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 1.
I20260709 13:22:21.190886 19671 leader_election.cc:304] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 357f6c97621e45a198ce354fe0bd763f
I20260709 13:22:21.191599 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca62d9d27f446e8aeb8850951385e0c" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:21.192498 19630 raft_consensus.cc:3060] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.151823 19919 tablet_bootstrap.cc:492] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:21.181985 19944 raft_consensus.cc:515] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.170334 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca62d9d27f446e8aeb8850951385e0c" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:21.195789 19707 raft_consensus.cc:3060] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.196678 19705 raft_consensus.cc:2393] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 297e05fcf4ee40bd8de6f84215563628 in current term 1: Already voted for candidate 22c9846c7aa64d079557e69432deaa08 in this term.
I20260709 13:22:21.199033 19944 leader_election.cc:290] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.192332 19945 raft_consensus.cc:2804] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:21.200450 19945 raft_consensus.cc:697] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Becoming Leader. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:21.201323 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f605a8a45043499255c6272b178e32" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:21.201327 19945 consensus_queue.cc:237] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.202154 19780 raft_consensus.cc:3060] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.202324 19629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f605a8a45043499255c6272b178e32" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:21.204330 19630 raft_consensus.cc:2468] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 1.
I20260709 13:22:21.205631 19745 leader_election.cc:304] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:21.206502 19859 raft_consensus.cc:2804] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:21.207122 19859 raft_consensus.cc:697] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Becoming Leader. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Running, Role: LEADER
I20260709 13:22:21.208009 19859 consensus_queue.cc:237] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.208750 19707 raft_consensus.cc:2468] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 1.
I20260709 13:22:21.181180 19920 raft_consensus.cc:359] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.211531 19920 raft_consensus.cc:385] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.209466 19919 ts_tablet_manager.cc:1403] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.243s	user 0.028s	sys 0.032s
I20260709 13:22:21.211881 19946 raft_consensus.cc:493] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.212481 19946 raft_consensus.cc:515] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.214340 19946 leader_election.cc:290] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:21.209764 19918 tablet_bootstrap.cc:492] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:21.215060 19918 ts_tablet_manager.cc:1403] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.003s
I20260709 13:22:21.217219 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b30a25c1cd45e38d5fdd746bf35624" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:21.218158 19707 raft_consensus.cc:2393] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 357f6c97621e45a198ce354fe0bd763f in current term 1: Already voted for candidate 22c9846c7aa64d079557e69432deaa08 in this term.
I20260709 13:22:21.219133 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b30a25c1cd45e38d5fdd746bf35624" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:21.227161 19630 raft_consensus.cc:2468] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 0.
I20260709 13:22:21.218346 19918 raft_consensus.cc:359] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.227855 19918 raft_consensus.cc:385] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.228242 19918 raft_consensus.cc:740] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.228998 19918 consensus_queue.cc:260] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.220033 19628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b30a25c1cd45e38d5fdd746bf35624" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:21.151851 19942 raft_consensus.cc:515] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.229760 19628 raft_consensus.cc:3060] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.219348 19951 raft_consensus.cc:515] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.232509 19951 leader_election.cc:290] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:21.230273 19919 raft_consensus.cc:359] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.221830 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b30a25c1cd45e38d5fdd746bf35624" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:21.233696 19919 raft_consensus.cc:385] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.234014 19781 raft_consensus.cc:3060] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.234869 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93ae81773754db79876bd5bc2f47005" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:21.235131 19932 raft_consensus.cc:515] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.236280 19632 raft_consensus.cc:2393] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 357f6c97621e45a198ce354fe0bd763f in current term 1: Already voted for candidate 297e05fcf4ee40bd8de6f84215563628 in this term.
I20260709 13:22:21.234088 19919 raft_consensus.cc:740] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.238336 19942 leader_election.cc:290] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:21.238448 19632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93ae81773754db79876bd5bc2f47005" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:21.237766 19918 ts_tablet_manager.cc:1434] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.002s
I20260709 13:22:21.238729 19919 consensus_queue.cc:260] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.211875 19920 raft_consensus.cc:740] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.233990 19745 leader_election.cc:304] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628, 357f6c97621e45a198ce354fe0bd763f; no voters: 22c9846c7aa64d079557e69432deaa08
I20260709 13:22:21.239858 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e552ce780972455abff2c78f22b4bed8" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:21.240535 19630 raft_consensus.cc:3060] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.240202 19920 consensus_queue.cc:260] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.239148 19632 raft_consensus.cc:3060] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.242551 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e552ce780972455abff2c78f22b4bed8" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:21.242786 19920 ts_tablet_manager.cc:1434] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.000s
I20260709 13:22:21.236588 19528 catalog_manager.cc:5697] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f reported cstate change: term changed from 0 to 1, leader changed from <none> to 357f6c97621e45a198ce354fe0bd763f (127.6.214.131). New cstate: current_term: 1 leader_uuid: "357f6c97621e45a198ce354fe0bd763f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:21.246102 19919 ts_tablet_manager.cc:1434] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:22:21.247175 19919 tablet_bootstrap.cc:492] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:21.249102 19707 raft_consensus.cc:3060] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.249603 19932 leader_election.cc:290] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 election: Requested vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.223029 19861 leader_election.cc:290] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.251127 19779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3beaabaae54ed4b222d46547c30edf" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:21.252591 19705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3beaabaae54ed4b222d46547c30edf" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:21.253475 19705 raft_consensus.cc:2393] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 297e05fcf4ee40bd8de6f84215563628 in current term 1: Already voted for candidate 357f6c97621e45a198ce354fe0bd763f in this term.
I20260709 13:22:21.254393 19628 raft_consensus.cc:2468] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 1.
I20260709 13:22:21.256793 19671 leader_election.cc:304] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:21.256999 19596 leader_election.cc:304] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628; no voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f
I20260709 13:22:21.256877 19632 raft_consensus.cc:2468] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 1.
I20260709 13:22:21.229703 19780 raft_consensus.cc:2468] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 1.
I20260709 13:22:21.255079 19781 raft_consensus.cc:2468] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 1.
I20260709 13:22:21.222919 19929 raft_consensus.cc:515] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.260277 19861 raft_consensus.cc:2804] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:22:21.243451 19745 leader_election.cc:343] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:21.258179 19918 tablet_bootstrap.cc:492] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f: Bootstrap starting.
I20260709 13:22:21.260454 19672 leader_election.cc:304] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:21.257884 19919 tablet_bootstrap.cc:654] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.258838 19932 raft_consensus.cc:2749] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:21.268215 19630 raft_consensus.cc:2468] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 1.
I20260709 13:22:21.280652 19629 raft_consensus.cc:2393] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22c9846c7aa64d079557e69432deaa08 in current term 1: Already voted for candidate 297e05fcf4ee40bd8de6f84215563628 in this term.
I20260709 13:22:21.271976 19952 raft_consensus.cc:2764] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:22:21.283506 19929 leader_election.cc:290] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 election: Requested vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.289561 19945 raft_consensus.cc:2804] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:21.290328 19945 raft_consensus.cc:697] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Becoming Leader. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:21.291457 19745 leader_election.cc:304] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628, 357f6c97621e45a198ce354fe0bd763f; no voters: 22c9846c7aa64d079557e69432deaa08
I20260709 13:22:21.293504 19945 consensus_queue.cc:237] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.296496 19942 raft_consensus.cc:2804] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:21.296916 19745 leader_election.cc:304] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:21.284946 19861 raft_consensus.cc:697] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Becoming Leader. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:21.297091 19942 raft_consensus.cc:697] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Becoming Leader. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Running, Role: LEADER
I20260709 13:22:21.297535 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f605a8a45043499255c6272b178e32" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:21.294574 19707 raft_consensus.cc:2468] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 1.
I20260709 13:22:21.285470 19705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f605a8a45043499255c6272b178e32" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:21.298249 19942 consensus_queue.cc:237] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.298249 19861 consensus_queue.cc:237] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.298375 19781 raft_consensus.cc:2393] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 297e05fcf4ee40bd8de6f84215563628 in current term 1: Already voted for candidate 22c9846c7aa64d079557e69432deaa08 in this term.
I20260709 13:22:21.302510 19596 leader_election.cc:304] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628; no voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f
I20260709 13:22:21.303683 19929 raft_consensus.cc:2749] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:21.304749 19951 raft_consensus.cc:2804] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:21.305285 19951 raft_consensus.cc:697] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Becoming Leader. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Running, Role: LEADER
I20260709 13:22:21.305858 19918 tablet_bootstrap.cc:654] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.306262 19951 consensus_queue.cc:237] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.306205 19530 catalog_manager.cc:5697] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22c9846c7aa64d079557e69432deaa08 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "22c9846c7aa64d079557e69432deaa08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:21.319646 19919 tablet_bootstrap.cc:492] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:21.320591 19919 ts_tablet_manager.cc:1403] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.074s	user 0.005s	sys 0.009s
I20260709 13:22:21.325953 19918 tablet_bootstrap.cc:492] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f: No bootstrap required, opened a new log
I20260709 13:22:21.326602 19918 ts_tablet_manager.cc:1403] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.005s
I20260709 13:22:21.330657 19919 raft_consensus.cc:359] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.331540 19919 raft_consensus.cc:385] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.331897 19919 raft_consensus.cc:740] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.332749 19919 consensus_queue.cc:260] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.336473 19919 ts_tablet_manager.cc:1434] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.006s
I20260709 13:22:21.337586 19919 tablet_bootstrap.cc:492] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08: Bootstrap starting.
I20260709 13:22:21.336776 19918 raft_consensus.cc:359] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.338192 19918 raft_consensus.cc:385] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.339062 19918 raft_consensus.cc:740] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.339769 19918 consensus_queue.cc:260] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.342135 19918 ts_tablet_manager.cc:1434] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:22:21.344468 19919 tablet_bootstrap.cc:654] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.354687 19919 tablet_bootstrap.cc:492] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08: No bootstrap required, opened a new log
I20260709 13:22:21.355141 19919 ts_tablet_manager.cc:1403] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 13:22:21.357076 19919 raft_consensus.cc:359] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.356492 19530 catalog_manager.cc:5697] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f reported cstate change: term changed from 0 to 1, leader changed from <none> to 357f6c97621e45a198ce354fe0bd763f (127.6.214.131). New cstate: current_term: 1 leader_uuid: "357f6c97621e45a198ce354fe0bd763f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:21.357748 19919 raft_consensus.cc:385] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.358028 19919 raft_consensus.cc:740] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.358325 19530 catalog_manager.cc:5697] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f reported cstate change: term changed from 0 to 1, leader changed from <none> to 357f6c97621e45a198ce354fe0bd763f (127.6.214.131). New cstate: current_term: 1 leader_uuid: "357f6c97621e45a198ce354fe0bd763f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:21.358649 19919 consensus_queue.cc:260] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.360422 19919 ts_tablet_manager.cc:1434] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:22:21.359916 19530 catalog_manager.cc:5697] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f reported cstate change: term changed from 0 to 1, leader changed from <none> to 357f6c97621e45a198ce354fe0bd763f (127.6.214.131). New cstate: current_term: 1 leader_uuid: "357f6c97621e45a198ce354fe0bd763f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:21.370680 19528 catalog_manager.cc:5697] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22c9846c7aa64d079557e69432deaa08 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "22c9846c7aa64d079557e69432deaa08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:21.372507 19528 catalog_manager.cc:5697] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22c9846c7aa64d079557e69432deaa08 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "22c9846c7aa64d079557e69432deaa08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:21.373590 19528 catalog_manager.cc:5697] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22c9846c7aa64d079557e69432deaa08 (127.6.214.130). New cstate: current_term: 1 leader_uuid: "22c9846c7aa64d079557e69432deaa08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:21.389812 19951 raft_consensus.cc:493] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.390352 19951 raft_consensus.cc:515] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.392272 19951 leader_election.cc:290] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:21.392865 19629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73e4fbe954d47fc9927075051fc91a7" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:21.393383 19705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b73e4fbe954d47fc9927075051fc91a7" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:21.393749 19629 raft_consensus.cc:2393] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 357f6c97621e45a198ce354fe0bd763f in current term 1: Already voted for candidate 22c9846c7aa64d079557e69432deaa08 in this term.
I20260709 13:22:21.395030 19745 leader_election.cc:304] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 357f6c97621e45a198ce354fe0bd763f; no voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:21.395644 19951 raft_consensus.cc:3060] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.400898 19951 raft_consensus.cc:2749] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:21.434353 19945 raft_consensus.cc:493] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.435236 19945 raft_consensus.cc:515] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.437126 19945 leader_election.cc:290] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.437997 19629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93ae81773754db79876bd5bc2f47005" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "297e05fcf4ee40bd8de6f84215563628" is_pre_election: true
I20260709 13:22:21.438194 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93ae81773754db79876bd5bc2f47005" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:21.438913 19629 raft_consensus.cc:2393] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22c9846c7aa64d079557e69432deaa08 in current term 1: Already voted for candidate 357f6c97621e45a198ce354fe0bd763f in this term.
I20260709 13:22:21.440179 19671 leader_election.cc:304] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08; no voters: 297e05fcf4ee40bd8de6f84215563628, 357f6c97621e45a198ce354fe0bd763f
I20260709 13:22:21.441110 19945 raft_consensus.cc:3060] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.446666 19945 raft_consensus.cc:2749] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:21.456382 19932 raft_consensus.cc:493] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.457239 19932 raft_consensus.cc:515] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.459148 19932 leader_election.cc:290] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.460088 19705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daae52fadc9f4edc8731dc294c1ba8e1" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:21.460227 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daae52fadc9f4edc8731dc294c1ba8e1" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:21.461076 19781 raft_consensus.cc:2393] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 297e05fcf4ee40bd8de6f84215563628 in current term 1: Already voted for candidate 22c9846c7aa64d079557e69432deaa08 in this term.
I20260709 13:22:21.462126 19597 leader_election.cc:304] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628; no voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f
I20260709 13:22:21.462839 19932 raft_consensus.cc:3060] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.468763 19932 raft_consensus.cc:2749] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:21.498809 19578 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:21.608978 19932 raft_consensus.cc:493] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:21.609656 19932 raft_consensus.cc:515] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.611640 19932 leader_election.cc:290] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.612406 19705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677e1413101d4ff191d9949d890444fa" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08" is_pre_election: true
I20260709 13:22:21.612675 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677e1413101d4ff191d9949d890444fa" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f" is_pre_election: true
I20260709 13:22:21.613219 19705 raft_consensus.cc:2468] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 0.
I20260709 13:22:21.613377 19781 raft_consensus.cc:2468] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 0.
I20260709 13:22:21.614462 19596 leader_election.cc:304] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:21.614394 19945 consensus_queue.cc:1048] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.615490 19932 raft_consensus.cc:2804] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:21.615883 19932 raft_consensus.cc:493] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:21.616179 19932 raft_consensus.cc:3060] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.623459 19932 raft_consensus.cc:515] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.624984 19951 consensus_queue.cc:1048] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.626062 19932 leader_election.cc:290] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 election: Requested vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.626719 19705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677e1413101d4ff191d9949d890444fa" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:21.627440 19705 raft_consensus.cc:3060] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.630534 19951 consensus_queue.cc:1048] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.632004 19948 consensus_queue.cc:1048] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.641265 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677e1413101d4ff191d9949d890444fa" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:21.642668 19781 raft_consensus.cc:3060] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.653244 19945 consensus_queue.cc:1048] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.655704 19942 consensus_queue.cc:1048] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.657352 19705 raft_consensus.cc:2468] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 1.
I20260709 13:22:21.712214 19596 leader_election.cc:304] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:21.713191 19932 raft_consensus.cc:2804] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:21.713706 19932 raft_consensus.cc:697] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Becoming Leader. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Running, Role: LEADER
I20260709 13:22:21.714515 19932 consensus_queue.cc:237] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.717449 19781 raft_consensus.cc:2468] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 1.
I20260709 13:22:21.723824 19945 consensus_queue.cc:1048] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.728744 19951 consensus_queue.cc:1048] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:21.760653 19530 catalog_manager.cc:5697] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 reported cstate change: term changed from 0 to 1, leader changed from <none> to 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129). New cstate: current_term: 1 leader_uuid: "297e05fcf4ee40bd8de6f84215563628" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:21.763352 19945 consensus_queue.cc:1048] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:21.776438 19944 consensus_queue.cc:1048] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:21.786077 19780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf3beaabaae54ed4b222d46547c30edf"
dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
mode: GRACEFUL
new_leader_uuid: "297e05fcf4ee40bd8de6f84215563628"
 from {username='slave'} at 127.0.0.1:40970
I20260709 13:22:21.786670 19780 raft_consensus.cc:606] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Received request to transfer leadership to TS 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:21.789646 19951 consensus_queue.cc:1048] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:21.794976 19707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04f605a8a45043499255c6272b178e32"
dest_uuid: "22c9846c7aa64d079557e69432deaa08"
mode: GRACEFUL
new_leader_uuid: "297e05fcf4ee40bd8de6f84215563628"
 from {username='slave'} at 127.0.0.1:34774
I20260709 13:22:21.795604 19707 raft_consensus.cc:606] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Received request to transfer leadership to TS 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:21.798807 19944 consensus_queue.cc:1048] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:21.803864 19707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57b30a25c1cd45e38d5fdd746bf35624"
dest_uuid: "22c9846c7aa64d079557e69432deaa08"
mode: GRACEFUL
new_leader_uuid: "297e05fcf4ee40bd8de6f84215563628"
 from {username='slave'} at 127.0.0.1:34774
I20260709 13:22:21.804512 19707 raft_consensus.cc:606] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Received request to transfer leadership to TS 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:21.815518 19780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e93ae81773754db79876bd5bc2f47005"
dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
mode: GRACEFUL
new_leader_uuid: "297e05fcf4ee40bd8de6f84215563628"
 from {username='slave'} at 127.0.0.1:40970
I20260709 13:22:21.816219 19780 raft_consensus.cc:606] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Received request to transfer leadership to TS 297e05fcf4ee40bd8de6f84215563628
I20260709 13:22:21.831526 19945 consensus_queue.cc:1048] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:21.833230 19780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e552ce780972455abff2c78f22b4bed8"
dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
mode: GRACEFUL
new_leader_uuid: "22c9846c7aa64d079557e69432deaa08"
 from {username='slave'} at 127.0.0.1:40970
I20260709 13:22:21.834079 19780 raft_consensus.cc:606] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Received request to transfer leadership to TS 22c9846c7aa64d079557e69432deaa08
I20260709 13:22:21.839506 19859 consensus_queue.cc:1048] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:21.858273 19945 raft_consensus.cc:993] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08: : Instructing follower 297e05fcf4ee40bd8de6f84215563628 to start an election
I20260709 13:22:21.858851 19944 raft_consensus.cc:1081] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Signalling peer 297e05fcf4ee40bd8de6f84215563628 to start an election
I20260709 13:22:21.863788 19942 raft_consensus.cc:993] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f: : Instructing follower 297e05fcf4ee40bd8de6f84215563628 to start an election
I20260709 13:22:21.864279 19942 raft_consensus.cc:1081] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Signalling peer 297e05fcf4ee40bd8de6f84215563628 to start an election
I20260709 13:22:21.865223 19628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04f605a8a45043499255c6272b178e32"
dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
 from {username='slave'} at 127.0.0.1:38188
I20260709 13:22:21.865948 19628 raft_consensus.cc:493] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:21.866032 19632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e93ae81773754db79876bd5bc2f47005"
dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
 from {username='slave'} at 127.0.0.1:38180
I20260709 13:22:21.866436 19628 raft_consensus.cc:3060] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:21.866798 19632 raft_consensus.cc:493] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:21.867307 19632 raft_consensus.cc:3060] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:21.868196 19630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "677e1413101d4ff191d9949d890444fa"
dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
mode: GRACEFUL
new_leader_uuid: "22c9846c7aa64d079557e69432deaa08"
 from {username='slave'} at 127.0.0.1:38196
I20260709 13:22:21.868858 19630 raft_consensus.cc:606] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Received request to transfer leadership to TS 22c9846c7aa64d079557e69432deaa08
I20260709 13:22:21.875218 19628 raft_consensus.cc:515] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.875101 19632 raft_consensus.cc:515] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.878475 19705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93ae81773754db79876bd5bc2f47005" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:21.877931 19628 leader_election.cc:290] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 2 election: Requested vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.879274 19705 raft_consensus.cc:3060] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:21.880944 19942 consensus_queue.cc:1048] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:21.881594 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f605a8a45043499255c6272b178e32" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:21.882259 19781 raft_consensus.cc:3060] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:21.888898 19781 raft_consensus.cc:2468] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 2.
I20260709 13:22:21.888584 19705 raft_consensus.cc:2468] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 2.
I20260709 13:22:21.890117 19707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f605a8a45043499255c6272b178e32" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:21.890828 19707 raft_consensus.cc:3055] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:21.890866 19596 leader_election.cc:304] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:21.891271 19707 raft_consensus.cc:740] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:21.891925 19932 raft_consensus.cc:2804] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:21.892433 19932 raft_consensus.cc:697] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 2 LEADER]: Becoming Leader. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Running, Role: LEADER
I20260709 13:22:21.892194 19707 consensus_queue.cc:260] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.893544 19707 raft_consensus.cc:3060] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:21.893287 19932 consensus_queue.cc:237] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.898614 19597 leader_election.cc:304] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:21.898406 19632 leader_election.cc:290] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 2 election: Requested vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.902359 19952 consensus_queue.cc:1048] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:21.903446 19990 raft_consensus.cc:2804] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:21.903939 19990 raft_consensus.cc:697] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 2 LEADER]: Becoming Leader. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Running, Role: LEADER
I20260709 13:22:21.904801 19990 consensus_queue.cc:237] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.902094 19707 raft_consensus.cc:2468] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 2.
I20260709 13:22:21.909473 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e93ae81773754db79876bd5bc2f47005" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:21.910264 19781 raft_consensus.cc:3055] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:21.910686 19781 raft_consensus.cc:740] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Running, Role: LEADER
I20260709 13:22:21.912185 19781 consensus_queue.cc:260] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.913570 19781 raft_consensus.cc:3060] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:21.917202 19952 raft_consensus.cc:993] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f: : Instructing follower 22c9846c7aa64d079557e69432deaa08 to start an election
I20260709 13:22:21.917923 19942 raft_consensus.cc:1081] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Signalling peer 22c9846c7aa64d079557e69432deaa08 to start an election
I20260709 13:22:21.919703 19705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e552ce780972455abff2c78f22b4bed8"
dest_uuid: "22c9846c7aa64d079557e69432deaa08"
 from {username='slave'} at 127.0.0.1:34752
I20260709 13:22:21.920397 19705 raft_consensus.cc:493] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:21.920884 19705 raft_consensus.cc:3060] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:21.922065 19781 raft_consensus.cc:2468] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 2.
I20260709 13:22:21.925344 19528 catalog_manager.cc:5697] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 reported cstate change: term changed from 1 to 2, leader changed from 357f6c97621e45a198ce354fe0bd763f (127.6.214.131) to 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "297e05fcf4ee40bd8de6f84215563628" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:21.926728 19528 catalog_manager.cc:5697] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 reported cstate change: term changed from 1 to 2, leader changed from 22c9846c7aa64d079557e69432deaa08 (127.6.214.130) to 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "297e05fcf4ee40bd8de6f84215563628" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:21.928205 19705 raft_consensus.cc:515] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.930753 19705 leader_election.cc:290] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 2 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:21.931469 19632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e552ce780972455abff2c78f22b4bed8" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:21.932060 19781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e552ce780972455abff2c78f22b4bed8" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:21.932158 19632 raft_consensus.cc:3060] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:21.933658 19781 raft_consensus.cc:3055] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:21.934052 19781 raft_consensus.cc:740] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Running, Role: LEADER
I20260709 13:22:21.934820 19781 consensus_queue.cc:260] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.935922 19781 raft_consensus.cc:3060] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:21.940172 19632 raft_consensus.cc:2468] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 2.
I20260709 13:22:21.941558 19671 leader_election.cc:304] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:21.942021 19781 raft_consensus.cc:2468] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 2.
I20260709 13:22:21.942320 19861 raft_consensus.cc:2804] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:21.942984 19861 raft_consensus.cc:697] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [term 2 LEADER]: Becoming Leader. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:21.943770 19861 consensus_queue.cc:237] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:21.952558 19530 catalog_manager.cc:5697] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 reported cstate change: term changed from 1 to 2, leader changed from 357f6c97621e45a198ce354fe0bd763f (127.6.214.131) to 22c9846c7aa64d079557e69432deaa08 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "22c9846c7aa64d079557e69432deaa08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.100831 19990 consensus_queue.cc:1048] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:22.108630 19932 raft_consensus.cc:993] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628: : Instructing follower 22c9846c7aa64d079557e69432deaa08 to start an election
I20260709 13:22:22.109124 19932 raft_consensus.cc:1081] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Signalling peer 22c9846c7aa64d079557e69432deaa08 to start an election
I20260709 13:22:22.111143 19705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "677e1413101d4ff191d9949d890444fa"
dest_uuid: "22c9846c7aa64d079557e69432deaa08"
 from {username='slave'} at 127.0.0.1:34762
I20260709 13:22:22.112390 19705 raft_consensus.cc:493] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:22.112823 19705 raft_consensus.cc:3060] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:22.113798 19990 consensus_queue.cc:1048] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:22.121979 19705 raft_consensus.cc:515] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:22.124312 19705 leader_election.cc:290] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 2 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:22.124845 19630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677e1413101d4ff191d9949d890444fa" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:22.125505 19630 raft_consensus.cc:3055] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:22.125839 19630 raft_consensus.cc:740] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Running, Role: LEADER
I20260709 13:22:22.125697 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677e1413101d4ff191d9949d890444fa" candidate_uuid: "22c9846c7aa64d079557e69432deaa08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:22.126379 19780 raft_consensus.cc:3060] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:22.126680 19630 consensus_queue.cc:260] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:22.127933 19630 raft_consensus.cc:3060] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:22.133378 19780 raft_consensus.cc:2468] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 2.
I20260709 13:22:22.134904 19630 raft_consensus.cc:2468] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c9846c7aa64d079557e69432deaa08 in term 2.
I20260709 13:22:22.136353 19672 leader_election.cc:304] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:22.137233 19861 raft_consensus.cc:2804] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:22.137701 19861 raft_consensus.cc:697] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [term 2 LEADER]: Becoming Leader. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:22.138451 19861 consensus_queue.cc:237] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:22.144838 19530 catalog_manager.cc:5697] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 reported cstate change: term changed from 1 to 2, leader changed from 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129) to 22c9846c7aa64d079557e69432deaa08 (127.6.214.130). New cstate: current_term: 2 leader_uuid: "22c9846c7aa64d079557e69432deaa08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.160732 19945 raft_consensus.cc:993] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08: : Instructing follower 297e05fcf4ee40bd8de6f84215563628 to start an election
I20260709 13:22:22.161254 19861 raft_consensus.cc:1081] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Signalling peer 297e05fcf4ee40bd8de6f84215563628 to start an election
I20260709 13:22:22.163029 19630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57b30a25c1cd45e38d5fdd746bf35624"
dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
 from {username='slave'} at 127.0.0.1:38188
I20260709 13:22:22.163576 19630 raft_consensus.cc:493] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:22.164036 19630 raft_consensus.cc:3060] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:22.169622 19630 raft_consensus.cc:515] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:22.171077 19630 leader_election.cc:290] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 2 election: Requested vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:22.172035 19705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b30a25c1cd45e38d5fdd746bf35624" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:22.172180 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b30a25c1cd45e38d5fdd746bf35624" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:22.172775 19705 raft_consensus.cc:3055] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:22.172984 19780 raft_consensus.cc:3060] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:22.173097 19705 raft_consensus.cc:740] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:22.174070 19705 consensus_queue.cc:260] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:22.175025 19705 raft_consensus.cc:3060] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:22.179268 19780 raft_consensus.cc:2468] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 2.
I20260709 13:22:22.180742 19597 leader_election.cc:304] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 297e05fcf4ee40bd8de6f84215563628, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:22.181643 19990 raft_consensus.cc:2804] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:22.182168 19990 raft_consensus.cc:697] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [term 2 LEADER]: Becoming Leader. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Running, Role: LEADER
I20260709 13:22:22.182972 19990 consensus_queue.cc:237] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:22.185770 19859 raft_consensus.cc:993] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f: : Instructing follower 297e05fcf4ee40bd8de6f84215563628 to start an election
I20260709 13:22:22.186363 19942 raft_consensus.cc:1081] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Signalling peer 297e05fcf4ee40bd8de6f84215563628 to start an election
I20260709 13:22:22.187695 19705 raft_consensus.cc:2468] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 2.
I20260709 13:22:22.188323 19630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf3beaabaae54ed4b222d46547c30edf"
dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
 from {username='slave'} at 127.0.0.1:38180
I20260709 13:22:22.188982 19630 raft_consensus.cc:493] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:22.189407 19630 raft_consensus.cc:3060] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:22.192188 19530 catalog_manager.cc:5697] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 reported cstate change: term changed from 1 to 2, leader changed from 22c9846c7aa64d079557e69432deaa08 (127.6.214.130) to 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "297e05fcf4ee40bd8de6f84215563628" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.197122 19630 raft_consensus.cc:515] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:22.199249 19630 leader_election.cc:290] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 2 election: Requested vote from peers 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333), 357f6c97621e45a198ce354fe0bd763f (127.6.214.131:44227)
I20260709 13:22:22.200138 19705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3beaabaae54ed4b222d46547c30edf" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:22.200845 19705 raft_consensus.cc:3060] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:22.200384 19780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3beaabaae54ed4b222d46547c30edf" candidate_uuid: "297e05fcf4ee40bd8de6f84215563628" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
I20260709 13:22:22.201778 19780 raft_consensus.cc:3055] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:22.202160 19780 raft_consensus.cc:740] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Running, Role: LEADER
I20260709 13:22:22.202970 19780 consensus_queue.cc:260] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:22.203939 19780 raft_consensus.cc:3060] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:22.206979 19705 raft_consensus.cc:2468] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 2.
I20260709 13:22:22.208281 19596 leader_election.cc:304] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 297e05fcf4ee40bd8de6f84215563628; no voters: 
I20260709 13:22:22.209192 19990 raft_consensus.cc:2804] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:22.209326 19780 raft_consensus.cc:2468] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 297e05fcf4ee40bd8de6f84215563628 in term 2.
I20260709 13:22:22.209896 19990 raft_consensus.cc:697] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 2 LEADER]: Becoming Leader. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Running, Role: LEADER
I20260709 13:22:22.210750 19990 consensus_queue.cc:237] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:22.219192 19530 catalog_manager.cc:5697] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 reported cstate change: term changed from 1 to 2, leader changed from 357f6c97621e45a198ce354fe0bd763f (127.6.214.131) to 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129). New cstate: current_term: 2 leader_uuid: "297e05fcf4ee40bd8de6f84215563628" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.343500 19705 raft_consensus.cc:1275] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Refusing update from remote peer 297e05fcf4ee40bd8de6f84215563628: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:22.345098 19990 consensus_queue.cc:1048] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:22.353655 19780 raft_consensus.cc:1275] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Refusing update from remote peer 297e05fcf4ee40bd8de6f84215563628: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:22.355409 19932 consensus_queue.cc:1048] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:22.374581 19780 raft_consensus.cc:1275] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Refusing update from remote peer 297e05fcf4ee40bd8de6f84215563628: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:22.376055 19932 consensus_queue.cc:1048] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:22.385358 19705 raft_consensus.cc:1275] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Refusing update from remote peer 297e05fcf4ee40bd8de6f84215563628: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:22.387029 19932 consensus_queue.cc:1048] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:22.462067 19630 raft_consensus.cc:1275] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Refusing update from remote peer 22c9846c7aa64d079557e69432deaa08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:22.463505 19945 consensus_queue.cc:1048] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:22.475509 19780 raft_consensus.cc:1275] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Refusing update from remote peer 22c9846c7aa64d079557e69432deaa08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:22.476800 19945 consensus_queue.cc:1048] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:22.552464 19630 raft_consensus.cc:1275] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Refusing update from remote peer 22c9846c7aa64d079557e69432deaa08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:22.553923 19780 raft_consensus.cc:1275] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Refusing update from remote peer 22c9846c7aa64d079557e69432deaa08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:22.553860 19945 consensus_queue.cc:1048] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:22.555425 19945 consensus_queue.cc:1048] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:22.615280 19705 raft_consensus.cc:1275] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Refusing update from remote peer 297e05fcf4ee40bd8de6f84215563628: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:22.616957 19990 consensus_queue.cc:1048] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:22.619305 19780 raft_consensus.cc:1275] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Refusing update from remote peer 297e05fcf4ee40bd8de6f84215563628: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:22.620579 19990 consensus_queue.cc:1048] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:22.663931 19705 raft_consensus.cc:1275] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Refusing update from remote peer 297e05fcf4ee40bd8de6f84215563628: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:22.665230 19990 consensus_queue.cc:1048] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:22.674925 19780 raft_consensus.cc:1275] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Refusing update from remote peer 297e05fcf4ee40bd8de6f84215563628: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:22.678012 19990 consensus_queue.cc:1048] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:24.881281 19530 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51084:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:22:24.902618 19530 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51084:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:22:24.927140  7002 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:22:25.066815 20018 log.cc:927] Time spent T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:22:25.124156 19706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b90dbf31b4c423c9822ef485b8b1987"
dest_uuid: "22c9846c7aa64d079557e69432deaa08"
mode: GRACEFUL
new_leader_uuid: "357f6c97621e45a198ce354fe0bd763f"
 from {username='slave'} at 127.0.0.1:36040
I20260709 13:22:25.125114 19706 raft_consensus.cc:606] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Received request to transfer leadership to TS 357f6c97621e45a198ce354fe0bd763f
I20260709 13:22:25.155392 20036 tablet.cc:1724] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.205314 20048 tablet.cc:1724] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.209813 20050 tablet.cc:1724] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:25.225943 20035 log.cc:927] Time spent T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 13:22:25.245947 20039 log.cc:927] Time spent T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:22:25.258836 19999 raft_consensus.cc:993] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08: : Instructing follower 357f6c97621e45a198ce354fe0bd763f to start an election
I20260709 13:22:25.259477 19999 raft_consensus.cc:1081] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Signalling peer 357f6c97621e45a198ce354fe0bd763f to start an election
I20260709 13:22:25.280865 19774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b90dbf31b4c423c9822ef485b8b1987"
dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
 from {username='slave'} at 127.0.0.1:40956
I20260709 13:22:25.281664 19774 raft_consensus.cc:493] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:25.282084 19774 raft_consensus.cc:3060] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:25.285701 19630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a98c8be586184e7d9265fa9a1b805f00"
dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
mode: GRACEFUL
new_leader_uuid: "357f6c97621e45a198ce354fe0bd763f"
 from {username='slave'} at 127.0.0.1:49106
I20260709 13:22:25.286607 19630 raft_consensus.cc:606] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Received request to transfer leadership to TS 357f6c97621e45a198ce354fe0bd763f
I20260709 13:22:25.315905 20055 tablet.cc:1724] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.340631 20057 tablet.cc:1724] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.348450 20029 raft_consensus.cc:993] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628: : Instructing follower 357f6c97621e45a198ce354fe0bd763f to start an election
I20260709 13:22:25.355016 20050 tablet.cc:1724] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.289774 20049 tablet.cc:1724] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.366962  7002 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:25.368005  7002 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:25.375849 20021 raft_consensus.cc:1081] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Signalling peer 357f6c97621e45a198ce354fe0bd763f to start an election
I20260709 13:22:25.375903 19774 raft_consensus.cc:515] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:25.402081 19778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a98c8be586184e7d9265fa9a1b805f00"
dest_uuid: "357f6c97621e45a198ce354fe0bd763f"
 from {username='slave'} at 127.0.0.1:40942
I20260709 13:22:25.404529 19778 raft_consensus.cc:493] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:25.405025 19778 raft_consensus.cc:3060] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:25.363829 20052 tablet.cc:1724] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.407707 20059 tablet.cc:1724] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:25.409894 20053 log.cc:927] Time spent T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628: Append to log took a long time: real 0.130s	user 0.003s	sys 0.000s
W20260709 13:22:25.434527 20054 log.cc:927] Time spent T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:22:25.448658 20051 log.cc:927] Time spent T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:22:25.452306 20048 tablet.cc:1724] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.463276 20063 tablet.cc:1724] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.445317 20036 tablet.cc:1724] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.475107 20052 tablet.cc:1724] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.475139 20059 tablet.cc:1724] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.482733 19628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90dbf31b4c423c9822ef485b8b1987" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:25.483405 19628 raft_consensus.cc:3060] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:25.483810 19774 leader_election.cc:290] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 2 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:25.484166 19703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b90dbf31b4c423c9822ef485b8b1987" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:25.484807 19703 raft_consensus.cc:3055] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:25.485092 19703 raft_consensus.cc:740] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22c9846c7aa64d079557e69432deaa08, State: Running, Role: LEADER
I20260709 13:22:25.486047 19703 consensus_queue.cc:260] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:25.426508 20055 tablet.cc:1724] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.487303 19703 raft_consensus.cc:3060] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:25.492461 20064 tablet.cc:1724] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.502205 19703 raft_consensus.cc:2468] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 2.
I20260709 13:22:25.504933 19745 leader_election.cc:304] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:25.505934 19942 raft_consensus.cc:2804] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:25.506429 19942 raft_consensus.cc:697] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [term 2 LEADER]: Becoming Leader. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Running, Role: LEADER
I20260709 13:22:25.507635 19942 consensus_queue.cc:237] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:25.510437 20052 tablet.cc:1724] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.475317 20050 tablet.cc:1724] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.520133 20049 tablet.cc:1724] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.522912 19778 raft_consensus.cc:515] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:25.523733 20067 tablet.cc:1724] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.482427 20063 tablet.cc:1724] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.528623 20068 tablet.cc:1724] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.552476 19528 catalog_manager.cc:5697] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f reported cstate change: term changed from 1 to 2, leader changed from 22c9846c7aa64d079557e69432deaa08 (127.6.214.130) to 357f6c97621e45a198ce354fe0bd763f (127.6.214.131). New cstate: current_term: 2 leader_uuid: "357f6c97621e45a198ce354fe0bd763f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:25.540395 20055 tablet.cc:1724] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.560127 20063 tablet.cc:1724] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.561813 20064 tablet.cc:1724] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.548309 19628 raft_consensus.cc:2468] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 2.
I20260709 13:22:25.530861 20057 tablet.cc:1724] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.575536 19703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98c8be586184e7d9265fa9a1b805f00" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22c9846c7aa64d079557e69432deaa08"
I20260709 13:22:25.586194 19703 raft_consensus.cc:3060] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:25.575135 19632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98c8be586184e7d9265fa9a1b805f00" candidate_uuid: "357f6c97621e45a198ce354fe0bd763f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "297e05fcf4ee40bd8de6f84215563628"
I20260709 13:22:25.590157 19632 raft_consensus.cc:3055] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:25.590574 19632 raft_consensus.cc:740] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 297e05fcf4ee40bd8de6f84215563628, State: Running, Role: LEADER
I20260709 13:22:25.591684 19632 consensus_queue.cc:260] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:25.593199 19632 raft_consensus.cc:3060] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:25.594084 19703 raft_consensus.cc:2468] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 2.
I20260709 13:22:25.602535 19745 leader_election.cc:304] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c9846c7aa64d079557e69432deaa08, 357f6c97621e45a198ce354fe0bd763f; no voters: 
I20260709 13:22:25.603633 19942 raft_consensus.cc:2804] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:25.604156 19942 raft_consensus.cc:697] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [term 2 LEADER]: Becoming Leader. State: Replica: 357f6c97621e45a198ce354fe0bd763f, State: Running, Role: LEADER
I20260709 13:22:25.605410 19942 consensus_queue.cc:237] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } }
I20260709 13:22:25.574286 19778 leader_election.cc:290] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [CANDIDATE]: Term 2 election: Requested vote from peers 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257), 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333)
I20260709 13:22:25.613889 19632 raft_consensus.cc:2468] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357f6c97621e45a198ce354fe0bd763f in term 2.
I20260709 13:22:25.614935 20067 tablet.cc:1724] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:25.648123 19528 catalog_manager.cc:5697] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f reported cstate change: term changed from 1 to 2, leader changed from 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129) to 357f6c97621e45a198ce354fe0bd763f (127.6.214.131). New cstate: current_term: 2 leader_uuid: "357f6c97621e45a198ce354fe0bd763f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "357f6c97621e45a198ce354fe0bd763f" member_type: VOTER last_known_addr { host: "127.6.214.131" port: 44227 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:25.650754 19529 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa: soft_deleted_table [id=b8f11dfb0a4f4261b3556570a6eeb5fa] alter complete (version 1)
I20260709 13:22:26.016420 19703 raft_consensus.cc:1275] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Refusing update from remote peer 357f6c97621e45a198ce354fe0bd763f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:26.018167 19942 consensus_queue.cc:1048] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:26.029088 19632 raft_consensus.cc:1275] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Refusing update from remote peer 357f6c97621e45a198ce354fe0bd763f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:26.030952 19942 consensus_queue.cc:1048] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:26.113673 19703 raft_consensus.cc:1275] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Refusing update from remote peer 357f6c97621e45a198ce354fe0bd763f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:26.115069 19942 consensus_queue.cc:1048] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "22c9846c7aa64d079557e69432deaa08" member_type: VOTER last_known_addr { host: "127.6.214.130" port: 44333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:26.139184 19632 raft_consensus.cc:1275] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Refusing update from remote peer 357f6c97621e45a198ce354fe0bd763f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:26.140882 20037 consensus_queue.cc:1048] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [LEADER]: Connected to new peer: Peer: permanent_uuid: "297e05fcf4ee40bd8de6f84215563628" member_type: VOTER last_known_addr { host: "127.6.214.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:26.441090  7002 tablet_server.cc:179] TabletServer@127.6.214.129:0 shutting down...
W20260709 13:22:26.462137 19745 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 13:22:26.468031 19745 consensus_peers.cc:597] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f -> Peer 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257): Couldn't send request to peer 297e05fcf4ee40bd8de6f84215563628. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:26.487861  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:26.488716  7002 tablet_replica.cc:333] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.489354  7002 raft_consensus.cc:2243] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.489920  7002 raft_consensus.cc:2272] T daae52fadc9f4edc8731dc294c1ba8e1 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.493060  7002 tablet_replica.cc:333] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.493795  7002 raft_consensus.cc:2243] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.494383  7002 raft_consensus.cc:2272] T 677e1413101d4ff191d9949d890444fa P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.496817  7002 tablet_replica.cc:333] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.497575  7002 raft_consensus.cc:2243] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:26.497826 19671 consensus_peers.cc:597] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 -> Peer 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257): Couldn't send request to peer 297e05fcf4ee40bd8de6f84215563628. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:26.498020  7002 raft_consensus.cc:2272] T e552ce780972455abff2c78f22b4bed8 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.500988  7002 tablet_replica.cc:333] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.501776  7002 raft_consensus.cc:2243] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.502269  7002 raft_consensus.cc:2272] T 8ca62d9d27f446e8aeb8850951385e0c P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.505263  7002 tablet_replica.cc:333] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.506181  7002 raft_consensus.cc:2243] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.507148  7002 raft_consensus.cc:2272] T 57b30a25c1cd45e38d5fdd746bf35624 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.509227  7002 tablet_replica.cc:333] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.509871  7002 raft_consensus.cc:2243] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.510340  7002 raft_consensus.cc:2272] T b73e4fbe954d47fc9927075051fc91a7 P 297e05fcf4ee40bd8de6f84215563628 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.512215  7002 tablet_replica.cc:333] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.512848  7002 raft_consensus.cc:2243] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.513844  7002 raft_consensus.cc:2272] T 04f605a8a45043499255c6272b178e32 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.516337  7002 tablet_replica.cc:333] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.516986  7002 raft_consensus.cc:2243] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.517856  7002 raft_consensus.cc:2272] T 2ba8b98481394565bee73438c70e34e2 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.519920  7002 tablet_replica.cc:333] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.520512  7002 raft_consensus.cc:2243] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.520962  7002 raft_consensus.cc:2272] T ae1d5c2b0d784308b194995f71686278 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.522970  7002 tablet_replica.cc:333] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.523666  7002 raft_consensus.cc:2243] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.524436  7002 raft_consensus.cc:2272] T 23edf4f0e2d6432589cde181f8e8d234 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.526499  7002 tablet_replica.cc:333] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.527026  7002 raft_consensus.cc:2243] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.527470  7002 raft_consensus.cc:2272] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.529389  7002 tablet_replica.cc:333] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.530011  7002 raft_consensus.cc:2243] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.530869  7002 raft_consensus.cc:2272] T e93ae81773754db79876bd5bc2f47005 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.533584  7002 tablet_replica.cc:333] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.534189  7002 raft_consensus.cc:2243] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.534582  7002 raft_consensus.cc:2272] T c0ad8ec7c1884c85b531bf2e7ae200ff P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.536576  7002 tablet_replica.cc:333] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.537869  7002 raft_consensus.cc:2243] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.538422  7002 raft_consensus.cc:2272] T dbb443f6e8544fdea5f5895598ddd879 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.541023  7002 tablet_replica.cc:333] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.541812  7002 raft_consensus.cc:2243] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.542364  7002 raft_consensus.cc:2272] T 6b90dbf31b4c423c9822ef485b8b1987 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.545724  7002 tablet_replica.cc:333] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.546460  7002 raft_consensus.cc:2243] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.547252  7002 raft_consensus.cc:2272] T bf3beaabaae54ed4b222d46547c30edf P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.549010  7002 tablet_replica.cc:333] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.549577  7002 raft_consensus.cc:2243] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.550051  7002 raft_consensus.cc:2272] T a98c8be586184e7d9265fa9a1b805f00 P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.552330  7002 tablet_replica.cc:333] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628: stopping tablet replica
I20260709 13:22:26.552819  7002 raft_consensus.cc:2243] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.553774  7002 raft_consensus.cc:2272] T 70fd296c3fc94a1d95d6494ee73a2beb P 297e05fcf4ee40bd8de6f84215563628 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.584491  7002 tablet_server.cc:196] TabletServer@127.6.214.129:0 shutdown complete.
W20260709 13:22:26.606514 19671 consensus_peers.cc:597] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 -> Peer 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257): Couldn't send request to peer 297e05fcf4ee40bd8de6f84215563628. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:37257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:26.616045  7002 tablet_server.cc:179] TabletServer@127.6.214.130:0 shutting down...
I20260709 13:22:26.648025  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:26.648836  7002 tablet_replica.cc:333] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.649794  7002 raft_consensus.cc:2243] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.650688  7002 raft_consensus.cc:2272] T 677e1413101d4ff191d9949d890444fa P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.652586  7002 tablet_replica.cc:333] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.653103  7002 raft_consensus.cc:2243] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.653899  7002 raft_consensus.cc:2272] T e552ce780972455abff2c78f22b4bed8 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.655674  7002 tablet_replica.cc:333] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.656256  7002 raft_consensus.cc:2243] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.656688  7002 raft_consensus.cc:2272] T 8ca62d9d27f446e8aeb8850951385e0c P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.659053  7002 tablet_replica.cc:333] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.659832  7002 raft_consensus.cc:2243] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.661011  7002 raft_consensus.cc:2272] T b73e4fbe954d47fc9927075051fc91a7 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.663918  7002 tablet_replica.cc:333] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.664698  7002 raft_consensus.cc:2243] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.665995  7002 raft_consensus.cc:2272] T daae52fadc9f4edc8731dc294c1ba8e1 P 22c9846c7aa64d079557e69432deaa08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.668632  7002 tablet_replica.cc:333] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.669703  7002 raft_consensus.cc:2243] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.670420  7002 raft_consensus.cc:2272] T bf3beaabaae54ed4b222d46547c30edf P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.673775  7002 tablet_replica.cc:333] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.674810  7002 raft_consensus.cc:2243] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.675516  7002 raft_consensus.cc:2272] T 57b30a25c1cd45e38d5fdd746bf35624 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.678234  7002 tablet_replica.cc:333] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.678845  7002 raft_consensus.cc:2243] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:26.679044 19745 consensus_peers.cc:597] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f -> Peer 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257): Couldn't send request to peer 297e05fcf4ee40bd8de6f84215563628. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:37257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:26.679358  7002 raft_consensus.cc:2272] T 2ba8b98481394565bee73438c70e34e2 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.682173  7002 tablet_replica.cc:333] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
W20260709 13:22:26.682116 19745 consensus_peers.cc:597] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f -> Peer 297e05fcf4ee40bd8de6f84215563628 (127.6.214.129:37257): Couldn't send request to peer 297e05fcf4ee40bd8de6f84215563628. Status: Network error: Client connection negotiation failed: client connection to 127.6.214.129:37257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:26.683032  7002 raft_consensus.cc:2243] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.683640  7002 raft_consensus.cc:2272] T 04f605a8a45043499255c6272b178e32 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.685621  7002 tablet_replica.cc:333] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.686213  7002 raft_consensus.cc:2243] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.686961  7002 raft_consensus.cc:2272] T ae1d5c2b0d784308b194995f71686278 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.689126  7002 tablet_replica.cc:333] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.689757  7002 raft_consensus.cc:2243] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.690476  7002 raft_consensus.cc:2272] T c0ad8ec7c1884c85b531bf2e7ae200ff P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.692442  7002 tablet_replica.cc:333] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.692974  7002 raft_consensus.cc:2243] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.693389  7002 raft_consensus.cc:2272] T 6b90dbf31b4c423c9822ef485b8b1987 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.695634  7002 tablet_replica.cc:333] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.696172  7002 raft_consensus.cc:2243] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.696587  7002 raft_consensus.cc:2272] T dbb443f6e8544fdea5f5895598ddd879 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.698571  7002 tablet_replica.cc:333] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.699072  7002 raft_consensus.cc:2243] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.699499  7002 raft_consensus.cc:2272] T e93ae81773754db79876bd5bc2f47005 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.701215  7002 tablet_replica.cc:333] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.701777  7002 raft_consensus.cc:2243] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.702527  7002 raft_consensus.cc:2272] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.704365  7002 tablet_replica.cc:333] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.704850  7002 raft_consensus.cc:2243] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.705263  7002 raft_consensus.cc:2272] T a98c8be586184e7d9265fa9a1b805f00 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.707953  7002 tablet_replica.cc:333] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.708470  7002 raft_consensus.cc:2243] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.708974  7002 raft_consensus.cc:2272] T 70fd296c3fc94a1d95d6494ee73a2beb P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:26.710542 19745 consensus_peers.cc:597] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f -> Peer 22c9846c7aa64d079557e69432deaa08 (127.6.214.130:44333): Couldn't send request to peer 22c9846c7aa64d079557e69432deaa08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:26.711395  7002 tablet_replica.cc:333] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08: stopping tablet replica
I20260709 13:22:26.711890  7002 raft_consensus.cc:2243] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.712281  7002 raft_consensus.cc:2272] T 23edf4f0e2d6432589cde181f8e8d234 P 22c9846c7aa64d079557e69432deaa08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.755136  7002 tablet_server.cc:196] TabletServer@127.6.214.130:0 shutdown complete.
I20260709 13:22:26.785214  7002 tablet_server.cc:179] TabletServer@127.6.214.131:0 shutting down...
I20260709 13:22:26.812389  7002 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:26.813315  7002 tablet_replica.cc:333] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.814028  7002 raft_consensus.cc:2243] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.814515  7002 raft_consensus.cc:2272] T b73e4fbe954d47fc9927075051fc91a7 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.816732  7002 tablet_replica.cc:333] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.817332  7002 raft_consensus.cc:2243] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.817891  7002 raft_consensus.cc:2272] T 677e1413101d4ff191d9949d890444fa P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.819757  7002 tablet_replica.cc:333] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.820348  7002 raft_consensus.cc:2243] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.820772  7002 raft_consensus.cc:2272] T 57b30a25c1cd45e38d5fdd746bf35624 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.822541  7002 tablet_replica.cc:333] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.823099  7002 raft_consensus.cc:2243] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.823527  7002 raft_consensus.cc:2272] T e552ce780972455abff2c78f22b4bed8 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.825184  7002 tablet_replica.cc:333] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.825800  7002 raft_consensus.cc:2243] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.826573  7002 raft_consensus.cc:2272] T 8ca62d9d27f446e8aeb8850951385e0c P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.828263  7002 tablet_replica.cc:333] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.828796  7002 raft_consensus.cc:2243] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.829208  7002 raft_consensus.cc:2272] T 04f605a8a45043499255c6272b178e32 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.830837  7002 tablet_replica.cc:333] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.831450  7002 raft_consensus.cc:2243] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.831881  7002 raft_consensus.cc:2272] T ae1d5c2b0d784308b194995f71686278 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.833832  7002 tablet_replica.cc:333] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.834360  7002 raft_consensus.cc:2243] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.834789  7002 raft_consensus.cc:2272] T 2ba8b98481394565bee73438c70e34e2 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.836615  7002 tablet_replica.cc:333] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.837154  7002 raft_consensus.cc:2243] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.837930  7002 raft_consensus.cc:2272] T a98c8be586184e7d9265fa9a1b805f00 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.840273  7002 tablet_replica.cc:333] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.840822  7002 raft_consensus.cc:2243] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.841250  7002 raft_consensus.cc:2272] T 70fd296c3fc94a1d95d6494ee73a2beb P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.843398  7002 tablet_replica.cc:333] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.843927  7002 raft_consensus.cc:2243] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.844358  7002 raft_consensus.cc:2272] T daae52fadc9f4edc8731dc294c1ba8e1 P 357f6c97621e45a198ce354fe0bd763f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.846263  7002 tablet_replica.cc:333] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.846789  7002 raft_consensus.cc:2243] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.847232  7002 raft_consensus.cc:2272] T bf3beaabaae54ed4b222d46547c30edf P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.849009  7002 tablet_replica.cc:333] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.849596  7002 raft_consensus.cc:2243] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.850026  7002 raft_consensus.cc:2272] T e93ae81773754db79876bd5bc2f47005 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.851728  7002 tablet_replica.cc:333] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.852288  7002 raft_consensus.cc:2243] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.852698  7002 raft_consensus.cc:2272] T 5ac7a0da888e40d38a51fcbe7966e1d5 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.854483  7002 tablet_replica.cc:333] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.854972  7002 raft_consensus.cc:2243] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.855742  7002 raft_consensus.cc:2272] T dbb443f6e8544fdea5f5895598ddd879 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.857678  7002 tablet_replica.cc:333] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.858170  7002 raft_consensus.cc:2243] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:26.858913  7002 raft_consensus.cc:2272] T 6b90dbf31b4c423c9822ef485b8b1987 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.861742  7002 tablet_replica.cc:333] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.862246  7002 raft_consensus.cc:2243] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.862717  7002 raft_consensus.cc:2272] T c0ad8ec7c1884c85b531bf2e7ae200ff P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.864598  7002 tablet_replica.cc:333] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f: stopping tablet replica
I20260709 13:22:26.865064  7002 raft_consensus.cc:2243] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:26.865523  7002 raft_consensus.cc:2272] T 23edf4f0e2d6432589cde181f8e8d234 P 357f6c97621e45a198ce354fe0bd763f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:26.929165  7002 tablet_server.cc:196] TabletServer@127.6.214.131:0 shutdown complete.
I20260709 13:22:26.994766  7002 master.cc:562] Master@127.6.214.190:39421 shutting down...
I20260709 13:22:27.022449  7002 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:27.023490  7002 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:27.023917  7002 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6802cc11f64840688cbe914fce832caa: stopping tablet replica
I20260709 13:22:27.047936  7002 master.cc:584] Master@127.6.214.190:39421 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11817 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24654 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (423057 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:22:27.124480  7002 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 390 messages since previous log ~15 seconds ago
I20260709 13:22:27.124929  7002 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 390 messages since previous log ~15 seconds ago
I20260709 13:22:27.125231  7002 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 389 messages since previous log ~15 seconds ago
I20260709 13:22:27.125847  7002 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:22:27.126071  7002 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:22:27.126253  7002 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~183 seconds ago
I20260709 13:22:27.126564  7002 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 5 messages since previous log ~0 seconds ago
I20260709 13:22:27.126859  7002 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
